2024-02-02T11:33:25.448 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-02T11:33:25.448 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} --name vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi --verbose --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393 -- /home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393/orig.config.yaml 2024-02-02T11:33:25.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-02T11:33:25.587 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393 branch: wip-vshankar-testing1-reef-2024-02-02-1152 description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} email: vshankar@redhat.com first_in_suite: false job_id: '7543393' kernel: client: branch: testing flavor: default kdb: true sha1: cd42140e628558a450ba1d39a9d0835a2fa62cda ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing1-reef-2024-02-02-1152 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 0fb327883c124fd83155c94db0804f823b805a12 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 0fb327883c124fd83155c94db0804f823b805a12 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing1-reef-2024-02-02-1152 sha1: 0fb327883c124fd83155c94db0804f823b805a12 owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 1628 sha1: 0fb327883c124fd83155c94db0804f823b805a12 sleep_before_teardown: 0 subset: 50/1024 suite: fs suite_branch: wip-vshankar-testing1-reef-2024-02-02-1152 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_0fb327883c124fd83155c94db0804f823b805a12/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 0fb327883c124fd83155c94db0804f823b805a12 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD8AQxeyGy1Ran+lsQkpIBYdni1Na9WVvUjOtv2uNm8OBPg5oQi+345XoPA33KN0dITYMzj8a+qAoky/LUIqErM= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOy+tkgV21E+41tQtUdhGX7YE3e/kTnTfWnDI1MPetjwsV4kyXD5V4DCJO+sC5rP0EnNNghhPIQ14wHpvZWHHw= smithi177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMetkB1DiD+2vxtyQikH8Ai3S6nK+r+lzjQOCt9ilykW5d8RP9vWy35ixSqHlFkEzx6LzKU28YYB3bUsvKYMPvY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: d9fdb2209e15b39d9f061fd85399f352ce0f0894 timestamp: 2024-02-02_11:17:23 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-02T11:33:25.587 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_0fb327883c124fd83155c94db0804f823b805a12/qa; will attempt to use it 2024-02-02T11:33:25.588 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_0fb327883c124fd83155c94db0804f823b805a12/qa/tasks 2024-02-02T11:33:25.588 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-02T11:33:25.590 INFO:teuthology.task.internal:Checking packages... 2024-02-02T11:33:25.615 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '0fb327883c124fd83155c94db0804f823b805a12' 2024-02-02T11:33:25.615 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-02T11:33:25.615 INFO:teuthology.packaging:ref: None 2024-02-02T11:33:25.616 INFO:teuthology.packaging:tag: None 2024-02-02T11:33:25.616 INFO:teuthology.packaging:branch: wip-vshankar-testing1-reef-2024-02-02-1152 2024-02-02T11:33:25.616 INFO:teuthology.packaging:sha1: 0fb327883c124fd83155c94db0804f823b805a12 2024-02-02T11:33:25.616 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing1-reef-2024-02-02-1152 2024-02-02T11:33:25.837 INFO:teuthology.task.internal:Found packages for ceph version 18.2.1-325-g0fb32788-1jammy 2024-02-02T11:33:25.839 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-02T11:33:25.846 INFO:teuthology.task.internal:no buildpackages task found 2024-02-02T11:33:25.846 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-02T11:33:25.852 INFO:teuthology.task.internal:Saving configuration 2024-02-02T11:33:25.870 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-02T11:33:25.876 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-02T11:33:25.900 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-02 11:27:32.014869', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAwoCXgXIGQRRDsYWZBsBC7rngjtCmiAb9sav5t7+hFy'} 2024-02-02T11:33:25.923 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-02 11:27:32.013744', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPC0b2L2uYQmiYzS38zC4egYYo7QaG7W8xSx393VjJ8X'} 2024-02-02T11:33:25.944 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-02 11:27:32.012326', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBOyf7Dev0Rtzg6YMq6CqwU/Vwq+I+W9o+P1E+M+k8Dv'} 2024-02-02T11:33:25.944 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-02T11:33:25.950 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-02-02T11:33:25.950 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-02-02T11:33:25.951 INFO:teuthology.task.internal:roles: ubuntu@smithi177.front.sepia.ceph.com - ['client.0'] 2024-02-02T11:33:25.951 INFO:teuthology.run_tasks:Running task console_log... 2024-02-02T11:33:26.047 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f33ba96a0d0>, signals=[15]) 2024-02-02T11:33:26.048 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-02T11:33:26.053 INFO:teuthology.task.internal:Opening connections... 2024-02-02T11:33:26.054 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2024-02-02T11:33:26.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-02T11:33:26.140 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-02-02T11:33:26.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-02T11:33:26.216 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi177.front.sepia.ceph.com 2024-02-02T11:33:26.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-02T11:33:26.294 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-02T11:33:26.300 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-02-02T11:33:26.305 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-02-02T11:33:26.306 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-02-02T11:33:26.351 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-02T11:33:26.351 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2024-02-02T11:33:26.352 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="22.04" 2024-02-02T11:33:26.352 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-02T11:33:26.352 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=jammy 2024-02-02T11:33:26.352 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2024-02-02T11:33:26.352 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2024-02-02T11:33:26.352 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-02T11:33:26.352 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-02T11:33:26.352 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-02T11:33:26.352 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-02T11:33:26.352 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=jammy 2024-02-02T11:33:26.353 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-02-02T11:33:26.375 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-02-02T11:33:26.380 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-02-02T11:33:26.380 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-02-02T11:33:26.427 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-02T11:33:26.427 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Ubuntu" 2024-02-02T11:33:26.427 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="22.04" 2024-02-02T11:33:26.427 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-02T11:33:26.427 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_CODENAME=jammy 2024-02-02T11:33:26.428 INFO:teuthology.orchestra.run.smithi162.stdout:ID=ubuntu 2024-02-02T11:33:26.428 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE=debian 2024-02-02T11:33:26.428 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-02T11:33:26.428 INFO:teuthology.orchestra.run.smithi162.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-02T11:33:26.428 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-02T11:33:26.428 INFO:teuthology.orchestra.run.smithi162.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-02T11:33:26.428 INFO:teuthology.orchestra.run.smithi162.stdout:UBUNTU_CODENAME=jammy 2024-02-02T11:33:26.428 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-02-02T11:33:26.449 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2024-02-02T11:33:26.455 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2024-02-02T11:33:26.455 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-02-02T11:33:26.503 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-02T11:33:26.504 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Ubuntu" 2024-02-02T11:33:26.504 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="22.04" 2024-02-02T11:33:26.504 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-02T11:33:26.504 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_CODENAME=jammy 2024-02-02T11:33:26.504 INFO:teuthology.orchestra.run.smithi177.stdout:ID=ubuntu 2024-02-02T11:33:26.504 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE=debian 2024-02-02T11:33:26.504 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-02T11:33:26.504 INFO:teuthology.orchestra.run.smithi177.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-02T11:33:26.504 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-02T11:33:26.504 INFO:teuthology.orchestra.run.smithi177.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-02T11:33:26.504 INFO:teuthology.orchestra.run.smithi177.stdout:UBUNTU_CODENAME=jammy 2024-02-02T11:33:26.505 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-02-02T11:33:26.524 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-02T11:33:26.534 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-02T11:33:26.540 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-02T11:33:26.540 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2024-02-02T11:33:26.542 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-02-02T11:33:26.545 DEBUG:teuthology.orchestra.run.smithi177:> test '!' -e /home/ubuntu/cephtest 2024-02-02T11:33:26.551 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-02T11:33:26.556 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-02T11:33:26.557 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2024-02-02T11:33:26.588 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-02-02T11:33:26.592 DEBUG:teuthology.orchestra.run.smithi177:> test -z $(ls -A /var/lib/ceph) 2024-02-02T11:33:26.694 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-02T11:33:26.775 INFO:teuthology.run_tasks:Running task kernel... 2024-02-02T11:33:26.788 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd42140e628558a450ba1d39a9d0835a2fa62cda'} 2024-02-02T11:33:26.789 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-02-02T11:33:26.789 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-02-02T11:33:26.789 DEBUG:teuthology.orchestra.run.smithi177:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-02T11:33:26.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-02T11:33:26.794 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-02-02T11:33:27.051 DEBUG:teuthology.task.kernel:sha1 for client.0 is cd42140e628558a450ba1d39a9d0835a2fa62cda 2024-02-02T11:33:27.051 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "cd42140e628558a450ba1d39a9d0835a2fa62cda"... 2024-02-02T11:33:27.051 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2024-02-02T11:33:27.057 INFO:teuthology.orchestra.run.smithi177.stdout:5.15.0-56-generic 2024-02-02T11:33:27.057 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs cd42140e628558a450ba1d39a9d0835a2fa62cda 2024-02-02T11:33:27.057 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-02-02T11:33:27.058 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-02-02T11:33:27.058 DEBUG:teuthology.orchestra.run.smithi177:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-02-02T11:33:27.122 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-02-02T11:33:27.299 INFO:teuthology.orchestra.run.smithi177.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-02-02T11:33:27.299 INFO:teuthology.orchestra.run.smithi177.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-02-02T11:33:27.299 INFO:teuthology.orchestra.run.smithi177.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-02-02T11:33:27.299 INFO:teuthology.orchestra.run.smithi177.stderr:hint: 2024-02-02T11:33:27.299 INFO:teuthology.orchestra.run.smithi177.stderr:hint: git config --global init.defaultBranch 2024-02-02T11:33:27.299 INFO:teuthology.orchestra.run.smithi177.stderr:hint: 2024-02-02T11:33:27.299 INFO:teuthology.orchestra.run.smithi177.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-02-02T11:33:27.299 INFO:teuthology.orchestra.run.smithi177.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-02-02T11:33:27.299 INFO:teuthology.orchestra.run.smithi177.stderr:hint: 2024-02-02T11:33:27.299 INFO:teuthology.orchestra.run.smithi177.stderr:hint: git branch -m 2024-02-02T11:33:27.300 INFO:teuthology.orchestra.run.smithi177.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-02-02T11:33:27.302 DEBUG:teuthology.orchestra.run.smithi177:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-02-02T11:33:27.370 DEBUG:teuthology.orchestra.run.smithi177:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-02-02T11:33:27.425 DEBUG:teuthology.orchestra.run.smithi177:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-02-02T11:34:57.195 INFO:teuthology.orchestra.run.smithi177.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-02-02T11:34:57.195 INFO:teuthology.orchestra.run.smithi177.stderr: * [new branch] main -> origin/main 2024-02-02T11:34:57.227 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190312 -> 20190312 2024-02-02T11:34:57.228 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190416 -> 20190416 2024-02-02T11:34:57.228 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190514 -> 20190514 2024-02-02T11:34:57.228 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190618 -> 20190618 2024-02-02T11:34:57.228 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190717 -> 20190717 2024-02-02T11:34:57.228 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190815 -> 20190815 2024-02-02T11:34:57.228 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190923 -> 20190923 2024-02-02T11:34:57.228 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20191022 -> 20191022 2024-02-02T11:34:57.230 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20191215 -> 20191215 2024-02-02T11:34:57.230 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200122 -> 20200122 2024-02-02T11:34:57.231 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200316 -> 20200316 2024-02-02T11:34:57.231 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200421 -> 20200421 2024-02-02T11:34:57.231 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200519 -> 20200519 2024-02-02T11:34:57.231 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200619 -> 20200619 2024-02-02T11:34:57.231 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200721 -> 20200721 2024-02-02T11:34:57.231 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200817 -> 20200817 2024-02-02T11:34:57.231 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200918 -> 20200918 2024-02-02T11:34:57.231 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20201022 -> 20201022 2024-02-02T11:34:57.231 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20201118 -> 20201118 2024-02-02T11:34:57.231 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20201218 -> 20201218 2024-02-02T11:34:57.231 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20210208 -> 20210208 2024-02-02T11:34:57.231 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20210315 -> 20210315 2024-02-02T11:34:57.231 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20210511 -> 20210511 2024-02-02T11:34:57.231 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20210716 -> 20210716 2024-02-02T11:34:57.231 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20210818 -> 20210818 2024-02-02T11:34:57.232 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20210919 -> 20210919 2024-02-02T11:34:57.232 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20211027 -> 20211027 2024-02-02T11:34:57.232 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20211216 -> 20211216 2024-02-02T11:34:57.234 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220209 -> 20220209 2024-02-02T11:34:57.234 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220310 -> 20220310 2024-02-02T11:34:57.234 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220411 -> 20220411 2024-02-02T11:34:57.235 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220509 -> 20220509 2024-02-02T11:34:57.235 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220610 -> 20220610 2024-02-02T11:34:57.235 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220708 -> 20220708 2024-02-02T11:34:57.235 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220815 -> 20220815 2024-02-02T11:34:57.235 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220913 -> 20220913 2024-02-02T11:34:57.235 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20221012 -> 20221012 2024-02-02T11:34:57.235 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20221109 -> 20221109 2024-02-02T11:34:57.235 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20221214 -> 20221214 2024-02-02T11:34:57.235 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230117 -> 20230117 2024-02-02T11:34:57.235 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230210 -> 20230210 2024-02-02T11:34:57.235 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230310 -> 20230310 2024-02-02T11:34:57.235 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230404 -> 20230404 2024-02-02T11:34:57.235 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230515 -> 20230515 2024-02-02T11:34:57.235 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230625 -> 20230625 2024-02-02T11:34:57.235 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230804 -> 20230804 2024-02-02T11:34:57.236 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230919 -> 20230919 2024-02-02T11:34:57.236 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20231030 -> 20231030 2024-02-02T11:34:57.236 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20231111 -> 20231111 2024-02-02T11:34:57.236 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20231211 -> 20231211 2024-02-02T11:34:57.236 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20240115 -> 20240115 2024-02-02T11:35:01.325 INFO:teuthology.orchestra.run.smithi177.stderr:Updating files: 51% (1840/3550) Updating files: 52% (1846/3550) Updating files: 53% (1882/3550) Updating files: 54% (1917/3550) Updating files: 55% (1953/3550) Updating files: 56% (1988/3550) Updating files: 57% (2024/3550) Updating files: 58% (2059/3550) Updating files: 59% (2095/3550) Updating files: 60% (2130/3550) Updating files: 61% (2166/3550) Updating files: 62% (2201/3550) Updating files: 63% (2237/3550) Updating files: 64% (2272/3550) Updating files: 65% (2308/3550) Updating files: 65% (2339/3550) Updating files: 66% (2343/3550) Updating files: 67% (2379/3550) Updating files: 68% (2414/3550) Updating files: 69% (2450/3550) Updating files: 70% (2485/3550) Updating files: 71% (2521/3550) Updating files: 72% (2556/3550) Updating files: 73% (2592/3550) Updating files: 74% (2627/3550) Updating files: 75% (2663/3550) Updating files: 76% (2698/3550) Updating files: 77% (2734/3550) Updating files: 78% (2769/3550) Updating files: 79% (2805/3550) Updating files: 80% (2840/3550) Updating files: 81% (2876/3550) Updating files: 81% (2905/3550) Updating files: 82% (2911/3550) Updating files: 83% (2947/3550) Updating files: 84% (2982/3550) Updating files: 85% (3018/3550) Updating files: 86% (3053/3550) Updating files: 87% (3089/3550) Updating files: 88% (3124/3550) Updating files: 89% (3160/3550) Updating files: 90% (3195/3550) Updating files: 91% (3231/3550) Updating files: 92% (3266/3550) Updating files: 93% (3302/3550) Updating files: 94% (3337/3550) Updating files: 95% (3373/3550) Updating files: 96% (3408/3550) Updating files: 96% (3415/3550) Updating files: 97% (3444/3550) Updating files: 98% (3479/3550) Updating files: 99% (3515/3550) Updating files: 100% (3550/3550) Updating files: 100% (3550/3550), done. 2024-02-02T11:35:01.330 INFO:teuthology.orchestra.run.smithi177.stdout:HEAD is now at 36777504 Merge branch 'robot/patch-0-1706798549' into 'main' 2024-02-02T11:35:01.351 INFO:teuthology.task.kernel:Downloading kernel cd42140e628558a450ba1d39a9d0835a2fa62cda on client.0... 2024-02-02T11:35:01.351 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd42140e628558a450ba1d39a9d0835a2fa62cda 2024-02-02T11:35:01.492 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/cd42140e628558a450ba1d39a9d0835a2fa62cda/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gcd42140e6285/ 2024-02-02T11:35:01.492 DEBUG:teuthology.orchestra.run.smithi177:> rm -f /tmp/linux-image.deb && echo linux-image-6.7.0-gcd42140e6285_6.7.0-gcd42140e6285-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/cd42140e628558a450ba1d39a9d0835a2fa62cda/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gcd42140e6285/ --input-file=- 2024-02-02T11:35:01.495 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi177.front.sepia.ceph.com to complete... 2024-02-02T11:35:04.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-02-02 11:35:04 URL:https://2.chacra.ceph.com/r/kernel/testing/cd42140e628558a450ba1d39a9d0835a2fa62cda/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-gcd42140e6285/linux-image-6.7.0-gcd42140e6285_6.7.0-gcd42140e6285-1_amd64.deb [39118482/39118482] -> "/tmp/linux-image.deb" [1] 2024-02-02T11:35:04.024 INFO:teuthology.orchestra.run.smithi177.stderr:FINISHED --2024-02-02 11:35:04-- 2024-02-02T11:35:04.024 INFO:teuthology.orchestra.run.smithi177.stderr:Total wall clock time: 2.5s 2024-02-02T11:35:04.024 INFO:teuthology.orchestra.run.smithi177.stderr:Downloaded: 1 files, 37M in 2.3s (16.2 MB/s) 2024-02-02T11:35:04.028 INFO:teuthology.task.kernel:Installing kernel cd42140e628558a450ba1d39a9d0835a2fa62cda on client.0... 2024-02-02T11:35:04.028 DEBUG:teuthology.orchestra.run.smithi177:> sudo dpkg -i /tmp/linux-image.deb 2024-02-02T11:35:04.299 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package linux-image-6.7.0-gcd42140e6285. 2024-02-02T11:35:06.319 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-02-02T11:35:06.325 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-02-02T11:35:06.484 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking linux-image-6.7.0-gcd42140e6285 (6.7.0-gcd42140e6285-1) ... 2024-02-02T11:35:10.048 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up linux-image-6.7.0-gcd42140e6285 (6.7.0-gcd42140e6285-1) ... 2024-02-02T11:35:10.157 INFO:teuthology.orchestra.run.smithi177.stderr:update-initramfs: Generating /boot/initrd.img-6.7.0-gcd42140e6285 2024-02-02T11:35:31.087 INFO:teuthology.orchestra.run.smithi177.stderr:Sourcing file `/etc/default/grub' 2024-02-02T11:35:31.102 INFO:teuthology.orchestra.run.smithi177.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-02T11:35:31.128 INFO:teuthology.orchestra.run.smithi177.stderr:Generating grub configuration file ... 2024-02-02T11:35:31.452 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-6.7.0-gcd42140e6285 2024-02-02T11:35:31.482 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-6.7.0-gcd42140e6285 2024-02-02T11:35:31.769 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-02T11:35:31.777 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-02T11:35:31.857 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-02T11:35:31.862 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-02T11:35:32.014 INFO:teuthology.orchestra.run.smithi177.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-02T11:35:32.014 INFO:teuthology.orchestra.run.smithi177.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-02-02T11:35:32.014 INFO:teuthology.orchestra.run.smithi177.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-02T11:35:32.046 INFO:teuthology.orchestra.run.smithi177.stderr:done 2024-02-02T11:35:32.236 DEBUG:teuthology.orchestra.run.smithi177:> dpkg-deb -c /tmp/linux-image.deb 2024-02-02T11:35:32.284 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./ 2024-02-02T11:35:32.284 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./boot/ 2024-02-02T11:35:32.284 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 4444641 2024-01-25 04:04 ./boot/System.map-6.7.0-gcd42140e6285 2024-02-02T11:35:32.296 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 170149 2024-01-25 04:04 ./boot/config-6.7.0-gcd42140e6285 2024-02-02T11:35:32.296 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11441152 2024-01-25 04:04 ./boot/vmlinuz-6.7.0-gcd42140e6285 2024-02-02T11:35:32.316 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/ 2024-02-02T11:35:32.316 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/ 2024-02-02T11:35:32.316 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/postinst.d/ 2024-02-02T11:35:32.317 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/postrm.d/ 2024-02-02T11:35:32.317 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/preinst.d/ 2024-02-02T11:35:32.317 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./etc/kernel/prerm.d/ 2024-02-02T11:35:32.317 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/ 2024-02-02T11:35:32.317 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/ 2024-02-02T11:35:32.317 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/ 2024-02-02T11:35:32.317 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/ 2024-02-02T11:35:32.317 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/ 2024-02-02T11:35:32.317 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/ 2024-02-02T11:35:32.317 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/ 2024-02-02T11:35:32.317 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 490345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/aesni-intel.ko 2024-02-02T11:35:32.320 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-02-02T11:35:32.320 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-02-02T11:35:32.320 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-02-02T11:35:32.320 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 93113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-02-02T11:35:32.320 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 106729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-02-02T11:35:32.320 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 152241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-02-02T11:35:32.320 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-02-02T11:35:32.320 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-02-02T11:35:32.320 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 83889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-02-02T11:35:32.320 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-02-02T11:35:32.320 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-02-02T11:35:32.320 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/serpent-avx2.ko 2024-02-02T11:35:32.321 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-02-02T11:35:32.321 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-02-02T11:35:32.321 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-02-02T11:35:32.321 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-02-02T11:35:32.321 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-02-02T11:35:32.321 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-02-02T11:35:32.321 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-02-02T11:35:32.321 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/ 2024-02-02T11:35:32.321 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpu/ 2024-02-02T11:35:32.321 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpu/mce/ 2024-02-02T11:35:32.321 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-02-02T11:35:32.321 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/cpuid.ko 2024-02-02T11:35:32.321 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kernel/msr.ko 2024-02-02T11:35:32.321 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/ 2024-02-02T11:35:32.322 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 353705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/kvm-amd.ko 2024-02-02T11:35:32.322 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 881649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/kvm-intel.ko 2024-02-02T11:35:32.322 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 2276625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/arch/x86/kvm/kvm.ko 2024-02-02T11:35:32.378 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/ 2024-02-02T11:35:32.378 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/af_alg.ko 2024-02-02T11:35:32.378 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/algif_hash.ko 2024-02-02T11:35:32.378 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/algif_skcipher.ko 2024-02-02T11:35:32.378 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/ansi_cprng.ko 2024-02-02T11:35:32.378 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/anubis.ko 2024-02-02T11:35:32.378 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/arc4.ko 2024-02-02T11:35:32.378 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/asymmetric_keys/ 2024-02-02T11:35:32.378 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-02-02T11:35:32.378 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/ 2024-02-02T11:35:32.378 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_memcpy.ko 2024-02-02T11:35:32.378 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_pq.ko 2024-02-02T11:35:32.378 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_raid6_recov.ko 2024-02-02T11:35:32.379 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_tx.ko 2024-02-02T11:35:32.379 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/async_xor.ko 2024-02-02T11:35:32.379 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/async_tx/raid6test.ko 2024-02-02T11:35:32.379 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/authenc.ko 2024-02-02T11:35:32.379 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/authencesn.ko 2024-02-02T11:35:32.379 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/blake2b_generic.ko 2024-02-02T11:35:32.379 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/blowfish_common.ko 2024-02-02T11:35:32.379 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/blowfish_generic.ko 2024-02-02T11:35:32.379 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/camellia_generic.ko 2024-02-02T11:35:32.379 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cast5_generic.ko 2024-02-02T11:35:32.379 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cast6_generic.ko 2024-02-02T11:35:32.379 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cast_common.ko 2024-02-02T11:35:32.379 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/ccm.ko 2024-02-02T11:35:32.379 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cmac.ko 2024-02-02T11:35:32.379 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crc32_generic.ko 2024-02-02T11:35:32.379 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cryptd.ko 2024-02-02T11:35:32.380 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crypto_engine.ko 2024-02-02T11:35:32.380 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crypto_simd.ko 2024-02-02T11:35:32.380 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/crypto_user.ko 2024-02-02T11:35:32.380 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/cts.ko 2024-02-02T11:35:32.380 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/des_generic.ko 2024-02-02T11:35:32.380 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/dh_generic.ko 2024-02-02T11:35:32.380 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/echainiv.ko 2024-02-02T11:35:32.380 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/essiv.ko 2024-02-02T11:35:32.380 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/fcrypt.ko 2024-02-02T11:35:32.380 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/khazad.ko 2024-02-02T11:35:32.380 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/lrw.ko 2024-02-02T11:35:32.380 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/lz4.ko 2024-02-02T11:35:32.380 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/lz4hc.ko 2024-02-02T11:35:32.380 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/md4.ko 2024-02-02T11:35:32.381 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/michael_mic.ko 2024-02-02T11:35:32.381 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/pcbc.ko 2024-02-02T11:35:32.381 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/pcrypt.ko 2024-02-02T11:35:32.381 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/rmd160.ko 2024-02-02T11:35:32.381 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/seed.ko 2024-02-02T11:35:32.381 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/serpent_generic.ko 2024-02-02T11:35:32.381 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 149481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/tcrypt.ko 2024-02-02T11:35:32.381 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/tea.ko 2024-02-02T11:35:32.381 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/twofish_common.ko 2024-02-02T11:35:32.381 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/twofish_generic.ko 2024-02-02T11:35:32.381 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/vmac.ko 2024-02-02T11:35:32.381 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/wp512.ko 2024-02-02T11:35:32.381 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xcbc.ko 2024-02-02T11:35:32.381 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xor.ko 2024-02-02T11:35:32.381 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xts.ko 2024-02-02T11:35:32.381 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/crypto/xxhash_generic.ko 2024-02-02T11:35:32.382 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ 2024-02-02T11:35:32.382 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/ 2024-02-02T11:35:32.382 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/acpi_extlog.ko 2024-02-02T11:35:32.382 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/acpi_ipmi.ko 2024-02-02T11:35:32.382 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/acpi_pad.ko 2024-02-02T11:35:32.382 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/apei/ 2024-02-02T11:35:32.382 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/apei/einj.ko 2024-02-02T11:35:32.382 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/ec_sys.ko 2024-02-02T11:35:32.382 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/platform_profile.ko 2024-02-02T11:35:32.382 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/sbs.ko 2024-02-02T11:35:32.382 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/sbshc.ko 2024-02-02T11:35:32.382 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 104729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/acpi/video.ko 2024-02-02T11:35:32.382 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/ 2024-02-02T11:35:32.382 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/acard-ahci.ko 2024-02-02T11:35:32.382 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 89649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/ahci.ko 2024-02-02T11:35:32.382 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/ahci_platform.ko 2024-02-02T11:35:32.383 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 88401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/libahci.ko 2024-02-02T11:35:32.383 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/libahci_platform.ko 2024-02-02T11:35:32.383 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_acpi.ko 2024-02-02T11:35:32.383 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ali.ko 2024-02-02T11:35:32.383 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_amd.ko 2024-02-02T11:35:32.383 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_artop.ko 2024-02-02T11:35:32.383 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_atiixp.ko 2024-02-02T11:35:32.383 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_atp867x.ko 2024-02-02T11:35:32.383 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_cmd640.ko 2024-02-02T11:35:32.383 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_cmd64x.ko 2024-02-02T11:35:32.383 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_cypress.ko 2024-02-02T11:35:32.383 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_efar.ko 2024-02-02T11:35:32.383 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt366.ko 2024-02-02T11:35:32.383 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt37x.ko 2024-02-02T11:35:32.383 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt3x2n.ko 2024-02-02T11:35:32.384 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_hpt3x3.ko 2024-02-02T11:35:32.384 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_it8213.ko 2024-02-02T11:35:32.384 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_it821x.ko 2024-02-02T11:35:32.384 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_jmicron.ko 2024-02-02T11:35:32.384 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_legacy.ko 2024-02-02T11:35:32.384 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_marvell.ko 2024-02-02T11:35:32.384 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_mpiix.ko 2024-02-02T11:35:32.384 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_netcell.ko 2024-02-02T11:35:32.384 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ninja32.ko 2024-02-02T11:35:32.384 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ns87410.ko 2024-02-02T11:35:32.384 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_ns87415.ko 2024-02-02T11:35:32.384 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_oldpiix.ko 2024-02-02T11:35:32.384 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_opti.ko 2024-02-02T11:35:32.384 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_optidma.ko 2024-02-02T11:35:32.384 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_pcmcia.ko 2024-02-02T11:35:32.385 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_pdc2027x.ko 2024-02-02T11:35:32.385 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-02-02T11:35:32.385 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_piccolo.ko 2024-02-02T11:35:32.385 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_radisys.ko 2024-02-02T11:35:32.385 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_rdc.ko 2024-02-02T11:35:32.385 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_rz1000.ko 2024-02-02T11:35:32.385 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_sch.ko 2024-02-02T11:35:32.385 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_serverworks.ko 2024-02-02T11:35:32.385 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_sil680.ko 2024-02-02T11:35:32.385 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_sl82c105.ko 2024-02-02T11:35:32.385 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_triflex.ko 2024-02-02T11:35:32.385 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pata_via.ko 2024-02-02T11:35:32.385 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/pdc_adma.ko 2024-02-02T11:35:32.385 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_inic162x.ko 2024-02-02T11:35:32.385 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 83345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_mv.ko 2024-02-02T11:35:32.386 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_nv.ko 2024-02-02T11:35:32.386 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_promise.ko 2024-02-02T11:35:32.386 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_qstor.ko 2024-02-02T11:35:32.386 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sil.ko 2024-02-02T11:35:32.386 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sil24.ko 2024-02-02T11:35:32.386 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sis.ko 2024-02-02T11:35:32.386 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_svw.ko 2024-02-02T11:35:32.386 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_sx4.ko 2024-02-02T11:35:32.386 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_uli.ko 2024-02-02T11:35:32.386 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_via.ko 2024-02-02T11:35:32.386 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ata/sata_vsc.ko 2024-02-02T11:35:32.386 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/auxdisplay/ 2024-02-02T11:35:32.386 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/auxdisplay/ks0108.ko 2024-02-02T11:35:32.386 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/bcma/ 2024-02-02T11:35:32.386 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 124473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/bcma/bcma.ko 2024-02-02T11:35:32.387 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/ 2024-02-02T11:35:32.387 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/aoe/ 2024-02-02T11:35:32.387 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 113753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/aoe/aoe.ko 2024-02-02T11:35:32.387 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/drbd/ 2024-02-02T11:35:32.387 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 965305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/drbd/drbd.ko 2024-02-02T11:35:32.387 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 173353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/floppy.ko 2024-02-02T11:35:32.387 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/mtip32xx/ 2024-02-02T11:35:32.387 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 94297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-02-02T11:35:32.387 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 116321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/nbd.ko 2024-02-02T11:35:32.387 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/null_blk/ 2024-02-02T11:35:32.387 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 110737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/null_blk/null_blk.ko 2024-02-02T11:35:32.387 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 98281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/pktcdvd.ko 2024-02-02T11:35:32.387 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 263769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/rbd.ko 2024-02-02T11:35:32.387 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/xen-blkback/ 2024-02-02T11:35:32.387 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 98185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-02-02T11:35:32.388 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/zram/ 2024-02-02T11:35:32.388 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/block/zram/zram.ko 2024-02-02T11:35:32.388 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ 2024-02-02T11:35:32.388 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/applicom.ko 2024-02-02T11:35:32.388 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hangcheck-timer.ko 2024-02-02T11:35:32.388 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/ 2024-02-02T11:35:32.388 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/amd-rng.ko 2024-02-02T11:35:32.388 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/intel-rng.ko 2024-02-02T11:35:32.388 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-02-02T11:35:32.388 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/via-rng.ko 2024-02-02T11:35:32.388 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/hw_random/virtio-rng.ko 2024-02-02T11:35:32.388 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ 2024-02-02T11:35:32.388 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-02-02T11:35:32.388 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 148609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-02-02T11:35:32.389 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-02-02T11:35:32.389 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 139313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_si.ko 2024-02-02T11:35:32.389 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-02-02T11:35:32.389 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-02-02T11:35:32.389 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/lp.ko 2024-02-02T11:35:32.389 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/mwave/ 2024-02-02T11:35:32.389 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 84097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/mwave/mwave.ko 2024-02-02T11:35:32.389 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/nvram.ko 2024-02-02T11:35:32.389 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/ppdev.ko 2024-02-02T11:35:32.389 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tlclk.ko 2024-02-02T11:35:32.389 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/ 2024-02-02T11:35:32.389 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_atmel.ko 2024-02-02T11:35:32.389 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-02-02T11:35:32.389 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-02-02T11:35:32.389 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-02-02T11:35:32.390 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_infineon.ko 2024-02-02T11:35:32.390 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/tpm_nsc.ko 2024-02-02T11:35:32.390 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-02-02T11:35:32.390 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/ 2024-02-02T11:35:32.390 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/xillybus_class.ko 2024-02-02T11:35:32.390 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/xillybus_core.ko 2024-02-02T11:35:32.390 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-02-02T11:35:32.390 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/ 2024-02-02T11:35:32.390 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-palmas.ko 2024-02-02T11:35:32.390 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-si5351.ko 2024-02-02T11:35:32.390 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-twl6040.ko 2024-02-02T11:35:32.390 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/clk/clk-wm831x.ko 2024-02-02T11:35:32.390 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/ 2024-02-02T11:35:32.390 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-02-02T11:35:32.390 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/p4-clockmod.ko 2024-02-02T11:35:32.391 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/cpufreq/speedstep-lib.ko 2024-02-02T11:35:32.391 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ 2024-02-02T11:35:32.391 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ccp/ 2024-02-02T11:35:32.391 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-02-02T11:35:32.391 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 246841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/ccp/ccp.ko 2024-02-02T11:35:32.391 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/ 2024-02-02T11:35:32.391 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/ 2024-02-02T11:35:32.391 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_common/ 2024-02-02T11:35:32.391 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 517033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-02-02T11:35:32.391 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-02-02T11:35:32.391 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-02-02T11:35:32.391 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/padlock-aes.ko 2024-02-02T11:35:32.391 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/padlock-sha.ko 2024-02-02T11:35:32.391 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/virtio/ 2024-02-02T11:35:32.391 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-02-02T11:35:32.392 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dca/ 2024-02-02T11:35:32.392 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dca/dca.ko 2024-02-02T11:35:32.392 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/ 2024-02-02T11:35:32.392 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/dw/ 2024-02-02T11:35:32.392 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/dw/dw_dmac.ko 2024-02-02T11:35:32.392 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/ioat/ 2024-02-02T11:35:32.392 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 122569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/dma/ioat/ioatdma.ko 2024-02-02T11:35:32.392 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/ 2024-02-02T11:35:32.392 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 79953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/amd64_edac.ko 2024-02-02T11:35:32.392 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/e752x_edac.ko 2024-02-02T11:35:32.392 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 63617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/edac_mce_amd.ko 2024-02-02T11:35:32.392 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i3000_edac.ko 2024-02-02T11:35:32.392 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i3200_edac.ko 2024-02-02T11:35:32.392 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i5100_edac.ko 2024-02-02T11:35:32.393 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i5400_edac.ko 2024-02-02T11:35:32.393 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i7300_edac.ko 2024-02-02T11:35:32.393 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i7core_edac.ko 2024-02-02T11:35:32.393 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/i82975x_edac.ko 2024-02-02T11:35:32.393 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/ie31200_edac.ko 2024-02-02T11:35:32.393 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 56825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/sb_edac.ko 2024-02-02T11:35:32.393 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/edac/x38_edac.ko 2024-02-02T11:35:32.393 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/ 2024-02-02T11:35:32.393 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-gpio.ko 2024-02-02T11:35:32.393 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-max14577.ko 2024-02-02T11:35:32.393 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-max77693.ko 2024-02-02T11:35:32.393 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-max8997.ko 2024-02-02T11:35:32.393 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-palmas.ko 2024-02-02T11:35:32.393 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-rt8973a.ko 2024-02-02T11:35:32.393 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/extcon/extcon-sm5502.ko 2024-02-02T11:35:32.394 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/ 2024-02-02T11:35:32.394 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/dmi-sysfs.ko 2024-02-02T11:35:32.394 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/efi/ 2024-02-02T11:35:32.394 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/efi/efi-pstore.ko 2024-02-02T11:35:32.394 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/firmware/iscsi_ibft.ko 2024-02-02T11:35:32.394 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/ 2024-02-02T11:35:32.394 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-adp5520.ko 2024-02-02T11:35:32.394 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-amd8111.ko 2024-02-02T11:35:32.394 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-arizona.ko 2024-02-02T11:35:32.394 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-da9052.ko 2024-02-02T11:35:32.394 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-da9055.ko 2024-02-02T11:35:32.394 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-dln2.ko 2024-02-02T11:35:32.394 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 77849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-f7188x.ko 2024-02-02T11:35:32.394 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-generic.ko 2024-02-02T11:35:32.394 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-ich.ko 2024-02-02T11:35:32.395 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-02-02T11:35:32.395 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-kempld.ko 2024-02-02T11:35:32.395 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-lp3943.ko 2024-02-02T11:35:32.395 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-max7300.ko 2024-02-02T11:35:32.395 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-max730x.ko 2024-02-02T11:35:32.395 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-max732x.ko 2024-02-02T11:35:32.395 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-02-02T11:35:32.395 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-pca953x.ko 2024-02-02T11:35:32.395 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-pcf857x.ko 2024-02-02T11:35:32.395 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-rdc321x.ko 2024-02-02T11:35:32.395 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-sch.ko 2024-02-02T11:35:32.395 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-sch311x.ko 2024-02-02T11:35:32.395 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-tps65912.ko 2024-02-02T11:35:32.395 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-twl4030.ko 2024-02-02T11:35:32.395 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-twl6040.ko 2024-02-02T11:35:32.396 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-viperboard.ko 2024-02-02T11:35:32.396 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-vx855.ko 2024-02-02T11:35:32.396 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-wm831x.ko 2024-02-02T11:35:32.396 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-wm8350.ko 2024-02-02T11:35:32.396 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/gpio/gpio-wm8994.ko 2024-02-02T11:35:32.396 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/ 2024-02-02T11:35:32.396 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-a4tech.ko 2024-02-02T11:35:32.396 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-apple.ko 2024-02-02T11:35:32.396 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-appleir.ko 2024-02-02T11:35:32.396 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-aureal.ko 2024-02-02T11:35:32.396 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-axff.ko 2024-02-02T11:35:32.396 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-belkin.ko 2024-02-02T11:35:32.396 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-cherry.ko 2024-02-02T11:35:32.396 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-chicony.ko 2024-02-02T11:35:32.396 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-cp2112.ko 2024-02-02T11:35:32.397 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-cypress.ko 2024-02-02T11:35:32.397 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-dr.ko 2024-02-02T11:35:32.397 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-elecom.ko 2024-02-02T11:35:32.397 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-elo.ko 2024-02-02T11:35:32.397 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-emsff.ko 2024-02-02T11:35:32.397 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-ezkey.ko 2024-02-02T11:35:32.397 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-gaff.ko 2024-02-02T11:35:32.397 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-generic.ko 2024-02-02T11:35:32.397 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-gt683r.ko 2024-02-02T11:35:32.397 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-gyration.ko 2024-02-02T11:35:32.397 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-holtek-kbd.ko 2024-02-02T11:35:32.397 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-holtek-mouse.ko 2024-02-02T11:35:32.397 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-holtekff.ko 2024-02-02T11:35:32.397 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-hyperv.ko 2024-02-02T11:35:32.398 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-icade.ko 2024-02-02T11:35:32.398 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-kensington.ko 2024-02-02T11:35:32.398 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-keytouch.ko 2024-02-02T11:35:32.398 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-kye.ko 2024-02-02T11:35:32.398 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-lcpower.ko 2024-02-02T11:35:32.398 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-led.ko 2024-02-02T11:35:32.398 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-lenovo.ko 2024-02-02T11:35:32.398 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-lg-g15.ko 2024-02-02T11:35:32.398 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-logitech-dj.ko 2024-02-02T11:35:32.398 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 100649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-02-02T11:35:32.398 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 80993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-logitech.ko 2024-02-02T11:35:32.398 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-magicmouse.ko 2024-02-02T11:35:32.398 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-microsoft.ko 2024-02-02T11:35:32.398 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-monterey.ko 2024-02-02T11:35:32.399 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-multitouch.ko 2024-02-02T11:35:32.399 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-ntrig.ko 2024-02-02T11:35:32.399 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-ortek.ko 2024-02-02T11:35:32.399 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-penmount.ko 2024-02-02T11:35:32.399 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-petalynx.ko 2024-02-02T11:35:32.399 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 72937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-picolcd.ko 2024-02-02T11:35:32.399 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-pl.ko 2024-02-02T11:35:32.399 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-plantronics.ko 2024-02-02T11:35:32.399 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-primax.ko 2024-02-02T11:35:32.399 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-rmi.ko 2024-02-02T11:35:32.399 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-arvo.ko 2024-02-02T11:35:32.399 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-common.ko 2024-02-02T11:35:32.399 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-isku.ko 2024-02-02T11:35:32.399 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-kone.ko 2024-02-02T11:35:32.399 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-02-02T11:35:32.400 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-konepure.ko 2024-02-02T11:35:32.400 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-02-02T11:35:32.400 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-lua.ko 2024-02-02T11:35:32.400 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-pyra.ko 2024-02-02T11:35:32.400 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-ryos.ko 2024-02-02T11:35:32.400 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat-savu.ko 2024-02-02T11:35:32.400 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-roccat.ko 2024-02-02T11:35:32.400 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-saitek.ko 2024-02-02T11:35:32.400 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-samsung.ko 2024-02-02T11:35:32.400 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sensor-hub.ko 2024-02-02T11:35:32.400 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sjoy.ko 2024-02-02T11:35:32.400 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sony.ko 2024-02-02T11:35:32.400 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-speedlink.ko 2024-02-02T11:35:32.400 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-steelseries.ko 2024-02-02T11:35:32.400 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-sunplus.ko 2024-02-02T11:35:32.401 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-thrustmaster.ko 2024-02-02T11:35:32.401 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-tivo.ko 2024-02-02T11:35:32.401 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-tmff.ko 2024-02-02T11:35:32.401 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-topseed.ko 2024-02-02T11:35:32.401 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-twinhan.ko 2024-02-02T11:35:32.401 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 71073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-uclogic.ko 2024-02-02T11:35:32.401 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-waltop.ko 2024-02-02T11:35:32.401 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 143473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-wiimote.ko 2024-02-02T11:35:32.401 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-xinmo.ko 2024-02-02T11:35:32.401 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-zpff.ko 2024-02-02T11:35:32.401 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid-zydacron.ko 2024-02-02T11:35:32.401 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 269281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/hid.ko 2024-02-02T11:35:32.401 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/uhid.ko 2024-02-02T11:35:32.401 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/ 2024-02-02T11:35:32.401 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 125785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/usbhid.ko 2024-02-02T11:35:32.402 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/usbkbd.ko 2024-02-02T11:35:32.402 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/usbhid/usbmouse.ko 2024-02-02T11:35:32.402 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 217873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hid/wacom.ko 2024-02-02T11:35:32.402 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/ 2024-02-02T11:35:32.402 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 64201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/hv_balloon.ko 2024-02-02T11:35:32.402 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 89625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/hv_utils.ko 2024-02-02T11:35:32.402 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 305321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hv/hv_vmbus.ko 2024-02-02T11:35:32.402 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ 2024-02-02T11:35:32.402 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/abituguru.ko 2024-02-02T11:35:32.402 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/abituguru3.ko 2024-02-02T11:35:32.402 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/acpi_power_meter.ko 2024-02-02T11:35:32.402 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ad7414.ko 2024-02-02T11:35:32.402 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ad7418.ko 2024-02-02T11:35:32.402 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adc128d818.ko 2024-02-02T11:35:32.402 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1025.ko 2024-02-02T11:35:32.403 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 97977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1026.ko 2024-02-02T11:35:32.403 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1029.ko 2024-02-02T11:35:32.403 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm1031.ko 2024-02-02T11:35:32.403 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adm9240.ko 2024-02-02T11:35:32.403 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ads7828.ko 2024-02-02T11:35:32.403 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7410.ko 2024-02-02T11:35:32.403 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7411.ko 2024-02-02T11:35:32.403 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 74409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7462.ko 2024-02-02T11:35:32.403 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7470.ko 2024-02-02T11:35:32.403 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 69401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7475.ko 2024-02-02T11:35:32.403 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/adt7x10.ko 2024-02-02T11:35:32.403 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/amc6821.ko 2024-02-02T11:35:32.403 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/applesmc.ko 2024-02-02T11:35:32.403 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/asb100.ko 2024-02-02T11:35:32.403 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/asc7621.ko 2024-02-02T11:35:32.403 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/asus_atk0110.ko 2024-02-02T11:35:32.404 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/atxp1.ko 2024-02-02T11:35:32.404 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/coretemp.ko 2024-02-02T11:35:32.404 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/da9052-hwmon.ko 2024-02-02T11:35:32.404 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/da9055-hwmon.ko 2024-02-02T11:35:32.404 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-02-02T11:35:32.404 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 99601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/dme1737.ko 2024-02-02T11:35:32.404 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ds1621.ko 2024-02-02T11:35:32.404 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ds620.ko 2024-02-02T11:35:32.404 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/emc1403.ko 2024-02-02T11:35:32.404 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/emc2103.ko 2024-02-02T11:35:32.404 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/emc6w201.ko 2024-02-02T11:35:32.404 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/f71805f.ko 2024-02-02T11:35:32.404 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 94689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/f71882fg.ko 2024-02-02T11:35:32.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/f75375s.ko 2024-02-02T11:35:32.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/fam15h_power.ko 2024-02-02T11:35:32.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/fschmd.ko 2024-02-02T11:35:32.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/g760a.ko 2024-02-02T11:35:32.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/g762.ko 2024-02-02T11:35:32.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/gl518sm.ko 2024-02-02T11:35:32.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/gl520sm.ko 2024-02-02T11:35:32.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/hih6130.ko 2024-02-02T11:35:32.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/hwmon-vid.ko 2024-02-02T11:35:32.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/i5500_temp.ko 2024-02-02T11:35:32.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/i5k_amb.ko 2024-02-02T11:35:32.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ibmaem.ko 2024-02-02T11:35:32.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ibmpex.ko 2024-02-02T11:35:32.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ina209.ko 2024-02-02T11:35:32.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ina2xx.ko 2024-02-02T11:35:32.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 130449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/it87.ko 2024-02-02T11:35:32.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/jc42.ko 2024-02-02T11:35:32.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/k10temp.ko 2024-02-02T11:35:32.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/k8temp.ko 2024-02-02T11:35:32.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lineage-pem.ko 2024-02-02T11:35:32.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm63.ko 2024-02-02T11:35:32.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm73.ko 2024-02-02T11:35:32.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm75.ko 2024-02-02T11:35:32.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm77.ko 2024-02-02T11:35:32.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm78.ko 2024-02-02T11:35:32.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm80.ko 2024-02-02T11:35:32.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm83.ko 2024-02-02T11:35:32.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 72833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm85.ko 2024-02-02T11:35:32.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm87.ko 2024-02-02T11:35:32.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm90.ko 2024-02-02T11:35:32.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm92.ko 2024-02-02T11:35:32.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 108841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm93.ko 2024-02-02T11:35:32.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm95234.ko 2024-02-02T11:35:32.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm95241.ko 2024-02-02T11:35:32.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/lm95245.ko 2024-02-02T11:35:32.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc2945.ko 2024-02-02T11:35:32.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4151.ko 2024-02-02T11:35:32.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4215.ko 2024-02-02T11:35:32.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4222.ko 2024-02-02T11:35:32.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4245.ko 2024-02-02T11:35:32.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4260.ko 2024-02-02T11:35:32.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/ltc4261.ko 2024-02-02T11:35:32.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max16065.ko 2024-02-02T11:35:32.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max1619.ko 2024-02-02T11:35:32.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max1668.ko 2024-02-02T11:35:32.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max197.ko 2024-02-02T11:35:32.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max6639.ko 2024-02-02T11:35:32.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max6650.ko 2024-02-02T11:35:32.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/max6697.ko 2024-02-02T11:35:32.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/mc13783-adc.ko 2024-02-02T11:35:32.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/mcp3021.ko 2024-02-02T11:35:32.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-02-02T11:35:32.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct6683.ko 2024-02-02T11:35:32.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 119689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct6775-core.ko 2024-02-02T11:35:32.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct6775.ko 2024-02-02T11:35:32.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/nct7802.ko 2024-02-02T11:35:32.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 82337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pc87360.ko 2024-02-02T11:35:32.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pc87427.ko 2024-02-02T11:35:32.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pcf8591.ko 2024-02-02T11:35:32.409 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ 2024-02-02T11:35:32.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-02-02T11:35:32.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-02-02T11:35:32.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-02-02T11:35:32.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/max16064.ko 2024-02-02T11:35:32.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/max34440.ko 2024-02-02T11:35:32.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/max8688.ko 2024-02-02T11:35:32.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-02-02T11:35:32.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 82577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-02-02T11:35:32.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-02-02T11:35:32.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-02-02T11:35:32.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-02-02T11:35:32.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-02-02T11:35:32.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/powr1220.ko 2024-02-02T11:35:32.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sch5627.ko 2024-02-02T11:35:32.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sch5636.ko 2024-02-02T11:35:32.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sch56xx-common.ko 2024-02-02T11:35:32.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sht15.ko 2024-02-02T11:35:32.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sht21.ko 2024-02-02T11:35:32.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/shtc1.ko 2024-02-02T11:35:32.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/sis5595.ko 2024-02-02T11:35:32.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/smsc47b397.ko 2024-02-02T11:35:32.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/smsc47m1.ko 2024-02-02T11:35:32.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/smsc47m192.ko 2024-02-02T11:35:32.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/thmc50.ko 2024-02-02T11:35:32.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp102.ko 2024-02-02T11:35:32.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp103.ko 2024-02-02T11:35:32.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp401.ko 2024-02-02T11:35:32.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/tmp421.ko 2024-02-02T11:35:32.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/via-cputemp.ko 2024-02-02T11:35:32.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/via686a.ko 2024-02-02T11:35:32.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/vt1211.ko 2024-02-02T11:35:32.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/vt8231.ko 2024-02-02T11:35:32.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83627ehf.ko 2024-02-02T11:35:32.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83627hf.ko 2024-02-02T11:35:32.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 71345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83781d.ko 2024-02-02T11:35:32.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 63225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83791d.ko 2024-02-02T11:35:32.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 71321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83792d.ko 2024-02-02T11:35:32.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 101473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83793.ko 2024-02-02T11:35:32.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 119505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83795.ko 2024-02-02T11:35:32.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83l785ts.ko 2024-02-02T11:35:32.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/w83l786ng.ko 2024-02-02T11:35:32.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-02-02T11:35:32.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-02-02T11:35:32.411 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/ 2024-02-02T11:35:32.412 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/algos/ 2024-02-02T11:35:32.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-02-02T11:35:32.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-02-02T11:35:32.412 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/ 2024-02-02T11:35:32.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-02-02T11:35:32.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-02-02T11:35:32.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-02-02T11:35:32.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-02-02T11:35:32.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-02-02T11:35:32.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-02-02T11:35:32.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-02-02T11:35:32.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 6929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-02-02T11:35:32.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-02-02T11:35:32.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-02-02T11:35:32.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-02-02T11:35:32.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-02-02T11:35:32.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-02-02T11:35:32.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-02-02T11:35:32.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-02-02T11:35:32.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-i801.ko 2024-02-02T11:35:32.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-isch.ko 2024-02-02T11:35:32.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-02-02T11:35:32.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-02-02T11:35:32.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-02-02T11:35:32.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-02-02T11:35:32.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-02-02T11:35:32.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-parport.ko 2024-02-02T11:35:32.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-02-02T11:35:32.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-02-02T11:35:32.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-02-02T11:35:32.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-02-02T11:35:32.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-02-02T11:35:32.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-02-02T11:35:32.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-02-02T11:35:32.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-02-02T11:35:32.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-02-02T11:35:32.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-02-02T11:35:32.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-via.ko 2024-02-02T11:35:32.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-02-02T11:35:32.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-02-02T11:35:32.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-02-02T11:35:32.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/i2c-mux.ko 2024-02-02T11:35:32.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/i2c-smbus.ko 2024-02-02T11:35:32.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/i2c-stub.ko 2024-02-02T11:35:32.414 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/ 2024-02-02T11:35:32.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-02-02T11:35:32.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-02-02T11:35:32.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-02-02T11:35:32.415 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ 2024-02-02T11:35:32.415 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ 2024-02-02T11:35:32.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 273609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_cm.ko 2024-02-02T11:35:32.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 883681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_core.ko 2024-02-02T11:35:32.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 69273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_umad.ko 2024-02-02T11:35:32.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 324329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-02-02T11:35:32.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 97921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/iw_cm.ko 2024-02-02T11:35:32.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 282601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/rdma_cm.ko 2024-02-02T11:35:32.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-02-02T11:35:32.415 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/ 2024-02-02T11:35:32.415 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/cxgb4/ 2024-02-02T11:35:32.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 493217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-02-02T11:35:32.416 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx4/ 2024-02-02T11:35:32.416 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 420561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-02-02T11:35:32.416 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx5/ 2024-02-02T11:35:32.416 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 741449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-02-02T11:35:32.416 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mthca/ 2024-02-02T11:35:32.416 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 296881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-02-02T11:35:32.416 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/ocrdma/ 2024-02-02T11:35:32.416 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 153801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-02-02T11:35:32.416 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/usnic/ 2024-02-02T11:35:32.416 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 168969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-02-02T11:35:32.416 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/ 2024-02-02T11:35:32.416 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/ipoib/ 2024-02-02T11:35:32.416 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 263081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-02-02T11:35:32.485 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/iser/ 2024-02-02T11:35:32.485 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 100353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-02-02T11:35:32.485 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/isert/ 2024-02-02T11:35:32.485 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 111425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-02-02T11:35:32.485 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srp/ 2024-02-02T11:35:32.485 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 128753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-02-02T11:35:32.485 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srpt/ 2024-02-02T11:35:32.485 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 129529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-02-02T11:35:32.485 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/ 2024-02-02T11:35:32.485 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/evbug.ko 2024-02-02T11:35:32.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/ff-memless.ko 2024-02-02T11:35:32.486 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/ 2024-02-02T11:35:32.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-02-02T11:35:32.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/fm801-gp.ko 2024-02-02T11:35:32.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/gameport/gameport.ko 2024-02-02T11:35:32.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/joydev.ko 2024-02-02T11:35:32.486 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/ 2024-02-02T11:35:32.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-02-02T11:35:32.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-02-02T11:35:32.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-02-02T11:35:32.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-02-02T11:35:32.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/gpio_keys.ko 2024-02-02T11:35:32.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-02-02T11:35:32.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/lkkbd.ko 2024-02-02T11:35:32.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/lm8323.ko 2024-02-02T11:35:32.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/lm8333.ko 2024-02-02T11:35:32.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-02-02T11:35:32.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-02-02T11:35:32.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-02-02T11:35:32.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-02-02T11:35:32.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/newtonkbd.ko 2024-02-02T11:35:32.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-02-02T11:35:32.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/qt1070.ko 2024-02-02T11:35:32.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/qt2160.ko 2024-02-02T11:35:32.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-02-02T11:35:32.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/stowaway.ko 2024-02-02T11:35:32.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/sunkbd.ko 2024-02-02T11:35:32.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-02-02T11:35:32.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-02-02T11:35:32.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-02-02T11:35:32.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/keyboard/xtkbd.ko 2024-02-02T11:35:32.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/matrix-keymap.ko 2024-02-02T11:35:32.488 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/ 2024-02-02T11:35:32.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/appletouch.ko 2024-02-02T11:35:32.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/bcm5974.ko 2024-02-02T11:35:32.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 123417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/cyapatp.ko 2024-02-02T11:35:32.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 89449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/elan_i2c.ko 2024-02-02T11:35:32.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/gpio_mouse.ko 2024-02-02T11:35:32.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 335953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/psmouse.ko 2024-02-02T11:35:32.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/sermouse.ko 2024-02-02T11:35:32.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-02-02T11:35:32.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/synaptics_usb.ko 2024-02-02T11:35:32.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/mouse/vsxxxaa.ko 2024-02-02T11:35:32.488 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/rmi4/ 2024-02-02T11:35:32.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 109873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/rmi4/rmi_core.ko 2024-02-02T11:35:32.489 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/ 2024-02-02T11:35:32.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/altera_ps2.ko 2024-02-02T11:35:32.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/arc_ps2.ko 2024-02-02T11:35:32.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/ct82c710.ko 2024-02-02T11:35:32.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-02-02T11:35:32.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/parkbd.ko 2024-02-02T11:35:32.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/pcips2.ko 2024-02-02T11:35:32.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/ps2mult.ko 2024-02-02T11:35:32.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/serio_raw.ko 2024-02-02T11:35:32.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/serio/serport.ko 2024-02-02T11:35:32.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/input/sparse-keymap.ko 2024-02-02T11:35:32.489 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/ 2024-02-02T11:35:32.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-88pm860x.ko 2024-02-02T11:35:32.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-adp5520.ko 2024-02-02T11:35:32.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-bd2802.ko 2024-02-02T11:35:32.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-blinkm.ko 2024-02-02T11:35:32.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-da903x.ko 2024-02-02T11:35:32.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-da9052.ko 2024-02-02T11:35:32.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-gpio.ko 2024-02-02T11:35:32.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm3530.ko 2024-02-02T11:35:32.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm3533.ko 2024-02-02T11:35:32.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm355x.ko 2024-02-02T11:35:32.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lm3642.ko 2024-02-02T11:35:32.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lp3944.ko 2024-02-02T11:35:32.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-lp8788.ko 2024-02-02T11:35:32.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-max8997.ko 2024-02-02T11:35:32.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-mc13783.ko 2024-02-02T11:35:32.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-menf21bmc.ko 2024-02-02T11:35:32.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-pca9532.ko 2024-02-02T11:35:32.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-pca955x.ko 2024-02-02T11:35:32.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-pca963x.ko 2024-02-02T11:35:32.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-ss4200.ko 2024-02-02T11:35:32.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-tca6507.ko 2024-02-02T11:35:32.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-wm831x-status.ko 2024-02-02T11:35:32.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/leds-wm8350.ko 2024-02-02T11:35:32.491 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ 2024-02-02T11:35:32.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-02-02T11:35:32.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-02-02T11:35:32.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-02-02T11:35:32.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-02-02T11:35:32.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-02-02T11:35:32.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-02-02T11:35:32.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-02-02T11:35:32.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-02-02T11:35:32.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-02-02T11:35:32.492 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/ 2024-02-02T11:35:32.492 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/bcache/ 2024-02-02T11:35:32.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 647193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/bcache/bcache.ko 2024-02-02T11:35:32.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-bio-prison.ko 2024-02-02T11:35:32.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 93409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-bufio.ko 2024-02-02T11:35:32.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-cache-smq.ko 2024-02-02T11:35:32.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 155897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-cache.ko 2024-02-02T11:35:32.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 107257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-crypt.ko 2024-02-02T11:35:32.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-delay.ko 2024-02-02T11:35:32.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-era.ko 2024-02-02T11:35:32.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-flakey.ko 2024-02-02T11:35:32.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-log-userspace.ko 2024-02-02T11:35:32.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-log.ko 2024-02-02T11:35:32.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-mirror.ko 2024-02-02T11:35:32.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-multipath.ko 2024-02-02T11:35:32.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-queue-length.ko 2024-02-02T11:35:32.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 71073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-raid.ko 2024-02-02T11:35:32.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-region-hash.ko 2024-02-02T11:35:32.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-round-robin.ko 2024-02-02T11:35:32.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-service-time.ko 2024-02-02T11:35:32.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 109529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-snapshot.ko 2024-02-02T11:35:32.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-switch.ko 2024-02-02T11:35:32.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 181865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-thin-pool.ko 2024-02-02T11:35:32.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-verity.ko 2024-02-02T11:35:32.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/dm-zero.ko 2024-02-02T11:35:32.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/faulty.ko 2024-02-02T11:35:32.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/linear.ko 2024-02-02T11:35:32.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/multipath.ko 2024-02-02T11:35:32.494 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/persistent-data/ 2024-02-02T11:35:32.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 199937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-02-02T11:35:32.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid0.ko 2024-02-02T11:35:32.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 113001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid1.ko 2024-02-02T11:35:32.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 158657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid10.ko 2024-02-02T11:35:32.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 393777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/md/raid456.ko 2024-02-02T11:35:32.494 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/ 2024-02-02T11:35:32.494 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/ 2024-02-02T11:35:32.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 178137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptbase.ko 2024-02-02T11:35:32.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 63321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptctl.ko 2024-02-02T11:35:32.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptfc.ko 2024-02-02T11:35:32.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptlan.ko 2024-02-02T11:35:32.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 123321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptsas.ko 2024-02-02T11:35:32.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 81009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptscsih.ko 2024-02-02T11:35:32.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/message/fusion/mptspi.ko 2024-02-02T11:35:32.495 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/ 2024-02-02T11:35:32.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/88pm800.ko 2024-02-02T11:35:32.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/88pm805.ko 2024-02-02T11:35:32.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/88pm80x.ko 2024-02-02T11:35:32.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/arizona-i2c.ko 2024-02-02T11:35:32.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 123721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/arizona.ko 2024-02-02T11:35:32.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/bcm590xx.ko 2024-02-02T11:35:32.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/cros_ec_dev.ko 2024-02-02T11:35:32.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/dln2.ko 2024-02-02T11:35:32.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/janz-cmodio.ko 2024-02-02T11:35:32.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/kempld-core.ko 2024-02-02T11:35:32.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lm3533-core.ko 2024-02-02T11:35:32.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-02-02T11:35:32.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lp3943.ko 2024-02-02T11:35:32.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lpc_ich.ko 2024-02-02T11:35:32.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/lpc_sch.ko 2024-02-02T11:35:32.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/max8907.ko 2024-02-02T11:35:32.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/mc13xxx-core.ko 2024-02-02T11:35:32.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-02-02T11:35:32.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/menf21bmc.ko 2024-02-02T11:35:32.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/pcf50633-adc.ko 2024-02-02T11:35:32.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/pcf50633-gpio.ko 2024-02-02T11:35:32.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/pcf50633.ko 2024-02-02T11:35:32.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-02-02T11:35:32.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/retu-mfd.ko 2024-02-02T11:35:32.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 80425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/si476x-core.ko 2024-02-02T11:35:32.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/sm501.ko 2024-02-02T11:35:32.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/ti_am335x_tscadc.ko 2024-02-02T11:35:32.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/tps65010.ko 2024-02-02T11:35:32.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/tps6507x.ko 2024-02-02T11:35:32.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/viperboard.ko 2024-02-02T11:35:32.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/vx855.ko 2024-02-02T11:35:32.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/wl1273-core.ko 2024-02-02T11:35:32.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/mfd/wm8994.ko 2024-02-02T11:35:32.497 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ 2024-02-02T11:35:32.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-02-02T11:35:32.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ad525x_dpot.ko 2024-02-02T11:35:32.497 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/altera-stapl/ 2024-02-02T11:35:32.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-02-02T11:35:32.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/apds9802als.ko 2024-02-02T11:35:32.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/apds990x.ko 2024-02-02T11:35:32.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/bh1770glc.ko 2024-02-02T11:35:32.498 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/c2port/ 2024-02-02T11:35:32.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-02-02T11:35:32.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/c2port/core.ko 2024-02-02T11:35:32.498 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/cb710/ 2024-02-02T11:35:32.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/cb710/cb710.ko 2024-02-02T11:35:32.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ds1682.ko 2024-02-02T11:35:32.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/dummy-irq.ko 2024-02-02T11:35:32.498 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/echo/ 2024-02-02T11:35:32.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/echo/echo.ko 2024-02-02T11:35:32.498 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/ 2024-02-02T11:35:32.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/at24.ko 2024-02-02T11:35:32.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-02-02T11:35:32.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/eeprom/max6875.ko 2024-02-02T11:35:32.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/enclosure.ko 2024-02-02T11:35:32.498 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/genwqe/ 2024-02-02T11:35:32.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 152201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-02-02T11:35:32.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/hmc6352.ko 2024-02-02T11:35:32.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/hpilo.ko 2024-02-02T11:35:32.499 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ibmasm/ 2024-02-02T11:35:32.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 72601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-02-02T11:35:32.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ics932s401.ko 2024-02-02T11:35:32.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/isl29003.ko 2024-02-02T11:35:32.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/isl29020.ko 2024-02-02T11:35:32.499 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/lis3lv02d/ 2024-02-02T11:35:32.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-02-02T11:35:32.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-02-02T11:35:32.499 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/ 2024-02-02T11:35:32.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 125945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/mei-me.ko 2024-02-02T11:35:32.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 56521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/mei-txe.ko 2024-02-02T11:35:32.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 313641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/mei/mei.ko 2024-02-02T11:35:32.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/phantom.ko 2024-02-02T11:35:32.500 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ti-st/ 2024-02-02T11:35:32.500 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 74377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/ti-st/st_drv.ko 2024-02-02T11:35:32.500 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/tifm_7xx1.ko 2024-02-02T11:35:32.500 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/tifm_core.ko 2024-02-02T11:35:32.500 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/tsl2550.ko 2024-02-02T11:35:32.500 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/vmw_balloon.ko 2024-02-02T11:35:32.500 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/vmw_vmci/ 2024-02-02T11:35:32.500 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 183609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-02-02T11:35:32.500 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ 2024-02-02T11:35:32.500 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/bonding/ 2024-02-02T11:35:32.500 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 490849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/bonding/bonding.ko 2024-02-02T11:35:32.500 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/ 2024-02-02T11:35:32.500 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/b53/ 2024-02-02T11:35:32.500 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 106033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/b53/b53_common.ko 2024-02-02T11:35:32.501 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/bcm-sf2.ko 2024-02-02T11:35:32.501 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/mv88e6060.ko 2024-02-02T11:35:32.501 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/mv88e6xxx/ 2024-02-02T11:35:32.501 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 455065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-02-02T11:35:32.501 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/dummy.ko 2024-02-02T11:35:32.501 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/eql.ko 2024-02-02T11:35:32.501 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ 2024-02-02T11:35:32.501 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/ 2024-02-02T11:35:32.501 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-02-02T11:35:32.501 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-02-02T11:35:32.501 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 130553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-02-02T11:35:32.501 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 68849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-02-02T11:35:32.501 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/ 2024-02-02T11:35:32.501 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/8390.ko 2024-02-02T11:35:32.501 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-02-02T11:35:32.502 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-02-02T11:35:32.502 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 99049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-02-02T11:35:32.502 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/adaptec/ 2024-02-02T11:35:32.502 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-02-02T11:35:32.502 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/agere/ 2024-02-02T11:35:32.502 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 69137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/agere/et131x.ko 2024-02-02T11:35:32.502 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/alteon/ 2024-02-02T11:35:32.502 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-02-02T11:35:32.502 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/altera/ 2024-02-02T11:35:32.502 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-02-02T11:35:32.502 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/ 2024-02-02T11:35:32.502 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-02-02T11:35:32.502 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-02-02T11:35:32.502 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 87297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-02-02T11:35:32.502 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/ 2024-02-02T11:35:32.503 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/alx/ 2024-02-02T11:35:32.503 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 97337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-02-02T11:35:32.503 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-02-02T11:35:32.503 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 102497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-02-02T11:35:32.503 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-02-02T11:35:32.503 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 90345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-02-02T11:35:32.503 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atlx/ 2024-02-02T11:35:32.503 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 81569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-02-02T11:35:32.503 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 69633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-02-02T11:35:32.503 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/ 2024-02-02T11:35:32.503 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-02-02T11:35:32.503 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 176761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-02-02T11:35:32.503 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-02-02T11:35:32.503 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1421529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-02-02T11:35:32.503 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 128569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-02-02T11:35:32.503 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/genet/ 2024-02-02T11:35:32.504 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 131337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-02-02T11:35:32.504 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 314553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-02-02T11:35:32.504 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/brocade/ 2024-02-02T11:35:32.504 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/brocade/bna/ 2024-02-02T11:35:32.504 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 323745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-02-02T11:35:32.504 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/ 2024-02-02T11:35:32.504 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-02-02T11:35:32.504 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 193497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-02-02T11:35:32.504 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-02-02T11:35:32.504 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 347257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-02-02T11:35:32.504 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-02-02T11:35:32.504 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1044793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-02-02T11:35:32.504 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-02-02T11:35:32.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 166193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-02-02T11:35:32.505 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-02-02T11:35:32.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-02-02T11:35:32.505 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/cisco/ 2024-02-02T11:35:32.505 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/cisco/enic/ 2024-02-02T11:35:32.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 204345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-02-02T11:35:32.505 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/ 2024-02-02T11:35:32.505 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/ 2024-02-02T11:35:32.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 69449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-02-02T11:35:32.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-02-02T11:35:32.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 141225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-02-02T11:35:32.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-02-02T11:35:32.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-02-02T11:35:32.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-02-02T11:35:32.505 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dlink/ 2024-02-02T11:35:32.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-02-02T11:35:32.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-02-02T11:35:32.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/dnet.ko 2024-02-02T11:35:32.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ec_bhf.ko 2024-02-02T11:35:32.506 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/emulex/ 2024-02-02T11:35:32.506 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/emulex/benet/ 2024-02-02T11:35:32.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 281137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-02-02T11:35:32.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ethoc.ko 2024-02-02T11:35:32.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/fealnx.ko 2024-02-02T11:35:32.506 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/fujitsu/ 2024-02-02T11:35:32.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-02-02T11:35:32.506 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ 2024-02-02T11:35:32.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 90369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e100.ko 2024-02-02T11:35:32.506 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000/ 2024-02-02T11:35:32.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 295481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-02-02T11:35:32.507 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000e/ 2024-02-02T11:35:32.507 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 584497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-02-02T11:35:32.507 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/fm10k/ 2024-02-02T11:35:32.507 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 246209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-02-02T11:35:32.507 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/i40e/ 2024-02-02T11:35:32.507 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 937673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-02-02T11:35:32.507 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/iavf/ 2024-02-02T11:35:32.507 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 287305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-02-02T11:35:32.507 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igb/ 2024-02-02T11:35:32.507 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 514569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-02-02T11:35:32.507 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igbvf/ 2024-02-02T11:35:32.507 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 93497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-02-02T11:35:32.507 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-02-02T11:35:32.507 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 734353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-02-02T11:35:32.507 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-02-02T11:35:32.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 151769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-02-02T11:35:32.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 86921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/jme.ko 2024-02-02T11:35:32.508 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/ 2024-02-02T11:35:32.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-02-02T11:35:32.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 102289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/skge.ko 2024-02-02T11:35:32.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 122601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-02-02T11:35:32.508 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/ 2024-02-02T11:35:32.508 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-02-02T11:35:32.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 727473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-02-02T11:35:32.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 278961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-02-02T11:35:32.508 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-02-02T11:35:32.508 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-02-02T11:35:32.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1118201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-02-02T11:35:32.508 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ 2024-02-02T11:35:32.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-02-02T11:35:32.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-02-02T11:35:32.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-02-02T11:35:32.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 95665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-02-02T11:35:32.509 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/myricom/ 2024-02-02T11:35:32.509 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-02-02T11:35:32.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 108649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-02-02T11:35:32.509 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/natsemi/ 2024-02-02T11:35:32.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 73441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-02-02T11:35:32.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-02-02T11:35:32.509 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/neterion/ 2024-02-02T11:35:32.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 150905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-02-02T11:35:32.509 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/nvidia/ 2024-02-02T11:35:32.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 136721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-02-02T11:35:32.509 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/packetengines/ 2024-02-02T11:35:32.510 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-02-02T11:35:32.510 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-02-02T11:35:32.510 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/ 2024-02-02T11:35:32.510 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-02-02T11:35:32.510 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 227897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-02-02T11:35:32.510 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 87105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-02-02T11:35:32.510 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-02-02T11:35:32.510 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 671937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-02-02T11:35:32.510 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/rdc/ 2024-02-02T11:35:32.510 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-02-02T11:35:32.510 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/ 2024-02-02T11:35:32.510 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-02-02T11:35:32.510 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 83985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-02-02T11:35:32.510 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/atp.ko 2024-02-02T11:35:32.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 192353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-02-02T11:35:32.511 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/samsung/ 2024-02-02T11:35:32.511 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-02-02T11:35:32.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 104241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-02-02T11:35:32.511 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sfc/ 2024-02-02T11:35:32.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1064737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-02-02T11:35:32.511 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/silan/ 2024-02-02T11:35:32.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-02-02T11:35:32.511 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sis/ 2024-02-02T11:35:32.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sis/sis190.ko 2024-02-02T11:35:32.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 63337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sis/sis900.ko 2024-02-02T11:35:32.511 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/ 2024-02-02T11:35:32.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-02-02T11:35:32.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-02-02T11:35:32.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 73409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-02-02T11:35:32.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 68177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-02-02T11:35:32.512 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/ 2024-02-02T11:35:32.512 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-02-02T11:35:32.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-02-02T11:35:32.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-02-02T11:35:32.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-02-02T11:35:32.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 487593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-02-02T11:35:32.512 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/ 2024-02-02T11:35:32.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 103337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/cassini.ko 2024-02-02T11:35:32.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 166097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/niu.ko 2024-02-02T11:35:32.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/sungem.ko 2024-02-02T11:35:32.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-02-02T11:35:32.512 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/tehuti/ 2024-02-02T11:35:32.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-02-02T11:35:32.512 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ti/ 2024-02-02T11:35:32.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 86529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/ti/tlan.ko 2024-02-02T11:35:32.513 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/via/ 2024-02-02T11:35:32.513 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 80273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-02-02T11:35:32.513 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 83793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-02-02T11:35:32.513 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/wiznet/ 2024-02-02T11:35:32.513 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-02-02T11:35:32.513 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-02-02T11:35:32.513 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/xircom/ 2024-02-02T11:35:32.513 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-02-02T11:35:32.513 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/ 2024-02-02T11:35:32.513 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/defxx.ko 2024-02-02T11:35:32.513 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/skfp/ 2024-02-02T11:35:32.513 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 216985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/fddi/skfp/skfp.ko 2024-02-02T11:35:32.513 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 74569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/geneve.ko 2024-02-02T11:35:32.513 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/hyperv/ 2024-02-02T11:35:32.513 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 236225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-02-02T11:35:32.514 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ieee802154/ 2024-02-02T11:35:32.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ieee802154/fakelb.ko 2024-02-02T11:35:32.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ifb.ko 2024-02-02T11:35:32.514 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ipvlan/ 2024-02-02T11:35:32.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 85817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ipvlan/ipvlan.ko 2024-02-02T11:35:32.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/macvlan.ko 2024-02-02T11:35:32.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/macvtap.ko 2024-02-02T11:35:32.514 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/ 2024-02-02T11:35:32.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-02-02T11:35:32.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-02-02T11:35:32.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-gpio.ko 2024-02-02T11:35:32.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio/mdio-regmap.ko 2024-02-02T11:35:32.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mdio.ko 2024-02-02T11:35:32.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/mii.ko 2024-02-02T11:35:32.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/netconsole.ko 2024-02-02T11:35:32.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/nlmon.ko 2024-02-02T11:35:32.515 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/pcs/ 2024-02-02T11:35:32.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/pcs/pcs-lynx.ko 2024-02-02T11:35:32.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-02-02T11:35:32.515 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/ 2024-02-02T11:35:32.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/amd.ko 2024-02-02T11:35:32.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-02-02T11:35:32.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/bcm7xxx.ko 2024-02-02T11:35:32.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/bcm87xx.ko 2024-02-02T11:35:32.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/broadcom.ko 2024-02-02T11:35:32.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/cicada.ko 2024-02-02T11:35:32.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/davicom.ko 2024-02-02T11:35:32.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/et1011c.ko 2024-02-02T11:35:32.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/icplus.ko 2024-02-02T11:35:32.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/lxt.ko 2024-02-02T11:35:32.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 82049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/marvell.ko 2024-02-02T11:35:32.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 76409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/micrel.ko 2024-02-02T11:35:32.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/national.ko 2024-02-02T11:35:32.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 95561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/phylink.ko 2024-02-02T11:35:32.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/qsemi.ko 2024-02-02T11:35:32.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/realtek.ko 2024-02-02T11:35:32.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/smsc.ko 2024-02-02T11:35:32.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/ste10Xp.ko 2024-02-02T11:35:32.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/phy/vitesse.ko 2024-02-02T11:35:32.516 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/plip/ 2024-02-02T11:35:32.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/plip/plip.ko 2024-02-02T11:35:32.516 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ 2024-02-02T11:35:32.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/bsd_comp.ko 2024-02-02T11:35:32.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_async.ko 2024-02-02T11:35:32.517 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_deflate.ko 2024-02-02T11:35:32.517 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_mppe.ko 2024-02-02T11:35:32.517 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/ppp_synctty.ko 2024-02-02T11:35:32.517 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/pppoe.ko 2024-02-02T11:35:32.517 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/pppox.ko 2024-02-02T11:35:32.517 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/ppp/pptp.ko 2024-02-02T11:35:32.517 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/sb1000.ko 2024-02-02T11:35:32.517 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/slip/ 2024-02-02T11:35:32.517 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/slip/slip.ko 2024-02-02T11:35:32.517 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/sungem_phy.ko 2024-02-02T11:35:32.517 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 64585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/tap.ko 2024-02-02T11:35:32.517 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/ 2024-02-02T11:35:32.517 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 107089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team.ko 2024-02-02T11:35:32.517 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_activebackup.ko 2024-02-02T11:35:32.518 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_broadcast.ko 2024-02-02T11:35:32.518 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-02-02T11:35:32.518 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_random.ko 2024-02-02T11:35:32.518 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-02-02T11:35:32.518 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 86945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/veth.ko 2024-02-02T11:35:32.518 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vmxnet3/ 2024-02-02T11:35:32.518 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 144361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-02-02T11:35:32.518 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vxlan/ 2024-02-02T11:35:32.518 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 301281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/vxlan/vxlan.ko 2024-02-02T11:35:32.518 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/xen-netback/ 2024-02-02T11:35:32.518 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 144001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/net/xen-netback/xen-netback.ko 2024-02-02T11:35:32.518 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ntb/ 2024-02-02T11:35:32.518 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ntb/ntb.ko 2024-02-02T11:35:32.518 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/ 2024-02-02T11:35:32.519 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/host/ 2024-02-02T11:35:32.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 265777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/host/nvme-core.ko 2024-02-02T11:35:32.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 102545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/nvme/host/nvme.ko 2024-02-02T11:35:32.519 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/ 2024-02-02T11:35:32.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 131249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport.ko 2024-02-02T11:35:32.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport_cs.ko 2024-02-02T11:35:32.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 85377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport_pc.ko 2024-02-02T11:35:32.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/parport/parport_serial.ko 2024-02-02T11:35:32.519 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/ 2024-02-02T11:35:32.519 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/ 2024-02-02T11:35:32.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-02-02T11:35:32.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-02-02T11:35:32.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-02-02T11:35:32.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/pci-stub.ko 2024-02-02T11:35:32.520 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pci/xen-pcifront.ko 2024-02-02T11:35:32.520 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/ 2024-02-02T11:35:32.520 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/i82092.ko 2024-02-02T11:35:32.520 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 146289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pcmcia.ko 2024-02-02T11:35:32.520 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pcmcia_core.ko 2024-02-02T11:35:32.520 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-02-02T11:35:32.520 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/pd6729.ko 2024-02-02T11:35:32.520 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 112889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pcmcia/yenta_socket.ko 2024-02-02T11:35:32.520 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/ 2024-02-02T11:35:32.520 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/broadcom/ 2024-02-02T11:35:32.520 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-02-02T11:35:32.520 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/samsung/ 2024-02-02T11:35:32.520 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-02-02T11:35:32.520 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pinctrl/ 2024-02-02T11:35:32.520 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pinctrl/intel/ 2024-02-02T11:35:32.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 69137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-02-02T11:35:32.521 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/ 2024-02-02T11:35:32.521 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/ 2024-02-02T11:35:32.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-02-02T11:35:32.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec.ko 2024-02-02T11:35:32.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-02-02T11:35:32.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-02-02T11:35:32.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-02-02T11:35:32.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-02-02T11:35:32.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-02-02T11:35:32.521 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/ 2024-02-02T11:35:32.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/acer-wmi.ko 2024-02-02T11:35:32.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/acerhdf.ko 2024-02-02T11:35:32.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/apple-gmux.ko 2024-02-02T11:35:32.522 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/asus-laptop.ko 2024-02-02T11:35:32.522 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-02-02T11:35:32.522 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 132025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/asus-wmi.ko 2024-02-02T11:35:32.522 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/classmate-laptop.ko 2024-02-02T11:35:32.522 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-02-02T11:35:32.522 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-02-02T11:35:32.522 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-02-02T11:35:32.522 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-02-02T11:35:32.522 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/hdaps.ko 2024-02-02T11:35:32.522 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/ibm_rtl.ko 2024-02-02T11:35:32.522 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel/ 2024-02-02T11:35:32.522 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-02-02T11:35:32.522 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-02-02T11:35:32.522 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/intel_ips.ko 2024-02-02T11:35:32.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/msi-wmi.ko 2024-02-02T11:35:32.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/mxm-wmi.ko 2024-02-02T11:35:32.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-02-02T11:35:32.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/samsung-laptop.ko 2024-02-02T11:35:32.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/samsung-q10.ko 2024-02-02T11:35:32.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/topstar-laptop.ko 2024-02-02T11:35:32.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-02-02T11:35:32.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/toshiba_haps.ko 2024-02-02T11:35:32.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/wmi-bmof.ko 2024-02-02T11:35:32.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 56905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/platform/x86/wmi.ko 2024-02-02T11:35:32.523 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/ 2024-02-02T11:35:32.523 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ 2024-02-02T11:35:32.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/88pm860x_battery.ko 2024-02-02T11:35:32.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/88pm860x_charger.ko 2024-02-02T11:35:32.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/bq2415x_charger.ko 2024-02-02T11:35:32.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/bq24190_charger.ko 2024-02-02T11:35:32.524 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/bq24735-charger.ko 2024-02-02T11:35:32.524 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-02-02T11:35:32.524 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/da9030_battery.ko 2024-02-02T11:35:32.524 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/da9052-battery.ko 2024-02-02T11:35:32.524 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2760_battery.ko 2024-02-02T11:35:32.524 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2780_battery.ko 2024-02-02T11:35:32.524 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2781_battery.ko 2024-02-02T11:35:32.524 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/ds2782_battery.ko 2024-02-02T11:35:32.524 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/gpio-charger.ko 2024-02-02T11:35:32.524 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/isp1704_charger.ko 2024-02-02T11:35:32.524 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/lp8727_charger.ko 2024-02-02T11:35:32.524 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max14577_charger.ko 2024-02-02T11:35:32.524 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max17042_battery.ko 2024-02-02T11:35:32.524 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max8903_charger.ko 2024-02-02T11:35:32.524 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/max8925_power.ko 2024-02-02T11:35:32.525 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/pcf50633-charger.ko 2024-02-02T11:35:32.525 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/sbs-battery.ko 2024-02-02T11:35:32.525 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/test_power.ko 2024-02-02T11:35:32.525 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/tps65090-charger.ko 2024-02-02T11:35:32.525 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/wm831x_backup.ko 2024-02-02T11:35:32.525 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/wm831x_power.ko 2024-02-02T11:35:32.525 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/power/supply/wm8350_power.ko 2024-02-02T11:35:32.525 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/powercap/ 2024-02-02T11:35:32.525 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/powercap/intel_rapl_common.ko 2024-02-02T11:35:32.525 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/powercap/intel_rapl_msr.ko 2024-02-02T11:35:32.525 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/ 2024-02-02T11:35:32.525 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/ 2024-02-02T11:35:32.525 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/pps-gpio.ko 2024-02-02T11:35:32.525 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/pps-ldisc.ko 2024-02-02T11:35:32.525 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/clients/pps_parport.ko 2024-02-02T11:35:32.526 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/pps/pps_core.ko 2024-02-02T11:35:32.526 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ptp/ 2024-02-02T11:35:32.526 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ptp/ptp.ko 2024-02-02T11:35:32.526 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ptp/ptp_kvm.ko 2024-02-02T11:35:32.526 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/ 2024-02-02T11:35:32.526 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-88pm80x.ko 2024-02-02T11:35:32.526 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-88pm860x.ko 2024-02-02T11:35:32.526 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-bq32k.ko 2024-02-02T11:35:32.526 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-da9052.ko 2024-02-02T11:35:32.526 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-da9055.ko 2024-02-02T11:35:32.526 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-da9063.ko 2024-02-02T11:35:32.526 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1286.ko 2024-02-02T11:35:32.526 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 68577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1307.ko 2024-02-02T11:35:32.526 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1374.ko 2024-02-02T11:35:32.526 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1511.ko 2024-02-02T11:35:32.526 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1553.ko 2024-02-02T11:35:32.527 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1672.ko 2024-02-02T11:35:32.527 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds1742.ko 2024-02-02T11:35:32.527 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds2404.ko 2024-02-02T11:35:32.527 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-ds3232.ko 2024-02-02T11:35:32.527 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-em3027.ko 2024-02-02T11:35:32.527 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-fm3130.ko 2024-02-02T11:35:32.527 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-isl12022.ko 2024-02-02T11:35:32.527 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-isl1208.ko 2024-02-02T11:35:32.527 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-lp8788.ko 2024-02-02T11:35:32.527 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m41t80.ko 2024-02-02T11:35:32.527 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m48t35.ko 2024-02-02T11:35:32.527 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m48t59.ko 2024-02-02T11:35:32.527 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-m48t86.ko 2024-02-02T11:35:32.527 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max6900.ko 2024-02-02T11:35:32.527 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8907.ko 2024-02-02T11:35:32.528 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8925.ko 2024-02-02T11:35:32.528 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8997.ko 2024-02-02T11:35:32.528 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-max8998.ko 2024-02-02T11:35:32.528 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-02-02T11:35:32.528 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-msm6242.ko 2024-02-02T11:35:32.528 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-palmas.ko 2024-02-02T11:35:32.528 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf2127.ko 2024-02-02T11:35:32.528 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf50633.ko 2024-02-02T11:35:32.528 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf85063.ko 2024-02-02T11:35:32.528 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf8523.ko 2024-02-02T11:35:32.528 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf8563.ko 2024-02-02T11:35:32.528 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-pcf8583.ko 2024-02-02T11:35:32.528 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rc5t583.ko 2024-02-02T11:35:32.528 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rp5c01.ko 2024-02-02T11:35:32.528 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rs5c372.ko 2024-02-02T11:35:32.529 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-02-02T11:35:32.529 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rx8025.ko 2024-02-02T11:35:32.529 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-rx8581.ko 2024-02-02T11:35:32.529 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-s35390a.ko 2024-02-02T11:35:32.529 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-02-02T11:35:32.529 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-tps6586x.ko 2024-02-02T11:35:32.529 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-tps65910.ko 2024-02-02T11:35:32.529 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-wm831x.ko 2024-02-02T11:35:32.529 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-wm8350.ko 2024-02-02T11:35:32.529 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/rtc/rtc-x1205.ko 2024-02-02T11:35:32.529 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ 2024-02-02T11:35:32.529 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 77617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/3w-9xxx.ko 2024-02-02T11:35:32.529 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/3w-sas.ko 2024-02-02T11:35:32.529 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/3w-xxxx.ko 2024-02-02T11:35:32.529 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 135185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/BusLogic.ko 2024-02-02T11:35:32.530 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/a100u2w.ko 2024-02-02T11:35:32.530 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aacraid/ 2024-02-02T11:35:32.530 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 271113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aacraid/aacraid.ko 2024-02-02T11:35:32.530 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 100617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/advansys.ko 2024-02-02T11:35:32.530 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic7xxx/ 2024-02-02T11:35:32.530 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 356929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-02-02T11:35:32.530 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 296049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-02-02T11:35:32.530 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic94xx/ 2024-02-02T11:35:32.530 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 189185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-02-02T11:35:32.530 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/am53c974.ko 2024-02-02T11:35:32.530 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/arcmsr/ 2024-02-02T11:35:32.530 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 106881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-02-02T11:35:32.530 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/atp870u.ko 2024-02-02T11:35:32.530 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/be2iscsi/ 2024-02-02T11:35:32.530 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 247009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-02-02T11:35:32.531 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bfa/ 2024-02-02T11:35:32.531 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1171945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bfa/bfa.ko 2024-02-02T11:35:32.531 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2fc/ 2024-02-02T11:35:32.531 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 237721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-02-02T11:35:32.531 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2i/ 2024-02-02T11:35:32.531 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 115369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-02-02T11:35:32.531 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ch.ko 2024-02-02T11:35:32.531 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/csiostor/ 2024-02-02T11:35:32.531 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 308921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/csiostor/csiostor.ko 2024-02-02T11:35:32.531 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/ 2024-02-02T11:35:32.531 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-02-02T11:35:32.531 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 76145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-02-02T11:35:32.531 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-02-02T11:35:32.531 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 101449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-02-02T11:35:32.531 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 146625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-02-02T11:35:32.532 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 75553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/dc395x.ko 2024-02-02T11:35:32.532 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/dmx3191d.ko 2024-02-02T11:35:32.532 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/esas2r/ 2024-02-02T11:35:32.532 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 212425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/esas2r/esas2r.ko 2024-02-02T11:35:32.532 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/esp_scsi.ko 2024-02-02T11:35:32.532 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fcoe/ 2024-02-02T11:35:32.532 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fcoe/fcoe.ko 2024-02-02T11:35:32.532 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 158505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-02-02T11:35:32.532 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fdomain.ko 2024-02-02T11:35:32.532 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fnic/ 2024-02-02T11:35:32.532 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 263489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/fnic/fnic.ko 2024-02-02T11:35:32.532 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 201817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/hpsa.ko 2024-02-02T11:35:32.532 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/hptiop.ko 2024-02-02T11:35:32.532 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/hv_storvsc.ko 2024-02-02T11:35:32.532 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/imm.ko 2024-02-02T11:35:32.533 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/initio.ko 2024-02-02T11:35:32.533 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 266537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ipr.ko 2024-02-02T11:35:32.533 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 101473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ips.ko 2024-02-02T11:35:32.533 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/isci/ 2024-02-02T11:35:32.533 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 317153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/isci/isci.ko 2024-02-02T11:35:32.533 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-02-02T11:35:32.533 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/iscsi_tcp.ko 2024-02-02T11:35:32.533 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libfc/ 2024-02-02T11:35:32.533 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 315209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libfc/libfc.ko 2024-02-02T11:35:32.533 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 145585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libiscsi.ko 2024-02-02T11:35:32.533 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libiscsi_tcp.ko 2024-02-02T11:35:32.533 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libsas/ 2024-02-02T11:35:32.533 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 216441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/libsas/libsas.ko 2024-02-02T11:35:32.533 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/lpfc/ 2024-02-02T11:35:32.533 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 2197481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/lpfc/lpfc.ko 2024-02-02T11:35:32.533 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/ 2024-02-02T11:35:32.534 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 73569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-02-02T11:35:32.534 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-02-02T11:35:32.534 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 310841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-02-02T11:35:32.534 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 84649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/megaraid.ko 2024-02-02T11:35:32.534 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mpt3sas/ 2024-02-02T11:35:32.534 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 659801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-02-02T11:35:32.534 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mvsas/ 2024-02-02T11:35:32.534 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 119561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mvsas/mvsas.ko 2024-02-02T11:35:32.534 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/mvumi.ko 2024-02-02T11:35:32.534 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/ 2024-02-02T11:35:32.534 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 81649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-02-02T11:35:32.534 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-02-02T11:35:32.534 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-02-02T11:35:32.534 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-02-02T11:35:32.534 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pm8001/ 2024-02-02T11:35:32.535 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 366401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-02-02T11:35:32.535 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 124633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/pmcraid.ko 2024-02-02T11:35:32.535 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ppa.ko 2024-02-02T11:35:32.535 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla1280.ko 2024-02-02T11:35:32.535 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla2xxx/ 2024-02-02T11:35:32.535 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1876633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-02-02T11:35:32.535 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 85289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-02-02T11:35:32.535 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla4xxx/ 2024-02-02T11:35:32.535 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 559033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-02-02T11:35:32.535 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/qlogicfas408.ko 2024-02-02T11:35:32.535 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/raid_class.ko 2024-02-02T11:35:32.535 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 261241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_debug.ko 2024-02-02T11:35:32.535 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 173937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_fc.ko 2024-02-02T11:35:32.535 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 279313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-02-02T11:35:32.535 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 97729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_sas.ko 2024-02-02T11:35:32.535 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 73969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_spi.ko 2024-02-02T11:35:32.536 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/scsi_transport_srp.ko 2024-02-02T11:35:32.536 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/ses.ko 2024-02-02T11:35:32.536 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 115889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/st.ko 2024-02-02T11:35:32.536 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/stex.ko 2024-02-02T11:35:32.536 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/sym53c8xx_2/ 2024-02-02T11:35:32.536 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 164961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-02-02T11:35:32.536 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/virtio_scsi.ko 2024-02-02T11:35:32.536 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/vmw_pvscsi.ko 2024-02-02T11:35:32.536 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/wd719x.ko 2024-02-02T11:35:32.536 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/scsi/xen-scsifront.ko 2024-02-02T11:35:32.536 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ssb/ 2024-02-02T11:35:32.536 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 129441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ssb/ssb.ko 2024-02-02T11:35:32.536 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/ 2024-02-02T11:35:32.536 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/iscsi/ 2024-02-02T11:35:32.536 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 736769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-02-02T11:35:32.537 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/loopback/ 2024-02-02T11:35:32.537 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/loopback/tcm_loop.ko 2024-02-02T11:35:32.537 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_file.ko 2024-02-02T11:35:32.537 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_iblock.ko 2024-02-02T11:35:32.537 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 930697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_mod.ko 2024-02-02T11:35:32.625 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_pscsi.ko 2024-02-02T11:35:32.626 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 122521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/target_core_user.ko 2024-02-02T11:35:32.626 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/tcm_fc/ 2024-02-02T11:35:32.626 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 75593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-02-02T11:35:32.626 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/ 2024-02-02T11:35:32.626 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/ 2024-02-02T11:35:32.626 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/ 2024-02-02T11:35:32.626 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-02-02T11:35:32.626 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-02-02T11:35:32.626 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-02-02T11:35:32.626 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-02-02T11:35:32.626 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-02-02T11:35:32.626 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-02-02T11:35:32.626 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-02-02T11:35:32.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-02-02T11:35:32.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-02-02T11:35:32.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-02-02T11:35:32.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-02-02T11:35:32.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-02-02T11:35:32.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-02-02T11:35:32.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-02-02T11:35:32.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-02-02T11:35:32.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-02-02T11:35:32.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-02-02T11:35:32.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-02-02T11:35:32.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-02-02T11:35:32.627 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/ 2024-02-02T11:35:32.627 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/ipwireless/ 2024-02-02T11:35:32.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-02-02T11:35:32.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/moxa.ko 2024-02-02T11:35:32.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/mxser.ko 2024-02-02T11:35:32.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 108601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/n_gsm.ko 2024-02-02T11:35:32.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/n_hdlc.ko 2024-02-02T11:35:32.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/nozomi.ko 2024-02-02T11:35:32.628 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/ 2024-02-02T11:35:32.628 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/8250/ 2024-02-02T11:35:32.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-02-02T11:35:32.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-02-02T11:35:32.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-02-02T11:35:32.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/altera_uart.ko 2024-02-02T11:35:32.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/arc_uart.ko 2024-02-02T11:35:32.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 72425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-02-02T11:35:32.628 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/jsm/ 2024-02-02T11:35:32.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 103073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/jsm/jsm.ko 2024-02-02T11:35:32.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/rp2.ko 2024-02-02T11:35:32.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/tty/serial/sc16is7xx.ko 2024-02-02T11:35:32.629 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/ 2024-02-02T11:35:32.629 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/core/ 2024-02-02T11:35:32.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 535985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/core/ufshcd-core.ko 2024-02-02T11:35:32.629 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/host/ 2024-02-02T11:35:32.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-02-02T11:35:32.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-02-02T11:35:32.629 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/ 2024-02-02T11:35:32.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio.ko 2024-02-02T11:35:32.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_aec.ko 2024-02-02T11:35:32.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_cif.ko 2024-02-02T11:35:32.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_dmem_genirq.ko 2024-02-02T11:35:32.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_mf624.ko 2024-02-02T11:35:32.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_netx.ko 2024-02-02T11:35:32.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_pci_generic.ko 2024-02-02T11:35:32.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-02-02T11:35:32.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/uio/uio_sercos3.ko 2024-02-02T11:35:32.630 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/ 2024-02-02T11:35:32.630 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/c67x00/ 2024-02-02T11:35:32.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 73297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/c67x00/c67x00.ko 2024-02-02T11:35:32.630 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ 2024-02-02T11:35:32.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 144617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-02-02T11:35:32.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-02-02T11:35:32.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-02-02T11:35:32.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-02-02T11:35:32.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-02-02T11:35:32.630 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/ 2024-02-02T11:35:32.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 87073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/cdc-acm.ko 2024-02-02T11:35:32.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/cdc-wdm.ko 2024-02-02T11:35:32.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/usblp.ko 2024-02-02T11:35:32.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 89857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/class/usbtmc.ko 2024-02-02T11:35:32.631 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/common/ 2024-02-02T11:35:32.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/common/ulpi.ko 2024-02-02T11:35:32.631 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc2/ 2024-02-02T11:35:32.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-02-02T11:35:32.631 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/ 2024-02-02T11:35:32.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-02-02T11:35:32.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-02-02T11:35:32.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 454385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/dwc3/dwc3.ko 2024-02-02T11:35:32.631 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/ 2024-02-02T11:35:32.631 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/ 2024-02-02T11:35:32.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/u_ether.ko 2024-02-02T11:35:32.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/u_serial.ko 2024-02-02T11:35:32.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-02-02T11:35:32.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-02-02T11:35:32.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-02-02T11:35:32.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-02-02T11:35:32.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 92489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-02-02T11:35:32.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-02-02T11:35:32.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 122081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-02-02T11:35:32.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-02-02T11:35:32.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-02-02T11:35:32.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-02-02T11:35:32.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-02-02T11:35:32.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 85609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-02-02T11:35:32.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-02-02T11:35:32.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-02-02T11:35:32.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-02-02T11:35:32.633 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/ 2024-02-02T11:35:32.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-02-02T11:35:32.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-02-02T11:35:32.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-02-02T11:35:32.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-02-02T11:35:32.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-02-02T11:35:32.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-02-02T11:35:32.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-02-02T11:35:32.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-02-02T11:35:32.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-02-02T11:35:32.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-02-02T11:35:32.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-02-02T11:35:32.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-02-02T11:35:32.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-02-02T11:35:32.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-02-02T11:35:32.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 161225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/libcomposite.ko 2024-02-02T11:35:32.634 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/ 2024-02-02T11:35:32.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-02-02T11:35:32.634 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/bdc/ 2024-02-02T11:35:32.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 157681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-02-02T11:35:32.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-02-02T11:35:32.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-02-02T11:35:32.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 69705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-02-02T11:35:32.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 56033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-02-02T11:35:32.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 76057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/net2272.ko 2024-02-02T11:35:32.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 75073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/net2280.ko 2024-02-02T11:35:32.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 73169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-02-02T11:35:32.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 65809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-02-02T11:35:32.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-02-02T11:35:32.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 81505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-02-02T11:35:32.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 156409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-02-02T11:35:32.635 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/ 2024-02-02T11:35:32.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/bcma-hcd.ko 2024-02-02T11:35:32.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 80113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/isp116x-hcd.ko 2024-02-02T11:35:32.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 87353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-02-02T11:35:32.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-02-02T11:35:32.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/sl811-hcd.ko 2024-02-02T11:35:32.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/sl811_cs.ko 2024-02-02T11:35:32.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/ssb-hcd.ko 2024-02-02T11:35:32.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-02-02T11:35:32.635 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/image/ 2024-02-02T11:35:32.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/image/mdc800.ko 2024-02-02T11:35:32.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/image/microtek.ko 2024-02-02T11:35:32.635 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ 2024-02-02T11:35:32.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/adutux.ko 2024-02-02T11:35:32.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/appledisplay.ko 2024-02-02T11:35:32.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-02-02T11:35:32.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/cytherm.ko 2024-02-02T11:35:32.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ehset.ko 2024-02-02T11:35:32.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/emi26.ko 2024-02-02T11:35:32.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/emi62.ko 2024-02-02T11:35:32.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ezusb.ko 2024-02-02T11:35:32.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/idmouse.ko 2024-02-02T11:35:32.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/iowarrior.ko 2024-02-02T11:35:32.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/isight_firmware.ko 2024-02-02T11:35:32.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/ldusb.ko 2024-02-02T11:35:32.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/legousbtower.ko 2024-02-02T11:35:32.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/lvstest.ko 2024-02-02T11:35:32.636 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/sisusbvga/ 2024-02-02T11:35:32.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 64841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-02-02T11:35:32.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/trancevibrator.ko 2024-02-02T11:35:32.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usb3503.ko 2024-02-02T11:35:32.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usblcd.ko 2024-02-02T11:35:32.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usbsevseg.ko 2024-02-02T11:35:32.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/usbtest.ko 2024-02-02T11:35:32.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/uss720.ko 2024-02-02T11:35:32.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/misc/yurex.ko 2024-02-02T11:35:32.637 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/mon/ 2024-02-02T11:35:32.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 72953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/mon/usbmon.ko 2024-02-02T11:35:32.637 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/musb/ 2024-02-02T11:35:32.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 301697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/musb/musb_hdrc.ko 2024-02-02T11:35:32.637 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/ 2024-02-02T11:35:32.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-generic.ko 2024-02-02T11:35:32.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-02-02T11:35:32.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-isp1301.ko 2024-02-02T11:35:32.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/phy/phy-tahvo.ko 2024-02-02T11:35:32.638 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ 2024-02-02T11:35:32.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/aircable.ko 2024-02-02T11:35:32.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ark3116.ko 2024-02-02T11:35:32.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/belkin_sa.ko 2024-02-02T11:35:32.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ch341.ko 2024-02-02T11:35:32.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/cp210x.ko 2024-02-02T11:35:32.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/cyberjack.ko 2024-02-02T11:35:32.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/cypress_m8.ko 2024-02-02T11:35:32.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/digi_acceleport.ko 2024-02-02T11:35:32.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/empeg.ko 2024-02-02T11:35:32.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/f81232.ko 2024-02-02T11:35:32.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 175193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ftdi_sio.ko 2024-02-02T11:35:32.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/garmin_gps.ko 2024-02-02T11:35:32.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 137081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/io_edgeport.ko 2024-02-02T11:35:32.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 124833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/io_ti.ko 2024-02-02T11:35:32.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ipaq.ko 2024-02-02T11:35:32.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ipw.ko 2024-02-02T11:35:32.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ir-usb.ko 2024-02-02T11:35:32.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-02-02T11:35:32.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 107521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/keyspan.ko 2024-02-02T11:35:32.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/keyspan_pda.ko 2024-02-02T11:35:32.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/kl5kusb105.ko 2024-02-02T11:35:32.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/kobil_sct.ko 2024-02-02T11:35:32.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mct_u232.ko 2024-02-02T11:35:32.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/metro-usb.ko 2024-02-02T11:35:32.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mos7720.ko 2024-02-02T11:35:32.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mos7840.ko 2024-02-02T11:35:32.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 56337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/mxuport.ko 2024-02-02T11:35:32.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/navman.ko 2024-02-02T11:35:32.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/omninet.ko 2024-02-02T11:35:32.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/opticon.ko 2024-02-02T11:35:32.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 191801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/option.ko 2024-02-02T11:35:32.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/oti6858.ko 2024-02-02T11:35:32.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/pl2303.ko 2024-02-02T11:35:32.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/qcaux.ko 2024-02-02T11:35:32.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/qcserial.ko 2024-02-02T11:35:32.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/quatech2.ko 2024-02-02T11:35:32.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/safe_serial.ko 2024-02-02T11:35:32.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/sierra.ko 2024-02-02T11:35:32.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/spcp8x5.ko 2024-02-02T11:35:32.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ssu100.ko 2024-02-02T11:35:32.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/symbolserial.ko 2024-02-02T11:35:32.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-02-02T11:35:32.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-02-02T11:35:32.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usb_debug.ko 2024-02-02T11:35:32.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33201 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usb_wwan.ko 2024-02-02T11:35:32.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 125609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/usbserial.ko 2024-02-02T11:35:32.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/visor.ko 2024-02-02T11:35:32.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/whiteheat.ko 2024-02-02T11:35:32.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/wishbone-serial.ko 2024-02-02T11:35:32.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/serial/xsens_mt.ko 2024-02-02T11:35:32.641 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ 2024-02-02T11:35:32.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/uas.ko 2024-02-02T11:35:32.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-alauda.ko 2024-02-02T11:35:32.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-cypress.ko 2024-02-02T11:35:32.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-datafab.ko 2024-02-02T11:35:32.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-02-02T11:35:32.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-freecom.ko 2024-02-02T11:35:32.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-isd200.ko 2024-02-02T11:35:32.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-02-02T11:35:32.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-karma.ko 2024-02-02T11:35:32.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-onetouch.ko 2024-02-02T11:35:32.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-realtek.ko 2024-02-02T11:35:32.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-sddr09.ko 2024-02-02T11:35:32.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-sddr55.ko 2024-02-02T11:35:32.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/ums-usbat.ko 2024-02-02T11:35:32.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 180225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/storage/usb-storage.ko 2024-02-02T11:35:32.642 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/ 2024-02-02T11:35:32.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/usbip-core.ko 2024-02-02T11:35:32.643 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 71097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/usbip-host.ko 2024-02-02T11:35:32.643 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 103977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-02-02T11:35:32.643 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/ 2024-02-02T11:35:32.643 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/pci/ 2024-02-02T11:35:32.643 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 154297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-02-02T11:35:32.643 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/pci/vfio-pci.ko 2024-02-02T11:35:32.643 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 103737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/vfio.ko 2024-02-02T11:35:32.643 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 77609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-02-02T11:35:32.643 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/ 2024-02-02T11:35:32.643 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 113785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost.ko 2024-02-02T11:35:32.643 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost_iotlb.ko 2024-02-02T11:35:32.643 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost_net.ko 2024-02-02T11:35:32.643 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 89233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/vhost/vhost_scsi.ko 2024-02-02T11:35:32.643 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/ 2024-02-02T11:35:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/ 2024-02-02T11:35:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-02-02T11:35:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/aat2870_bl.ko 2024-02-02T11:35:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/adp5520_bl.ko 2024-02-02T11:35:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/adp8860_bl.ko 2024-02-02T11:35:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/adp8870_bl.ko 2024-02-02T11:35:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/apple_bl.ko 2024-02-02T11:35:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/as3711_bl.ko 2024-02-02T11:35:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/bd6107.ko 2024-02-02T11:35:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/da903x_bl.ko 2024-02-02T11:35:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/da9052_bl.ko 2024-02-02T11:35:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/gpio_backlight.ko 2024-02-02T11:35:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/kb3886_bl.ko 2024-02-02T11:35:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lcd.ko 2024-02-02T11:35:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lm3533_bl.ko 2024-02-02T11:35:32.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lm3639_bl.ko 2024-02-02T11:35:32.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/lv5207lp.ko 2024-02-02T11:35:32.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/max8925_bl.ko 2024-02-02T11:35:32.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/pandora_bl.ko 2024-02-02T11:35:32.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-02-02T11:35:32.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/platform_lcd.ko 2024-02-02T11:35:32.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/video/backlight/wm831x_bl.ko 2024-02-02T11:35:32.645 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/ 2024-02-02T11:35:32.645 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/ 2024-02-02T11:35:32.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/ds2482.ko 2024-02-02T11:35:32.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/ds2490.ko 2024-02-02T11:35:32.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/matrox_w1.ko 2024-02-02T11:35:32.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/masters/w1-gpio.ko 2024-02-02T11:35:32.645 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/ 2024-02-02T11:35:32.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-02-02T11:35:32.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-02-02T11:35:32.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-02-02T11:35:32.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-02-02T11:35:32.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-02-02T11:35:32.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-02-02T11:35:32.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-02-02T11:35:32.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-02-02T11:35:32.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-02-02T11:35:32.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_smem.ko 2024-02-02T11:35:32.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 56425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/slaves/w1_therm.ko 2024-02-02T11:35:32.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 102673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/w1/wire.ko 2024-02-02T11:35:32.646 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ 2024-02-02T11:35:32.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/acquirewdt.ko 2024-02-02T11:35:32.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/advantechwdt.ko 2024-02-02T11:35:32.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/alim1535_wdt.ko 2024-02-02T11:35:32.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/alim7101_wdt.ko 2024-02-02T11:35:32.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/cpu5wdt.ko 2024-02-02T11:35:32.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/da9052_wdt.ko 2024-02-02T11:35:32.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/da9055_wdt.ko 2024-02-02T11:35:32.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/da9063_wdt.ko 2024-02-02T11:35:32.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/dw_wdt.ko 2024-02-02T11:35:32.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/eurotechwdt.ko 2024-02-02T11:35:32.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/f71808e_wdt.ko 2024-02-02T11:35:32.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/hpwdt.ko 2024-02-02T11:35:32.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/i6300esb.ko 2024-02-02T11:35:32.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-02-02T11:35:32.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/iTCO_wdt.ko 2024-02-02T11:35:32.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ib700wdt.ko 2024-02-02T11:35:32.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ibmasr.ko 2024-02-02T11:35:32.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-02-02T11:35:32.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/it8712f_wdt.ko 2024-02-02T11:35:32.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/it87_wdt.ko 2024-02-02T11:35:32.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/kempld_wdt.ko 2024-02-02T11:35:32.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/machzwd.ko 2024-02-02T11:35:32.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/mena21_wdt.ko 2024-02-02T11:35:32.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-02-02T11:35:32.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/nv_tco.ko 2024-02-02T11:35:32.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-02-02T11:35:32.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/pc87413_wdt.ko 2024-02-02T11:35:32.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/pcwd_pci.ko 2024-02-02T11:35:32.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/pcwd_usb.ko 2024-02-02T11:35:32.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/retu_wdt.ko 2024-02-02T11:35:32.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-02-02T11:35:32.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-02-02T11:35:32.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-02-02T11:35:32.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sc1200wdt.ko 2024-02-02T11:35:32.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sch311x_wdt.ko 2024-02-02T11:35:32.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-02-02T11:35:32.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/softdog.ko 2024-02-02T11:35:32.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/sp5100_tco.ko 2024-02-02T11:35:32.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/twl4030_wdt.ko 2024-02-02T11:35:32.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/via_wdt.ko 2024-02-02T11:35:32.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-02-02T11:35:32.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/w83877f_wdt.ko 2024-02-02T11:35:32.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/w83977f_wdt.ko 2024-02-02T11:35:32.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wafer5823wdt.ko 2024-02-02T11:35:32.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wdt_pci.ko 2024-02-02T11:35:32.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wm831x_wdt.ko 2024-02-02T11:35:32.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/wm8350_wdt.ko 2024-02-02T11:35:32.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/watchdog/xen_wdt.ko 2024-02-02T11:35:32.650 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/ 2024-02-02T11:35:32.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-evtchn.ko 2024-02-02T11:35:32.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-gntalloc.ko 2024-02-02T11:35:32.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-gntdev.ko 2024-02-02T11:35:32.650 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-pciback/ 2024-02-02T11:35:32.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 176441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-02-02T11:35:32.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-privcmd.ko 2024-02-02T11:35:32.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 71249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xen-scsiback.ko 2024-02-02T11:35:32.650 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xenfs/ 2024-02-02T11:35:32.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/drivers/xen/xenfs/xenfs.ko 2024-02-02T11:35:32.650 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ 2024-02-02T11:35:32.650 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/9p/ 2024-02-02T11:35:32.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 166753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/9p/9p.ko 2024-02-02T11:35:32.651 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/adfs/ 2024-02-02T11:35:32.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/adfs/adfs.ko 2024-02-02T11:35:32.651 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/affs/ 2024-02-02T11:35:32.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 163449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/affs/affs.ko 2024-02-02T11:35:32.651 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/afs/ 2024-02-02T11:35:32.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 935033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/afs/kafs.ko 2024-02-02T11:35:32.651 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/autofs/ 2024-02-02T11:35:32.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 103401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/autofs/autofs4.ko 2024-02-02T11:35:32.651 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/befs/ 2024-02-02T11:35:32.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 64681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/befs/befs.ko 2024-02-02T11:35:32.651 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/bfs/ 2024-02-02T11:35:32.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/bfs/bfs.ko 2024-02-02T11:35:32.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/binfmt_misc.ko 2024-02-02T11:35:32.651 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/btrfs/ 2024-02-02T11:35:32.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 3455857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/btrfs/btrfs.ko 2024-02-02T11:35:32.652 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cachefiles/ 2024-02-02T11:35:32.652 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 306009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cachefiles/cachefiles.ko 2024-02-02T11:35:32.652 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ceph/ 2024-02-02T11:35:32.652 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1336985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ceph/ceph.ko 2024-02-02T11:35:32.652 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/coda/ 2024-02-02T11:35:32.652 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 100801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/coda/coda.ko 2024-02-02T11:35:32.652 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/configfs/ 2024-02-02T11:35:32.652 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 108641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/configfs/configfs.ko 2024-02-02T11:35:32.652 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cramfs/ 2024-02-02T11:35:32.652 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/cramfs/cramfs.ko 2024-02-02T11:35:32.652 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/dlm/ 2024-02-02T11:35:32.652 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 644073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/dlm/dlm.ko 2024-02-02T11:35:32.652 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/efs/ 2024-02-02T11:35:32.652 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/efs/efs.ko 2024-02-02T11:35:32.653 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/f2fs/ 2024-02-02T11:35:32.653 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1506641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/f2fs/f2fs.ko 2024-02-02T11:35:32.653 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fat/ 2024-02-02T11:35:32.653 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fat/msdos.ko 2024-02-02T11:35:32.653 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/freevxfs/ 2024-02-02T11:35:32.653 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/freevxfs/freevxfs.ko 2024-02-02T11:35:32.653 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fscache/ 2024-02-02T11:35:32.653 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 226481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fscache/fscache.ko 2024-02-02T11:35:32.653 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fuse/ 2024-02-02T11:35:32.653 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/fuse/cuse.ko 2024-02-02T11:35:32.653 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/gfs2/ 2024-02-02T11:35:32.653 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1229913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/gfs2/gfs2.ko 2024-02-02T11:35:32.653 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfs/ 2024-02-02T11:35:32.653 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 141985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfs/hfs.ko 2024-02-02T11:35:32.653 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfsplus/ 2024-02-02T11:35:32.653 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 223225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hfsplus/hfsplus.ko 2024-02-02T11:35:32.654 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hpfs/ 2024-02-02T11:35:32.654 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 193569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/hpfs/hpfs.ko 2024-02-02T11:35:32.654 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/isofs/ 2024-02-02T11:35:32.654 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 74785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/isofs/isofs.ko 2024-02-02T11:35:32.654 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/jfs/ 2024-02-02T11:35:32.654 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 419881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/jfs/jfs.ko 2024-02-02T11:35:32.654 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/lockd/ 2024-02-02T11:35:32.654 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 282049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/lockd/lockd.ko 2024-02-02T11:35:32.654 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/minix/ 2024-02-02T11:35:32.654 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 89761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/minix/minix.ko 2024-02-02T11:35:32.654 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/netfs/ 2024-02-02T11:35:32.654 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 124649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/netfs/netfs.ko 2024-02-02T11:35:32.654 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/ 2024-02-02T11:35:32.654 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/blocklayout/ 2024-02-02T11:35:32.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 81513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-02-02T11:35:32.655 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/filelayout/ 2024-02-02T11:35:32.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-02-02T11:35:32.655 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/flexfilelayout/ 2024-02-02T11:35:32.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 117465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-02-02T11:35:32.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1057969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfs.ko 2024-02-02T11:35:32.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfsv2.ko 2024-02-02T11:35:32.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 120265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfsv3.ko 2024-02-02T11:35:32.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 2042153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs/nfsv4.ko 2024-02-02T11:35:32.655 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs_common/ 2024-02-02T11:35:32.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs_common/grace.ko 2024-02-02T11:35:32.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfs_common/nfs_acl.ko 2024-02-02T11:35:32.655 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfsd/ 2024-02-02T11:35:32.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1563929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nfsd/nfsd.ko 2024-02-02T11:35:32.655 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nilfs2/ 2024-02-02T11:35:32.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 590713 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nilfs2/nilfs2.ko 2024-02-02T11:35:32.656 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/ 2024-02-02T11:35:32.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-celtic.ko 2024-02-02T11:35:32.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-centeuro.ko 2024-02-02T11:35:32.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-croatian.ko 2024-02-02T11:35:32.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-cyrillic.ko 2024-02-02T11:35:32.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-gaelic.ko 2024-02-02T11:35:32.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-greek.ko 2024-02-02T11:35:32.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-iceland.ko 2024-02-02T11:35:32.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-inuit.ko 2024-02-02T11:35:32.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-roman.ko 2024-02-02T11:35:32.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-romanian.ko 2024-02-02T11:35:32.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13793 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/mac-turkish.ko 2024-02-02T11:35:32.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_ascii.ko 2024-02-02T11:35:32.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp1250.ko 2024-02-02T11:35:32.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp1251.ko 2024-02-02T11:35:32.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp1255.ko 2024-02-02T11:35:32.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp737.ko 2024-02-02T11:35:32.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp775.ko 2024-02-02T11:35:32.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp850.ko 2024-02-02T11:35:32.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp852.ko 2024-02-02T11:35:32.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp855.ko 2024-02-02T11:35:32.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp857.ko 2024-02-02T11:35:32.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp860.ko 2024-02-02T11:35:32.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp861.ko 2024-02-02T11:35:32.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp862.ko 2024-02-02T11:35:32.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp863.ko 2024-02-02T11:35:32.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp864.ko 2024-02-02T11:35:32.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp865.ko 2024-02-02T11:35:32.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp866.ko 2024-02-02T11:35:32.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp869.ko 2024-02-02T11:35:32.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp874.ko 2024-02-02T11:35:32.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 94137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp932.ko 2024-02-02T11:35:32.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 142673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp936.ko 2024-02-02T11:35:32.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 165745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp949.ko 2024-02-02T11:35:32.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 118121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_cp950.ko 2024-02-02T11:35:32.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_euc-jp.ko 2024-02-02T11:35:32.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-1.ko 2024-02-02T11:35:32.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-13.ko 2024-02-02T11:35:32.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-14.ko 2024-02-02T11:35:32.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-15.ko 2024-02-02T11:35:32.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-2.ko 2024-02-02T11:35:32.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-3.ko 2024-02-02T11:35:32.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-4.ko 2024-02-02T11:35:32.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-5.ko 2024-02-02T11:35:32.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-6.ko 2024-02-02T11:35:32.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-7.ko 2024-02-02T11:35:32.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_iso8859-9.ko 2024-02-02T11:35:32.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_koi8-r.ko 2024-02-02T11:35:32.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_koi8-ru.ko 2024-02-02T11:35:32.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_koi8-u.ko 2024-02-02T11:35:32.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_ucs2_utils.ko 2024-02-02T11:35:32.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/nls/nls_utf8.ko 2024-02-02T11:35:32.659 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ntfs/ 2024-02-02T11:35:32.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 220553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ntfs/ntfs.ko 2024-02-02T11:35:32.659 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ 2024-02-02T11:35:32.659 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/cluster/ 2024-02-02T11:35:32.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 244737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-02-02T11:35:32.659 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlm/ 2024-02-02T11:35:32.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 440737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-02-02T11:35:32.660 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlmfs/ 2024-02-02T11:35:32.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-02-02T11:35:32.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 2593521 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2.ko 2024-02-02T11:35:32.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-02-02T11:35:32.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-02-02T11:35:32.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-02-02T11:35:32.660 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/omfs/ 2024-02-02T11:35:32.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/omfs/omfs.ko 2024-02-02T11:35:32.660 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/overlayfs/ 2024-02-02T11:35:32.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 370697 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/overlayfs/overlay.ko 2024-02-02T11:35:32.660 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/pstore/ 2024-02-02T11:35:32.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/pstore/ramoops.ko 2024-02-02T11:35:32.660 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx4/ 2024-02-02T11:35:32.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx4/qnx4.ko 2024-02-02T11:35:32.661 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx6/ 2024-02-02T11:35:32.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46689 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/qnx6/qnx6.ko 2024-02-02T11:35:32.661 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/ 2024-02-02T11:35:32.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/quota_tree.ko 2024-02-02T11:35:32.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/quota_v1.ko 2024-02-02T11:35:32.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/quota/quota_v2.ko 2024-02-02T11:35:32.661 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/reiserfs/ 2024-02-02T11:35:32.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 532025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/reiserfs/reiserfs.ko 2024-02-02T11:35:32.661 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/romfs/ 2024-02-02T11:35:32.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/romfs/romfs.ko 2024-02-02T11:35:32.661 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/ 2024-02-02T11:35:32.661 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/client/ 2024-02-02T11:35:32.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 2683249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/client/cifs.ko 2024-02-02T11:35:32.662 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/common/ 2024-02-02T11:35:32.662 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/common/cifs_arc4.ko 2024-02-02T11:35:32.662 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/smb/common/cifs_md4.ko 2024-02-02T11:35:32.662 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/squashfs/ 2024-02-02T11:35:32.662 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 134777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/squashfs/squashfs.ko 2024-02-02T11:35:32.662 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/sysv/ 2024-02-02T11:35:32.662 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 91249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/sysv/sysv.ko 2024-02-02T11:35:32.662 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/udf/ 2024-02-02T11:35:32.662 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 248425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/udf/udf.ko 2024-02-02T11:35:32.662 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ufs/ 2024-02-02T11:35:32.662 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 162537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/ufs/ufs.ko 2024-02-02T11:35:32.662 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/xfs/ 2024-02-02T11:35:32.662 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 4014433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/fs/xfs/xfs.ko 2024-02-02T11:35:32.662 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/ 2024-02-02T11:35:32.663 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/locking/ 2024-02-02T11:35:32.663 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 80585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/locking/locktorture.ko 2024-02-02T11:35:32.663 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/time/ 2024-02-02T11:35:32.663 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/time/test_udelay.ko 2024-02-02T11:35:32.663 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/kernel/torture.ko 2024-02-02T11:35:32.663 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ 2024-02-02T11:35:32.663 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 6833 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crc-itu-t.ko 2024-02-02T11:35:32.663 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 6529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crc7.ko 2024-02-02T11:35:32.663 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crc8.ko 2024-02-02T11:35:32.663 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crypto/ 2024-02-02T11:35:32.663 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crypto/libarc4.ko 2024-02-02T11:35:32.663 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/crypto/libdes.ko 2024-02-02T11:35:32.663 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/interval_tree_test.ko 2024-02-02T11:35:32.663 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/libcrc32c.ko 2024-02-02T11:35:32.664 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lru_cache.ko 2024-02-02T11:35:32.664 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lz4/ 2024-02-02T11:35:32.664 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lz4/lz4_compress.ko 2024-02-02T11:35:32.664 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/lz4/lz4hc_compress.ko 2024-02-02T11:35:32.664 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/math/ 2024-02-02T11:35:32.664 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 6617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/math/cordic.ko 2024-02-02T11:35:32.664 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/memory-notifier-error-inject.ko 2024-02-02T11:35:32.664 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/notifier-error-inject.ko 2024-02-02T11:35:32.664 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/percpu_test.ko 2024-02-02T11:35:32.664 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/pm-notifier-error-inject.ko 2024-02-02T11:35:32.664 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/raid6/ 2024-02-02T11:35:32.664 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 143353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/raid6/raid6_pq.ko 2024-02-02T11:35:32.664 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/rbtree_test.ko 2024-02-02T11:35:32.664 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/reed_solomon/ 2024-02-02T11:35:32.664 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/reed_solomon/reed_solomon.ko 2024-02-02T11:35:32.665 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test-kstrtox.ko 2024-02-02T11:35:32.665 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test-string_helpers.ko 2024-02-02T11:35:32.665 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 4876633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_bpf.ko 2024-02-02T11:35:32.665 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_firmware.ko 2024-02-02T11:35:32.665 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 6369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_module.ko 2024-02-02T11:35:32.665 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/test_user_copy.ko 2024-02-02T11:35:32.665 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ts_bm.ko 2024-02-02T11:35:32.665 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ts_fsm.ko 2024-02-02T11:35:32.665 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/ts_kmp.ko 2024-02-02T11:35:32.665 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/xz/ 2024-02-02T11:35:32.665 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/lib/xz/xz_dec_test.ko 2024-02-02T11:35:32.665 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/mm/ 2024-02-02T11:35:32.665 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/mm/hwpoison-inject.ko 2024-02-02T11:35:32.665 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ 2024-02-02T11:35:32.666 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/ 2024-02-02T11:35:32.666 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/6lowpan.ko 2024-02-02T11:35:32.666 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_dest.ko 2024-02-02T11:35:32.666 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_fragment.ko 2024-02-02T11:35:32.666 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_hop.ko 2024-02-02T11:35:32.666 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 6985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_ipv6.ko 2024-02-02T11:35:32.666 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_mobility.ko 2024-02-02T11:35:32.666 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_routing.ko 2024-02-02T11:35:32.666 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/6lowpan/nhc_udp.ko 2024-02-02T11:35:32.666 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/ 2024-02-02T11:35:32.666 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/garp.ko 2024-02-02T11:35:32.666 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/mrp.ko 2024-02-02T11:35:32.666 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/p8022.ko 2024-02-02T11:35:32.666 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/psnap.ko 2024-02-02T11:35:32.666 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/802/stp.ko 2024-02-02T11:35:32.667 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/8021q/ 2024-02-02T11:35:32.667 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 82593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/8021q/8021q.ko 2024-02-02T11:35:32.667 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/ 2024-02-02T11:35:32.667 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 198905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet.ko 2024-02-02T11:35:32.667 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet_fd.ko 2024-02-02T11:35:32.667 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet_rdma.ko 2024-02-02T11:35:32.667 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/9p/9pnet_virtio.ko 2024-02-02T11:35:32.667 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/batman-adv/ 2024-02-02T11:35:32.667 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 649977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/batman-adv/batman-adv.ko 2024-02-02T11:35:32.667 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/ 2024-02-02T11:35:32.667 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 65137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/br_netfilter.ko 2024-02-02T11:35:32.667 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 785817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/bridge.ko 2024-02-02T11:35:32.667 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ 2024-02-02T11:35:32.667 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-02-02T11:35:32.668 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_among.ko 2024-02-02T11:35:32.668 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_arp.ko 2024-02-02T11:35:32.668 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-02-02T11:35:32.668 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-02-02T11:35:32.668 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_ip.ko 2024-02-02T11:35:32.668 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9145 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-02-02T11:35:32.668 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_limit.ko 2024-02-02T11:35:32.668 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13217 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_log.ko 2024-02-02T11:35:32.668 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_mark.ko 2024-02-02T11:35:32.668 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-02-02T11:35:32.668 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-02-02T11:35:32.668 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-02-02T11:35:32.668 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9593 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-02-02T11:35:32.668 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_snat.ko 2024-02-02T11:35:32.669 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_stp.ko 2024-02-02T11:35:32.669 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-02-02T11:35:32.669 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11641 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-02-02T11:35:32.669 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-02-02T11:35:32.669 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-02-02T11:35:32.669 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 56033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/ebtables.ko 2024-02-02T11:35:32.669 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-02-02T11:35:32.669 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-02-02T11:35:32.669 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ceph/ 2024-02-02T11:35:32.669 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1046753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ceph/libceph.ko 2024-02-02T11:35:32.669 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/core/ 2024-02-02T11:35:32.669 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 126041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/core/pktgen.ko 2024-02-02T11:35:32.669 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/ 2024-02-02T11:35:32.669 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 194529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp.ko 2024-02-02T11:35:32.670 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp_diag.ko 2024-02-02T11:35:32.670 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp_ipv4.ko 2024-02-02T11:35:32.670 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dccp/dccp_ipv6.ko 2024-02-02T11:35:32.670 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/ 2024-02-02T11:35:32.670 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 390129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/dsa_core.ko 2024-02-02T11:35:32.670 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_brcm.ko 2024-02-02T11:35:32.670 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_dsa.ko 2024-02-02T11:35:32.670 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7721 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_none.ko 2024-02-02T11:35:32.670 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/dsa/tag_trailer.ko 2024-02-02T11:35:32.670 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/hsr/ 2024-02-02T11:35:32.670 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 99881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/hsr/hsr.ko 2024-02-02T11:35:32.670 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/ 2024-02-02T11:35:32.670 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/6lowpan/ 2024-02-02T11:35:32.670 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-02-02T11:35:32.670 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 255849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/ieee802154.ko 2024-02-02T11:35:32.671 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ieee802154/ieee802154_socket.ko 2024-02-02T11:35:32.671 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ 2024-02-02T11:35:32.671 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ah4.ko 2024-02-02T11:35:32.671 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/esp4.ko 2024-02-02T11:35:32.671 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/fou.ko 2024-02-02T11:35:32.671 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/gre.ko 2024-02-02T11:35:32.671 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/inet_diag.ko 2024-02-02T11:35:32.671 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ip_gre.ko 2024-02-02T11:35:32.671 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ip_tunnel.ko 2024-02-02T11:35:32.671 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ip_vti.ko 2024-02-02T11:35:32.671 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ipcomp.ko 2024-02-02T11:35:32.671 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/ipip.ko 2024-02-02T11:35:32.671 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ 2024-02-02T11:35:32.671 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/arp_tables.ko 2024-02-02T11:35:32.671 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-02-02T11:35:32.672 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-02-02T11:35:32.672 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ip_tables.ko 2024-02-02T11:35:32.672 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-02-02T11:35:32.672 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-02-02T11:35:32.672 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-02-02T11:35:32.672 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-02-02T11:35:32.672 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-02-02T11:35:32.672 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-02-02T11:35:32.672 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-02-02T11:35:32.672 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-02-02T11:35:32.672 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-02-02T11:35:32.672 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/iptable_security.ko 2024-02-02T11:35:32.672 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-02-02T11:35:32.672 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-02-02T11:35:32.673 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-02-02T11:35:32.673 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-02-02T11:35:32.673 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-02-02T11:35:32.673 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-02-02T11:35:32.673 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-02-02T11:35:32.673 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-02-02T11:35:32.673 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-02-02T11:35:32.673 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-02-02T11:35:32.673 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-02-02T11:35:32.673 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_bic.ko 2024-02-02T11:35:32.673 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_dctcp.ko 2024-02-02T11:35:32.673 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_diag.ko 2024-02-02T11:35:32.673 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_highspeed.ko 2024-02-02T11:35:32.673 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_htcp.ko 2024-02-02T11:35:32.673 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_hybla.ko 2024-02-02T11:35:32.674 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_illinois.ko 2024-02-02T11:35:32.674 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_lp.ko 2024-02-02T11:35:32.674 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_scalable.ko 2024-02-02T11:35:32.674 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_vegas.ko 2024-02-02T11:35:32.674 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_veno.ko 2024-02-02T11:35:32.674 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_westwood.ko 2024-02-02T11:35:32.674 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tcp_yeah.ko 2024-02-02T11:35:32.674 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/tunnel4.ko 2024-02-02T11:35:32.674 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/udp_diag.ko 2024-02-02T11:35:32.674 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/udp_tunnel.ko 2024-02-02T11:35:32.674 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11361 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv4/xfrm4_tunnel.ko 2024-02-02T11:35:32.674 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ 2024-02-02T11:35:32.674 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ah6.ko 2024-02-02T11:35:32.674 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39705 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/esp6.ko 2024-02-02T11:35:32.674 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/fou6.ko 2024-02-02T11:35:32.675 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 80105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_gre.ko 2024-02-02T11:35:32.675 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 93977 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_tunnel.ko 2024-02-02T11:35:32.675 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-02-02T11:35:32.675 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ip6_vti.ko 2024-02-02T11:35:32.675 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/ipcomp6.ko 2024-02-02T11:35:32.675 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/mip6.ko 2024-02-02T11:35:32.675 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ 2024-02-02T11:35:32.675 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-02-02T11:35:32.675 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-02-02T11:35:32.675 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-02-02T11:35:32.675 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14137 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-02-02T11:35:32.675 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14273 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-02-02T11:35:32.675 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-02-02T11:35:32.675 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-02-02T11:35:32.675 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-02-02T11:35:32.676 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-02-02T11:35:32.676 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-02-02T11:35:32.676 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-02-02T11:35:32.676 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-02-02T11:35:32.676 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-02-02T11:35:32.676 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-02-02T11:35:32.676 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-02-02T11:35:32.676 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-02-02T11:35:32.676 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-02-02T11:35:32.676 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-02-02T11:35:32.676 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-02-02T11:35:32.676 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25225 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-02-02T11:35:32.676 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-02-02T11:35:32.676 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-02-02T11:35:32.677 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-02-02T11:35:32.677 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-02-02T11:35:32.677 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-02-02T11:35:32.677 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 74921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/sit.ko 2024-02-02T11:35:32.677 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/tunnel6.ko 2024-02-02T11:35:32.677 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/ipv6/xfrm6_tunnel.ko 2024-02-02T11:35:32.677 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/key/ 2024-02-02T11:35:32.677 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 84433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/key/af_key.ko 2024-02-02T11:35:32.677 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/ 2024-02-02T11:35:32.677 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 125305 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_core.ko 2024-02-02T11:35:32.677 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_debugfs.ko 2024-02-02T11:35:32.677 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_eth.ko 2024-02-02T11:35:32.677 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_ip.ko 2024-02-02T11:35:32.678 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_ip6.ko 2024-02-02T11:35:32.678 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_netlink.ko 2024-02-02T11:35:32.678 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/l2tp/l2tp_ppp.ko 2024-02-02T11:35:32.678 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/lapb/ 2024-02-02T11:35:32.678 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48121 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/lapb/lapb.ko 2024-02-02T11:35:32.678 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/llc/ 2024-02-02T11:35:32.678 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/llc/llc.ko 2024-02-02T11:35:32.678 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 268265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/llc/llc2.ko 2024-02-02T11:35:32.678 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mac802154/ 2024-02-02T11:35:32.678 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 290441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mac802154/mac802154.ko 2024-02-02T11:35:32.678 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mpls/ 2024-02-02T11:35:32.678 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9393 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/mpls/mpls_gso.ko 2024-02-02T11:35:32.678 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ 2024-02-02T11:35:32.679 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ 2024-02-02T11:35:32.679 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 118801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set.ko 2024-02-02T11:35:32.679 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-02-02T11:35:32.679 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-02-02T11:35:32.679 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-02-02T11:35:32.679 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 100297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-02-02T11:35:32.679 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 100633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-02-02T11:35:32.679 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 102881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-02-02T11:35:32.679 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 102649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-02-02T11:35:32.679 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 112017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-02-02T11:35:32.679 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-02-02T11:35:32.679 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 108761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-02-02T11:35:32.679 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 112297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-02-02T11:35:32.679 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 112649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-02-02T11:35:32.679 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 110753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-02-02T11:35:32.680 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 113633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-02-02T11:35:32.680 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-02-02T11:35:32.680 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ 2024-02-02T11:35:32.680 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 412561 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs.ko 2024-02-02T11:35:32.680 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-02-02T11:35:32.680 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-02-02T11:35:32.680 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-02-02T11:35:32.680 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-02-02T11:35:32.680 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-02-02T11:35:32.680 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-02-02T11:35:32.680 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-02-02T11:35:32.680 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-02-02T11:35:32.680 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-02-02T11:35:32.681 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-02-02T11:35:32.681 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-02-02T11:35:32.681 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-02-02T11:35:32.681 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-02-02T11:35:32.681 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49265 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conncount.ko 2024-02-02T11:35:32.681 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 411489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack.ko 2024-02-02T11:35:32.681 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-02-02T11:35:32.681 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-02-02T11:35:32.681 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-02-02T11:35:32.681 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 118193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_h323.ko 2024-02-02T11:35:32.681 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_irc.ko 2024-02-02T11:35:32.681 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-02-02T11:35:32.681 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 108105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-02-02T11:35:32.681 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-02-02T11:35:32.682 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_sane.ko 2024-02-02T11:35:32.682 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_sip.ko 2024-02-02T11:35:32.682 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11233 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-02-02T11:35:32.682 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-02-02T11:35:32.682 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10113 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_dup_netdev.ko 2024-02-02T11:35:32.682 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 91737 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_flow_table.ko 2024-02-02T11:35:32.682 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_flow_table_inet.ko 2024-02-02T11:35:32.682 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_log_syslog.ko 2024-02-02T11:35:32.682 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 96545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat.ko 2024-02-02T11:35:32.682 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10129 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_amanda.ko 2024-02-02T11:35:32.682 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_ftp.ko 2024-02-02T11:35:32.682 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_irc.ko 2024-02-02T11:35:32.682 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_sip.ko 2024-02-02T11:35:32.682 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_nat_tftp.ko 2024-02-02T11:35:32.682 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_synproxy_core.ko 2024-02-02T11:35:32.683 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 614025 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nf_tables.ko 2024-02-02T11:35:32.683 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42609 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink.ko 2024-02-02T11:35:32.683 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_acct.ko 2024-02-02T11:35:32.683 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-02-02T11:35:32.683 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_log.ko 2024-02-02T11:35:32.683 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_osf.ko 2024-02-02T11:35:32.683 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nfnetlink_queue.ko 2024-02-02T11:35:32.683 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_chain_nat.ko 2024-02-02T11:35:32.683 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_compat.ko 2024-02-02T11:35:32.683 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_ct.ko 2024-02-02T11:35:32.683 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9601 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_dup_netdev.ko 2024-02-02T11:35:32.683 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11513 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_fib.ko 2024-02-02T11:35:32.683 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_fwd_netdev.ko 2024-02-02T11:35:32.683 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_hash.ko 2024-02-02T11:35:32.684 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_limit.ko 2024-02-02T11:35:32.684 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_log.ko 2024-02-02T11:35:32.684 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_masq.ko 2024-02-02T11:35:32.684 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_nat.ko 2024-02-02T11:35:32.684 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13673 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_numgen.ko 2024-02-02T11:35:32.684 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_osf.ko 2024-02-02T11:35:32.684 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_queue.ko 2024-02-02T11:35:32.684 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_redir.ko 2024-02-02T11:35:32.684 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_reject.ko 2024-02-02T11:35:32.684 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10081 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_reject_inet.ko 2024-02-02T11:35:32.684 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_socket.ko 2024-02-02T11:35:32.684 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_synproxy.ko 2024-02-02T11:35:32.684 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/nft_tproxy.ko 2024-02-02T11:35:32.684 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 89313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/x_tables.ko 2024-02-02T11:35:32.685 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_AUDIT.ko 2024-02-02T11:35:32.685 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CHECKSUM.ko 2024-02-02T11:35:32.685 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CLASSIFY.ko 2024-02-02T11:35:32.685 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-02-02T11:35:32.685 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_CT.ko 2024-02-02T11:35:32.685 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_DSCP.ko 2024-02-02T11:35:32.685 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_HL.ko 2024-02-02T11:35:32.685 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13369 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_HMARK.ko 2024-02-02T11:35:32.685 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38873 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_IDLETIMER.ko 2024-02-02T11:35:32.685 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13889 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_LED.ko 2024-02-02T11:35:32.685 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_LOG.ko 2024-02-02T11:35:32.685 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11753 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_MASQUERADE.ko 2024-02-02T11:35:32.685 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_NETMAP.ko 2024-02-02T11:35:32.685 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_NFLOG.ko 2024-02-02T11:35:32.686 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_NFQUEUE.ko 2024-02-02T11:35:32.686 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_RATEEST.ko 2024-02-02T11:35:32.686 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11073 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_REDIRECT.ko 2024-02-02T11:35:32.686 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14337 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_SECMARK.ko 2024-02-02T11:35:32.686 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TCPMSS.ko 2024-02-02T11:35:32.686 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10433 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-02-02T11:35:32.686 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TEE.ko 2024-02-02T11:35:32.686 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TPROXY.ko 2024-02-02T11:35:32.686 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8321 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_TRACE.ko 2024-02-02T11:35:32.686 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13193 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_addrtype.ko 2024-02-02T11:35:32.686 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_bpf.ko 2024-02-02T11:35:32.686 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_cgroup.ko 2024-02-02T11:35:32.686 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_cluster.ko 2024-02-02T11:35:32.686 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_comment.ko 2024-02-02T11:35:32.687 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connbytes.ko 2024-02-02T11:35:32.687 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connlabel.ko 2024-02-02T11:35:32.687 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connlimit.ko 2024-02-02T11:35:32.687 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_connmark.ko 2024-02-02T11:35:32.687 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_conntrack.ko 2024-02-02T11:35:32.687 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_cpu.ko 2024-02-02T11:35:32.687 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10969 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_dccp.ko 2024-02-02T11:35:32.687 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_devgroup.ko 2024-02-02T11:35:32.687 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8801 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_dscp.ko 2024-02-02T11:35:32.687 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10657 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_ecn.ko 2024-02-02T11:35:32.687 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_esp.ko 2024-02-02T11:35:32.687 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_hashlimit.ko 2024-02-02T11:35:32.687 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_helper.ko 2024-02-02T11:35:32.687 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7865 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_hl.ko 2024-02-02T11:35:32.688 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11921 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_ipcomp.ko 2024-02-02T11:35:32.688 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_iprange.ko 2024-02-02T11:35:32.688 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11785 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_ipvs.ko 2024-02-02T11:35:32.688 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_l2tp.ko 2024-02-02T11:35:32.688 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8001 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_length.ko 2024-02-02T11:35:32.688 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10209 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_limit.ko 2024-02-02T11:35:32.688 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_mac.ko 2024-02-02T11:35:32.688 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_mark.ko 2024-02-02T11:35:32.688 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11825 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_multiport.ko 2024-02-02T11:35:32.688 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_nat.ko 2024-02-02T11:35:32.688 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10105 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_nfacct.ko 2024-02-02T11:35:32.688 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_osf.ko 2024-02-02T11:35:32.688 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_owner.ko 2024-02-02T11:35:32.689 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9729 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_physdev.ko 2024-02-02T11:35:32.689 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7633 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_pkttype.ko 2024-02-02T11:35:32.689 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11985 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_policy.ko 2024-02-02T11:35:32.689 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_quota.ko 2024-02-02T11:35:32.689 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_rateest.ko 2024-02-02T11:35:32.689 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8257 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_realm.ko 2024-02-02T11:35:32.689 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36457 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_recent.ko 2024-02-02T11:35:32.689 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13329 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_sctp.ko 2024-02-02T11:35:32.689 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_set.ko 2024-02-02T11:35:32.689 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16913 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_socket.ko 2024-02-02T11:35:32.689 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9505 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_state.ko 2024-02-02T11:35:32.689 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9473 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_statistic.ko 2024-02-02T11:35:32.689 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8809 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_string.ko 2024-02-02T11:35:32.689 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8553 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_tcpmss.ko 2024-02-02T11:35:32.690 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_tcpudp.ko 2024-02-02T11:35:32.690 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11065 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_time.ko 2024-02-02T11:35:32.690 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netfilter/xt_u32.ko 2024-02-02T11:35:32.690 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netlink/ 2024-02-02T11:35:32.690 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/netlink/netlink_diag.ko 2024-02-02T11:35:32.690 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/nsh/ 2024-02-02T11:35:32.690 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12425 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/nsh/nsh.ko 2024-02-02T11:35:32.690 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/ 2024-02-02T11:35:32.690 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 383481 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/openvswitch.ko 2024-02-02T11:35:32.690 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/vport-geneve.ko 2024-02-02T11:35:32.690 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9585 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/vport-gre.ko 2024-02-02T11:35:32.690 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11929 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/openvswitch/vport-vxlan.ko 2024-02-02T11:35:32.690 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/packet/ 2024-02-02T11:35:32.690 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13569 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/packet/af_packet_diag.ko 2024-02-02T11:35:32.690 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/phonet/ 2024-02-02T11:35:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 112057 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/phonet/phonet.ko 2024-02-02T11:35:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54857 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/phonet/pn_pep.ko 2024-02-02T11:35:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/ 2024-02-02T11:35:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 252953 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/rds.ko 2024-02-02T11:35:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 164937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/rds_rdma.ko 2024-02-02T11:35:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 68161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rds/rds_tcp.ko 2024-02-02T11:35:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rxrpc/ 2024-02-02T11:35:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 818777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/rxrpc/rxrpc.ko 2024-02-02T11:35:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/ 2024-02-02T11:35:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32241 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_csum.ko 2024-02-02T11:35:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_gact.ko 2024-02-02T11:35:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_ipt.ko 2024-02-02T11:35:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34097 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_mirred.ko 2024-02-02T11:35:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23401 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_nat.ko 2024-02-02T11:35:32.692 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43449 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_pedit.ko 2024-02-02T11:35:32.692 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31961 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_police.ko 2024-02-02T11:35:32.692 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20289 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_simple.ko 2024-02-02T11:35:32.692 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35297 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_skbedit.ko 2024-02-02T11:35:32.692 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36665 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/act_vlan.ko 2024-02-02T11:35:32.692 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26465 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_basic.ko 2024-02-02T11:35:32.692 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34353 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_bpf.ko 2024-02-02T11:35:32.692 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_cgroup.ko 2024-02-02T11:35:32.692 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_flow.ko 2024-02-02T11:35:32.692 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32377 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_fw.ko 2024-02-02T11:35:32.692 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_route.ko 2024-02-02T11:35:32.692 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61529 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/cls_u32.ko 2024-02-02T11:35:32.692 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7441 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_cmp.ko 2024-02-02T11:35:32.692 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_ipset.ko 2024-02-02T11:35:32.692 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33313 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_meta.ko 2024-02-02T11:35:32.693 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7897 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_nbyte.ko 2024-02-02T11:35:32.693 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_text.ko 2024-02-02T11:35:32.693 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/em_u32.ko 2024-02-02T11:35:32.693 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21769 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_choke.ko 2024-02-02T11:35:32.693 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20849 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_codel.ko 2024-02-02T11:35:32.693 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34681 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_drr.ko 2024-02-02T11:35:32.693 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35817 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_fq.ko 2024-02-02T11:35:32.693 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31617 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_fq_codel.ko 2024-02-02T11:35:32.693 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35545 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_gred.ko 2024-02-02T11:35:32.693 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49937 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_hfsc.ko 2024-02-02T11:35:32.693 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22089 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_hhf.ko 2024-02-02T11:35:32.693 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66577 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_htb.ko 2024-02-02T11:35:32.693 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_ingress.ko 2024-02-02T11:35:32.694 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30385 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_mqprio.ko 2024-02-02T11:35:32.694 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10905 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_mqprio_lib.ko 2024-02-02T11:35:32.694 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26185 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_multiq.ko 2024-02-02T11:35:32.694 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36249 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_netem.ko 2024-02-02T11:35:32.694 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27497 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_pie.ko 2024-02-02T11:35:32.694 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10745 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_plug.ko 2024-02-02T11:35:32.694 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24841 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_prio.ko 2024-02-02T11:35:32.694 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48625 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_qfq.ko 2024-02-02T11:35:32.694 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_red.ko 2024-02-02T11:35:32.694 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26881 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_sfb.ko 2024-02-02T11:35:32.694 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_sfq.ko 2024-02-02T11:35:32.694 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28945 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_tbf.ko 2024-02-02T11:35:32.694 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28153 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sched/sch_teql.ko 2024-02-02T11:35:32.694 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sctp/ 2024-02-02T11:35:32.695 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 932169 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sctp/sctp.ko 2024-02-02T11:35:32.695 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sctp/sctp_diag.ko 2024-02-02T11:35:32.695 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/ 2024-02-02T11:35:32.695 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/auth_gss/ 2024-02-02T11:35:32.695 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 336777 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-02-02T11:35:32.695 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54993 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-02-02T11:35:32.695 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1518417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/sunrpc.ko 2024-02-02T11:35:32.695 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/xprtrdma/ 2024-02-02T11:35:32.695 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 708281 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-02-02T11:35:32.695 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/tipc/ 2024-02-02T11:35:32.695 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10489 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/tipc/diag.ko 2024-02-02T11:35:32.695 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 866345 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/tipc/tipc.ko 2024-02-02T11:35:32.695 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/unix/ 2024-02-02T11:35:32.695 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/unix/unix_diag.ko 2024-02-02T11:35:32.695 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/ 2024-02-02T11:35:32.696 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 86417 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-02-02T11:35:32.696 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 68049 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-02-02T11:35:32.696 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 98017 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vsock.ko 2024-02-02T11:35:32.696 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11177 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vsock_diag.ko 2024-02-02T11:35:32.696 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17761 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/vmw_vsock/vsock_loopback.ko 2024-02-02T11:35:32.696 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/x25/ 2024-02-02T11:35:32.696 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 125409 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/x25/x25.ko 2024-02-02T11:35:32.696 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/ 2024-02-02T11:35:32.696 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23041 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/xfrm_algo.ko 2024-02-02T11:35:32.696 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20649 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/xfrm_ipcomp.ko 2024-02-02T11:35:32.696 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 104161 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/net/xfrm/xfrm_user.ko 2024-02-02T11:35:32.696 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/virt/ 2024-02-02T11:35:32.696 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/virt/lib/ 2024-02-02T11:35:32.696 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15537 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/kernel/virt/lib/irqbypass.ko 2024-02-02T11:35:32.697 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 641009 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.alias 2024-02-02T11:35:32.697 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 625033 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.alias.bin 2024-02-02T11:35:32.697 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7677 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin 2024-02-02T11:35:32.697 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23634 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin.alias.bin 2024-02-02T11:35:32.697 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9916 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin.bin 2024-02-02T11:35:32.697 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70653 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.builtin.modinfo 2024-02-02T11:35:32.697 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 147734 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.dep 2024-02-02T11:35:32.697 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 234045 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.dep.bin 2024-02-02T11:35:32.697 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 210 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.devname 2024-02-02T11:35:32.697 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 72797 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.order 2024-02-02T11:35:32.697 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 879 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.softdep 2024-02-02T11:35:32.697 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 255175 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.symbols 2024-02-02T11:35:32.697 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 309826 2024-01-25 04:04 ./lib/modules/6.7.0-gcd42140e6285/modules.symbols.bin 2024-02-02T11:35:32.697 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/ 2024-02-02T11:35:32.698 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/share/ 2024-02-02T11:35:32.698 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/share/doc/ 2024-02-02T11:35:32.698 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-01-25 04:04 ./usr/share/doc/linux-image-6.7.0-gcd42140e6285/ 2024-02-02T11:35:32.698 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 171 2024-01-25 04:04 ./usr/share/doc/linux-image-6.7.0-gcd42140e6285/changelog.Debian.gz 2024-02-02T11:35:32.698 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 691 2024-01-25 04:04 ./usr/share/doc/linux-image-6.7.0-gcd42140e6285/copyright 2024-02-02T11:35:32.699 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-gcd42140e6285 2024-02-02T11:35:32.699 INFO:teuthology.task.kernel:searching for kernel 6.7.0-gcd42140e6285 2024-02-02T11:35:32.699 DEBUG:teuthology.orchestra.run.smithi177:> egrep '(submenu|menuentry.*6.7.0-gcd42140e6285).*{' /boot/grub/grub.cfg 2024-02-02T11:35:32.706 INFO:teuthology.orchestra.run.smithi177.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-02-02T11:35:32.706 INFO:teuthology.orchestra.run.smithi177.stdout: menuentry 'Ubuntu, with Linux 6.7.0-gcd42140e6285' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-gcd42140e6285-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-02-02T11:35:32.706 INFO:teuthology.orchestra.run.smithi177.stdout: menuentry 'Ubuntu, with Linux 6.7.0-gcd42140e6285 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-gcd42140e6285-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-02-02T11:35:32.707 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-02-02T11:35:32.707 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.7.0-gcd42140e6285 2024-02-02T11:35:32.707 DEBUG:teuthology.orchestra.run.smithi177:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-02-02T11:35:32.750 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi177.front.sepia.ceph.com to complete... 2024-02-02T11:35:33.164 INFO:teuthology.orchestra.run.smithi177.stderr:Sourcing file `/etc/default/grub' 2024-02-02T11:35:33.165 INFO:teuthology.orchestra.run.smithi177.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-02T11:35:33.194 INFO:teuthology.orchestra.run.smithi177.stderr:Generating grub configuration file ... 2024-02-02T11:35:33.358 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-6.7.0-gcd42140e6285 2024-02-02T11:35:33.364 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-6.7.0-gcd42140e6285 2024-02-02T11:35:33.588 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-02T11:35:33.593 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-02T11:35:33.632 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-02T11:35:33.637 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-02T11:35:33.766 INFO:teuthology.orchestra.run.smithi177.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-02T11:35:33.766 INFO:teuthology.orchestra.run.smithi177.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-02-02T11:35:33.766 INFO:teuthology.orchestra.run.smithi177.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-02T11:35:33.794 INFO:teuthology.orchestra.run.smithi177.stderr:done 2024-02-02T11:36:04.910 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-02-02T11:36:04.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-02-02T11:36:04.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-02T11:36:23.356 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-02-02T11:36:32.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-02-02T11:36:32.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-02T11:36:35.420 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-02-02T11:36:47.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-02-02T11:36:47.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-02T11:37:19.452 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-02-02T11:37:20.207 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-02-02T11:37:20.208 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.7.0-gcd42140e6285"... 2024-02-02T11:37:20.208 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2024-02-02T11:37:20.260 INFO:teuthology.orchestra.run.smithi177.stdout:6.7.0-gcd42140e6285 2024-02-02T11:37:20.260 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-gcd42140e6285 vs 6.7.0-gcd42140e6285 2024-02-02T11:37:20.260 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-02T11:37:20.260 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-02-02T11:37:21.262 DEBUG:teuthology.parallel:result is None 2024-02-02T11:37:21.262 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-02T11:37:21.269 INFO:teuthology.task.internal:Creating test directory... 2024-02-02T11:37:21.269 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-02T11:37:21.272 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-02T11:37:21.274 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-02T11:37:21.283 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-02T11:37:21.289 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-02T11:37:21.299 INFO:teuthology.task.internal:Creating archive directory... 2024-02-02T11:37:21.299 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-02T11:37:21.321 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-02T11:37:21.324 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-02T11:37:21.438 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-02T11:37:21.445 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-02T11:37:21.445 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-02T11:37:21.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-02T11:37:21.450 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-02T11:37:21.455 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-02T11:37:21.455 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-02T11:37:21.493 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-02T11:37:21.498 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-02T11:37:21.516 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-02T11:37:21.526 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-02T11:37:21.530 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-02T11:37:21.542 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-02T11:37:21.583 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-02T11:37:21.601 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-02T11:37:21.604 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-02T11:37:21.611 INFO:teuthology.task.internal:Configuring sudo... 2024-02-02T11:37:21.611 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-02T11:37:21.613 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-02T11:37:21.615 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-02T11:37:21.636 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-02T11:37:21.645 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-02T11:37:21.646 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-02T11:37:21.669 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-02T11:37:21.672 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-02T11:37:21.689 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-02T11:37:21.721 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-02T11:37:21.769 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:37:21.769 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-02T11:37:21.833 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-02T11:37:21.839 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-02T11:37:21.885 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:37:21.885 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-02T11:37:21.948 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-02T11:37:21.957 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-02T11:37:22.009 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T11:37:22.009 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-02T11:37:22.081 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2024-02-02T11:37:22.083 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-02-02T11:37:22.086 DEBUG:teuthology.orchestra.run.smithi177:> sudo service rsyslog restart 2024-02-02T11:37:22.243 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-02T11:37:22.253 INFO:teuthology.task.internal:Starting timer... 2024-02-02T11:37:22.253 INFO:teuthology.run_tasks:Running task pcp... 2024-02-02T11:37:22.263 INFO:teuthology.run_tasks:Running task selinux... 2024-02-02T11:37:22.271 DEBUG:teuthology.task.selinux:Excluding smithi161: OS 'ubuntu' does not support SELinux 2024-02-02T11:37:22.271 DEBUG:teuthology.task.selinux:Excluding smithi162: OS 'ubuntu' does not support SELinux 2024-02-02T11:37:22.271 DEBUG:teuthology.task.selinux:Excluding smithi177: OS 'ubuntu' does not support SELinux 2024-02-02T11:37:22.272 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-02T11:37:22.272 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-02-02T11:37:22.272 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-02T11:37:22.272 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-02T11:37:22.281 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-02-02T11:37:22.287 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-02-02T11:37:22.440 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-02T11:37:22.458 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-02T11:37:22.459 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi161.front.sepia.ceph.com,smithi162.front.sepia.ceph.com,smithi177.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-02T11:44:46.920 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi161.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com'), Remote(name='ubuntu@smithi177.front.sepia.ceph.com')] 2024-02-02T11:44:46.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-02-02T11:44:46.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-02T11:44:47.006 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-02-02T11:44:47.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-02-02T11:44:47.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-02-02T11:44:47.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-02T11:44:47.200 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-02-02T11:44:47.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-02-02T11:44:47.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-02-02T11:44:47.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-02T11:44:47.398 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-02-02T11:44:47.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-02-02T11:44:47.517 INFO:teuthology.run_tasks:Running task clock... 2024-02-02T11:44:47.528 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-02T11:44:47.528 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-02T11:44:47.529 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-02T11:44:47.532 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-02T11:44:47.532 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-02T11:44:47.534 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-02T11:44:47.534 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-02T11:44:47.557 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-02-02T11:44:47.558 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: Command line: ntpd -gq 2024-02-02T11:44:47.558 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: ---------------------------------------------------- 2024-02-02T11:44:47.558 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: ntp-4 is maintained by Network Time Foundation, 2024-02-02T11:44:47.558 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-02-02T11:44:47.558 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: corporation. Support and training for ntp-4 are 2024-02-02T11:44:47.558 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: available at https://www.nwtime.org/support 2024-02-02T11:44:47.558 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: ---------------------------------------------------- 2024-02-02T11:44:47.558 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: proto: precision = 0.044 usec (-24) 2024-02-02T11:44:47.560 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: basedate set to 2022-02-04 2024-02-02T11:44:47.560 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: gps base set to 2022-02-06 (week 2196) 2024-02-02T11:44:47.560 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-02T11:44:47.560 INFO:teuthology.orchestra.run.smithi161.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-02T11:44:47.560 INFO:teuthology.orchestra.run.smithi161.stderr:restrict ::: KOD does nothing without LIMITED. 2024-02-02T11:44:47.561 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-02-02T11:44:47.561 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: Command line: ntpd -gq 2024-02-02T11:44:47.561 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: ---------------------------------------------------- 2024-02-02T11:44:47.561 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: ntp-4 is maintained by Network Time Foundation, 2024-02-02T11:44:47.561 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-02-02T11:44:47.561 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: corporation. Support and training for ntp-4 are 2024-02-02T11:44:47.561 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: available at https://www.nwtime.org/support 2024-02-02T11:44:47.561 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: ---------------------------------------------------- 2024-02-02T11:44:47.561 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: proto: precision = 0.056 usec (-24) 2024-02-02T11:44:47.561 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: basedate set to 2022-02-04 2024-02-02T11:44:47.561 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: gps base set to 2022-02-06 (week 2196) 2024-02-02T11:44:47.562 INFO:teuthology.orchestra.run.smithi162.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-02T11:44:47.562 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-02T11:44:47.563 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: restrict ::: KOD does nothing without LIMITED. 2024-02-02T11:44:47.563 INFO:teuthology.orchestra.run.smithi162.stderr:restrict ::: KOD does nothing without LIMITED. 2024-02-02T11:44:47.564 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: restrict ::: KOD does nothing without LIMITED. 2024-02-02T11:44:47.564 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: Listen and drop on 0 v6wildcard [::]:123 2024-02-02T11:44:47.564 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-02-02T11:44:47.564 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: Listen normally on 2 lo 127.0.0.1:123 2024-02-02T11:44:47.564 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: Listen normally on 3 enp3s0f1 172.21.15.161:123 2024-02-02T11:44:47.564 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: Listen normally on 4 lo [::1]:123 2024-02-02T11:44:47.564 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7251%5]:123 2024-02-02T11:44:47.564 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:47 ntpd[17483]: Listening on routing socket on fd #22 for interface updates 2024-02-02T11:44:47.565 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: Listen and drop on 0 v6wildcard [::]:123 2024-02-02T11:44:47.565 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-02-02T11:44:47.565 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: Listen normally on 2 lo 127.0.0.1:123 2024-02-02T11:44:47.566 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: Listen normally on 3 enp3s0f1 172.21.15.162:123 2024-02-02T11:44:47.566 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: Listen normally on 4 lo [::1]:123 2024-02-02T11:44:47.566 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f41%5]:123 2024-02-02T11:44:47.566 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:47 ntpd[17523]: Listening on routing socket on fd #22 for interface updates 2024-02-02T11:44:47.603 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-02-02T11:44:47.603 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: Command line: ntpd -gq 2024-02-02T11:44:47.603 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: ---------------------------------------------------- 2024-02-02T11:44:47.603 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: ntp-4 is maintained by Network Time Foundation, 2024-02-02T11:44:47.603 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-02-02T11:44:47.603 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: corporation. Support and training for ntp-4 are 2024-02-02T11:44:47.603 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: available at https://www.nwtime.org/support 2024-02-02T11:44:47.603 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: ---------------------------------------------------- 2024-02-02T11:44:47.604 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: proto: precision = 0.042 usec (-24) 2024-02-02T11:44:47.604 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: basedate set to 2022-02-04 2024-02-02T11:44:47.604 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: gps base set to 2022-02-06 (week 2196) 2024-02-02T11:44:47.604 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-02T11:44:47.604 INFO:teuthology.orchestra.run.smithi177.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-02T11:44:47.605 INFO:teuthology.orchestra.run.smithi177.stderr:restrict ::: KOD does nothing without LIMITED. 2024-02-02T11:44:47.606 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: restrict ::: KOD does nothing without LIMITED. 2024-02-02T11:44:47.606 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: Listen and drop on 0 v6wildcard [::]:123 2024-02-02T11:44:47.606 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-02-02T11:44:47.606 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: Listen normally on 2 lo 127.0.0.1:123 2024-02-02T11:44:47.606 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: Listen normally on 3 enp3s0f1 172.21.15.177:123 2024-02-02T11:44:47.606 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: Listen normally on 4 lo [::1]:123 2024-02-02T11:44:47.606 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feea:b04b%5]:123 2024-02-02T11:44:47.606 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:47 ntpd[17037]: Listening on routing socket on fd #22 for interface updates 2024-02-02T11:44:48.560 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:48 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:48.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:48 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:48.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:48 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:48.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:48 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:48.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:48 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:48.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:48 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:48.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:48 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:48.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:48 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:48.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:48 ntpd[17523]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:48.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:48 ntpd[17523]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:48.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:48 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:48.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:48 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:48.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:48 ntpd[17523]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:48.562 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:48 ntpd[17523]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:48.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:48 ntpd[17037]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:48.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:48 ntpd[17037]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:48.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:48 ntpd[17037]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:48.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:48 ntpd[17037]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:48.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:48 ntpd[17037]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:48.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:48 ntpd[17037]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:49.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:49 ntpd[17037]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:49.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:49 ntpd[17037]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:49.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:49 ntpd[17037]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:49.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:49 ntpd[17037]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:49.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:49 ntpd[17037]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:49.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:49 ntpd[17037]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:50.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:50 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:50.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:50 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:50.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:50 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:50.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:50 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:50.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:50 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:50.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:50 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:50.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:50 ntpd[17523]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:50.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:50 ntpd[17523]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:50.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:50 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:50.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:50 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:50.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:50 ntpd[17523]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:50.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:50 ntpd[17523]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:50.602 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:50 ntpd[17037]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:50.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:50 ntpd[17037]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:50.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:50 ntpd[17037]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:50.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:50 ntpd[17037]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:50.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:50 ntpd[17037]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:50.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:50 ntpd[17037]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:51.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:51 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:51.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:51 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:51.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:51 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:51.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:51 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:51.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:51 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:51.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:51 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:51.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:51 ntpd[17483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:51.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:51 ntpd[17483]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:51.560 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:51 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:51.560 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:51 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:51.560 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:51 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:51.560 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:51 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:51.560 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:51 ntpd[17523]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:51.560 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:51 ntpd[17523]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:51.604 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:51 ntpd[17037]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:51.604 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:51 ntpd[17037]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:51.604 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:51 ntpd[17037]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:51.604 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:51 ntpd[17037]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:51.604 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:51 ntpd[17037]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:51.604 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:51 ntpd[17037]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:51.604 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:51 ntpd[17037]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:51.604 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:51 ntpd[17037]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:51.604 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:51 ntpd[17037]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:51.605 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:51 ntpd[17037]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:51.605 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:51 ntpd[17037]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:51.605 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:51 ntpd[17037]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:52.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:52 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:52.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:52 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:52.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:52 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:52.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:52 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:52.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:52 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:52.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:52 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:52.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:52 ntpd[17483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:52.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:52 ntpd[17483]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:52.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:52 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:52.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:52 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:52.560 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:52 ntpd[17483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:52.560 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:52 ntpd[17483]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:52.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:52 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:52.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:52 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:52.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:52 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:52.562 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:52 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:52.562 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:52 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:52.562 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:52 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:52.562 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:52 ntpd[17523]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:52.562 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:52 ntpd[17523]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:52.562 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:52 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:52.562 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:52 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:52.562 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:52 ntpd[17523]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:52.562 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:52 ntpd[17523]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:52.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:52 ntpd[17037]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:52.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:52 ntpd[17037]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:52.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:52 ntpd[17037]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:52.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:52 ntpd[17037]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:52.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:52 ntpd[17037]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:52.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:52 ntpd[17037]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:52.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:52 ntpd[17037]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:52.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:52 ntpd[17037]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:53.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:53 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:53.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:53 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:53.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:53 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:53.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:53 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:53.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:53 ntpd[17483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:53.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:53 ntpd[17483]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:53.560 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:53 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:53.560 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:53 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:53.560 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:53 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:53.560 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:53 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:53.560 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:53 ntpd[17523]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:53.560 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:53 ntpd[17523]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:53.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:53 ntpd[17037]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:53.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:53 ntpd[17037]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:53.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:53 ntpd[17037]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:53.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:53 ntpd[17037]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:53.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:53 ntpd[17037]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:53.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:53 ntpd[17037]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:53.604 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:53 ntpd[17037]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:53.604 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:53 ntpd[17037]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:53.604 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:53 ntpd[17037]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:53.604 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:53 ntpd[17037]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:53.604 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:53 ntpd[17037]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:53.604 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:53 ntpd[17037]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:54.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:54 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:54.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:54 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:54.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:54 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:54.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:54 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:54.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:54 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:54.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:54 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:54.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:54 ntpd[17483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:54.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:54 ntpd[17483]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:54.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:54 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:54.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:54 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:54.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:54 ntpd[17483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:54.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:54 ntpd[17483]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:54.560 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:54 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:54.560 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:54 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:54.560 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:54 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:54.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:54 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:54.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:54 ntpd[17523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:54.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:54 ntpd[17523]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:54.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:54 ntpd[17523]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:54.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:54 ntpd[17523]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:54.561 INFO:teuthology.orchestra.run.smithi162.stdout: 2 Feb 11:44:54 ntpd[17523]: ntpd: time slew -0.002543 s 2024-02-02T11:44:54.561 INFO:teuthology.orchestra.run.smithi162.stdout:ntpd: time slew -0.002543s 2024-02-02T11:44:54.561 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:54 ntpd[17523]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-02-02T11:44:54.562 INFO:teuthology.orchestra.run.smithi162.stderr: 2 Feb 11:44:54 ntpd[17523]: can't open /var/log/ntpstats/loopstats.20240202: Permission denied 2024-02-02T11:44:54.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:54 ntpd[17037]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:54.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:54 ntpd[17037]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:54.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:54 ntpd[17037]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:54.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:54 ntpd[17037]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:54.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:54 ntpd[17037]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:54.603 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:54 ntpd[17037]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:54.603 INFO:teuthology.orchestra.run.smithi177.stdout: 2 Feb 11:44:54 ntpd[17037]: ntpd: time slew -0.000782 s 2024-02-02T11:44:54.603 INFO:teuthology.orchestra.run.smithi177.stdout:ntpd: time slew -0.000782s 2024-02-02T11:44:54.604 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:54 ntpd[17037]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-02-02T11:44:54.604 INFO:teuthology.orchestra.run.smithi177.stderr: 2 Feb 11:44:54 ntpd[17037]: can't open /var/log/ntpstats/loopstats.20240202: Permission denied 2024-02-02T11:44:54.639 INFO:teuthology.orchestra.run.smithi162.stdout: remote refid st t when poll reach delay offset jitter 2024-02-02T11:44:54.639 INFO:teuthology.orchestra.run.smithi162.stdout:============================================================================== 2024-02-02T11:44:54.639 INFO:teuthology.orchestra.run.smithi162.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-02T11:44:54.639 INFO:teuthology.orchestra.run.smithi162.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-02T11:44:54.639 INFO:teuthology.orchestra.run.smithi162.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-02T11:44:54.640 INFO:teuthology.orchestra.run.smithi162.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-02T11:44:54.943 INFO:teuthology.orchestra.run.smithi177.stdout: remote refid st t when poll reach delay offset jitter 2024-02-02T11:44:54.943 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================== 2024-02-02T11:44:54.943 INFO:teuthology.orchestra.run.smithi177.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-02T11:44:54.943 INFO:teuthology.orchestra.run.smithi177.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-02T11:44:54.943 INFO:teuthology.orchestra.run.smithi177.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-02T11:44:54.943 INFO:teuthology.orchestra.run.smithi177.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-02T11:44:55.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:55 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:55.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:55 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:55.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:55 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:55.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:55 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:55.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:55 ntpd[17483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:55.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:55 ntpd[17483]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:56.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:56 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:56.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:56 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:56.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:56 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:56.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:56 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:56.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:56 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:56.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:56 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:56.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:56 ntpd[17483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:56.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:56 ntpd[17483]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:56.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:56 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:56.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:56 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:56.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:56 ntpd[17483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:56.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:56 ntpd[17483]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:57.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:57 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:57.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:57 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:57.558 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:57 ntpd[17483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-02T11:44:57.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:57 ntpd[17483]: can't open /var/log/ntpstats/rawstats.20240202: Permission denied 2024-02-02T11:44:57.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:57 ntpd[17483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-02T11:44:57.559 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:57 ntpd[17483]: can't open /var/log/ntpstats/peerstats.20240202: Permission denied 2024-02-02T11:44:57.560 INFO:teuthology.orchestra.run.smithi161.stdout: 2 Feb 11:44:57 ntpd[17483]: ntpd: time slew -0.004204 s 2024-02-02T11:44:57.560 INFO:teuthology.orchestra.run.smithi161.stdout:ntpd: time slew -0.004204s 2024-02-02T11:44:57.560 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:57 ntpd[17483]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-02-02T11:44:57.560 INFO:teuthology.orchestra.run.smithi161.stderr: 2 Feb 11:44:57 ntpd[17483]: can't open /var/log/ntpstats/loopstats.20240202: Permission denied 2024-02-02T11:44:57.661 INFO:teuthology.orchestra.run.smithi161.stdout: remote refid st t when poll reach delay offset jitter 2024-02-02T11:44:57.661 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================== 2024-02-02T11:44:57.661 INFO:teuthology.orchestra.run.smithi161.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-02T11:44:57.661 INFO:teuthology.orchestra.run.smithi161.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-02T11:44:57.661 INFO:teuthology.orchestra.run.smithi161.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-02T11:44:57.661 INFO:teuthology.orchestra.run.smithi161.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-02T11:44:57.661 INFO:teuthology.run_tasks:Running task install... 2024-02-02T11:44:57.671 DEBUG:teuthology.task.install:project ceph 2024-02-02T11:44:57.671 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0fb327883c124fd83155c94db0804f823b805a12'}} 2024-02-02T11:44:57.671 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '0fb327883c124fd83155c94db0804f823b805a12'} 2024-02-02T11:44:57.672 INFO:teuthology.task.install:Using flavor: default 2024-02-02T11:44:57.678 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-02T11:44:57.678 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-02-02T11:44:57.678 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-key list | grep Ceph 2024-02-02T11:44:57.679 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-key list | grep Ceph 2024-02-02T11:44:57.679 DEBUG:teuthology.orchestra.run.smithi177:> sudo apt-key list | grep Ceph 2024-02-02T11:44:57.744 INFO:teuthology.orchestra.run.smithi162.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-02-02T11:44:57.759 INFO:teuthology.orchestra.run.smithi161.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-02-02T11:44:57.772 INFO:teuthology.orchestra.run.smithi162.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-02-02T11:44:57.772 INFO:teuthology.orchestra.run.smithi162.stdout:uid [ unknown] Ceph.com (release key) 2024-02-02T11:44:57.773 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-02-02T11:44:57.773 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-02-02T11:44:57.773 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0fb327883c124fd83155c94db0804f823b805a12 2024-02-02T11:44:57.782 INFO:teuthology.orchestra.run.smithi177.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-02-02T11:44:57.785 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-02-02T11:44:57.785 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph.com (release key) 2024-02-02T11:44:57.786 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-02-02T11:44:57.786 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-02-02T11:44:57.787 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0fb327883c124fd83155c94db0804f823b805a12 2024-02-02T11:44:57.833 INFO:teuthology.orchestra.run.smithi177.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-02-02T11:44:57.833 INFO:teuthology.orchestra.run.smithi177.stdout:uid [ unknown] Ceph.com (release key) 2024-02-02T11:44:57.834 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-02-02T11:44:57.834 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-02-02T11:44:57.835 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0fb327883c124fd83155c94db0804f823b805a12 2024-02-02T11:44:57.915 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default/ 2024-02-02T11:44:57.915 INFO:teuthology.task.install.deb:Package version is 18.2.1-325-g0fb32788-1jammy 2024-02-02T11:44:57.937 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default/ 2024-02-02T11:44:57.937 INFO:teuthology.task.install.deb:Package version is 18.2.1-325-g0fb32788-1jammy 2024-02-02T11:44:57.987 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default/ 2024-02-02T11:44:57.987 INFO:teuthology.task.install.deb:Package version is 18.2.1-325-g0fb32788-1jammy 2024-02-02T11:44:58.129 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T11:44:58.129 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-02-02T11:44:58.136 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:44:58.136 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-02-02T11:44:58.138 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:44:58.138 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-02-02T11:44:58.148 DEBUG:teuthology.orchestra.run.smithi177:> sudo apt-get update 2024-02-02T11:44:58.151 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get update 2024-02-02T11:44:58.152 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get update 2024-02-02T11:44:58.320 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-02T11:44:58.332 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-02T11:44:58.334 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-02T11:44:58.352 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-02T11:44:58.379 INFO:teuthology.orchestra.run.smithi177.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy InRelease 2024-02-02T11:44:58.380 INFO:teuthology.orchestra.run.smithi162.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy InRelease 2024-02-02T11:44:58.401 INFO:teuthology.orchestra.run.smithi177.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-02-02T11:44:58.402 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-02-02T11:44:58.423 INFO:teuthology.orchestra.run.smithi177.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy Release.gpg 2024-02-02T11:44:58.425 INFO:teuthology.orchestra.run.smithi162.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy Release.gpg 2024-02-02T11:44:58.438 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy InRelease 2024-02-02T11:44:58.452 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-02T11:44:58.456 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-02T11:44:58.459 INFO:teuthology.orchestra.run.smithi177.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-02-02T11:44:58.462 INFO:teuthology.orchestra.run.smithi177.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2024-02-02T11:44:58.466 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,428 B] 2024-02-02T11:44:58.481 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-02-02T11:44:58.494 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2024-02-02T11:44:58.494 INFO:teuthology.orchestra.run.smithi177.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,428 B] 2024-02-02T11:44:58.518 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy Release.gpg 2024-02-02T11:44:58.522 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-02-02T11:44:58.527 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-02-02T11:44:58.555 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2024-02-02T11:44:58.597 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,428 B] 2024-02-02T11:44:58.674 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 28.5 kB in 0s (82.5 kB/s) 2024-02-02T11:44:58.876 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-02T11:44:58.895 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-02T11:44:59.205 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 258 kB in 1s (307 kB/s) 2024-02-02T11:44:59.558 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-02-02T11:44:59.574 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.1-325-g0fb32788-1jammy cephadm=18.2.1-325-g0fb32788-1jammy ceph-mds=18.2.1-325-g0fb32788-1jammy ceph-mgr=18.2.1-325-g0fb32788-1jammy ceph-common=18.2.1-325-g0fb32788-1jammy ceph-fuse=18.2.1-325-g0fb32788-1jammy ceph-test=18.2.1-325-g0fb32788-1jammy ceph-volume=18.2.1-325-g0fb32788-1jammy radosgw=18.2.1-325-g0fb32788-1jammy python3-rados=18.2.1-325-g0fb32788-1jammy python3-rgw=18.2.1-325-g0fb32788-1jammy python3-cephfs=18.2.1-325-g0fb32788-1jammy python3-rbd=18.2.1-325-g0fb32788-1jammy libcephfs2=18.2.1-325-g0fb32788-1jammy libcephfs-dev=18.2.1-325-g0fb32788-1jammy librados2=18.2.1-325-g0fb32788-1jammy librbd1=18.2.1-325-g0fb32788-1jammy rbd-fuse=18.2.1-325-g0fb32788-1jammy python3-cephfs=18.2.1-325-g0fb32788-1jammy cephfs-shell=18.2.1-325-g0fb32788-1jammy cephfs-top=18.2.1-325-g0fb32788-1jammy cephfs-mirror=18.2.1-325-g0fb32788-1jammy 2024-02-02T11:44:59.625 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-02-02T11:44:59.792 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2024-02-02T11:44:59.792 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2024-02-02T11:44:59.946 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages were automatically installed and are no longer required: 2024-02-02T11:44:59.947 INFO:teuthology.orchestra.run.smithi161.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-02T11:44:59.947 INFO:teuthology.orchestra.run.smithi161.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-02T11:44:59.948 INFO:teuthology.orchestra.run.smithi161.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-02T11:44:59.948 INFO:teuthology.orchestra.run.smithi161.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-02-02T11:44:59.948 INFO:teuthology.orchestra.run.smithi161.stdout: python2.7-minimal 2024-02-02T11:44:59.948 INFO:teuthology.orchestra.run.smithi161.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-02T11:44:59.948 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2024-02-02T11:44:59.948 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-02-02T11:44:59.948 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-02-02T11:44:59.948 INFO:teuthology.orchestra.run.smithi161.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-02-02T11:44:59.948 INFO:teuthology.orchestra.run.smithi161.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-02-02T11:44:59.950 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-02-02T11:44:59.950 INFO:teuthology.orchestra.run.smithi161.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-02-02T11:44:59.950 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-02-02T11:44:59.950 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-02-02T11:44:59.950 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-02-02T11:44:59.950 INFO:teuthology.orchestra.run.smithi161.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-02-02T11:44:59.950 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-02-02T11:44:59.950 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-02-02T11:44:59.950 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-02-02T11:44:59.950 INFO:teuthology.orchestra.run.smithi161.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-02-02T11:44:59.950 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-02-02T11:44:59.951 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-02-02T11:44:59.951 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-02-02T11:44:59.951 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-02-02T11:44:59.951 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-02-02T11:44:59.951 INFO:teuthology.orchestra.run.smithi161.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-02-02T11:44:59.951 INFO:teuthology.orchestra.run.smithi161.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-02-02T11:44:59.951 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-02-02T11:44:59.951 INFO:teuthology.orchestra.run.smithi161.stdout: qttranslations5-l10n socat xmlstarlet 2024-02-02T11:44:59.951 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2024-02-02T11:44:59.951 INFO:teuthology.orchestra.run.smithi161.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-02-02T11:44:59.951 INFO:teuthology.orchestra.run.smithi161.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-02-02T11:44:59.951 INFO:teuthology.orchestra.run.smithi161.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-02-02T11:44:59.952 INFO:teuthology.orchestra.run.smithi161.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-02-02T11:44:59.952 INFO:teuthology.orchestra.run.smithi161.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-02-02T11:44:59.952 INFO:teuthology.orchestra.run.smithi161.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-02-02T11:44:59.952 INFO:teuthology.orchestra.run.smithi161.stdout: python3-watchdog 2024-02-02T11:44:59.952 INFO:teuthology.orchestra.run.smithi161.stdout:Recommended packages: 2024-02-02T11:44:59.952 INFO:teuthology.orchestra.run.smithi161.stdout: btrfs-tools 2024-02-02T11:45:00.054 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2024-02-02T11:45:00.054 INFO:teuthology.orchestra.run.smithi161.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-02-02T11:45:00.054 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-02-02T11:45:00.054 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-02-02T11:45:00.055 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-02-02T11:45:00.055 INFO:teuthology.orchestra.run.smithi161.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-02-02T11:45:00.055 INFO:teuthology.orchestra.run.smithi161.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-02-02T11:45:00.055 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-02-02T11:45:00.056 INFO:teuthology.orchestra.run.smithi161.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-02-02T11:45:00.056 INFO:teuthology.orchestra.run.smithi161.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-02-02T11:45:00.056 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-02-02T11:45:00.056 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-02-02T11:45:00.056 INFO:teuthology.orchestra.run.smithi161.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-02-02T11:45:00.056 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-02T11:45:00.056 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-02T11:45:00.056 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-02T11:45:00.056 INFO:teuthology.orchestra.run.smithi161.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-02T11:45:00.056 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-02T11:45:00.056 INFO:teuthology.orchestra.run.smithi161.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-02T11:45:00.056 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-02-02T11:45:00.057 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-02-02T11:45:00.057 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-02-02T11:45:00.057 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-02-02T11:45:00.057 INFO:teuthology.orchestra.run.smithi161.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-02-02T11:45:00.057 INFO:teuthology.orchestra.run.smithi161.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-02-02T11:45:00.057 INFO:teuthology.orchestra.run.smithi161.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-02-02T11:45:00.057 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-02-02T11:45:00.057 INFO:teuthology.orchestra.run.smithi161.stdout: socat xmlstarlet 2024-02-02T11:45:00.121 INFO:teuthology.orchestra.run.smithi161.stdout:0 upgraded, 115 newly installed, 0 to remove and 272 not upgraded. 2024-02-02T11:45:00.122 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 181 MB of archives. 2024-02-02T11:45:00.122 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 812 MB of additional disk space will be used. 2024-02-02T11:45:00.122 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-02-02T11:45:00.139 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2024-02-02T11:45:00.152 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-02-02T11:45:00.155 DEBUG:teuthology.orchestra.run.smithi177:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.1-325-g0fb32788-1jammy cephadm=18.2.1-325-g0fb32788-1jammy ceph-mds=18.2.1-325-g0fb32788-1jammy ceph-mgr=18.2.1-325-g0fb32788-1jammy ceph-common=18.2.1-325-g0fb32788-1jammy ceph-fuse=18.2.1-325-g0fb32788-1jammy ceph-test=18.2.1-325-g0fb32788-1jammy ceph-volume=18.2.1-325-g0fb32788-1jammy radosgw=18.2.1-325-g0fb32788-1jammy python3-rados=18.2.1-325-g0fb32788-1jammy python3-rgw=18.2.1-325-g0fb32788-1jammy python3-cephfs=18.2.1-325-g0fb32788-1jammy python3-rbd=18.2.1-325-g0fb32788-1jammy libcephfs2=18.2.1-325-g0fb32788-1jammy libcephfs-dev=18.2.1-325-g0fb32788-1jammy librados2=18.2.1-325-g0fb32788-1jammy librbd1=18.2.1-325-g0fb32788-1jammy rbd-fuse=18.2.1-325-g0fb32788-1jammy python3-cephfs=18.2.1-325-g0fb32788-1jammy cephfs-shell=18.2.1-325-g0fb32788-1jammy cephfs-top=18.2.1-325-g0fb32788-1jammy cephfs-mirror=18.2.1-325-g0fb32788-1jammy 2024-02-02T11:45:00.161 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-02-02T11:45:00.229 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2024-02-02T11:45:00.236 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-02-02T11:45:00.243 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-02-02T11:45:00.271 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-02-02T11:45:00.274 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-02-02T11:45:00.296 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-02-02T11:45:00.371 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-02-02T11:45:00.376 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-02-02T11:45:00.394 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-02-02T11:45:00.396 INFO:teuthology.orchestra.run.smithi177.stdout:Building dependency tree... 2024-02-02T11:45:00.397 INFO:teuthology.orchestra.run.smithi177.stdout:Reading state information... 2024-02-02T11:45:00.400 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-02-02T11:45:00.401 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-02-02T11:45:00.412 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-02-02T11:45:00.413 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-02-02T11:45:00.414 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-02-02T11:45:00.415 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-02-02T11:45:00.418 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-02-02T11:45:00.440 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:9 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-02T11:45:00.449 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-02-02T11:45:00.449 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-02-02T11:45:00.450 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-02-02T11:45:00.450 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-02-02T11:45:00.451 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-02-02T11:45:00.454 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-02-02T11:45:00.455 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-02-02T11:45:00.455 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-02-02T11:45:00.456 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-02-02T11:45:00.499 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-02-02T11:45:00.500 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-02-02T11:45:00.500 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-02-02T11:45:00.503 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-02-02T11:45:00.504 INFO:teuthology.orchestra.run.smithi161.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-02-02T11:45:00.535 INFO:teuthology.orchestra.run.smithi161.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-02-02T11:45:00.545 INFO:teuthology.orchestra.run.smithi161.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-02-02T11:45:00.545 INFO:teuthology.orchestra.run.smithi161.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-02-02T11:45:00.547 INFO:teuthology.orchestra.run.smithi161.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-02-02T11:45:00.548 INFO:teuthology.orchestra.run.smithi161.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-02-02T11:45:00.552 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages were automatically installed and are no longer required: 2024-02-02T11:45:00.552 INFO:teuthology.orchestra.run.smithi177.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-02T11:45:00.552 INFO:teuthology.orchestra.run.smithi177.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-02T11:45:00.552 INFO:teuthology.orchestra.run.smithi177.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-02T11:45:00.553 INFO:teuthology.orchestra.run.smithi177.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-02T11:45:00.553 INFO:teuthology.orchestra.run.smithi177.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-02T11:45:00.553 INFO:teuthology.orchestra.run.smithi177.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-02T11:45:00.554 INFO:teuthology.orchestra.run.smithi177.stdout:The following additional packages will be installed: 2024-02-02T11:45:00.554 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-02-02T11:45:00.554 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-02-02T11:45:00.554 INFO:teuthology.orchestra.run.smithi177.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-02-02T11:45:00.554 INFO:teuthology.orchestra.run.smithi177.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-02-02T11:45:00.556 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-02-02T11:45:00.556 INFO:teuthology.orchestra.run.smithi177.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-02-02T11:45:00.556 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-02-02T11:45:00.556 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-02-02T11:45:00.556 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-02-02T11:45:00.556 INFO:teuthology.orchestra.run.smithi177.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-02-02T11:45:00.556 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-02-02T11:45:00.556 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-02-02T11:45:00.556 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-02-02T11:45:00.556 INFO:teuthology.orchestra.run.smithi177.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-02-02T11:45:00.556 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-02-02T11:45:00.557 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-02-02T11:45:00.557 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-02-02T11:45:00.557 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-02-02T11:45:00.557 INFO:teuthology.orchestra.run.smithi177.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-02-02T11:45:00.557 INFO:teuthology.orchestra.run.smithi177.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-02-02T11:45:00.557 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-02-02T11:45:00.557 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-02-02T11:45:00.557 INFO:teuthology.orchestra.run.smithi177.stdout: qttranslations5-l10n socat xmlstarlet 2024-02-02T11:45:00.557 INFO:teuthology.orchestra.run.smithi177.stdout:Suggested packages: 2024-02-02T11:45:00.558 INFO:teuthology.orchestra.run.smithi177.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-02-02T11:45:00.558 INFO:teuthology.orchestra.run.smithi177.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-02-02T11:45:00.558 INFO:teuthology.orchestra.run.smithi177.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-02-02T11:45:00.558 INFO:teuthology.orchestra.run.smithi177.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-02-02T11:45:00.558 INFO:teuthology.orchestra.run.smithi177.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-02-02T11:45:00.558 INFO:teuthology.orchestra.run.smithi177.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-02-02T11:45:00.558 INFO:teuthology.orchestra.run.smithi177.stdout: python3-watchdog 2024-02-02T11:45:00.558 INFO:teuthology.orchestra.run.smithi177.stdout:Recommended packages: 2024-02-02T11:45:00.558 INFO:teuthology.orchestra.run.smithi177.stdout: btrfs-tools 2024-02-02T11:45:00.562 INFO:teuthology.orchestra.run.smithi161.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-02-02T11:45:00.566 INFO:teuthology.orchestra.run.smithi161.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-02-02T11:45:00.567 INFO:teuthology.orchestra.run.smithi161.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-02-02T11:45:00.570 INFO:teuthology.orchestra.run.smithi161.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-02-02T11:45:00.572 INFO:teuthology.orchestra.run.smithi161.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-02-02T11:45:00.583 INFO:teuthology.orchestra.run.smithi161.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-02-02T11:45:00.584 INFO:teuthology.orchestra.run.smithi161.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-02-02T11:45:00.589 INFO:teuthology.orchestra.run.smithi161.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-02-02T11:45:00.599 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 147 kB in 2s (65.2 kB/s) 2024-02-02T11:45:00.701 INFO:teuthology.orchestra.run.smithi177.stdout:The following NEW packages will be installed: 2024-02-02T11:45:00.701 INFO:teuthology.orchestra.run.smithi177.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-02-02T11:45:00.701 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-02-02T11:45:00.701 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-02-02T11:45:00.702 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-02-02T11:45:00.703 INFO:teuthology.orchestra.run.smithi177.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-02-02T11:45:00.703 INFO:teuthology.orchestra.run.smithi177.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-02-02T11:45:00.703 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-02-02T11:45:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-02-02T11:45:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-02-02T11:45:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-02-02T11:45:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-02-02T11:45:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-02-02T11:45:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-02T11:45:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-02T11:45:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-02T11:45:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-02T11:45:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-02T11:45:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-02T11:45:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-02-02T11:45:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-02-02T11:45:00.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-02-02T11:45:00.705 INFO:teuthology.orchestra.run.smithi177.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-02-02T11:45:00.705 INFO:teuthology.orchestra.run.smithi177.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-02-02T11:45:00.705 INFO:teuthology.orchestra.run.smithi177.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-02-02T11:45:00.705 INFO:teuthology.orchestra.run.smithi177.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-02-02T11:45:00.705 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-02-02T11:45:00.705 INFO:teuthology.orchestra.run.smithi177.stdout: socat xmlstarlet 2024-02-02T11:45:00.768 INFO:teuthology.orchestra.run.smithi161.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-02-02T11:45:00.781 INFO:teuthology.orchestra.run.smithi161.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-02-02T11:45:00.783 INFO:teuthology.orchestra.run.smithi161.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-02-02T11:45:00.784 INFO:teuthology.orchestra.run.smithi161.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-02-02T11:45:00.785 INFO:teuthology.orchestra.run.smithi161.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-02-02T11:45:00.787 INFO:teuthology.orchestra.run.smithi161.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-02-02T11:45:00.788 INFO:teuthology.orchestra.run.smithi161.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-02-02T11:45:00.789 INFO:teuthology.orchestra.run.smithi161.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.1-325-g0fb32788-1jammy [3,419 kB] 2024-02-02T11:45:00.789 INFO:teuthology.orchestra.run.smithi161.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-02-02T11:45:00.794 INFO:teuthology.orchestra.run.smithi161.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-02-02T11:45:00.795 INFO:teuthology.orchestra.run.smithi161.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-02-02T11:45:00.799 INFO:teuthology.orchestra.run.smithi177.stdout:0 upgraded, 115 newly installed, 0 to remove and 272 not upgraded. 2024-02-02T11:45:00.799 INFO:teuthology.orchestra.run.smithi177.stdout:Need to get 181 MB of archives. 2024-02-02T11:45:00.799 INFO:teuthology.orchestra.run.smithi177.stdout:After this operation, 812 MB of additional disk space will be used. 2024-02-02T11:45:00.799 INFO:teuthology.orchestra.run.smithi177.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-02-02T11:45:00.809 INFO:teuthology.orchestra.run.smithi161.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-02-02T11:45:00.833 INFO:teuthology.orchestra.run.smithi177.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-02-02T11:45:00.849 INFO:teuthology.orchestra.run.smithi177.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-02-02T11:45:00.852 INFO:teuthology.orchestra.run.smithi161.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-02-02T11:45:00.856 INFO:teuthology.orchestra.run.smithi161.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-02-02T11:45:00.856 INFO:teuthology.orchestra.run.smithi161.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-02-02T11:45:00.879 INFO:teuthology.orchestra.run.smithi161.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-02-02T11:45:00.879 INFO:teuthology.orchestra.run.smithi161.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-02-02T11:45:00.880 INFO:teuthology.orchestra.run.smithi161.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-02-02T11:45:00.881 INFO:teuthology.orchestra.run.smithi161.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-02-02T11:45:00.881 INFO:teuthology.orchestra.run.smithi161.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-02-02T11:45:00.882 INFO:teuthology.orchestra.run.smithi161.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-02-02T11:45:00.908 INFO:teuthology.orchestra.run.smithi161.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-02-02T11:45:00.937 INFO:teuthology.orchestra.run.smithi161.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-02-02T11:45:00.944 INFO:teuthology.orchestra.run.smithi161.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-02-02T11:45:00.947 INFO:teuthology.orchestra.run.smithi161.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-02-02T11:45:00.950 INFO:teuthology.orchestra.run.smithi161.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-02-02T11:45:00.951 INFO:teuthology.orchestra.run.smithi161.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-02-02T11:45:00.957 INFO:teuthology.orchestra.run.smithi161.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-02-02T11:45:01.011 INFO:teuthology.orchestra.run.smithi177.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-02-02T11:45:01.013 INFO:teuthology.orchestra.run.smithi161.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-02-02T11:45:01.014 INFO:teuthology.orchestra.run.smithi161.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-02-02T11:45:01.031 INFO:teuthology.orchestra.run.smithi177.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.1-325-g0fb32788-1jammy [3,419 kB] 2024-02-02T11:45:01.035 INFO:teuthology.orchestra.run.smithi161.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-02-02T11:45:01.042 INFO:teuthology.orchestra.run.smithi177.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-02-02T11:45:01.042 INFO:teuthology.orchestra.run.smithi161.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-02-02T11:45:01.043 INFO:teuthology.orchestra.run.smithi161.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-02-02T11:45:01.047 INFO:teuthology.orchestra.run.smithi161.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-02-02T11:45:01.066 INFO:teuthology.orchestra.run.smithi161.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-02-02T11:45:01.067 INFO:teuthology.orchestra.run.smithi161.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-02-02T11:45:01.068 INFO:teuthology.orchestra.run.smithi161.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-02-02T11:45:01.087 INFO:teuthology.orchestra.run.smithi177.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-02-02T11:45:01.097 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-02-02T11:45:01.116 INFO:teuthology.orchestra.run.smithi177.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-02-02T11:45:01.197 INFO:teuthology.orchestra.run.smithi177.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-02-02T11:45:01.203 INFO:teuthology.orchestra.run.smithi177.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-02-02T11:45:01.226 INFO:teuthology.orchestra.run.smithi177.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-02-02T11:45:01.236 INFO:teuthology.orchestra.run.smithi177.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-02-02T11:45:01.237 INFO:teuthology.orchestra.run.smithi177.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-02-02T11:45:01.256 INFO:teuthology.orchestra.run.smithi177.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-02-02T11:45:01.257 INFO:teuthology.orchestra.run.smithi177.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-02-02T11:45:01.257 INFO:teuthology.orchestra.run.smithi177.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-02-02T11:45:01.259 INFO:teuthology.orchestra.run.smithi177.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-02-02T11:45:01.260 INFO:teuthology.orchestra.run.smithi177.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-02-02T11:45:01.295 INFO:teuthology.orchestra.run.smithi177.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-02-02T11:45:01.295 INFO:teuthology.orchestra.run.smithi177.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-02-02T11:45:01.295 INFO:teuthology.orchestra.run.smithi177.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-02-02T11:45:01.296 INFO:teuthology.orchestra.run.smithi177.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-02-02T11:45:01.296 INFO:teuthology.orchestra.run.smithi177.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-02-02T11:45:01.315 INFO:teuthology.orchestra.run.smithi177.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-02-02T11:45:01.315 INFO:teuthology.orchestra.run.smithi177.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-02-02T11:45:01.316 INFO:teuthology.orchestra.run.smithi177.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-02-02T11:45:01.316 INFO:teuthology.orchestra.run.smithi177.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-02-02T11:45:01.317 INFO:teuthology.orchestra.run.smithi177.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-02-02T11:45:01.335 INFO:teuthology.orchestra.run.smithi177.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-02-02T11:45:01.335 INFO:teuthology.orchestra.run.smithi177.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-02-02T11:45:01.336 INFO:teuthology.orchestra.run.smithi177.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-02-02T11:45:01.337 INFO:teuthology.orchestra.run.smithi177.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-02-02T11:45:01.338 INFO:teuthology.orchestra.run.smithi177.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-02-02T11:45:01.356 INFO:teuthology.orchestra.run.smithi177.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-02-02T11:45:01.356 INFO:teuthology.orchestra.run.smithi177.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-02-02T11:45:01.356 INFO:teuthology.orchestra.run.smithi177.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-02-02T11:45:01.357 INFO:teuthology.orchestra.run.smithi177.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-02-02T11:45:01.358 INFO:teuthology.orchestra.run.smithi177.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-02-02T11:45:01.376 INFO:teuthology.orchestra.run.smithi177.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-02-02T11:45:01.377 INFO:teuthology.orchestra.run.smithi177.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-02-02T11:45:01.378 INFO:teuthology.orchestra.run.smithi177.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-02-02T11:45:01.379 INFO:teuthology.orchestra.run.smithi177.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-02-02T11:45:01.381 INFO:teuthology.orchestra.run.smithi177.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-02-02T11:45:01.399 INFO:teuthology.orchestra.run.smithi177.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-02-02T11:45:01.402 INFO:teuthology.orchestra.run.smithi177.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-02-02T11:45:01.527 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-02-02T11:45:01.541 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.1-325-g0fb32788-1jammy cephadm=18.2.1-325-g0fb32788-1jammy ceph-mds=18.2.1-325-g0fb32788-1jammy ceph-mgr=18.2.1-325-g0fb32788-1jammy ceph-common=18.2.1-325-g0fb32788-1jammy ceph-fuse=18.2.1-325-g0fb32788-1jammy ceph-test=18.2.1-325-g0fb32788-1jammy ceph-volume=18.2.1-325-g0fb32788-1jammy radosgw=18.2.1-325-g0fb32788-1jammy python3-rados=18.2.1-325-g0fb32788-1jammy python3-rgw=18.2.1-325-g0fb32788-1jammy python3-cephfs=18.2.1-325-g0fb32788-1jammy python3-rbd=18.2.1-325-g0fb32788-1jammy libcephfs2=18.2.1-325-g0fb32788-1jammy libcephfs-dev=18.2.1-325-g0fb32788-1jammy librados2=18.2.1-325-g0fb32788-1jammy librbd1=18.2.1-325-g0fb32788-1jammy rbd-fuse=18.2.1-325-g0fb32788-1jammy python3-cephfs=18.2.1-325-g0fb32788-1jammy cephfs-shell=18.2.1-325-g0fb32788-1jammy cephfs-top=18.2.1-325-g0fb32788-1jammy cephfs-mirror=18.2.1-325-g0fb32788-1jammy 2024-02-02T11:45:01.589 INFO:teuthology.orchestra.run.smithi177.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-02-02T11:45:01.590 INFO:teuthology.orchestra.run.smithi177.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-02-02T11:45:01.592 INFO:teuthology.orchestra.run.smithi177.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-02-02T11:45:01.593 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-02-02T11:45:01.604 INFO:teuthology.orchestra.run.smithi177.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-02-02T11:45:01.605 INFO:teuthology.orchestra.run.smithi177.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-02-02T11:45:01.605 INFO:teuthology.orchestra.run.smithi177.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-02-02T11:45:01.606 INFO:teuthology.orchestra.run.smithi177.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-02-02T11:45:01.606 INFO:teuthology.orchestra.run.smithi177.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-02-02T11:45:01.608 INFO:teuthology.orchestra.run.smithi177.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-02-02T11:45:01.625 INFO:teuthology.orchestra.run.smithi177.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-02-02T11:45:01.632 INFO:teuthology.orchestra.run.smithi177.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-02-02T11:45:01.658 INFO:teuthology.orchestra.run.smithi177.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-02-02T11:45:01.660 INFO:teuthology.orchestra.run.smithi177.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-02-02T11:45:01.661 INFO:teuthology.orchestra.run.smithi177.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-02-02T11:45:01.684 INFO:teuthology.orchestra.run.smithi177.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-02-02T11:45:01.685 INFO:teuthology.orchestra.run.smithi177.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-02-02T11:45:01.685 INFO:teuthology.orchestra.run.smithi177.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-02-02T11:45:01.686 INFO:teuthology.orchestra.run.smithi177.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-02-02T11:45:01.686 INFO:teuthology.orchestra.run.smithi177.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-02-02T11:45:01.690 INFO:teuthology.orchestra.run.smithi177.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-02-02T11:45:01.690 INFO:teuthology.orchestra.run.smithi177.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-02-02T11:45:01.691 INFO:teuthology.orchestra.run.smithi177.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-02-02T11:45:01.694 INFO:teuthology.orchestra.run.smithi177.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-02-02T11:45:01.710 INFO:teuthology.orchestra.run.smithi177.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-02-02T11:45:01.711 INFO:teuthology.orchestra.run.smithi177.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-02-02T11:45:01.712 INFO:teuthology.orchestra.run.smithi177.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-02-02T11:45:01.716 INFO:teuthology.orchestra.run.smithi177.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-02-02T11:45:01.719 INFO:teuthology.orchestra.run.smithi177.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-02-02T11:45:01.719 INFO:teuthology.orchestra.run.smithi177.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-02-02T11:45:01.730 INFO:teuthology.orchestra.run.smithi177.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-02-02T11:45:01.736 INFO:teuthology.orchestra.run.smithi177.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-02-02T11:45:01.736 INFO:teuthology.orchestra.run.smithi177.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-02-02T11:45:01.737 INFO:teuthology.orchestra.run.smithi177.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-02-02T11:45:01.759 INFO:teuthology.orchestra.run.smithi177.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-02-02T11:45:01.760 INFO:teuthology.orchestra.run.smithi177.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-02-02T11:45:01.760 INFO:teuthology.orchestra.run.smithi177.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-02-02T11:45:01.762 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2024-02-02T11:45:01.762 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2024-02-02T11:45:01.917 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2024-02-02T11:45:01.917 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-02T11:45:01.918 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-02T11:45:01.918 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-02T11:45:01.918 INFO:teuthology.orchestra.run.smithi162.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-02-02T11:45:01.918 INFO:teuthology.orchestra.run.smithi162.stdout: python2.7-minimal 2024-02-02T11:45:01.918 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-02T11:45:01.919 INFO:teuthology.orchestra.run.smithi162.stdout:The following additional packages will be installed: 2024-02-02T11:45:01.919 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-02-02T11:45:01.919 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-02-02T11:45:01.919 INFO:teuthology.orchestra.run.smithi162.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-02-02T11:45:01.919 INFO:teuthology.orchestra.run.smithi162.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-02-02T11:45:01.920 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-02-02T11:45:01.920 INFO:teuthology.orchestra.run.smithi162.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-02-02T11:45:01.920 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-02-02T11:45:01.920 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-02-02T11:45:01.920 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-02-02T11:45:01.921 INFO:teuthology.orchestra.run.smithi162.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-02-02T11:45:01.921 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-02-02T11:45:01.921 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-02-02T11:45:01.921 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-02-02T11:45:01.921 INFO:teuthology.orchestra.run.smithi162.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-02-02T11:45:01.921 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-02-02T11:45:01.921 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-02-02T11:45:01.921 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-02-02T11:45:01.921 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-02-02T11:45:01.921 INFO:teuthology.orchestra.run.smithi162.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-02-02T11:45:01.921 INFO:teuthology.orchestra.run.smithi162.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-02-02T11:45:01.921 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-02-02T11:45:01.921 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-02-02T11:45:01.921 INFO:teuthology.orchestra.run.smithi162.stdout: qttranslations5-l10n socat xmlstarlet 2024-02-02T11:45:01.922 INFO:teuthology.orchestra.run.smithi162.stdout:Suggested packages: 2024-02-02T11:45:01.922 INFO:teuthology.orchestra.run.smithi162.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-02-02T11:45:01.922 INFO:teuthology.orchestra.run.smithi162.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-02-02T11:45:01.922 INFO:teuthology.orchestra.run.smithi162.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-02-02T11:45:01.922 INFO:teuthology.orchestra.run.smithi162.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-02-02T11:45:01.922 INFO:teuthology.orchestra.run.smithi162.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-02-02T11:45:01.922 INFO:teuthology.orchestra.run.smithi162.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-02-02T11:45:01.922 INFO:teuthology.orchestra.run.smithi162.stdout: python3-watchdog 2024-02-02T11:45:01.922 INFO:teuthology.orchestra.run.smithi162.stdout:Recommended packages: 2024-02-02T11:45:01.922 INFO:teuthology.orchestra.run.smithi162.stdout: btrfs-tools 2024-02-02T11:45:02.013 INFO:teuthology.orchestra.run.smithi177.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.1-325-g0fb32788-1jammy [3,103 kB] 2024-02-02T11:45:02.025 INFO:teuthology.orchestra.run.smithi162.stdout:The following NEW packages will be installed: 2024-02-02T11:45:02.025 INFO:teuthology.orchestra.run.smithi162.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-02-02T11:45:02.026 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-02-02T11:45:02.026 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-02-02T11:45:02.026 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-02-02T11:45:02.026 INFO:teuthology.orchestra.run.smithi162.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-02-02T11:45:02.026 INFO:teuthology.orchestra.run.smithi162.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-02-02T11:45:02.026 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-02-02T11:45:02.026 INFO:teuthology.orchestra.run.smithi162.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-02-02T11:45:02.027 INFO:teuthology.orchestra.run.smithi162.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-02-02T11:45:02.027 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-02-02T11:45:02.027 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-02-02T11:45:02.027 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-02-02T11:45:02.027 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-02T11:45:02.027 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-02T11:45:02.027 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-02T11:45:02.027 INFO:teuthology.orchestra.run.smithi162.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-02T11:45:02.027 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-02T11:45:02.027 INFO:teuthology.orchestra.run.smithi162.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-02T11:45:02.027 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-02-02T11:45:02.027 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-02-02T11:45:02.027 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-02-02T11:45:02.028 INFO:teuthology.orchestra.run.smithi162.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-02-02T11:45:02.028 INFO:teuthology.orchestra.run.smithi162.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-02-02T11:45:02.028 INFO:teuthology.orchestra.run.smithi162.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-02-02T11:45:02.028 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-02-02T11:45:02.028 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-02-02T11:45:02.028 INFO:teuthology.orchestra.run.smithi162.stdout: socat xmlstarlet 2024-02-02T11:45:02.242 INFO:teuthology.orchestra.run.smithi162.stdout:0 upgraded, 115 newly installed, 0 to remove and 272 not upgraded. 2024-02-02T11:45:02.242 INFO:teuthology.orchestra.run.smithi162.stdout:Need to get 181 MB of archives. 2024-02-02T11:45:02.242 INFO:teuthology.orchestra.run.smithi162.stdout:After this operation, 812 MB of additional disk space will be used. 2024-02-02T11:45:02.242 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.1-325-g0fb32788-1jammy [3,419 kB] 2024-02-02T11:45:02.565 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.1-325-g0fb32788-1jammy [3,103 kB] 2024-02-02T11:45:02.592 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-02-02T11:45:02.666 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.1-325-g0fb32788-1jammy [672 kB] 2024-02-02T11:45:02.675 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-02-02T11:45:02.721 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-02-02T11:45:02.783 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.1-325-g0fb32788-1jammy [356 kB] 2024-02-02T11:45:02.807 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.1-325-g0fb32788-1jammy [32.8 kB] 2024-02-02T11:45:02.826 INFO:teuthology.orchestra.run.smithi177.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.1-325-g0fb32788-1jammy [672 kB] 2024-02-02T11:45:02.829 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.1-325-g0fb32788-1jammy [180 kB] 2024-02-02T11:45:02.850 INFO:teuthology.orchestra.run.smithi162.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.1-325-g0fb32788-1jammy [61.5 kB] 2024-02-02T11:45:02.869 INFO:teuthology.orchestra.run.smithi162.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.1-325-g0fb32788-1jammy [330 kB] 2024-02-02T11:45:02.909 INFO:teuthology.orchestra.run.smithi162.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.1-325-g0fb32788-1jammy [5,881 kB] 2024-02-02T11:45:02.923 INFO:teuthology.orchestra.run.smithi162.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-02-02T11:45:02.935 INFO:teuthology.orchestra.run.smithi177.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.1-325-g0fb32788-1jammy [356 kB] 2024-02-02T11:45:02.963 INFO:teuthology.orchestra.run.smithi162.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-02-02T11:45:03.036 INFO:teuthology.orchestra.run.smithi177.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.1-325-g0fb32788-1jammy [32.8 kB] 2024-02-02T11:45:03.037 INFO:teuthology.orchestra.run.smithi177.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.1-325-g0fb32788-1jammy [180 kB] 2024-02-02T11:45:03.038 INFO:teuthology.orchestra.run.smithi162.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-02-02T11:45:03.049 INFO:teuthology.orchestra.run.smithi162.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-02-02T11:45:03.090 INFO:teuthology.orchestra.run.smithi177.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.1-325-g0fb32788-1jammy [61.5 kB] 2024-02-02T11:45:03.092 INFO:teuthology.orchestra.run.smithi177.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.1-325-g0fb32788-1jammy [330 kB] 2024-02-02T11:45:03.095 INFO:teuthology.orchestra.run.smithi162.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-02-02T11:45:03.165 INFO:teuthology.orchestra.run.smithi177.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.1-325-g0fb32788-1jammy [5,881 kB] 2024-02-02T11:45:03.265 INFO:teuthology.orchestra.run.smithi162.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-02-02T11:45:03.274 INFO:teuthology.orchestra.run.smithi162.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-02-02T11:45:03.299 INFO:teuthology.orchestra.run.smithi162.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-02-02T11:45:03.441 INFO:teuthology.orchestra.run.smithi162.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.1-325-g0fb32788-1jammy [112 kB] 2024-02-02T11:45:03.446 INFO:teuthology.orchestra.run.smithi162.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.1-325-g0fb32788-1jammy [442 kB] 2024-02-02T11:45:03.469 INFO:teuthology.orchestra.run.smithi162.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.1-325-g0fb32788-1jammy [22.0 MB] 2024-02-02T11:45:03.614 INFO:teuthology.orchestra.run.smithi162.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-02-02T11:45:03.822 INFO:teuthology.orchestra.run.smithi162.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-02-02T11:45:04.198 INFO:teuthology.orchestra.run.smithi162.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-02-02T11:45:04.205 INFO:teuthology.orchestra.run.smithi162.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-02-02T11:45:04.207 INFO:teuthology.orchestra.run.smithi162.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-02-02T11:45:04.219 INFO:teuthology.orchestra.run.smithi162.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-02-02T11:45:04.220 INFO:teuthology.orchestra.run.smithi162.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-02-02T11:45:04.221 INFO:teuthology.orchestra.run.smithi162.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-02-02T11:45:04.223 INFO:teuthology.orchestra.run.smithi162.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-02-02T11:45:04.225 INFO:teuthology.orchestra.run.smithi162.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-02-02T11:45:04.226 INFO:teuthology.orchestra.run.smithi162.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-02-02T11:45:04.392 INFO:teuthology.orchestra.run.smithi162.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-02-02T11:45:04.635 INFO:teuthology.orchestra.run.smithi162.stdout:Get:36 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.1-325-g0fb32788-1jammy [6,835 kB] 2024-02-02T11:45:04.823 INFO:teuthology.orchestra.run.smithi162.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-02-02T11:45:04.833 INFO:teuthology.orchestra.run.smithi162.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-02-02T11:45:04.838 INFO:teuthology.orchestra.run.smithi162.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-02-02T11:45:04.842 INFO:teuthology.orchestra.run.smithi162.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-02-02T11:45:04.860 INFO:teuthology.orchestra.run.smithi162.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-02-02T11:45:04.864 INFO:teuthology.orchestra.run.smithi162.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-02-02T11:45:04.870 INFO:teuthology.orchestra.run.smithi162.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-02-02T11:45:04.907 INFO:teuthology.orchestra.run.smithi162.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-02-02T11:45:04.922 INFO:teuthology.orchestra.run.smithi162.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-02-02T11:45:04.926 INFO:teuthology.orchestra.run.smithi162.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-02-02T11:45:04.942 INFO:teuthology.orchestra.run.smithi177.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.1-325-g0fb32788-1jammy [112 kB] 2024-02-02T11:45:04.952 INFO:teuthology.orchestra.run.smithi177.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.1-325-g0fb32788-1jammy [442 kB] 2024-02-02T11:45:04.962 INFO:teuthology.orchestra.run.smithi162.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.1-325-g0fb32788-1jammy [237 kB] 2024-02-02T11:45:04.989 INFO:teuthology.orchestra.run.smithi162.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.1-325-g0fb32788-1jammy [130 kB] 2024-02-02T11:45:04.992 INFO:teuthology.orchestra.run.smithi162.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.1-325-g0fb32788-1jammy [1,484 kB] 2024-02-02T11:45:05.077 INFO:teuthology.orchestra.run.smithi162.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.1-325-g0fb32788-1jammy [9,875 kB] 2024-02-02T11:45:05.158 INFO:teuthology.orchestra.run.smithi177.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.1-325-g0fb32788-1jammy [22.0 MB] 2024-02-02T11:45:05.179 INFO:teuthology.orchestra.run.smithi162.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-02-02T11:45:05.262 INFO:teuthology.orchestra.run.smithi162.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-02-02T11:45:05.360 INFO:teuthology.orchestra.run.smithi162.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-02-02T11:45:05.424 INFO:teuthology.orchestra.run.smithi162.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-02-02T11:45:05.518 INFO:teuthology.orchestra.run.smithi161.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.1-325-g0fb32788-1jammy [3,103 kB] 2024-02-02T11:45:05.539 INFO:teuthology.orchestra.run.smithi162.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-02-02T11:45:05.627 INFO:teuthology.orchestra.run.smithi162.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-02-02T11:45:05.645 INFO:teuthology.orchestra.run.smithi162.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-02-02T11:45:05.674 INFO:teuthology.orchestra.run.smithi162.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-02-02T11:45:05.686 INFO:teuthology.orchestra.run.smithi162.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-02-02T11:45:05.724 INFO:teuthology.orchestra.run.smithi162.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-02-02T11:45:05.732 INFO:teuthology.orchestra.run.smithi162.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-02-02T11:45:05.753 INFO:teuthology.orchestra.run.smithi162.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.1-325-g0fb32788-1jammy [31.5 MB] 2024-02-02T11:45:05.923 INFO:teuthology.orchestra.run.smithi162.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-02-02T11:45:06.748 INFO:teuthology.orchestra.run.smithi162.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-02-02T11:45:06.750 INFO:teuthology.orchestra.run.smithi162.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-02-02T11:45:06.753 INFO:teuthology.orchestra.run.smithi162.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-02-02T11:45:06.755 INFO:teuthology.orchestra.run.smithi162.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-02-02T11:45:06.756 INFO:teuthology.orchestra.run.smithi162.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-02-02T11:45:06.758 INFO:teuthology.orchestra.run.smithi162.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-02-02T11:45:06.759 INFO:teuthology.orchestra.run.smithi162.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-02-02T11:45:06.760 INFO:teuthology.orchestra.run.smithi162.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-02-02T11:45:06.766 INFO:teuthology.orchestra.run.smithi162.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-02-02T11:45:06.829 INFO:teuthology.orchestra.run.smithi162.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-02-02T11:45:06.996 INFO:teuthology.orchestra.run.smithi162.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-02-02T11:45:07.242 INFO:teuthology.orchestra.run.smithi161.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.1-325-g0fb32788-1jammy [672 kB] 2024-02-02T11:45:07.636 INFO:teuthology.orchestra.run.smithi161.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.1-325-g0fb32788-1jammy [356 kB] 2024-02-02T11:45:07.701 INFO:teuthology.orchestra.run.smithi162.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-02-02T11:45:07.706 INFO:teuthology.orchestra.run.smithi162.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-02-02T11:45:07.707 INFO:teuthology.orchestra.run.smithi162.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-02-02T11:45:07.758 INFO:teuthology.orchestra.run.smithi162.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-02-02T11:45:07.759 INFO:teuthology.orchestra.run.smithi162.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-02-02T11:45:07.783 INFO:teuthology.orchestra.run.smithi162.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-02-02T11:45:07.785 INFO:teuthology.orchestra.run.smithi162.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-02-02T11:45:07.786 INFO:teuthology.orchestra.run.smithi162.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-02-02T11:45:07.788 INFO:teuthology.orchestra.run.smithi162.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-02-02T11:45:07.849 INFO:teuthology.orchestra.run.smithi161.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.1-325-g0fb32788-1jammy [32.8 kB] 2024-02-02T11:45:07.859 INFO:teuthology.orchestra.run.smithi161.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.1-325-g0fb32788-1jammy [180 kB] 2024-02-02T11:45:07.953 INFO:teuthology.orchestra.run.smithi162.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-02-02T11:45:07.973 INFO:teuthology.orchestra.run.smithi161.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.1-325-g0fb32788-1jammy [61.5 kB] 2024-02-02T11:45:08.005 INFO:teuthology.orchestra.run.smithi161.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.1-325-g0fb32788-1jammy [330 kB] 2024-02-02T11:45:08.089 INFO:teuthology.orchestra.run.smithi162.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-02-02T11:45:08.187 INFO:teuthology.orchestra.run.smithi161.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.1-325-g0fb32788-1jammy [5,881 kB] 2024-02-02T11:45:08.382 INFO:teuthology.orchestra.run.smithi162.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-02-02T11:45:08.426 INFO:teuthology.orchestra.run.smithi162.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-02-02T11:45:08.451 INFO:teuthology.orchestra.run.smithi162.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-02-02T11:45:08.460 INFO:teuthology.orchestra.run.smithi162.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-02-02T11:45:08.505 INFO:teuthology.orchestra.run.smithi162.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-02-02T11:45:08.530 INFO:teuthology.orchestra.run.smithi162.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-02-02T11:45:08.532 INFO:teuthology.orchestra.run.smithi162.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-02-02T11:45:08.566 INFO:teuthology.orchestra.run.smithi162.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-02-02T11:45:08.584 INFO:teuthology.orchestra.run.smithi162.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-02-02T11:45:08.751 INFO:teuthology.orchestra.run.smithi162.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-02-02T11:45:08.923 INFO:teuthology.orchestra.run.smithi162.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.1-325-g0fb32788-1jammy [14.1 kB] 2024-02-02T11:45:08.923 INFO:teuthology.orchestra.run.smithi162.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.1-325-g0fb32788-1jammy [824 kB] 2024-02-02T11:45:08.939 INFO:teuthology.orchestra.run.smithi162.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.1-325-g0fb32788-1jammy [2,175 kB] 2024-02-02T11:45:08.979 INFO:teuthology.orchestra.run.smithi162.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.1-325-g0fb32788-1jammy [235 kB] 2024-02-02T11:45:08.982 INFO:teuthology.orchestra.run.smithi162.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.1-325-g0fb32788-1jammy [138 kB] 2024-02-02T11:45:08.986 INFO:teuthology.orchestra.run.smithi162.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.1-325-g0fb32788-1jammy [1,901 kB] 2024-02-02T11:45:09.117 INFO:teuthology.orchestra.run.smithi162.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.1-325-g0fb32788-1jammy [8,625 kB] 2024-02-02T11:45:09.146 INFO:teuthology.orchestra.run.smithi162.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-02-02T11:45:09.368 INFO:teuthology.orchestra.run.smithi162.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-02-02T11:45:09.372 INFO:teuthology.orchestra.run.smithi162.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-02-02T11:45:09.380 INFO:teuthology.orchestra.run.smithi162.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-02-02T11:45:09.695 INFO:teuthology.orchestra.run.smithi162.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.1-325-g0fb32788-1jammy [14.3 kB] 2024-02-02T11:45:09.702 INFO:teuthology.orchestra.run.smithi162.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.1-325-g0fb32788-1jammy [46.5 MB] 2024-02-02T11:45:10.750 INFO:teuthology.orchestra.run.smithi161.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.1-325-g0fb32788-1jammy [112 kB] 2024-02-02T11:45:10.797 INFO:teuthology.orchestra.run.smithi161.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.1-325-g0fb32788-1jammy [442 kB] 2024-02-02T11:45:10.926 INFO:teuthology.orchestra.run.smithi161.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.1-325-g0fb32788-1jammy [22.0 MB] 2024-02-02T11:45:11.957 INFO:teuthology.orchestra.run.smithi177.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.1-325-g0fb32788-1jammy [6,835 kB] 2024-02-02T11:45:13.831 INFO:teuthology.orchestra.run.smithi177.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.1-325-g0fb32788-1jammy [237 kB] 2024-02-02T11:45:13.950 INFO:teuthology.orchestra.run.smithi177.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.1-325-g0fb32788-1jammy [130 kB] 2024-02-02T11:45:13.978 INFO:teuthology.orchestra.run.smithi177.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.1-325-g0fb32788-1jammy [1,484 kB] 2024-02-02T11:45:14.355 INFO:teuthology.orchestra.run.smithi161.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.1-325-g0fb32788-1jammy [6,835 kB] 2024-02-02T11:45:14.523 INFO:teuthology.orchestra.run.smithi177.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.1-325-g0fb32788-1jammy [9,875 kB] 2024-02-02T11:45:14.843 INFO:teuthology.orchestra.run.smithi162.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.1-325-g0fb32788-1jammy [121 kB] 2024-02-02T11:45:14.845 INFO:teuthology.orchestra.run.smithi162.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.1-325-g0fb32788-1jammy [229 kB] 2024-02-02T11:45:14.921 INFO:teuthology.orchestra.run.smithi162.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.1-325-g0fb32788-1jammy [34.0 kB] 2024-02-02T11:45:14.922 INFO:teuthology.orchestra.run.smithi162.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.1-325-g0fb32788-1jammy [23.3 kB] 2024-02-02T11:45:14.923 INFO:teuthology.orchestra.run.smithi162.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.1-325-g0fb32788-1jammy [38.3 kB] 2024-02-02T11:45:14.924 INFO:teuthology.orchestra.run.smithi162.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.1-325-g0fb32788-1jammy [11.6 MB] 2024-02-02T11:45:15.374 INFO:teuthology.orchestra.run.smithi161.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.1-325-g0fb32788-1jammy [237 kB] 2024-02-02T11:45:15.430 INFO:teuthology.orchestra.run.smithi161.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.1-325-g0fb32788-1jammy [130 kB] 2024-02-02T11:45:15.432 INFO:teuthology.orchestra.run.smithi161.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.1-325-g0fb32788-1jammy [1,484 kB] 2024-02-02T11:45:15.659 INFO:teuthology.orchestra.run.smithi161.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.1-325-g0fb32788-1jammy [9,875 kB] 2024-02-02T11:45:15.735 INFO:teuthology.orchestra.run.smithi162.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.1-325-g0fb32788-1jammy [92.9 kB] 2024-02-02T11:45:16.285 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 181 MB in 14s (13.2 MB/s) 2024-02-02T11:45:16.430 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyperclip. 2024-02-02T11:45:16.514 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-02-02T11:45:16.519 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-02-02T11:45:16.561 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-02-02T11:45:16.718 INFO:teuthology.orchestra.run.smithi161.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.1-325-g0fb32788-1jammy [31.5 MB] 2024-02-02T11:45:16.840 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-wcwidth. 2024-02-02T11:45:16.860 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-02-02T11:45:16.898 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-02T11:45:17.217 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cmd2. 2024-02-02T11:45:17.238 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-02-02T11:45:17.276 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-02-02T11:45:17.553 INFO:teuthology.orchestra.run.smithi177.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.1-325-g0fb32788-1jammy [31.5 MB] 2024-02-02T11:45:17.612 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libfmt8:amd64. 2024-02-02T11:45:17.632 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-02-02T11:45:17.712 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-02-02T11:45:18.007 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-02-02T11:45:18.027 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-02-02T11:45:18.057 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-02T11:45:18.344 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-02-02T11:45:18.364 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-02-02T11:45:18.393 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-02T11:45:18.755 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-02-02T11:45:18.776 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-02-02T11:45:18.813 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-02T11:45:19.409 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-02-02T11:45:19.429 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-02T11:45:19.466 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-02T11:45:19.854 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-02-02T11:45:19.863 INFO:teuthology.orchestra.run.smithi161.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.1-325-g0fb32788-1jammy [14.1 kB] 2024-02-02T11:45:19.864 INFO:teuthology.orchestra.run.smithi161.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.1-325-g0fb32788-1jammy [824 kB] 2024-02-02T11:45:19.874 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-02T11:45:19.880 INFO:teuthology.orchestra.run.smithi161.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.1-325-g0fb32788-1jammy [2,175 kB] 2024-02-02T11:45:19.912 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-02T11:45:19.918 INFO:teuthology.orchestra.run.smithi161.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.1-325-g0fb32788-1jammy [235 kB] 2024-02-02T11:45:19.922 INFO:teuthology.orchestra.run.smithi161.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.1-325-g0fb32788-1jammy [138 kB] 2024-02-02T11:45:19.924 INFO:teuthology.orchestra.run.smithi161.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.1-325-g0fb32788-1jammy [1,901 kB] 2024-02-02T11:45:20.092 INFO:teuthology.orchestra.run.smithi161.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.1-325-g0fb32788-1jammy [8,625 kB] 2024-02-02T11:45:20.257 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-02-02T11:45:20.277 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-02T11:45:20.315 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-02T11:45:20.693 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-02-02T11:45:20.714 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-02-02T11:45:20.752 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-02T11:45:20.794 INFO:teuthology.orchestra.run.smithi161.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.1-325-g0fb32788-1jammy [14.3 kB] 2024-02-02T11:45:20.795 INFO:teuthology.orchestra.run.smithi161.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.1-325-g0fb32788-1jammy [46.5 MB] 2024-02-02T11:45:21.080 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librados2. 2024-02-02T11:45:21.101 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../011-librados2_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:21.138 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librados2 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:21.591 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librbd1. 2024-02-02T11:45:21.612 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../012-librbd1_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:21.649 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librbd1 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:22.043 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libcephfs2. 2024-02-02T11:45:22.055 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../013-libcephfs2_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:22.085 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libcephfs2 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:22.388 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rados. 2024-02-02T11:45:22.399 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../014-python3-rados_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:22.438 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rados (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:22.766 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-02-02T11:45:22.786 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:45:22.824 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-ceph-argparse (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:23.077 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cephfs. 2024-02-02T11:45:23.098 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../016-python3-cephfs_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:23.135 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cephfs (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:23.239 INFO:teuthology.orchestra.run.smithi177.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.1-325-g0fb32788-1jammy [14.1 kB] 2024-02-02T11:45:23.240 INFO:teuthology.orchestra.run.smithi177.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.1-325-g0fb32788-1jammy [824 kB] 2024-02-02T11:45:23.347 INFO:teuthology.orchestra.run.smithi177.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.1-325-g0fb32788-1jammy [2,175 kB] 2024-02-02T11:45:23.454 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-ceph-common. 2024-02-02T11:45:23.475 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:45:23.512 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-ceph-common (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:23.648 INFO:teuthology.orchestra.run.smithi177.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.1-325-g0fb32788-1jammy [235 kB] 2024-02-02T11:45:23.667 INFO:teuthology.orchestra.run.smithi177.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.1-325-g0fb32788-1jammy [138 kB] 2024-02-02T11:45:23.702 INFO:teuthology.orchestra.run.smithi177.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.1-325-g0fb32788-1jammy [1,901 kB] 2024-02-02T11:45:23.858 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-prettytable. 2024-02-02T11:45:23.878 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-02-02T11:45:23.916 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-02-02T11:45:23.954 INFO:teuthology.orchestra.run.smithi177.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.1-325-g0fb32788-1jammy [8,625 kB] 2024-02-02T11:45:24.152 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rbd. 2024-02-02T11:45:24.164 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../019-python3-rbd_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:24.193 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rbd (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:24.564 INFO:teuthology.orchestra.run.smithi161.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.1-325-g0fb32788-1jammy [121 kB] 2024-02-02T11:45:24.566 INFO:teuthology.orchestra.run.smithi161.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.1-325-g0fb32788-1jammy [229 kB] 2024-02-02T11:45:24.570 INFO:teuthology.orchestra.run.smithi161.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.1-325-g0fb32788-1jammy [34.0 kB] 2024-02-02T11:45:24.571 INFO:teuthology.orchestra.run.smithi161.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.1-325-g0fb32788-1jammy [23.3 kB] 2024-02-02T11:45:24.626 INFO:teuthology.orchestra.run.smithi161.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.1-325-g0fb32788-1jammy [38.3 kB] 2024-02-02T11:45:24.627 INFO:teuthology.orchestra.run.smithi161.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.1-325-g0fb32788-1jammy [11.6 MB] 2024-02-02T11:45:24.663 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-02-02T11:45:24.684 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-02-02T11:45:24.722 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-02T11:45:25.058 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librgw2. 2024-02-02T11:45:25.059 INFO:teuthology.orchestra.run.smithi177.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.1-325-g0fb32788-1jammy [14.3 kB] 2024-02-02T11:45:25.060 INFO:teuthology.orchestra.run.smithi177.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.1-325-g0fb32788-1jammy [46.5 MB] 2024-02-02T11:45:25.079 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../021-librgw2_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:25.116 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librgw2 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:25.296 INFO:teuthology.orchestra.run.smithi161.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.1-325-g0fb32788-1jammy [92.9 kB] 2024-02-02T11:45:25.635 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rgw. 2024-02-02T11:45:25.656 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../022-python3-rgw_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:25.693 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rgw (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:25.853 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 181 MB in 25s (7,168 kB/s) 2024-02-02T11:45:25.979 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyperclip. 2024-02-02T11:45:26.024 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liboath0:amd64. 2024-02-02T11:45:26.025 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-02-02T11:45:26.029 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-02-02T11:45:26.045 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-02-02T11:45:26.082 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-02-02T11:45:26.096 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-02-02T11:45:26.390 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-wcwidth. 2024-02-02T11:45:26.401 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libradosstriper1. 2024-02-02T11:45:26.411 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-02-02T11:45:26.422 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../024-libradosstriper1_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:26.448 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-02T11:45:26.460 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libradosstriper1 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:26.709 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cmd2. 2024-02-02T11:45:26.721 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-02-02T11:45:26.751 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-02-02T11:45:26.838 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-common. 2024-02-02T11:45:26.859 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../025-ceph-common_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:26.896 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-common (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:27.304 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libfmt8:amd64. 2024-02-02T11:45:27.316 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-02-02T11:45:27.379 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-02-02T11:45:27.723 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-02-02T11:45:27.744 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-02-02T11:45:27.781 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-02T11:45:28.118 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-02-02T11:45:28.138 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-02-02T11:45:28.176 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-02T11:45:28.219 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-base. 2024-02-02T11:45:28.240 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../026-ceph-base_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:28.287 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-base (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:28.479 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-02-02T11:45:28.500 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-02-02T11:45:28.537 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-02T11:45:28.941 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-02-02T11:45:28.962 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-02T11:45:29.007 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-02T11:45:29.024 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-02-02T11:45:29.045 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-02-02T11:45:29.082 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-02-02T11:45:29.368 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cheroot. 2024-02-02T11:45:29.389 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-02-02T11:45:29.418 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-02T11:45:29.435 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-02-02T11:45:29.456 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-02T11:45:29.493 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-02T11:45:29.511 INFO:teuthology.orchestra.run.smithi177.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.1-325-g0fb32788-1jammy [121 kB] 2024-02-02T11:45:29.512 INFO:teuthology.orchestra.run.smithi177.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.1-325-g0fb32788-1jammy [229 kB] 2024-02-02T11:45:29.522 INFO:teuthology.orchestra.run.smithi177.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.1-325-g0fb32788-1jammy [34.0 kB] 2024-02-02T11:45:29.524 INFO:teuthology.orchestra.run.smithi177.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.1-325-g0fb32788-1jammy [23.3 kB] 2024-02-02T11:45:29.525 INFO:teuthology.orchestra.run.smithi177.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.1-325-g0fb32788-1jammy [38.3 kB] 2024-02-02T11:45:29.528 INFO:teuthology.orchestra.run.smithi177.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.1-325-g0fb32788-1jammy [11.6 MB] 2024-02-02T11:45:29.830 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-02-02T11:45:29.850 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-02T11:45:29.871 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-02-02T11:45:29.880 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-02T11:45:29.892 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-02-02T11:45:29.938 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-02-02T11:45:30.195 INFO:teuthology.orchestra.run.smithi177.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-02-02-1152/0fb327883c124fd83155c94db0804f823b805a12/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.1-325-g0fb32788-1jammy [92.9 kB] 2024-02-02T11:45:30.208 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-02-02T11:45:30.220 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-02-02T11:45:30.241 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.text. 2024-02-02T11:45:30.258 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-02T11:45:30.262 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-02-02T11:45:30.299 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-02-02T11:45:30.611 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librados2. 2024-02-02T11:45:30.627 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-02-02T11:45:30.631 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../011-librados2_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:30.648 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-02-02T11:45:30.669 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librados2 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:30.685 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-02-02T11:45:30.752 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 181 MB in 29s (6,134 kB/s) 2024-02-02T11:45:30.909 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyperclip. 2024-02-02T11:45:30.972 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-tempora. 2024-02-02T11:45:30.976 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2024-02-02T11:45:30.979 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-02-02T11:45:30.993 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-02-02T11:45:31.030 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-02-02T11:45:31.050 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-02-02T11:45:31.130 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librbd1. 2024-02-02T11:45:31.150 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../012-librbd1_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:31.188 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librbd1 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:31.333 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-portend. 2024-02-02T11:45:31.344 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-wcwidth. 2024-02-02T11:45:31.354 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-02-02T11:45:31.358 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-02-02T11:45:31.391 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-02-02T11:45:31.403 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-02T11:45:31.574 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs2. 2024-02-02T11:45:31.594 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../013-libcephfs2_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:31.624 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs2 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:31.694 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-02-02T11:45:31.696 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cmd2. 2024-02-02T11:45:31.711 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-02-02T11:45:31.715 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-02-02T11:45:31.747 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-02-02T11:45:31.752 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-02-02T11:45:31.885 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rados. 2024-02-02T11:45:31.905 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../014-python3-rados_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:32.031 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cherrypy3. 2024-02-02T11:45:32.041 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libfmt8:amd64. 2024-02-02T11:45:32.052 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-02-02T11:45:32.056 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-02-02T11:45:32.089 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-02-02T11:45:32.095 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rados (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:32.125 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-02-02T11:45:32.421 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-02-02T11:45:32.434 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-natsort. 2024-02-02T11:45:32.441 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:45:32.455 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-02-02T11:45:32.461 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-02-02T11:45:32.470 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-argparse (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:32.476 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-02-02T11:45:32.493 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-02-02T11:45:32.519 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-02T11:45:32.690 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cephfs. 2024-02-02T11:45:32.710 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../016-python3-cephfs_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:32.748 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cephfs (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:32.804 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-logutils. 2024-02-02T11:45:32.825 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-02-02T11:45:32.856 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-02-02T11:45:32.862 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-02-02T11:45:32.871 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-02-02T11:45:32.914 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-02T11:45:33.059 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-common. 2024-02-02T11:45:33.079 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:45:33.117 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-common (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:33.174 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-markupsafe. 2024-02-02T11:45:33.194 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-02-02T11:45:33.232 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-02-02T11:45:33.242 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-02-02T11:45:33.257 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-02-02T11:45:33.292 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-02T11:45:33.428 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-prettytable. 2024-02-02T11:45:33.448 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-02-02T11:45:33.485 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-mako. 2024-02-02T11:45:33.505 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-02-02T11:45:33.556 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-02T11:45:33.678 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-02-02T11:45:33.694 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-02T11:45:33.728 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-02-02T11:45:33.745 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-02T11:45:33.855 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-simplegeneric. 2024-02-02T11:45:33.875 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-02-02T11:45:33.922 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-02-02T11:45:34.148 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-02-02T11:45:34.163 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-02T11:45:34.206 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-02T11:45:34.225 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-singledispatch. 2024-02-02T11:45:34.245 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-02-02T11:45:34.283 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-02-02T11:45:34.481 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rbd. 2024-02-02T11:45:34.501 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../019-python3-rbd_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:34.526 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-02-02T11:45:34.539 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rbd (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:34.541 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-02T11:45:34.569 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-webob. 2024-02-02T11:45:34.576 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-02T11:45:34.590 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-02-02T11:45:34.627 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-02-02T11:45:34.892 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-02-02T11:45:34.896 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-02-02T11:45:34.910 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-02-02T11:45:34.912 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-02-02T11:45:34.950 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-02T11:45:34.953 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-02T11:45:34.981 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-waitress. 2024-02-02T11:45:35.001 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-02-02T11:45:35.042 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-02T11:45:35.265 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librados2. 2024-02-02T11:45:35.280 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../011-librados2_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:35.286 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librgw2. 2024-02-02T11:45:35.307 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../021-librgw2_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:35.323 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librados2 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:35.344 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librgw2 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:35.375 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-tempita. 2024-02-02T11:45:35.396 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-02-02T11:45:35.434 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-02-02T11:45:35.855 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rgw. 2024-02-02T11:45:35.867 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../022-python3-rgw_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:35.897 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rgw (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:35.917 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librbd1. 2024-02-02T11:45:35.933 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../012-librbd1_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:35.976 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librbd1 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:36.166 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liboath0:amd64. 2024-02-02T11:45:36.187 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-02-02T11:45:36.216 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-02-02T11:45:36.379 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libcephfs2. 2024-02-02T11:45:36.393 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../013-libcephfs2_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:36.437 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libcephfs2 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:36.535 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libradosstriper1. 2024-02-02T11:45:36.556 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../024-libradosstriper1_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:36.563 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-paste. 2024-02-02T11:45:36.584 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-02-02T11:45:36.594 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libradosstriper1 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:36.620 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-02-02T11:45:36.706 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rados. 2024-02-02T11:45:36.721 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../014-python3-rados_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:36.756 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rados (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:36.916 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-02-02T11:45:36.937 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-02-02T11:45:36.966 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-02-02T11:45:37.025 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-02-02T11:45:37.030 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-common. 2024-02-02T11:45:37.040 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:45:37.051 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../025-ceph-common_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:37.083 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-ceph-argparse (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:37.293 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pastedeploy. 2024-02-02T11:45:37.297 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-common (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:37.314 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-02-02T11:45:37.351 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-02-02T11:45:37.369 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cephfs. 2024-02-02T11:45:37.384 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../016-python3-cephfs_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:37.427 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cephfs (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:37.638 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-webtest. 2024-02-02T11:45:37.659 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-02-02T11:45:37.696 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-02-02T11:45:37.739 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-ceph-common. 2024-02-02T11:45:37.754 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:45:37.797 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-ceph-common (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:38.016 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pecan. 2024-02-02T11:45:38.037 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-02-02T11:45:38.074 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-02-02T11:45:38.125 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-prettytable. 2024-02-02T11:45:38.140 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-02-02T11:45:38.182 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-02-02T11:45:38.410 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rbd. 2024-02-02T11:45:38.425 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../019-python3-rbd_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:38.438 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-certifi. 2024-02-02T11:45:38.459 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-02-02T11:45:38.460 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rbd (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:38.496 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-02-02T11:45:38.694 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-base. 2024-02-02T11:45:38.715 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../026-ceph-base_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:38.777 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-base (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:38.788 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-02-02T11:45:38.799 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-idna. 2024-02-02T11:45:38.803 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-02-02T11:45:38.820 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2024-02-02T11:45:38.846 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-02T11:45:38.849 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-idna (3.3-1) ... 2024-02-02T11:45:39.191 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librgw2. 2024-02-02T11:45:39.194 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-urllib3. 2024-02-02T11:45:39.206 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../021-librgw2_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:39.215 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-02-02T11:45:39.249 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librgw2 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:39.252 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-02T11:45:39.573 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-02-02T11:45:39.580 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-requests. 2024-02-02T11:45:39.594 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-02-02T11:45:39.601 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-02-02T11:45:39.638 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-02T11:45:39.639 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-02-02T11:45:39.701 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rgw. 2024-02-02T11:45:39.716 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../022-python3-rgw_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:39.784 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rgw (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:39.959 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cheroot. 2024-02-02T11:45:39.980 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-02-02T11:45:40.017 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-02T11:45:40.062 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liboath0:amd64. 2024-02-02T11:45:40.077 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-02-02T11:45:40.112 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-02-02T11:45:40.118 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-werkzeug. 2024-02-02T11:45:40.139 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-02-02T11:45:40.200 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-02T11:45:40.387 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-02-02T11:45:40.407 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-02-02T11:45:40.415 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libradosstriper1. 2024-02-02T11:45:40.430 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../024-libradosstriper1_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:40.453 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-02-02T11:45:40.473 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libradosstriper1 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:40.494 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-02-02T11:45:40.507 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:45:40.544 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-modules-core (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:40.823 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.text. 2024-02-02T11:45:40.843 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-02-02T11:45:40.885 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-common. 2024-02-02T11:45:40.889 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-02-02T11:45:40.891 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-02-02T11:45:40.900 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../025-ceph-common_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:40.912 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:40.941 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libsqlite3-mod-ceph (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:40.943 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-common (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:41.259 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-02-02T11:45:41.261 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-openssl. 2024-02-02T11:45:41.279 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-02-02T11:45:41.282 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2024-02-02T11:45:41.319 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-02-02T11:45:41.325 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-02-02T11:45:41.656 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr. 2024-02-02T11:45:41.661 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tempora. 2024-02-02T11:45:41.677 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../058-ceph-mgr_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:41.681 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-02-02T11:45:41.714 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:41.719 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-02-02T11:45:41.973 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-base. 2024-02-02T11:45:41.988 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../026-ceph-base_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:42.040 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-base (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:42.056 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-portend. 2024-02-02T11:45:42.076 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-02-02T11:45:42.117 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mon. 2024-02-02T11:45:42.122 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-02-02T11:45:42.138 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../059-ceph-mon_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:42.175 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mon (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:42.492 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-02-02T11:45:42.512 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-02-02T11:45:42.558 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-02-02T11:45:42.702 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-02-02T11:45:42.716 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-02-02T11:45:42.760 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-02-02T11:45:42.927 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cherrypy3. 2024-02-02T11:45:42.948 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-02-02T11:45:42.994 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-02-02T11:45:42.996 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cheroot. 2024-02-02T11:45:43.011 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-02-02T11:45:43.046 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-02T11:45:43.096 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-osd. 2024-02-02T11:45:43.117 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../060-ceph-osd_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:43.162 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-osd (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:43.324 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-02-02T11:45:43.339 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-02-02T11:45:43.348 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-natsort. 2024-02-02T11:45:43.368 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-02-02T11:45:43.374 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-02-02T11:45:43.406 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-02-02T11:45:43.694 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jaraco.text. 2024-02-02T11:45:43.709 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-02-02T11:45:43.742 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-logutils. 2024-02-02T11:45:43.752 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-02-02T11:45:43.762 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-02-02T11:45:43.800 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-02-02T11:45:44.055 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-02-02T11:45:44.070 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-02-02T11:45:44.086 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-markupsafe. 2024-02-02T11:45:44.107 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-02-02T11:45:44.113 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-02-02T11:45:44.144 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-02-02T11:45:44.374 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-tempora. 2024-02-02T11:45:44.389 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-02-02T11:45:44.424 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-02-02T11:45:44.431 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-mako. 2024-02-02T11:45:44.451 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-02-02T11:45:44.489 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-02T11:45:44.685 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-portend. 2024-02-02T11:45:44.700 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-02-02T11:45:44.735 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-02-02T11:45:44.817 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplegeneric. 2024-02-02T11:45:44.838 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-02-02T11:45:44.875 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-02-02T11:45:45.063 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-02-02T11:45:45.065 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph. 2024-02-02T11:45:45.077 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-02-02T11:45:45.078 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../061-ceph_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:45.115 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:45.121 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-02-02T11:45:45.178 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-singledispatch. 2024-02-02T11:45:45.199 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-02-02T11:45:45.236 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-02-02T11:45:45.402 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-fuse. 2024-02-02T11:45:45.423 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../062-ceph-fuse_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:45.441 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cherrypy3. 2024-02-02T11:45:45.451 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-fuse (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:45.455 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-02-02T11:45:45.499 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-02-02T11:45:45.597 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webob. 2024-02-02T11:45:45.618 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-02-02T11:45:45.663 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-02-02T11:45:45.827 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-natsort. 2024-02-02T11:45:45.839 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mds. 2024-02-02T11:45:45.842 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-02-02T11:45:45.860 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../063-ceph-mds_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:45.885 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-02-02T11:45:45.897 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mds (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:46.083 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-waitress. 2024-02-02T11:45:46.104 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-02-02T11:45:46.153 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-02T11:45:46.300 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephadm. 2024-02-02T11:45:46.321 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../064-cephadm_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:46.358 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephadm (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:46.397 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-logutils. 2024-02-02T11:45:46.412 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-02-02T11:45:46.455 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-02-02T11:45:46.536 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tempita. 2024-02-02T11:45:46.557 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-02-02T11:45:46.594 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-02-02T11:45:46.678 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-asyncssh. 2024-02-02T11:45:46.699 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2024-02-02T11:45:46.728 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-02-02T11:45:46.758 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-markupsafe. 2024-02-02T11:45:46.773 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-02-02T11:45:46.816 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-02-02T11:45:46.939 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-paste. 2024-02-02T11:45:46.960 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-02-02T11:45:47.005 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-02-02T11:45:47.040 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python-babel-localedata. 2024-02-02T11:45:47.060 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-02-02T11:45:47.071 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-mako. 2024-02-02T11:45:47.084 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-02-02T11:45:47.106 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-02T11:45:47.119 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-02T11:45:47.375 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-02-02T11:45:47.396 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-02-02T11:45:47.450 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-02-02T11:45:47.472 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-simplegeneric. 2024-02-02T11:45:47.487 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-02-02T11:45:47.530 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-02-02T11:45:47.833 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-singledispatch. 2024-02-02T11:45:47.848 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-02-02T11:45:47.891 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-02-02T11:45:47.986 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastedeploy. 2024-02-02T11:45:48.007 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-02-02T11:45:48.044 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-02-02T11:45:48.203 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-webob. 2024-02-02T11:45:48.217 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-02-02T11:45:48.236 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-babel. 2024-02-02T11:45:48.252 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-02-02T11:45:48.257 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-02-02T11:45:48.294 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-02-02T11:45:48.355 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webtest. 2024-02-02T11:45:48.376 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-02-02T11:45:48.413 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-02-02T11:45:48.547 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-waitress. 2024-02-02T11:45:48.562 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-02-02T11:45:48.624 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-02T11:45:48.631 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jinja2. 2024-02-02T11:45:48.652 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-02-02T11:45:48.666 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pecan. 2024-02-02T11:45:48.681 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-02T11:45:48.683 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-02-02T11:45:48.724 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-02-02T11:45:48.891 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-tempita. 2024-02-02T11:45:48.906 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-02-02T11:45:48.941 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-02-02T11:45:49.010 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-02-02T11:45:49.022 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:45:49.051 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-cephadm (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:49.064 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-certifi. 2024-02-02T11:45:49.086 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-02-02T11:45:49.123 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-02-02T11:45:49.244 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-paste. 2024-02-02T11:45:49.259 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-02-02T11:45:49.302 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-02-02T11:45:49.389 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-bcrypt. 2024-02-02T11:45:49.409 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-02-02T11:45:49.446 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-02-02T11:45:49.459 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-idna. 2024-02-02T11:45:49.480 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2024-02-02T11:45:49.517 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-idna (3.3-1) ... 2024-02-02T11:45:49.630 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-02-02T11:45:49.645 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-02-02T11:45:49.688 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-02-02T11:45:49.750 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pluggy. 2024-02-02T11:45:49.770 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-02-02T11:45:49.807 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-02-02T11:45:49.828 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-urllib3. 2024-02-02T11:45:49.849 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-02-02T11:45:49.886 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-02T11:45:49.949 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pastedeploy. 2024-02-02T11:45:49.964 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-02-02T11:45:49.999 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-02-02T11:45:50.119 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-py. 2024-02-02T11:45:50.140 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-02-02T11:45:50.198 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-requests. 2024-02-02T11:45:50.219 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-02-02T11:45:50.248 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-02T11:45:50.302 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-webtest. 2024-02-02T11:45:50.317 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-02-02T11:45:50.328 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-py (1.10.0-1) ... 2024-02-02T11:45:50.360 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-02-02T11:45:50.543 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-werkzeug. 2024-02-02T11:45:50.563 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-02-02T11:45:50.601 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-02T11:45:50.655 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pecan. 2024-02-02T11:45:50.670 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-02-02T11:45:50.713 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-02-02T11:45:50.748 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-iniconfig. 2024-02-02T11:45:50.769 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-02-02T11:45:50.806 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-02-02T11:45:50.887 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-02-02T11:45:50.899 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:45:50.928 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-modules-core (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:51.067 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-toml. 2024-02-02T11:45:51.088 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-02-02T11:45:51.101 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-certifi. 2024-02-02T11:45:51.116 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-02-02T11:45:51.126 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-02-02T11:45:51.159 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-02-02T11:45:51.309 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-02-02T11:45:51.330 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:51.367 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libsqlite3-mod-ceph (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:51.429 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pytest. 2024-02-02T11:45:51.450 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-02-02T11:45:51.487 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-02-02T11:45:51.487 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-idna. 2024-02-02T11:45:51.502 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2024-02-02T11:45:51.545 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-idna (3.3-1) ... 2024-02-02T11:45:51.669 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-openssl. 2024-02-02T11:45:51.682 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2024-02-02T11:45:51.711 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-02-02T11:45:51.915 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-urllib3. 2024-02-02T11:45:51.930 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-02-02T11:45:51.932 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-repoze.lru. 2024-02-02T11:45:51.954 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-02-02T11:45:51.965 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-02T11:45:51.990 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-02-02T11:45:52.039 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr. 2024-02-02T11:45:52.060 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../058-ceph-mgr_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:52.097 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:52.260 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-requests. 2024-02-02T11:45:52.275 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-02-02T11:45:52.294 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-routes. 2024-02-02T11:45:52.315 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-02-02T11:45:52.334 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-02T11:45:52.352 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-02-02T11:45:52.534 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mon. 2024-02-02T11:45:52.555 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../059-ceph-mon_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:52.592 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mon (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:52.637 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-werkzeug. 2024-02-02T11:45:52.652 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-02-02T11:45:52.695 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-02T11:45:52.706 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-02-02T11:45:52.727 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:45:52.764 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-dashboard (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:52.940 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-02-02T11:45:52.955 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:45:52.990 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-modules-core (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:53.176 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-02-02T11:45:53.193 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-02-02T11:45:53.234 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-02T11:45:53.361 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-02-02T11:45:53.375 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:53.419 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libsqlite3-mod-ceph (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:53.454 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-osd. 2024-02-02T11:45:53.475 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../060-ceph-osd_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:53.520 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-osd (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:53.730 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-joblib. 2024-02-02T11:45:53.730 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-openssl. 2024-02-02T11:45:53.745 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2024-02-02T11:45:53.750 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-02-02T11:45:53.780 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-02-02T11:45:53.787 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-02-02T11:45:54.050 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr. 2024-02-02T11:45:54.065 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../058-ceph-mgr_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:54.099 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:54.150 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-02-02T11:45:54.170 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-02-02T11:45:54.208 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-02-02T11:45:54.461 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-sklearn. 2024-02-02T11:45:54.478 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mon. 2024-02-02T11:45:54.481 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-02-02T11:45:54.493 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../059-ceph-mon_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:54.519 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-02T11:45:54.536 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mon (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:55.322 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-02-02T11:45:55.343 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:45:55.356 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-osd. 2024-02-02T11:45:55.371 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../060-ceph-osd_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:55.388 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:55.414 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-osd (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:55.424 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph. 2024-02-02T11:45:55.445 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../061-ceph_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:55.482 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:55.801 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-fuse. 2024-02-02T11:45:55.822 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../062-ceph-fuse_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:55.859 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-fuse (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:56.204 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mds. 2024-02-02T11:45:56.225 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../063-ceph-mds_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:56.262 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mds (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:56.617 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cachetools. 2024-02-02T11:45:56.632 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephadm. 2024-02-02T11:45:56.638 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-02-02T11:45:56.653 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../064-cephadm_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:56.674 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-02-02T11:45:56.690 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephadm (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:56.703 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph. 2024-02-02T11:45:56.718 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../061-ceph_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:56.761 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:56.995 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyasn1. 2024-02-02T11:45:57.015 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-02-02T11:45:57.018 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-asyncssh. 2024-02-02T11:45:57.040 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2024-02-02T11:45:57.047 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-fuse. 2024-02-02T11:45:57.052 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-02-02T11:45:57.062 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../062-ceph-fuse_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:57.076 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-02-02T11:45:57.097 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-fuse (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:57.398 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-02-02T11:45:57.404 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-babel-localedata. 2024-02-02T11:45:57.414 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-02-02T11:45:57.419 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-02-02T11:45:57.425 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mds. 2024-02-02T11:45:57.440 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../063-ceph-mds_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:57.454 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-02T11:45:57.456 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-02-02T11:45:57.491 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mds (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:57.776 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rsa. 2024-02-02T11:45:57.797 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-02-02T11:45:57.834 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rsa (4.8-1) ... 2024-02-02T11:45:57.870 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package cephadm. 2024-02-02T11:45:57.884 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../064-cephadm_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:45:57.919 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking cephadm (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:58.155 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-google-auth. 2024-02-02T11:45:58.176 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-02-02T11:45:58.215 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-asyncssh. 2024-02-02T11:45:58.221 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-02-02T11:45:58.229 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2024-02-02T11:45:58.272 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-02-02T11:45:58.542 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-02-02T11:45:58.550 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-babel-localedata. 2024-02-02T11:45:58.562 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-02-02T11:45:58.564 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-02-02T11:45:58.600 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-02T11:45:58.600 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-02T11:45:58.701 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-babel. 2024-02-02T11:45:58.723 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-02-02T11:45:58.767 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-02-02T11:45:58.911 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-websocket. 2024-02-02T11:45:58.932 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-02-02T11:45:58.969 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-02-02T11:45:59.104 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jinja2. 2024-02-02T11:45:59.126 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-02-02T11:45:59.162 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-02T11:45:59.306 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-kubernetes. 2024-02-02T11:45:59.327 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-02-02T11:45:59.364 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-02T11:45:59.532 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-02-02T11:45:59.554 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:45:59.579 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-babel. 2024-02-02T11:45:59.590 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-cephadm (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:45:59.593 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-02-02T11:45:59.638 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-02-02T11:45:59.969 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-bcrypt. 2024-02-02T11:45:59.974 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jinja2. 2024-02-02T11:45:59.987 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-02-02T11:45:59.990 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-02-02T11:46:00.003 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-02-02T11:46:00.017 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:46:00.032 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-02T11:46:00.035 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-02-02T11:46:00.061 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-k8sevents (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:00.338 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pluggy. 2024-02-02T11:46:00.360 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-02-02T11:46:00.360 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-02-02T11:46:00.373 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libonig5:amd64. 2024-02-02T11:46:00.374 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:46:00.395 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-02-02T11:46:00.405 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-02-02T11:46:00.418 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-cephadm (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:00.439 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-02T11:46:00.725 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-py. 2024-02-02T11:46:00.742 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libjq1:amd64. 2024-02-02T11:46:00.746 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-02-02T11:46:00.747 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-bcrypt. 2024-02-02T11:46:00.755 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-02-02T11:46:00.761 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-02-02T11:46:00.783 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-py (1.10.0-1) ... 2024-02-02T11:46:00.784 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-02T11:46:00.805 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-02-02T11:46:01.045 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package jq. 2024-02-02T11:46:01.057 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-02-02T11:46:01.095 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-02-02T11:46:01.108 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pluggy. 2024-02-02T11:46:01.122 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-02-02T11:46:01.136 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-iniconfig. 2024-02-02T11:46:01.157 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-02-02T11:46:01.166 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-02-02T11:46:01.194 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-02-02T11:46:01.365 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package socat. 2024-02-02T11:46:01.377 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-02-02T11:46:01.406 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-02-02T11:46:01.464 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-toml. 2024-02-02T11:46:01.469 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-py. 2024-02-02T11:46:01.484 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-02-02T11:46:01.485 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-02-02T11:46:01.519 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-py (1.10.0-1) ... 2024-02-02T11:46:01.522 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-02-02T11:46:01.676 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package xmlstarlet. 2024-02-02T11:46:01.689 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-02-02T11:46:01.726 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-02-02T11:46:01.797 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-iniconfig. 2024-02-02T11:46:01.813 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-02-02T11:46:01.825 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pytest. 2024-02-02T11:46:01.847 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-02-02T11:46:01.864 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-02-02T11:46:01.892 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-02-02T11:46:02.056 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-test. 2024-02-02T11:46:02.068 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../098-ceph-test_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:46:02.097 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-test (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:02.167 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-toml. 2024-02-02T11:46:02.182 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-02-02T11:46:02.204 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-repoze.lru. 2024-02-02T11:46:02.225 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-02-02T11:46:02.225 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-02-02T11:46:02.262 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-02-02T11:46:02.536 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pytest. 2024-02-02T11:46:02.551 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-02-02T11:46:02.573 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-routes. 2024-02-02T11:46:02.594 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-02-02T11:46:02.595 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-02-02T11:46:02.640 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-02-02T11:46:02.915 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-repoze.lru. 2024-02-02T11:46:02.930 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-02-02T11:46:02.973 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-02-02T11:46:02.985 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-02-02T11:46:03.006 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:46:03.051 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-dashboard (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:03.275 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-routes. 2024-02-02T11:46:03.289 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-02-02T11:46:03.333 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-02-02T11:46:03.488 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-02-02T11:46:03.510 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-02-02T11:46:03.546 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-02T11:46:03.694 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-02-02T11:46:03.709 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:46:03.753 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-dashboard (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:04.042 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-joblib. 2024-02-02T11:46:04.063 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-02-02T11:46:04.100 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-02-02T11:46:04.140 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-02-02T11:46:04.154 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-02-02T11:46:04.207 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-02T11:46:04.360 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-volume. 2024-02-02T11:46:04.381 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../099-ceph-volume_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:46:04.426 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-volume (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:04.453 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-02-02T11:46:04.475 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-02-02T11:46:04.519 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-02-02T11:46:04.693 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-joblib. 2024-02-02T11:46:04.707 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-02-02T11:46:04.751 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-02-02T11:46:04.789 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn. 2024-02-02T11:46:04.811 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-02-02T11:46:04.814 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephfs-mirror. 2024-02-02T11:46:04.836 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:46:04.855 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-02T11:46:04.881 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephfs-mirror (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:05.113 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-02-02T11:46:05.127 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-02-02T11:46:05.171 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-02-02T11:46:05.201 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-colorama. 2024-02-02T11:46:05.222 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-02-02T11:46:05.267 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-02-02T11:46:05.424 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-sklearn. 2024-02-02T11:46:05.438 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-02-02T11:46:05.474 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-02T11:46:05.545 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephfs-shell. 2024-02-02T11:46:05.567 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../102-cephfs-shell_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:46:05.611 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephfs-shell (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:05.650 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-02-02T11:46:05.672 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:46:05.716 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:05.867 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephfs-top. 2024-02-02T11:46:05.888 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../103-cephfs-top_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:46:05.933 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephfs-top (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:06.186 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libcephfs-dev. 2024-02-02T11:46:06.198 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:46:06.234 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-02-02T11:46:06.236 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libcephfs-dev (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:06.248 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:46:06.292 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:06.695 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cachetools. 2024-02-02T11:46:06.716 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-02-02T11:46:06.761 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-02-02T11:46:06.856 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package nvme-cli. 2024-02-02T11:46:06.877 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-02-02T11:46:06.914 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-02-02T11:46:07.064 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1. 2024-02-02T11:46:07.085 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-02-02T11:46:07.130 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-02-02T11:46:07.227 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-02-02T11:46:07.240 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-02-02T11:46:07.277 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-02-02T11:46:07.345 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cachetools. 2024-02-02T11:46:07.360 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-02-02T11:46:07.395 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-02-02T11:46:07.442 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-02-02T11:46:07.454 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-02-02T11:46:07.484 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-02-02T11:46:07.680 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pastescript. 2024-02-02T11:46:07.702 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-02-02T11:46:07.723 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyasn1. 2024-02-02T11:46:07.738 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-02-02T11:46:07.738 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-02-02T11:46:07.745 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rsa. 2024-02-02T11:46:07.757 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-02-02T11:46:07.781 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-02-02T11:46:07.786 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rsa (4.8-1) ... 2024-02-02T11:46:08.042 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-psutil. 2024-02-02T11:46:08.054 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-02-02T11:46:08.091 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-02-02T11:46:08.109 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-02-02T11:46:08.124 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-02-02T11:46:08.167 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-02-02T11:46:08.190 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-google-auth. 2024-02-02T11:46:08.212 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-02-02T11:46:08.257 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-02-02T11:46:08.429 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pygments. 2024-02-02T11:46:08.449 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-02-02T11:46:08.454 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rsa. 2024-02-02T11:46:08.469 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-02-02T11:46:08.486 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-02-02T11:46:08.503 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rsa (4.8-1) ... 2024-02-02T11:46:08.765 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-google-auth. 2024-02-02T11:46:08.781 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-02-02T11:46:08.823 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-02-02T11:46:08.827 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-02-02T11:46:08.849 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-02-02T11:46:08.893 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-02T11:46:08.924 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyinotify. 2024-02-02T11:46:08.945 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-02-02T11:46:08.990 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-02-02T11:46:09.135 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-02-02T11:46:09.150 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-02-02T11:46:09.193 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-02T11:46:09.205 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-websocket. 2024-02-02T11:46:09.226 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-02-02T11:46:09.271 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-02-02T11:46:09.310 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-simplejson. 2024-02-02T11:46:09.331 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-02-02T11:46:09.376 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-02-02T11:46:09.513 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-websocket. 2024-02-02T11:46:09.528 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-02-02T11:46:09.571 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-02-02T11:46:09.616 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-kubernetes. 2024-02-02T11:46:09.638 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-02-02T11:46:09.645 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-02-02T11:46:09.658 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-02-02T11:46:09.683 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-02T11:46:09.695 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-02-02T11:46:09.883 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-kubernetes. 2024-02-02T11:46:09.898 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-02-02T11:46:09.965 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-02T11:46:10.438 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-02-02T11:46:10.460 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:46:10.483 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package radosgw. 2024-02-02T11:46:10.504 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../113-radosgw_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:46:10.513 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-k8sevents (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:10.549 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking radosgw (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:10.571 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-02-02T11:46:10.585 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:46:10.621 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-k8sevents (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:10.907 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libonig5:amd64. 2024-02-02T11:46:10.916 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libonig5:amd64. 2024-02-02T11:46:10.921 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-02-02T11:46:10.937 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-02-02T11:46:10.965 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-02T11:46:10.990 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-02T11:46:11.294 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package rbd-fuse. 2024-02-02T11:46:11.315 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../114-rbd-fuse_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:46:11.326 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libjq1:amd64. 2024-02-02T11:46:11.340 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-02-02T11:46:11.360 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking rbd-fuse (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:11.361 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjq1:amd64. 2024-02-02T11:46:11.382 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-02-02T11:46:11.384 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-02T11:46:11.427 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-02T11:46:11.645 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package jq. 2024-02-02T11:46:11.659 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-02-02T11:46:11.670 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-02-02T11:46:11.704 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-02-02T11:46:11.713 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package jq. 2024-02-02T11:46:11.725 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-02-02T11:46:11.771 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-02-02T11:46:11.924 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package socat. 2024-02-02T11:46:11.924 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-02T11:46:11.937 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-02-02T11:46:11.981 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-02-02T11:46:12.049 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-02-02T11:46:12.074 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package socat. 2024-02-02T11:46:12.095 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-02-02T11:46:12.140 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-02-02T11:46:12.267 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package xmlstarlet. 2024-02-02T11:46:12.282 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-02-02T11:46:12.313 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-02-02T11:46:12.325 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-02-02T11:46:12.494 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package xmlstarlet. 2024-02-02T11:46:12.515 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-02-02T11:46:12.560 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-02-02T11:46:12.632 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-02-02T11:46:12.680 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-test. 2024-02-02T11:46:12.694 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../098-ceph-test_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:46:12.738 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-test (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:12.923 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-test. 2024-02-02T11:46:12.944 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../098-ceph-test_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:46:12.981 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-test (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:13.071 INFO:teuthology.orchestra.run.smithi162.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-02-02T11:46:13.134 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephadm (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:13.736 INFO:teuthology.orchestra.run.smithi162.stdout:Adding system user cephadm....done 2024-02-02T11:46:13.891 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-02T11:46:14.159 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-02-02T11:46:14.402 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-02-02T11:46:14.500 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-volume. 2024-02-02T11:46:14.516 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../099-ceph-volume_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:46:14.528 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-02-02T11:46:14.558 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-volume (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:14.779 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-02-02T11:46:14.971 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package cephfs-mirror. 2024-02-02T11:46:14.987 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:46:15.029 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking cephfs-mirror (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:15.039 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-02-02T11:46:15.173 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-py (1.10.0-1) ... 2024-02-02T11:46:15.202 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-volume. 2024-02-02T11:46:15.223 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../099-ceph-volume_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:46:15.268 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-volume (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:15.316 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-colorama. 2024-02-02T11:46:15.331 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-02-02T11:46:15.365 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-02-02T11:46:15.475 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-02-02T11:46:15.576 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package cephfs-shell. 2024-02-02T11:46:15.592 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../102-cephfs-shell_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:46:15.614 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephfs-mirror. 2024-02-02T11:46:15.634 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking cephfs-shell (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:15.636 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:46:15.681 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephfs-mirror (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:15.852 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-02-02T11:46:15.879 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package cephfs-top. 2024-02-02T11:46:15.895 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../103-cephfs-top_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:46:15.929 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking cephfs-top (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:16.019 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-colorama. 2024-02-02T11:46:16.039 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-02-02T11:46:16.084 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-02-02T11:46:16.102 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-02-02T11:46:16.131 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libcephfs-dev. 2024-02-02T11:46:16.147 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:46:16.199 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libcephfs-dev (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:16.337 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-02-02T11:46:16.345 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephfs-shell. 2024-02-02T11:46:16.366 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../102-cephfs-shell_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:46:16.403 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephfs-shell (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:16.567 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package nvme-cli. 2024-02-02T11:46:16.583 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-02-02T11:46:16.621 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-02-02T11:46:16.625 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-02-02T11:46:16.630 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephfs-top. 2024-02-02T11:46:16.643 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../103-cephfs-top_18.2.1-325-g0fb32788-1jammy_all.deb ... 2024-02-02T11:46:16.680 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephfs-top (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:16.873 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-02-02T11:46:16.909 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs-dev. 2024-02-02T11:46:16.930 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:46:16.930 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-02-02T11:46:16.945 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-02-02T11:46:16.975 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs-dev (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:16.988 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-02-02T11:46:17.133 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-02-02T11:46:17.383 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pastescript. 2024-02-02T11:46:17.384 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-ceph-argparse (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:17.398 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-02-02T11:46:17.453 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-02-02T11:46:17.554 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package nvme-cli. 2024-02-02T11:46:17.575 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-02-02T11:46:17.628 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-02-02T11:46:17.727 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-02T11:46:17.869 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-02-02T11:46:17.920 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-psutil. 2024-02-02T11:46:17.935 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-02-02T11:46:17.977 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-02-02T11:46:18.008 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-02-02T11:46:18.030 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-02-02T11:46:18.083 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-02-02T11:46:18.112 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-02-02T11:46:18.264 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pygments. 2024-02-02T11:46:18.280 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-02-02T11:46:18.314 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-02-02T11:46:18.371 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-02T11:46:18.497 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-02-02T11:46:18.578 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastescript. 2024-02-02T11:46:18.599 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-02-02T11:46:18.652 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-02-02T11:46:18.785 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyinotify. 2024-02-02T11:46:18.800 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-02-02T11:46:18.842 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-02-02T11:46:18.865 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-02T11:46:18.991 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-02-02T11:46:19.039 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-psutil. 2024-02-02T11:46:19.061 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-02-02T11:46:19.106 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-02-02T11:46:19.162 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-simplejson. 2024-02-02T11:46:19.177 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-02-02T11:46:19.220 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-02-02T11:46:19.242 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-02-02T11:46:19.459 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pygments. 2024-02-02T11:46:19.480 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-02-02T11:46:19.489 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-02-02T11:46:19.504 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-02-02T11:46:19.510 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-02-02T11:46:19.525 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-02-02T11:46:19.547 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-02-02T11:46:19.828 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-02-02T11:46:19.971 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyinotify. 2024-02-02T11:46:19.984 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-02-02T11:46:20.021 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-02-02T11:46:20.243 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package radosgw. 2024-02-02T11:46:20.257 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../113-radosgw_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:46:20.301 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking radosgw (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:20.324 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplejson. 2024-02-02T11:46:20.346 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-02-02T11:46:20.390 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-02-02T11:46:20.539 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-02-02T11:46:20.660 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-02-02T11:46:20.682 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-02-02T11:46:20.726 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-02-02T11:46:20.806 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-02-02T11:46:20.871 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package rbd-fuse. 2024-02-02T11:46:20.885 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../114-rbd-fuse_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:46:20.929 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking rbd-fuse (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:20.932 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-02-02T11:46:21.042 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-02T11:46:21.255 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-02-02T11:46:21.334 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-02-02T11:46:21.439 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package radosgw. 2024-02-02T11:46:21.461 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../113-radosgw_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:46:21.505 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking radosgw (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:21.533 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-02T11:46:21.634 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-02-02T11:46:21.719 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-02-02T11:46:21.883 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-02-02T11:46:21.970 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-02-02T11:46:22.208 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package rbd-fuse. 2024-02-02T11:46:22.220 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../114-rbd-fuse_18.2.1-325-g0fb32788-1jammy_amd64.deb ... 2024-02-02T11:46:22.254 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-02-02T11:46:22.258 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking rbd-fuse (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:22.363 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-02T11:46:22.559 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-02-02T11:46:22.657 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-02-02T11:46:22.828 INFO:teuthology.orchestra.run.smithi177.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-02-02T11:46:22.862 INFO:teuthology.orchestra.run.smithi177.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-02-02T11:46:22.871 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-02T11:46:22.902 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up cephadm (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:22.966 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-02T11:46:23.022 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-02-02T11:46:23.301 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-02-02T11:46:23.314 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-02-02T11:46:23.422 INFO:teuthology.orchestra.run.smithi177.stdout:Adding system user cephadm....done 2024-02-02T11:46:23.543 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-02-02T11:46:23.567 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-02T11:46:23.651 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-02-02T11:46:23.669 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-ceph-common (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:23.843 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-02-02T11:46:23.963 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-idna (3.3-1) ... 2024-02-02T11:46:24.102 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-02-02T11:46:24.170 INFO:teuthology.orchestra.run.smithi161.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-02-02T11:46:24.228 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-02-02T11:46:24.297 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-02T11:46:24.496 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-02-02T11:46:24.608 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephadm (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:24.764 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-02-02T11:46:24.890 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-py (1.10.0-1) ... 2024-02-02T11:46:25.118 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user cephadm....done 2024-02-02T11:46:25.217 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-02-02T11:46:25.272 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-02T11:46:25.411 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-02T11:46:25.540 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-02-02T11:46:25.545 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-toml (0.10.2-1) ... 2024-02-02T11:46:25.568 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-02-02T11:46:25.796 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-02T11:46:25.800 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-02-02T11:46:25.837 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-02-02T11:46:25.931 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-02-02T11:46:25.943 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-02-02T11:46:26.057 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-02T11:46:26.113 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-02-02T11:46:26.227 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-02-02T11:46:26.358 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-02-02T11:46:26.405 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-02-02T11:46:26.495 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-02-02T11:46:26.626 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-02-02T11:46:26.663 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-py (1.10.0-1) ... 2024-02-02T11:46:26.673 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-02-02T11:46:26.869 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-02T11:46:26.995 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-02-02T11:46:27.006 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-02-02T11:46:27.041 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-02-02T11:46:27.121 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-02-02T11:46:27.308 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-ceph-argparse (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:27.383 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-02-02T11:46:27.568 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-02T11:46:27.631 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-02-02T11:46:27.642 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-02-02T11:46:27.694 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-02-02T11:46:27.882 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-02-02T11:46:27.918 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-02-02T11:46:27.978 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-02-02T11:46:28.133 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-02-02T11:46:28.195 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-02-02T11:46:28.246 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-02T11:46:28.372 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-02-02T11:46:28.384 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-02-02T11:46:28.462 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-02-02T11:46:28.627 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-02-02T11:46:28.738 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-02-02T11:46:28.739 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-02T11:46:28.865 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-02-02T11:46:28.878 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-02T11:46:29.004 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-02-02T11:46:29.006 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-argparse (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:29.134 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-02-02T11:46:29.283 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-02T11:46:29.288 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-02T11:46:29.384 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-02-02T11:46:29.409 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-02-02T11:46:29.414 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-02T11:46:29.676 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-02-02T11:46:29.677 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-02-02T11:46:29.741 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-02-02T11:46:29.961 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-02T11:46:30.025 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-02-02T11:46:30.112 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-02-02T11:46:30.293 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-02-02T11:46:30.362 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-02-02T11:46:30.488 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-02T11:46:30.614 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-02-02T11:46:30.630 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-02-02T11:46:30.728 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-02-02T11:46:30.756 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-02-02T11:46:30.874 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-02T11:46:30.882 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-02-02T11:46:30.979 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-02T11:46:31.114 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-02-02T11:46:31.150 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-02-02T11:46:31.208 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-02-02T11:46:31.451 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-02-02T11:46:31.515 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-02-02T11:46:31.584 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-02-02T11:46:31.766 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-portend (3.0.0-1) ... 2024-02-02T11:46:31.827 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-02-02T11:46:32.017 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-02T11:46:32.127 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-02T11:46:32.136 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-02-02T11:46:32.204 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-02T11:46:32.404 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-02-02T11:46:32.428 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-02-02T11:46:32.505 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-02-02T11:46:32.555 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-02-02T11:46:32.706 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-02T11:46:32.720 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-02T11:46:32.848 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-02T11:46:33.007 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-02-02T11:46:33.024 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-02-02T11:46:33.131 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rsa (4.8-1) ... 2024-02-02T11:46:33.199 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-02-02T11:46:33.400 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-02-02T11:46:33.407 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-02-02T11:46:33.442 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-02-02T11:46:33.542 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-ceph-common (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:33.660 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-02-02T11:46:33.666 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-02T11:46:33.827 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-idna (3.3-1) ... 2024-02-02T11:46:33.926 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-02-02T11:46:34.036 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-02T11:46:34.162 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-02T11:46:34.278 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-02-02T11:46:34.329 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-02-02T11:46:34.579 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-02-02T11:46:34.630 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-02T11:46:34.940 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-02T11:46:34.975 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-02-02T11:46:35.041 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librados2 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:35.158 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librgw2 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:35.227 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-02-02T11:46:35.344 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-common (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:35.367 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-02T11:46:35.370 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libsqlite3-mod-ceph (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:35.496 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libcephfs2 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:35.501 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-toml (0.10.2-1) ... 2024-02-02T11:46:35.630 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libradosstriper1 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:35.654 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-idna (3.3-1) ... 2024-02-02T11:46:35.757 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-02-02T11:46:35.769 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-02T11:46:35.895 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-02-02T11:46:36.005 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-02T11:46:36.020 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-02T11:46:36.033 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librbd1 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:36.159 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-modules-core (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:36.285 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-fuse (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:36.322 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-02-02T11:46:36.497 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-02T11:46:36.497 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-02T11:46:36.598 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-02-02T11:46:36.841 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-02T11:46:36.950 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-02-02T11:46:37.045 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libcephfs-dev (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:37.051 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-02-02T11:46:37.171 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rados (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:37.177 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-02T11:46:37.297 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephfs-top (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:37.337 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-toml (0.10.2-1) ... 2024-02-02T11:46:37.352 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-02-02T11:46:37.423 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-02T11:46:37.613 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-02T11:46:37.653 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-02-02T11:46:37.739 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-02-02T11:46:37.865 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-02T11:46:37.921 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-02-02T11:46:38.158 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-02-02T11:46:38.435 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-02-02T11:46:38.455 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-02-02T11:46:38.644 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rbd (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:38.694 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-02T11:46:38.715 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-02-02T11:46:38.770 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up rbd-fuse (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:38.803 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-02-02T11:46:38.896 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rgw (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:38.904 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-02-02T11:46:38.991 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-02T11:46:39.022 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cephfs (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:39.100 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-02-02T11:46:39.140 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephfs-shell (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:39.222 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-02-02T11:46:39.241 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-common (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:39.368 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-02T11:46:39.469 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-02T11:46:39.490 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-02-02T11:46:39.759 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-02-02T11:46:39.778 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-02-02T11:46:39.784 INFO:teuthology.orchestra.run.smithi162.stdout:Adding group ceph....done 2024-02-02T11:46:40.088 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-02-02T11:46:40.093 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-02-02T11:46:40.186 INFO:teuthology.orchestra.run.smithi162.stdout:Adding system user ceph....done 2024-02-02T11:46:40.338 INFO:teuthology.orchestra.run.smithi162.stdout:Setting system user ceph properties....done 2024-02-02T11:46:40.355 INFO:teuthology.orchestra.run.smithi162.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-02-02T11:46:40.355 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-02-02T11:46:40.371 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-02-02T11:46:40.489 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-02-02T11:46:40.628 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-02T11:46:40.737 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-02-02T11:46:40.745 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-02-02T11:46:40.866 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-02-02T11:46:40.992 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-02T11:46:41.005 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-02T11:46:41.092 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-02-02T11:46:41.131 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-02T11:46:41.409 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephfs-mirror (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:41.424 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-02-02T11:46:41.504 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-02-02T11:46:41.628 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-02-02T11:46:41.628 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-02-02T11:46:41.734 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-02-02T11:46:41.780 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-portend (3.0.0-1) ... 2024-02-02T11:46:41.993 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-02-02T11:46:42.048 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-02T11:46:42.161 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-test (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:42.174 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-02T11:46:42.287 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up radosgw (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:42.422 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-02-02T11:46:42.500 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-02-02T11:46:42.671 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-02T11:46:42.776 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-02T11:46:42.776 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-02T11:46:42.797 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-02-02T11:46:42.801 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-02T11:46:43.060 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-02-02T11:46:43.182 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-02-02T11:46:43.186 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rsa (4.8-1) ... 2024-02-02T11:46:43.280 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-base (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:43.450 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-portend (3.0.0-1) ... 2024-02-02T11:46:43.471 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-02-02T11:46:43.607 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-02-02T11:46:43.710 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-02T11:46:43.755 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-02T11:46:43.836 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-02T11:46:44.023 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-02-02T11:46:44.149 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mds (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:44.153 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-02-02T11:46:44.350 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-02T11:46:44.350 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-02T11:46:44.408 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-02-02T11:46:44.438 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-02T11:46:44.692 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-02-02T11:46:44.706 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-02-02T11:46:44.832 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rsa (4.8-1) ... 2024-02-02T11:46:44.859 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:45.036 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-02T11:46:45.080 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-02T11:46:45.080 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-02T11:46:45.108 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-02-02T11:46:45.170 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librados2 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:45.305 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librgw2 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:45.392 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-02T11:46:45.516 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libsqlite3-mod-ceph (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:45.585 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-osd (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:45.617 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libcephfs2 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:45.660 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-02-02T11:46:45.718 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libradosstriper1 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:45.827 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-02-02T11:46:45.904 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-02T11:46:45.904 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-02T11:46:46.037 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-02-02T11:46:46.120 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librbd1 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:46.280 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-modules-core (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:46.305 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-02-02T11:46:46.406 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-fuse (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:46.496 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-k8sevents (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:46.616 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-02T11:46:46.616 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-02T11:46:46.622 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-diskprediction-local (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:46.648 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-02T11:46:46.757 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mon (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:46.774 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librados2 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:46.901 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librgw2 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:46.975 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-02T11:46:46.975 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-02T11:46:47.096 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libsqlite3-mod-ceph (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:47.199 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libcephfs-dev (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:47.213 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs2 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:47.325 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rados (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:47.339 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libradosstriper1 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:47.465 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-02-02T11:46:47.484 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up cephfs-top (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:47.530 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-cephadm (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:47.610 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-02T11:46:47.750 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librbd1 (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:47.868 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:47.876 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-modules-core (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:48.002 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-fuse (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:48.122 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-dashboard (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:48.231 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-02T11:46:48.232 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-02T11:46:48.355 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-volume (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:48.803 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs-dev (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:48.807 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-02T11:46:48.882 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rbd (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:48.913 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rados (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:49.007 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up rbd-fuse (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:49.039 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephfs-top (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:49.125 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rgw (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:49.165 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-02T11:46:49.226 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cephfs (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:49.327 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up cephfs-shell (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:49.436 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-common (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:49.591 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-02T11:46:49.998 INFO:teuthology.orchestra.run.smithi177.stdout:Adding group ceph....done 2024-02-02T11:46:50.095 INFO:teuthology.orchestra.run.smithi162.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-02T11:46:50.098 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-02-02T11:46:50.196 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-02-02T11:46:50.324 INFO:teuthology.orchestra.run.smithi177.stdout:Adding system user ceph....done 2024-02-02T11:46:50.352 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rbd (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:50.386 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2024-02-02T11:46:50.387 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2024-02-02T11:46:50.476 INFO:teuthology.orchestra.run.smithi177.stdout:Setting system user ceph properties....done 2024-02-02T11:46:50.478 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up rbd-fuse (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:50.496 INFO:teuthology.orchestra.run.smithi177.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-02-02T11:46:50.553 INFO:teuthology.orchestra.run.smithi162.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-02-02T11:46:50.553 INFO:teuthology.orchestra.run.smithi162.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-02-02T11:46:50.553 INFO:teuthology.orchestra.run.smithi162.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-02-02T11:46:50.553 INFO:teuthology.orchestra.run.smithi162.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-02-02T11:46:50.553 INFO:teuthology.orchestra.run.smithi162.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-02-02T11:46:50.554 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2024-02-02T11:46:50.554 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-02T11:46:50.554 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-02T11:46:50.554 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-02T11:46:50.554 INFO:teuthology.orchestra.run.smithi162.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-02-02T11:46:50.554 INFO:teuthology.orchestra.run.smithi162.stdout: python2.7-minimal 2024-02-02T11:46:50.554 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-02T11:46:50.555 INFO:teuthology.orchestra.run.smithi162.stdout:The following additional packages will be installed: 2024-02-02T11:46:50.555 INFO:teuthology.orchestra.run.smithi162.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-02-02T11:46:50.555 INFO:teuthology.orchestra.run.smithi162.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-02-02T11:46:50.556 INFO:teuthology.orchestra.run.smithi162.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-02-02T11:46:50.556 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-02-02T11:46:50.556 INFO:teuthology.orchestra.run.smithi162.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-02-02T11:46:50.557 INFO:teuthology.orchestra.run.smithi162.stdout:Suggested packages: 2024-02-02T11:46:50.557 INFO:teuthology.orchestra.run.smithi162.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-02-02T11:46:50.557 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-02-02T11:46:50.557 INFO:teuthology.orchestra.run.smithi162.stdout: libengine-pkcs11-openssl 2024-02-02T11:46:50.579 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rgw (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:50.594 INFO:teuthology.orchestra.run.smithi162.stdout:The following NEW packages will be installed: 2024-02-02T11:46:50.594 INFO:teuthology.orchestra.run.smithi162.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-02-02T11:46:50.594 INFO:teuthology.orchestra.run.smithi162.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-02-02T11:46:50.595 INFO:teuthology.orchestra.run.smithi162.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-02-02T11:46:50.595 INFO:teuthology.orchestra.run.smithi162.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-02-02T11:46:50.595 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-02-02T11:46:50.595 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-02-02T11:46:50.595 INFO:teuthology.orchestra.run.smithi162.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-02-02T11:46:50.596 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages will be upgraded: 2024-02-02T11:46:50.596 INFO:teuthology.orchestra.run.smithi162.stdout: libssl3 2024-02-02T11:46:50.635 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-02-02T11:46:50.705 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cephfs (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:50.736 INFO:teuthology.orchestra.run.smithi162.stdout:1 upgraded, 39 newly installed, 0 to remove and 271 not upgraded. 2024-02-02T11:46:50.736 INFO:teuthology.orchestra.run.smithi162.stdout:Need to get 54.6 MB of archives. 2024-02-02T11:46:50.736 INFO:teuthology.orchestra.run.smithi162.stdout:After this operation, 202 MB of additional disk space will be used. 2024-02-02T11:46:50.737 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-02-02T11:46:50.831 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephfs-shell (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:50.859 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.13 [1,902 kB] 2024-02-02T11:46:50.932 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-02-02T11:46:50.946 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-02-02T11:46:50.947 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-02-02T11:46:50.950 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-02-02T11:46:50.951 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-02-02T11:46:50.952 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-02-02T11:46:50.954 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-02-02T11:46:50.955 INFO:teuthology.orchestra.run.smithi162.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-02-02T11:46:50.955 INFO:teuthology.orchestra.run.smithi162.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-02-02T11:46:50.957 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-common (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:50.958 INFO:teuthology.orchestra.run.smithi162.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-02-02T11:46:50.977 INFO:teuthology.orchestra.run.smithi162.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-02-02T11:46:50.988 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-02-02T11:46:51.331 INFO:teuthology.orchestra.run.smithi162.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-02-02T11:46:51.333 INFO:teuthology.orchestra.run.smithi162.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-02-02T11:46:51.333 INFO:teuthology.orchestra.run.smithi162.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-02-02T11:46:51.336 INFO:teuthology.orchestra.run.smithi162.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-02-02T11:46:51.336 INFO:teuthology.orchestra.run.smithi162.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-02-02T11:46:51.341 INFO:teuthology.orchestra.run.smithi162.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-02-02T11:46:51.342 INFO:teuthology.orchestra.run.smithi162.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-02-02T11:46:51.350 INFO:teuthology.orchestra.run.smithi162.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-02-02T11:46:51.350 INFO:teuthology.orchestra.run.smithi162.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.13 [2,374 kB] 2024-02-02T11:46:51.373 INFO:teuthology.orchestra.run.smithi162.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-02-02T11:46:51.373 INFO:teuthology.orchestra.run.smithi162.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-02-02T11:46:51.385 INFO:teuthology.orchestra.run.smithi162.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-02-02T11:46:51.410 INFO:teuthology.orchestra.run.smithi162.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-02-02T11:46:51.414 INFO:teuthology.orchestra.run.smithi162.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-02-02T11:46:51.414 INFO:teuthology.orchestra.run.smithi162.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-02-02T11:46:51.414 INFO:teuthology.orchestra.run.smithi162.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-02-02T11:46:51.415 INFO:teuthology.orchestra.run.smithi162.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-02-02T11:46:51.426 INFO:teuthology.orchestra.run.smithi162.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-02-02T11:46:51.428 INFO:teuthology.orchestra.run.smithi162.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-02-02T11:46:51.458 INFO:teuthology.orchestra.run.smithi161.stdout:Adding group ceph....done 2024-02-02T11:46:51.579 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up cephfs-mirror (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:51.719 INFO:teuthology.orchestra.run.smithi162.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-02-02T11:46:51.719 INFO:teuthology.orchestra.run.smithi162.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-02-02T11:46:51.719 INFO:teuthology.orchestra.run.smithi162.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-02-02T11:46:51.719 INFO:teuthology.orchestra.run.smithi162.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-02-02T11:46:51.719 INFO:teuthology.orchestra.run.smithi162.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-02-02T11:46:51.719 INFO:teuthology.orchestra.run.smithi162.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-02-02T11:46:51.731 INFO:teuthology.orchestra.run.smithi162.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-02-02T11:46:51.731 INFO:teuthology.orchestra.run.smithi162.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-02-02T11:46:51.798 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-02-02T11:46:51.798 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-02-02T11:46:51.836 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user ceph....done 2024-02-02T11:46:52.011 INFO:teuthology.orchestra.run.smithi161.stdout:Setting system user ceph properties....done 2024-02-02T11:46:52.025 INFO:teuthology.orchestra.run.smithi161.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-02-02T11:46:52.129 INFO:teuthology.orchestra.run.smithi162.stdout:Preconfiguring packages ... 2024-02-02T11:46:52.166 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-02-02T11:46:52.292 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 54.6 MB in 1s (48.4 MB/s) 2024-02-02T11:46:52.347 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-test (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:52.431 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package flex. 2024-02-02T11:46:52.506 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up radosgw (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:52.510 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137421 files and directories currently installed.) 2024-02-02T11:46:52.514 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-02-02T11:46:52.543 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-02-02T11:46:52.555 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking flex (2.6.4-8build2) ... 2024-02-02T11:46:53.012 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-02T11:46:53.013 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-02T11:46:53.142 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephfs-mirror (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:53.266 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.13_amd64.deb ... 2024-02-02T11:46:53.355 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-02-02T11:46:53.355 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-02-02T11:46:53.445 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.13) over (3.0.2-0ubuntu1.7) ... 2024-02-02T11:46:53.600 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-base (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:53.858 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.13) ... 2024-02-02T11:46:53.919 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-test (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:53.959 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-02-02T11:46:54.036 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up radosgw (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:54.388 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package bison. 2024-02-02T11:46:54.477 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137494 files and directories currently installed.) 2024-02-02T11:46:54.481 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-02-02T11:46:54.532 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-02-02T11:46:54.629 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-02T11:46:54.630 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-02T11:46:54.646 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mds (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:54.877 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-02T11:46:54.877 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-02T11:46:55.008 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-02-02T11:46:55.029 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-02-02T11:46:55.082 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-02-02T11:46:55.436 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package dump. 2024-02-02T11:46:55.457 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-02-02T11:46:55.472 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:55.487 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-base (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:55.502 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking dump (0.4b47-3) ... 2024-02-02T11:46:55.685 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-02T11:46:55.685 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-02T11:46:55.831 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package indent. 2024-02-02T11:46:55.852 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-02-02T11:46:55.889 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-02-02T11:46:55.906 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-02-02T11:46:56.250 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-02-02T11:46:56.265 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-osd (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:56.271 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-02-02T11:46:56.325 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-02-02T11:46:56.407 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mds (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:56.592 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-02T11:46:56.592 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-02T11:46:56.645 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-02T11:46:56.645 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-02T11:46:56.703 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-02-02T11:46:56.725 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-02-02T11:46:56.780 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-02-02T11:46:57.092 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-02-02T11:46:57.113 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-02-02T11:46:57.166 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-02-02T11:46:57.191 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-k8sevents (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:57.201 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:57.317 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-diskprediction-local (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:57.420 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-02T11:46:57.420 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-02T11:46:57.477 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mon (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:57.578 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libfl2:amd64. 2024-02-02T11:46:57.599 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-02-02T11:46:57.652 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-02-02T11:46:57.686 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-02T11:46:57.686 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-02T11:46:57.938 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-02-02T11:46:57.943 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-osd (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:57.951 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-02-02T11:46:57.988 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-02-02T11:46:58.247 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-02T11:46:58.247 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-02T11:46:58.261 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-cephadm (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:58.287 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libjson-perl. 2024-02-02T11:46:58.310 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-02-02T11:46:58.412 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:58.539 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-dashboard (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:58.595 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-02-02T11:46:58.706 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-volume (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:58.753 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-k8sevents (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:58.880 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-diskprediction-local (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:59.031 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mon (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:59.075 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-02T11:46:59.195 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libllvm14:amd64. 2024-02-02T11:46:59.217 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-02-02T11:46:59.261 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-02-02T11:46:59.262 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-02T11:46:59.262 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-02T11:46:59.782 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-cephadm (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:46:59.925 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:47:00.051 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-dashboard (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:47:00.203 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-volume (18.2.1-325-g0fb32788-1jammy) ... 2024-02-02T11:47:00.344 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-02T11:47:00.606 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-02T11:47:00.802 INFO:teuthology.orchestra.run.smithi177.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-02T11:47:00.807 DEBUG:teuthology.orchestra.run.smithi177:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-02-02T11:47:00.879 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2024-02-02T11:47:00.972 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-02-02T11:47:00.994 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-02-02T11:47:01.030 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-02-02T11:47:01.044 INFO:teuthology.orchestra.run.smithi177.stdout:Building dependency tree... 2024-02-02T11:47:01.045 INFO:teuthology.orchestra.run.smithi177.stdout:Reading state information... 2024-02-02T11:47:01.197 INFO:teuthology.orchestra.run.smithi177.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-02-02T11:47:01.197 INFO:teuthology.orchestra.run.smithi177.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-02-02T11:47:01.198 INFO:teuthology.orchestra.run.smithi177.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-02-02T11:47:01.198 INFO:teuthology.orchestra.run.smithi177.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-02-02T11:47:01.198 INFO:teuthology.orchestra.run.smithi177.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-02-02T11:47:01.198 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages were automatically installed and are no longer required: 2024-02-02T11:47:01.198 INFO:teuthology.orchestra.run.smithi177.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-02T11:47:01.198 INFO:teuthology.orchestra.run.smithi177.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-02T11:47:01.198 INFO:teuthology.orchestra.run.smithi177.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-02T11:47:01.198 INFO:teuthology.orchestra.run.smithi177.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-02T11:47:01.198 INFO:teuthology.orchestra.run.smithi177.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-02T11:47:01.198 INFO:teuthology.orchestra.run.smithi177.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-02T11:47:01.200 INFO:teuthology.orchestra.run.smithi177.stdout:The following additional packages will be installed: 2024-02-02T11:47:01.201 INFO:teuthology.orchestra.run.smithi177.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-02-02T11:47:01.201 INFO:teuthology.orchestra.run.smithi177.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-02-02T11:47:01.201 INFO:teuthology.orchestra.run.smithi177.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-02-02T11:47:01.201 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-02-02T11:47:01.201 INFO:teuthology.orchestra.run.smithi177.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-02-02T11:47:01.201 INFO:teuthology.orchestra.run.smithi177.stdout:Suggested packages: 2024-02-02T11:47:01.201 INFO:teuthology.orchestra.run.smithi177.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-02-02T11:47:01.201 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-02-02T11:47:01.201 INFO:teuthology.orchestra.run.smithi177.stdout: libengine-pkcs11-openssl 2024-02-02T11:47:01.247 INFO:teuthology.orchestra.run.smithi177.stdout:The following NEW packages will be installed: 2024-02-02T11:47:01.247 INFO:teuthology.orchestra.run.smithi177.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-02-02T11:47:01.247 INFO:teuthology.orchestra.run.smithi177.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-02-02T11:47:01.248 INFO:teuthology.orchestra.run.smithi177.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-02-02T11:47:01.248 INFO:teuthology.orchestra.run.smithi177.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-02-02T11:47:01.248 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-02-02T11:47:01.248 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-02-02T11:47:01.249 INFO:teuthology.orchestra.run.smithi177.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-02-02T11:47:01.249 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages will be upgraded: 2024-02-02T11:47:01.249 INFO:teuthology.orchestra.run.smithi177.stdout: libssl3 2024-02-02T11:47:01.316 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libmbim-proxy. 2024-02-02T11:47:01.329 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-02-02T11:47:01.366 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-02-02T11:47:01.706 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-02T11:47:01.719 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-02-02T11:47:01.741 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-02-02T11:47:01.785 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-02-02T11:47:02.105 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libndp0:amd64. 2024-02-02T11:47:02.117 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-02-02T11:47:02.154 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-02-02T11:47:02.209 INFO:teuthology.orchestra.run.smithi161.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-02T11:47:02.212 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-02-02T11:47:02.307 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2024-02-02T11:47:02.458 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libnm0:amd64. 2024-02-02T11:47:02.480 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-02-02T11:47:02.497 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2024-02-02T11:47:02.498 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2024-02-02T11:47:02.524 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-02-02T11:47:02.631 INFO:teuthology.orchestra.run.smithi177.stdout:1 upgraded, 39 newly installed, 0 to remove and 271 not upgraded. 2024-02-02T11:47:02.631 INFO:teuthology.orchestra.run.smithi177.stdout:Need to get 54.6 MB of archives. 2024-02-02T11:47:02.631 INFO:teuthology.orchestra.run.smithi177.stdout:After this operation, 202 MB of additional disk space will be used. 2024-02-02T11:47:02.631 INFO:teuthology.orchestra.run.smithi177.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-02-02T11:47:02.664 INFO:teuthology.orchestra.run.smithi161.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-02-02T11:47:02.664 INFO:teuthology.orchestra.run.smithi161.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-02-02T11:47:02.664 INFO:teuthology.orchestra.run.smithi161.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-02-02T11:47:02.664 INFO:teuthology.orchestra.run.smithi161.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-02-02T11:47:02.664 INFO:teuthology.orchestra.run.smithi161.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-02-02T11:47:02.664 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages were automatically installed and are no longer required: 2024-02-02T11:47:02.665 INFO:teuthology.orchestra.run.smithi161.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-02T11:47:02.665 INFO:teuthology.orchestra.run.smithi161.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-02T11:47:02.665 INFO:teuthology.orchestra.run.smithi161.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-02T11:47:02.666 INFO:teuthology.orchestra.run.smithi161.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-02-02T11:47:02.666 INFO:teuthology.orchestra.run.smithi161.stdout: python2.7-minimal 2024-02-02T11:47:02.666 INFO:teuthology.orchestra.run.smithi161.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-02T11:47:02.666 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2024-02-02T11:47:02.666 INFO:teuthology.orchestra.run.smithi161.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-02-02T11:47:02.666 INFO:teuthology.orchestra.run.smithi161.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-02-02T11:47:02.666 INFO:teuthology.orchestra.run.smithi161.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-02-02T11:47:02.667 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-02-02T11:47:02.667 INFO:teuthology.orchestra.run.smithi161.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-02-02T11:47:02.667 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2024-02-02T11:47:02.667 INFO:teuthology.orchestra.run.smithi161.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-02-02T11:47:02.667 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-02-02T11:47:02.668 INFO:teuthology.orchestra.run.smithi161.stdout: libengine-pkcs11-openssl 2024-02-02T11:47:02.703 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2024-02-02T11:47:02.703 INFO:teuthology.orchestra.run.smithi161.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-02-02T11:47:02.703 INFO:teuthology.orchestra.run.smithi161.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-02-02T11:47:02.704 INFO:teuthology.orchestra.run.smithi161.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-02-02T11:47:02.704 INFO:teuthology.orchestra.run.smithi161.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-02-02T11:47:02.704 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-02-02T11:47:02.704 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-02-02T11:47:02.704 INFO:teuthology.orchestra.run.smithi161.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-02-02T11:47:02.705 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages will be upgraded: 2024-02-02T11:47:02.705 INFO:teuthology.orchestra.run.smithi161.stdout: libssl3 2024-02-02T11:47:02.759 INFO:teuthology.orchestra.run.smithi177.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.13 [1,902 kB] 2024-02-02T11:47:02.836 INFO:teuthology.orchestra.run.smithi177.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-02-02T11:47:02.845 INFO:teuthology.orchestra.run.smithi177.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-02-02T11:47:02.846 INFO:teuthology.orchestra.run.smithi177.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-02-02T11:47:02.848 INFO:teuthology.orchestra.run.smithi177.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-02-02T11:47:02.849 INFO:teuthology.orchestra.run.smithi177.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-02-02T11:47:02.849 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-02-02T11:47:02.850 INFO:teuthology.orchestra.run.smithi177.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-02-02T11:47:02.851 INFO:teuthology.orchestra.run.smithi177.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-02-02T11:47:02.852 INFO:teuthology.orchestra.run.smithi177.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-02-02T11:47:02.858 INFO:teuthology.orchestra.run.smithi177.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-02-02T11:47:02.873 INFO:teuthology.orchestra.run.smithi177.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-02-02T11:47:02.877 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libpq5:amd64. 2024-02-02T11:47:02.884 INFO:teuthology.orchestra.run.smithi161.stdout:1 upgraded, 39 newly installed, 0 to remove and 271 not upgraded. 2024-02-02T11:47:02.884 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 54.6 MB of archives. 2024-02-02T11:47:02.885 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 202 MB of additional disk space will be used. 2024-02-02T11:47:02.885 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-02-02T11:47:02.898 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-02-02T11:47:02.943 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-02-02T11:47:03.160 INFO:teuthology.orchestra.run.smithi177.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-02-02T11:47:03.169 INFO:teuthology.orchestra.run.smithi177.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-02-02T11:47:03.169 INFO:teuthology.orchestra.run.smithi177.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-02-02T11:47:03.172 INFO:teuthology.orchestra.run.smithi177.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-02-02T11:47:03.172 INFO:teuthology.orchestra.run.smithi177.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-02-02T11:47:03.177 INFO:teuthology.orchestra.run.smithi177.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-02-02T11:47:03.178 INFO:teuthology.orchestra.run.smithi177.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-02-02T11:47:03.186 INFO:teuthology.orchestra.run.smithi177.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-02-02T11:47:03.186 INFO:teuthology.orchestra.run.smithi177.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.13 [2,374 kB] 2024-02-02T11:47:03.216 INFO:teuthology.orchestra.run.smithi177.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-02-02T11:47:03.229 INFO:teuthology.orchestra.run.smithi177.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-02-02T11:47:03.241 INFO:teuthology.orchestra.run.smithi177.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-02-02T11:47:03.263 INFO:teuthology.orchestra.run.smithi177.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-02-02T11:47:03.271 INFO:teuthology.orchestra.run.smithi177.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-02-02T11:47:03.272 INFO:teuthology.orchestra.run.smithi177.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-02-02T11:47:03.273 INFO:teuthology.orchestra.run.smithi177.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-02-02T11:47:03.274 INFO:teuthology.orchestra.run.smithi177.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-02-02T11:47:03.293 INFO:teuthology.orchestra.run.smithi177.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-02-02T11:47:03.294 INFO:teuthology.orchestra.run.smithi177.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-02-02T11:47:03.296 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-02-02T11:47:03.318 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-02-02T11:47:03.362 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-02-02T11:47:03.367 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.13 [1,902 kB] 2024-02-02T11:47:03.510 INFO:teuthology.orchestra.run.smithi177.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-02-02T11:47:03.510 INFO:teuthology.orchestra.run.smithi177.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-02-02T11:47:03.511 INFO:teuthology.orchestra.run.smithi177.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-02-02T11:47:03.511 INFO:teuthology.orchestra.run.smithi177.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-02-02T11:47:03.511 INFO:teuthology.orchestra.run.smithi177.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-02-02T11:47:03.511 INFO:teuthology.orchestra.run.smithi177.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-02-02T11:47:03.524 INFO:teuthology.orchestra.run.smithi177.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-02-02T11:47:03.525 INFO:teuthology.orchestra.run.smithi177.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-02-02T11:47:03.624 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-02-02T11:47:03.649 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqmi-proxy. 2024-02-02T11:47:03.658 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-02-02T11:47:03.660 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-02-02T11:47:03.661 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-02-02T11:47:03.665 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-02-02T11:47:03.669 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-02-02T11:47:03.669 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-02-02T11:47:03.672 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-02-02T11:47:03.674 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-02-02T11:47:03.675 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-02-02T11:47:03.690 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-02-02T11:47:03.839 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-02-02T11:47:03.894 INFO:teuthology.orchestra.run.smithi177.stdout:Preconfiguring packages ... 2024-02-02T11:47:03.977 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-02-02T11:47:03.999 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.13_amd64.deb ... 2024-02-02T11:47:04.041 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 54.6 MB in 2s (24.1 MB/s) 2024-02-02T11:47:04.043 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.13) ... 2024-02-02T11:47:04.161 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-02-02T11:47:04.184 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package flex. 2024-02-02T11:47:04.254 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139847 files and directories currently installed.) 2024-02-02T11:47:04.258 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-02-02T11:47:04.299 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking flex (2.6.4-8build2) ... 2024-02-02T11:47:04.580 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-02-02T11:47:04.601 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-02-02T11:47:04.654 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-02-02T11:47:04.819 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.13_amd64.deb ... 2024-02-02T11:47:04.979 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.13) over (3.0.2-0ubuntu1.7) ... 2024-02-02T11:47:05.091 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package modemmanager. 2024-02-02T11:47:05.112 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-02-02T11:47:05.166 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-02-02T11:47:05.329 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-02-02T11:47:05.334 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-02-02T11:47:05.335 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-02-02T11:47:05.342 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-02-02T11:47:05.343 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-02-02T11:47:05.353 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-02-02T11:47:05.357 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-02-02T11:47:05.374 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-02-02T11:47:05.374 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.13 [2,374 kB] 2024-02-02T11:47:05.375 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.13) ... 2024-02-02T11:47:05.611 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-02-02T11:47:05.695 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-02-02T11:47:05.830 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package network-manager. 2024-02-02T11:47:05.852 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-02-02T11:47:05.888 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package bison. 2024-02-02T11:47:05.905 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-02-02T11:47:05.961 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139920 files and directories currently installed.) 2024-02-02T11:47:05.965 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-02-02T11:47:06.007 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-02-02T11:47:06.175 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-02-02T11:47:06.304 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-02-02T11:47:06.316 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-02-02T11:47:06.318 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-02-02T11:47:06.319 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-02-02T11:47:06.320 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-02-02T11:47:06.352 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-02-02T11:47:06.357 INFO:teuthology.orchestra.run.smithi161.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-02-02T11:47:06.474 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-02-02T11:47:06.489 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-02-02T11:47:06.533 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-02-02T11:47:06.554 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ppp. 2024-02-02T11:47:06.575 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-02-02T11:47:06.859 INFO:teuthology.orchestra.run.smithi161.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-02-02T11:47:06.869 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package dump. 2024-02-02T11:47:06.883 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-02-02T11:47:06.909 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-02-02T11:47:06.927 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking dump (0.4b47-3) ... 2024-02-02T11:47:07.023 INFO:teuthology.orchestra.run.smithi161.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-02-02T11:47:07.108 INFO:teuthology.orchestra.run.smithi161.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-02-02T11:47:07.108 INFO:teuthology.orchestra.run.smithi161.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-02-02T11:47:07.192 INFO:teuthology.orchestra.run.smithi161.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-02-02T11:47:07.197 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package indent. 2024-02-02T11:47:07.199 INFO:teuthology.orchestra.run.smithi161.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-02-02T11:47:07.212 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-02-02T11:47:07.247 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-02-02T11:47:07.266 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package pptp-linux. 2024-02-02T11:47:07.288 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-02-02T11:47:07.333 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-02-02T11:47:07.467 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-02-02T11:47:07.481 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-02-02T11:47:07.525 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-02-02T11:47:07.627 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package network-manager-pptp. 2024-02-02T11:47:07.649 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-02-02T11:47:07.675 INFO:teuthology.orchestra.run.smithi161.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-02-02T11:47:07.677 INFO:teuthology.orchestra.run.smithi161.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-02-02T11:47:07.702 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-02-02T11:47:07.862 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-02-02T11:47:07.877 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-02-02T11:47:07.920 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-02-02T11:47:08.022 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-client-common. 2024-02-02T11:47:08.043 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-02-02T11:47:08.084 INFO:teuthology.orchestra.run.smithi161.stdout:Preconfiguring packages ... 2024-02-02T11:47:08.088 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-client-common (238) ... 2024-02-02T11:47:08.181 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-02-02T11:47:08.196 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-02-02T11:47:08.239 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-02-02T11:47:08.242 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 54.6 MB in 5s (11.0 MB/s) 2024-02-02T11:47:08.389 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package flex. 2024-02-02T11:47:08.392 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-client-14. 2024-02-02T11:47:08.413 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-02-02T11:47:08.458 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-02T11:47:08.475 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137421 files and directories currently installed.) 2024-02-02T11:47:08.480 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-02-02T11:47:08.500 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libfl2:amd64. 2024-02-02T11:47:08.516 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-02-02T11:47:08.521 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking flex (2.6.4-8build2) ... 2024-02-02T11:47:08.550 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-02-02T11:47:08.811 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-02-02T11:47:08.827 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-02-02T11:47:08.869 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-02-02T11:47:09.098 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.13_amd64.deb ... 2024-02-02T11:47:09.122 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libjson-perl. 2024-02-02T11:47:09.138 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-02-02T11:47:09.189 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-02-02T11:47:09.220 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-common. 2024-02-02T11:47:09.242 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-02-02T11:47:09.269 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.13) over (3.0.2-0ubuntu1.7) ... 2024-02-02T11:47:09.400 INFO:teuthology.orchestra.run.smithi162.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-02-02T11:47:09.438 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-common (238) ... 2024-02-02T11:47:09.483 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libllvm14:amd64. 2024-02-02T11:47:09.499 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-02-02T11:47:09.533 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-02-02T11:47:09.684 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.13) ... 2024-02-02T11:47:09.931 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-14. 2024-02-02T11:47:09.953 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-02-02T11:47:10.000 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-02T11:47:10.245 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package bison. 2024-02-02T11:47:10.331 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137494 files and directories currently installed.) 2024-02-02T11:47:10.336 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-02-02T11:47:10.389 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-02-02T11:47:10.869 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-02-02T11:47:10.885 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-02-02T11:47:10.927 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-02-02T11:47:11.008 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-02-02T11:47:11.030 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-02-02T11:47:11.082 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-02-02T11:47:11.238 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libmbim-proxy. 2024-02-02T11:47:11.254 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-02-02T11:47:11.292 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql. 2024-02-02T11:47:11.296 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-02-02T11:47:11.305 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-02-02T11:47:11.341 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql (14+238) ... 2024-02-02T11:47:11.444 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package dump. 2024-02-02T11:47:11.466 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-02-02T11:47:11.510 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking dump (0.4b47-3) ... 2024-02-02T11:47:11.552 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-client. 2024-02-02T11:47:11.574 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-02-02T11:47:11.607 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-02-02T11:47:11.610 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-client (14+238) ... 2024-02-02T11:47:11.623 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-02-02T11:47:11.657 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-02-02T11:47:11.839 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package indent. 2024-02-02T11:47:11.845 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-contrib. 2024-02-02T11:47:11.851 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-02-02T11:47:11.868 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-02-02T11:47:11.897 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-02-02T11:47:11.912 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-contrib (14+238) ... 2024-02-02T11:47:11.926 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libndp0:amd64. 2024-02-02T11:47:11.942 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-02-02T11:47:11.976 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-02-02T11:47:12.208 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-02-02T11:47:12.230 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-02-02T11:47:12.240 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package tcl8.6. 2024-02-02T11:47:12.254 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libnm0:amd64. 2024-02-02T11:47:12.262 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-02-02T11:47:12.270 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-02-02T11:47:12.283 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-02-02T11:47:12.306 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-02-02T11:47:12.312 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-02-02T11:47:12.652 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package tcl. 2024-02-02T11:47:12.662 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-02-02T11:47:12.673 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-02-02T11:47:12.682 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libpq5:amd64. 2024-02-02T11:47:12.684 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-02-02T11:47:12.697 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-02-02T11:47:12.728 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-02-02T11:47:12.730 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-02-02T11:47:12.739 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-02-02T11:47:13.023 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-02-02T11:47:13.044 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-02-02T11:47:13.059 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-02-02T11:47:13.075 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-02-02T11:47:13.097 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-02-02T11:47:13.109 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-02-02T11:47:13.162 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package wpasupplicant. 2024-02-02T11:47:13.184 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-02-02T11:47:13.237 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-02-02T11:47:13.395 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqmi-proxy. 2024-02-02T11:47:13.410 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-02-02T11:47:13.452 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-02-02T11:47:13.509 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libfl2:amd64. 2024-02-02T11:47:13.531 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-02-02T11:47:13.593 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-02-02T11:47:13.633 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-02-02T11:47:13.655 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-02-02T11:47:13.707 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-02-02T11:47:13.722 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-02-02T11:47:13.737 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.13_amd64.deb ... 2024-02-02T11:47:13.772 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.13) ... 2024-02-02T11:47:13.895 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-02-02T11:47:13.908 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-02-02T11:47:13.953 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-02-02T11:47:14.102 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package usb-modeswitch. 2024-02-02T11:47:14.124 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-02-02T11:47:14.176 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-02-02T11:47:14.214 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjson-perl. 2024-02-02T11:47:14.236 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-02-02T11:47:14.275 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-02-02T11:47:14.281 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-02-02T11:47:14.291 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-02-02T11:47:14.333 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-02-02T11:47:14.520 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-client-common (238) ... 2024-02-02T11:47:14.678 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package modemmanager. 2024-02-02T11:47:14.684 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libllvm14:amd64. 2024-02-02T11:47:14.693 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-02-02T11:47:14.706 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-02-02T11:47:14.725 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up flex (2.6.4-8build2) ... 2024-02-02T11:47:14.735 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-02-02T11:47:14.759 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-02-02T11:47:14.851 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-02-02T11:47:14.977 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-02-02T11:47:15.086 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-02-02T11:47:15.203 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-02-02T11:47:15.329 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-02T11:47:15.392 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package network-manager. 2024-02-02T11:47:15.408 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-02-02T11:47:15.458 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-02-02T11:47:15.876 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-02-02T11:47:15.968 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-02-02T11:47:16.074 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ppp. 2024-02-02T11:47:16.089 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-02-02T11:47:16.346 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-02-02T11:47:16.346 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-02-02T11:47:16.431 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-02-02T11:47:16.604 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-02-02T11:47:16.626 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-02-02T11:47:16.679 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-02-02T11:47:16.829 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package pptp-linux. 2024-02-02T11:47:16.843 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-02-02T11:47:16.862 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-02-02T11:47:16.887 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-02-02T11:47:16.965 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libmbim-proxy. 2024-02-02T11:47:16.972 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.13) ... 2024-02-02T11:47:16.987 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-02-02T11:47:17.023 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-02-02T11:47:17.073 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-02-02T11:47:17.174 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package network-manager-pptp. 2024-02-02T11:47:17.189 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-02-02T11:47:17.190 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-02-02T11:47:17.223 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-02-02T11:47:17.317 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-02-02T11:47:17.368 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-02-02T11:47:17.389 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-02-02T11:47:17.434 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-02-02T11:47:17.443 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-02-02T11:47:17.569 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-02-02T11:47:17.787 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libndp0:amd64. 2024-02-02T11:47:17.809 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-02-02T11:47:17.835 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-client-common. 2024-02-02T11:47:17.851 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-02-02T11:47:17.854 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-02-02T11:47:17.893 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-client-common (238) ... 2024-02-02T11:47:18.139 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-client-14. 2024-02-02T11:47:18.155 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-02-02T11:47:18.165 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libnm0:amd64. 2024-02-02T11:47:18.182 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-02-02T11:47:18.186 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-02-02T11:47:18.189 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-02T11:47:18.231 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-02-02T11:47:18.308 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up dump (0.4b47-3) ... 2024-02-02T11:47:18.427 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-02-02T11:47:18.485 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-02-02T11:47:18.576 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libpq5:amd64. 2024-02-02T11:47:18.598 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-02-02T11:47:18.643 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-02-02T11:47:18.702 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-02-02T11:47:18.785 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-common. 2024-02-02T11:47:18.801 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-02-02T11:47:18.828 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up tcl (8.6.11+1build2) ... 2024-02-02T11:47:18.861 INFO:teuthology.orchestra.run.smithi177.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-02-02T11:47:18.892 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-common (238) ... 2024-02-02T11:47:18.946 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libjson-perl (4.04000-1) ... 2024-02-02T11:47:19.004 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-02-02T11:47:19.025 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-02-02T11:47:19.047 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-02-02T11:47:19.070 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-02-02T11:47:19.121 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-02-02T11:47:19.182 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-02-02T11:47:19.300 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-02-02T11:47:19.309 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-14. 2024-02-02T11:47:19.324 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-02-02T11:47:19.361 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-02T11:47:19.406 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqmi-proxy. 2024-02-02T11:47:19.418 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-02-02T11:47:19.456 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-02-02T11:47:19.476 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-02-02T11:47:19.652 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-02-02T11:47:19.683 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-02-02T11:47:19.697 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.13_amd64.deb ... 2024-02-02T11:47:19.725 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.13) ... 2024-02-02T11:47:19.778 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-02-02T11:47:19.946 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-client (14+238) ... 2024-02-02T11:47:20.056 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-02-02T11:47:20.204 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-02-02T11:47:20.225 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-02-02T11:47:20.262 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-02-02T11:47:20.470 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql. 2024-02-02T11:47:20.485 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-02-02T11:47:20.519 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql (14+238) ... 2024-02-02T11:47:20.523 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:20.523 INFO:teuthology.orchestra.run.smithi162.stdout:The following network interfaces were found in /etc/network/interfaces 2024-02-02T11:47:20.523 INFO:teuthology.orchestra.run.smithi162.stdout:which means they are currently configured by ifupdown: 2024-02-02T11:47:20.523 INFO:teuthology.orchestra.run.smithi162.stdout:- enp3s0f1 2024-02-02T11:47:20.523 INFO:teuthology.orchestra.run.smithi162.stdout:If you want to manage those interfaces with NetworkManager instead 2024-02-02T11:47:20.523 INFO:teuthology.orchestra.run.smithi162.stdout:remove their configuration from /etc/network/interfaces. 2024-02-02T11:47:20.523 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:20.606 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package modemmanager. 2024-02-02T11:47:20.628 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-02-02T11:47:20.643 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-02-02T11:47:20.673 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-02-02T11:47:20.747 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-client. 2024-02-02T11:47:20.761 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-02-02T11:47:20.805 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-client (14+238) ... 2024-02-02T11:47:20.998 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-02-02T11:47:21.032 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-contrib. 2024-02-02T11:47:21.047 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-02-02T11:47:21.090 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-contrib (14+238) ... 2024-02-02T11:47:21.326 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-02-02T11:47:21.434 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package tcl8.6. 2024-02-02T11:47:21.450 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-02-02T11:47:21.492 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-02-02T11:47:21.548 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package network-manager. 2024-02-02T11:47:21.571 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-02-02T11:47:21.631 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-02-02T11:47:21.770 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package tcl. 2024-02-02T11:47:21.786 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-02-02T11:47:21.824 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-02-02T11:47:21.908 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-02-02T11:47:22.043 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-02-02T11:47:22.140 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package wpasupplicant. 2024-02-02T11:47:22.156 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-02-02T11:47:22.160 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-02-02T11:47:22.198 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-02-02T11:47:22.255 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ppp. 2024-02-02T11:47:22.277 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-02-02T11:47:22.286 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-common (238) ... 2024-02-02T11:47:22.569 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-02-02T11:47:22.616 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-02-02T11:47:22.616 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-02-02T11:47:22.626 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-02-02T11:47:22.952 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package pptp-linux. 2024-02-02T11:47:22.973 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-02-02T11:47:22.988 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package usb-modeswitch. 2024-02-02T11:47:23.004 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-02-02T11:47:23.018 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-02-02T11:47:23.046 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-02-02T11:47:23.188 INFO:teuthology.orchestra.run.smithi162.stdout:Adding user postgres to group ssl-cert 2024-02-02T11:47:23.237 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package network-manager-pptp. 2024-02-02T11:47:23.259 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-02-02T11:47:23.295 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-02-02T11:47:23.321 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-client-common (238) ... 2024-02-02T11:47:23.399 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:23.399 INFO:teuthology.orchestra.run.smithi162.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-02-02T11:47:23.527 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up flex (2.6.4-8build2) ... 2024-02-02T11:47:23.585 INFO:teuthology.orchestra.run.smithi162.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-02-02T11:47:23.585 INFO:teuthology.orchestra.run.smithi162.stdout:Removing obsolete dictionary files: 2024-02-02T11:47:23.623 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-client-common. 2024-02-02T11:47:23.645 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-02-02T11:47:23.653 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-02-02T11:47:23.690 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-client-common (238) ... 2024-02-02T11:47:23.829 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-02-02T11:47:23.930 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-02-02T11:47:23.994 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-client-14. 2024-02-02T11:47:24.015 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-02-02T11:47:24.031 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-02-02T11:47:24.060 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-02T11:47:24.157 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-02T11:47:24.200 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-02-02T11:47:24.590 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-common. 2024-02-02T11:47:24.612 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-02-02T11:47:24.620 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-02T11:47:24.676 INFO:teuthology.orchestra.run.smithi161.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-02-02T11:47:24.704 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-common (238) ... 2024-02-02T11:47:24.956 INFO:teuthology.orchestra.run.smithi162.stdout:Creating new PostgreSQL cluster 14/main ... 2024-02-02T11:47:24.975 INFO:teuthology.orchestra.run.smithi162.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-02-02T11:47:25.021 INFO:teuthology.orchestra.run.smithi162.stdout:The files belonging to this database system will be owned by user "postgres". 2024-02-02T11:47:25.022 INFO:teuthology.orchestra.run.smithi162.stdout:This user must also own the server process. 2024-02-02T11:47:25.022 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:25.022 INFO:teuthology.orchestra.run.smithi162.stdout:The database cluster will be initialized with locale "en_US". 2024-02-02T11:47:25.022 INFO:teuthology.orchestra.run.smithi162.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-02-02T11:47:25.022 INFO:teuthology.orchestra.run.smithi162.stdout:The default text search configuration will be set to "english". 2024-02-02T11:47:25.022 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:25.022 INFO:teuthology.orchestra.run.smithi162.stdout:Data page checksums are disabled. 2024-02-02T11:47:25.022 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:25.022 INFO:teuthology.orchestra.run.smithi162.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-02-02T11:47:25.023 INFO:teuthology.orchestra.run.smithi162.stdout:creating subdirectories ... ok 2024-02-02T11:47:25.023 INFO:teuthology.orchestra.run.smithi162.stdout:selecting dynamic shared memory implementation ... posix 2024-02-02T11:47:25.037 INFO:teuthology.orchestra.run.smithi162.stdout:selecting default max_connections ... 100 2024-02-02T11:47:25.057 INFO:teuthology.orchestra.run.smithi162.stdout:selecting default shared_buffers ... 128MB 2024-02-02T11:47:25.067 INFO:teuthology.orchestra.run.smithi162.stdout:selecting default time zone ... Etc/UTC 2024-02-02T11:47:25.068 INFO:teuthology.orchestra.run.smithi162.stdout:creating configuration files ... ok 2024-02-02T11:47:25.115 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-02-02T11:47:25.182 INFO:teuthology.orchestra.run.smithi162.stdout:running bootstrap script ... ok 2024-02-02T11:47:25.364 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-14. 2024-02-02T11:47:25.386 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-02-02T11:47:25.434 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-02T11:47:25.480 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-02-02T11:47:25.843 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-02-02T11:47:25.843 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-02-02T11:47:25.860 INFO:teuthology.orchestra.run.smithi162.stdout:performing post-bootstrap initialization ... ok 2024-02-02T11:47:26.439 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-02-02T11:47:26.556 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.13) ... 2024-02-02T11:47:26.590 INFO:teuthology.orchestra.run.smithi162.stdout:syncing data to disk ... ok 2024-02-02T11:47:26.682 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-02-02T11:47:26.808 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-02-02T11:47:26.934 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-02-02T11:47:27.030 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql. 2024-02-02T11:47:27.053 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-02-02T11:47:27.060 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-02-02T11:47:27.067 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-02-02T11:47:27.186 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-02-02T11:47:27.210 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql (14+238) ... 2024-02-02T11:47:27.444 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-client. 2024-02-02T11:47:27.458 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-02-02T11:47:27.494 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-client (14+238) ... 2024-02-02T11:47:27.696 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-contrib. 2024-02-02T11:47:27.709 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-02-02T11:47:27.746 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-contrib (14+238) ... 2024-02-02T11:47:27.916 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-02-02T11:47:28.042 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up dump (0.4b47-3) ... 2024-02-02T11:47:28.074 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package tcl8.6. 2024-02-02T11:47:28.096 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-02-02T11:47:28.137 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-02-02T11:47:28.140 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-02-02T11:47:28.210 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-02-02T11:47:28.336 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-02-02T11:47:28.435 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package tcl. 2024-02-02T11:47:28.458 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-02-02T11:47:28.464 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up tcl (8.6.11+1build2) ... 2024-02-02T11:47:28.507 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-02-02T11:47:28.574 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libjson-perl (4.04000-1) ... 2024-02-02T11:47:28.699 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-02-02T11:47:28.822 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-02-02T11:47:28.838 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package wpasupplicant. 2024-02-02T11:47:28.861 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-02-02T11:47:28.896 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-02-02T11:47:28.901 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-02-02T11:47:29.055 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-02-02T11:47:29.212 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-02-02T11:47:29.294 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-02-02T11:47:29.307 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-02-02T11:47:29.337 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-02-02T11:47:29.344 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-02-02T11:47:29.464 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-02-02T11:47:29.632 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-client (14+238) ... 2024-02-02T11:47:29.722 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package usb-modeswitch. 2024-02-02T11:47:29.745 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-02-02T11:47:29.757 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-02-02T11:47:29.789 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-02-02T11:47:29.927 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-02-02T11:47:30.053 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-contrib (14+238) ... 2024-02-02T11:47:30.073 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-client-common (238) ... 2024-02-02T11:47:30.154 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql (14+238) ... 2024-02-02T11:47:30.255 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-02-02T11:47:30.278 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up flex (2.6.4-8build2) ... 2024-02-02T11:47:30.351 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:30.351 INFO:teuthology.orchestra.run.smithi177.stdout:The following network interfaces were found in /etc/network/interfaces 2024-02-02T11:47:30.351 INFO:teuthology.orchestra.run.smithi177.stdout:which means they are currently configured by ifupdown: 2024-02-02T11:47:30.351 INFO:teuthology.orchestra.run.smithi177.stdout:- enp3s0f1 2024-02-02T11:47:30.351 INFO:teuthology.orchestra.run.smithi177.stdout:If you want to manage those interfaces with NetworkManager instead 2024-02-02T11:47:30.351 INFO:teuthology.orchestra.run.smithi177.stdout:remove their configuration from /etc/network/interfaces. 2024-02-02T11:47:30.351 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:30.356 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-02-02T11:47:30.404 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-02-02T11:47:30.482 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-02-02T11:47:30.530 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-02-02T11:47:30.609 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-02-02T11:47:30.610 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-02-02T11:47:30.655 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-02-02T11:47:30.782 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-02-02T11:47:30.855 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-02-02T11:47:30.907 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-02T11:47:31.183 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-02-02T11:47:31.237 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-02-02T11:47:31.423 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-02-02T11:47:31.485 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-02T11:47:31.504 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-02-02T11:47:31.654 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-02T11:47:31.903 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-02-02T11:47:31.904 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-02-02T11:47:31.904 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-02-02T11:47:32.061 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-02-02T11:47:32.187 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-02-02T11:47:32.313 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-common (238) ... 2024-02-02T11:47:32.792 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-02-02T11:47:32.909 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.13) ... 2024-02-02T11:47:33.035 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-02-02T11:47:33.170 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-02-02T11:47:33.242 INFO:teuthology.orchestra.run.smithi177.stdout:Adding user postgres to group ssl-cert 2024-02-02T11:47:33.257 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-02-02T11:47:33.295 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-02-02T11:47:33.356 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-02-02T11:47:33.421 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-02-02T11:47:33.476 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:33.476 INFO:teuthology.orchestra.run.smithi177.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-02-02T11:47:33.547 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-02-02T11:47:33.734 INFO:teuthology.orchestra.run.smithi177.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-02-02T11:47:33.734 INFO:teuthology.orchestra.run.smithi177.stdout:Removing obsolete dictionary files: 2024-02-02T11:47:34.004 INFO:teuthology.orchestra.run.smithi162.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-02T11:47:34.010 DEBUG:teuthology.parallel:result is None 2024-02-02T11:47:34.194 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-02-02T11:47:34.320 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up dump (0.4b47-3) ... 2024-02-02T11:47:34.414 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-02-02T11:47:34.434 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-02-02T11:47:34.488 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-02-02T11:47:34.615 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-02-02T11:47:34.740 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up tcl (8.6.11+1build2) ... 2024-02-02T11:47:34.867 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjson-perl (4.04000-1) ... 2024-02-02T11:47:34.890 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-02T11:47:34.984 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-02-02T11:47:35.058 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-02-02T11:47:35.153 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-02-02T11:47:35.237 INFO:teuthology.orchestra.run.smithi177.stdout:Creating new PostgreSQL cluster 14/main ... 2024-02-02T11:47:35.252 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-02-02T11:47:35.278 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-02-02T11:47:35.313 INFO:teuthology.orchestra.run.smithi177.stdout:The files belonging to this database system will be owned by user "postgres". 2024-02-02T11:47:35.314 INFO:teuthology.orchestra.run.smithi177.stdout:This user must also own the server process. 2024-02-02T11:47:35.314 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:35.314 INFO:teuthology.orchestra.run.smithi177.stdout:The database cluster will be initialized with locale "en_US". 2024-02-02T11:47:35.314 INFO:teuthology.orchestra.run.smithi177.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-02-02T11:47:35.314 INFO:teuthology.orchestra.run.smithi177.stdout:The default text search configuration will be set to "english". 2024-02-02T11:47:35.314 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:35.314 INFO:teuthology.orchestra.run.smithi177.stdout:Data page checksums are disabled. 2024-02-02T11:47:35.314 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:35.314 INFO:teuthology.orchestra.run.smithi177.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-02-02T11:47:35.315 INFO:teuthology.orchestra.run.smithi177.stdout:creating subdirectories ... ok 2024-02-02T11:47:35.315 INFO:teuthology.orchestra.run.smithi177.stdout:selecting dynamic shared memory implementation ... posix 2024-02-02T11:47:35.338 INFO:teuthology.orchestra.run.smithi177.stdout:selecting default max_connections ... 100 2024-02-02T11:47:35.371 INFO:teuthology.orchestra.run.smithi177.stdout:selecting default shared_buffers ... 128MB 2024-02-02T11:47:35.385 INFO:teuthology.orchestra.run.smithi177.stdout:selecting default time zone ... Etc/UTC 2024-02-02T11:47:35.386 INFO:teuthology.orchestra.run.smithi177.stdout:creating configuration files ... ok 2024-02-02T11:47:35.455 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-02-02T11:47:35.552 INFO:teuthology.orchestra.run.smithi177.stdout:running bootstrap script ... ok 2024-02-02T11:47:35.619 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-02-02T11:47:35.774 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-02-02T11:47:35.941 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-client (14+238) ... 2024-02-02T11:47:36.067 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-02-02T11:47:36.267 INFO:teuthology.orchestra.run.smithi177.stdout:performing post-bootstrap initialization ... ok 2024-02-02T11:47:36.580 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:36.580 INFO:teuthology.orchestra.run.smithi161.stdout:The following network interfaces were found in /etc/network/interfaces 2024-02-02T11:47:36.580 INFO:teuthology.orchestra.run.smithi161.stdout:which means they are currently configured by ifupdown: 2024-02-02T11:47:36.580 INFO:teuthology.orchestra.run.smithi161.stdout:- enp3s0f1 2024-02-02T11:47:36.580 INFO:teuthology.orchestra.run.smithi161.stdout:If you want to manage those interfaces with NetworkManager instead 2024-02-02T11:47:36.581 INFO:teuthology.orchestra.run.smithi161.stdout:remove their configuration from /etc/network/interfaces. 2024-02-02T11:47:36.581 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:36.709 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-02-02T11:47:36.746 INFO:teuthology.orchestra.run.smithi177.stdout:syncing data to disk ... ok 2024-02-02T11:47:37.040 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-02-02T11:47:37.260 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-02-02T11:47:37.411 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-02-02T11:47:37.962 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-02-02T11:47:38.105 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-02-02T11:47:38.231 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-02-02T11:47:38.357 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-common (238) ... 2024-02-02T11:47:39.264 INFO:teuthology.orchestra.run.smithi161.stdout:Adding user postgres to group ssl-cert 2024-02-02T11:47:39.456 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:39.456 INFO:teuthology.orchestra.run.smithi161.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-02-02T11:47:39.666 INFO:teuthology.orchestra.run.smithi161.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-02-02T11:47:39.666 INFO:teuthology.orchestra.run.smithi161.stdout:Removing obsolete dictionary files: 2024-02-02T11:47:40.205 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-02-02T11:47:40.291 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-02-02T11:47:40.323 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-contrib (14+238) ... 2024-02-02T11:47:40.465 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql (14+238) ... 2024-02-02T11:47:40.575 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-02-02T11:47:40.692 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-02-02T11:47:40.708 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-02T11:47:40.952 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-02-02T11:47:40.953 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-02-02T11:47:41.040 INFO:teuthology.orchestra.run.smithi161.stdout:Creating new PostgreSQL cluster 14/main ... 2024-02-02T11:47:41.062 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-02-02T11:47:41.105 INFO:teuthology.orchestra.run.smithi161.stdout:The files belonging to this database system will be owned by user "postgres". 2024-02-02T11:47:41.105 INFO:teuthology.orchestra.run.smithi161.stdout:This user must also own the server process. 2024-02-02T11:47:41.105 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:41.105 INFO:teuthology.orchestra.run.smithi161.stdout:The database cluster will be initialized with locale "en_US". 2024-02-02T11:47:41.105 INFO:teuthology.orchestra.run.smithi161.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-02-02T11:47:41.105 INFO:teuthology.orchestra.run.smithi161.stdout:The default text search configuration will be set to "english". 2024-02-02T11:47:41.105 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:41.106 INFO:teuthology.orchestra.run.smithi161.stdout:Data page checksums are disabled. 2024-02-02T11:47:41.106 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:41.106 INFO:teuthology.orchestra.run.smithi161.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-02-02T11:47:41.106 INFO:teuthology.orchestra.run.smithi161.stdout:creating subdirectories ... ok 2024-02-02T11:47:41.106 INFO:teuthology.orchestra.run.smithi161.stdout:selecting dynamic shared memory implementation ... posix 2024-02-02T11:47:41.121 INFO:teuthology.orchestra.run.smithi161.stdout:selecting default max_connections ... 100 2024-02-02T11:47:41.142 INFO:teuthology.orchestra.run.smithi161.stdout:selecting default shared_buffers ... 128MB 2024-02-02T11:47:41.153 INFO:teuthology.orchestra.run.smithi161.stdout:selecting default time zone ... Etc/UTC 2024-02-02T11:47:41.154 INFO:teuthology.orchestra.run.smithi161.stdout:creating configuration files ... ok 2024-02-02T11:47:41.268 INFO:teuthology.orchestra.run.smithi161.stdout:running bootstrap script ... ok 2024-02-02T11:47:41.670 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-02-02T11:47:41.882 INFO:teuthology.orchestra.run.smithi161.stdout:performing post-bootstrap initialization ... ok 2024-02-02T11:47:41.988 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-02T11:47:42.140 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-02T11:47:42.604 INFO:teuthology.orchestra.run.smithi161.stdout:syncing data to disk ... ok 2024-02-02T11:47:43.023 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-02-02T11:47:43.450 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-02-02T11:47:43.542 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-02-02T11:47:44.253 INFO:teuthology.orchestra.run.smithi177.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-02T11:47:44.259 DEBUG:teuthology.parallel:result is None 2024-02-02T11:47:45.856 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-02-02T11:47:45.957 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-contrib (14+238) ... 2024-02-02T11:47:46.066 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql (14+238) ... 2024-02-02T11:47:46.192 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-02-02T11:47:46.318 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-02-02T11:47:46.586 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-02-02T11:47:46.586 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-02-02T11:47:47.145 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-02-02T11:47:47.473 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-02T11:47:47.624 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-02T11:47:48.550 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-02-02T11:47:48.667 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-02-02T11:47:49.321 INFO:teuthology.orchestra.run.smithi161.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-02T11:47:49.326 DEBUG:teuthology.parallel:result is None 2024-02-02T11:47:49.327 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0fb327883c124fd83155c94db0804f823b805a12 2024-02-02T11:47:49.549 DEBUG:teuthology.orchestra.run.smithi161:> dpkg-query -W -f '${Version}' ceph 2024-02-02T11:47:49.569 INFO:teuthology.orchestra.run.smithi161.stdout:18.2.1-325-g0fb32788-1jammy 2024-02-02T11:47:49.569 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-325-g0fb32788-1jammy 2024-02-02T11:47:49.569 INFO:teuthology.task.install:The correct ceph version 18.2.1-325-g0fb32788-1jammy is installed. 2024-02-02T11:47:49.571 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0fb327883c124fd83155c94db0804f823b805a12 2024-02-02T11:47:49.712 DEBUG:teuthology.orchestra.run.smithi162:> dpkg-query -W -f '${Version}' ceph 2024-02-02T11:47:49.731 INFO:teuthology.orchestra.run.smithi162.stdout:18.2.1-325-g0fb32788-1jammy 2024-02-02T11:47:49.732 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-325-g0fb32788-1jammy 2024-02-02T11:47:49.732 INFO:teuthology.task.install:The correct ceph version 18.2.1-325-g0fb32788-1jammy is installed. 2024-02-02T11:47:49.736 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0fb327883c124fd83155c94db0804f823b805a12 2024-02-02T11:47:49.954 DEBUG:teuthology.orchestra.run.smithi177:> dpkg-query -W -f '${Version}' ceph 2024-02-02T11:47:49.977 INFO:teuthology.orchestra.run.smithi177.stdout:18.2.1-325-g0fb32788-1jammy 2024-02-02T11:47:49.977 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-325-g0fb32788-1jammy 2024-02-02T11:47:49.978 INFO:teuthology.task.install:The correct ceph version 18.2.1-325-g0fb32788-1jammy is installed. 2024-02-02T11:47:49.980 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-02T11:47:49.980 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:47:49.980 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-02T11:47:49.994 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:47:49.994 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-02T11:47:50.007 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T11:47:50.008 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-02T11:47:50.039 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-02T11:47:50.039 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:47:50.040 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2024-02-02T11:47:50.053 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-02T11:47:50.108 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:47:50.108 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-02-02T11:47:50.121 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-02T11:47:50.178 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T11:47:50.178 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/daemon-helper 2024-02-02T11:47:50.199 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-02T11:47:50.262 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-02T11:47:50.263 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:47:50.263 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-02T11:47:50.276 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-02T11:47:50.332 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:47:50.332 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-02T11:47:50.345 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-02T11:47:50.401 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T11:47:50.401 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-02T11:47:50.422 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-02T11:47:50.486 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-02T11:47:50.486 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:47:50.486 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/stdin-killer 2024-02-02T11:47:50.499 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-02T11:47:50.559 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:47:50.560 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-02-02T11:47:50.574 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-02T11:47:50.628 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T11:47:50.629 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/stdin-killer 2024-02-02T11:47:50.650 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-02T11:47:50.710 INFO:teuthology.run_tasks:Running task ceph... 2024-02-02T11:47:50.784 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-02T11:47:50.784 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /var/log/ceph 2024-02-02T11:47:50.786 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /var/log/ceph 2024-02-02T11:47:50.789 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 777 /var/log/ceph 2024-02-02T11:47:50.809 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-02T11:47:50.809 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-02T11:47:50.842 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-02T11:47:50.845 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-02T11:47:50.870 INFO:tasks.ceph:Creating extra log directories... 2024-02-02T11:47:50.870 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-02T11:47:50.898 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-02T11:47:50.900 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-02T11:47:50.941 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-02-02T11:47:50.941 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-02-02T11:47:50.941 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-02-02T11:47:50.941 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:47:50.941 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-02T11:47:50.957 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-02T11:47:51.033 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:47:51.034 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-02T11:47:51.039 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-02T11:47:51.113 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T11:47:51.113 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-02T11:47:51.122 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-02T11:47:51.221 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-02T11:47:51.221 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-02T11:47:51.221 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393', 'branch': 'wip-vshankar-testing1-reef-2024-02-02-1152', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7543393', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd42140e628558a450ba1d39a9d0835a2fa62cda'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing1-reef-2024-02-02-1152'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '0fb327883c124fd83155c94db0804f823b805a12'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '0fb327883c124fd83155c94db0804f823b805a12'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing1-reef-2024-02-02-1152', 'sha1': '0fb327883c124fd83155c94db0804f823b805a12'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 1628, 'sha1': '0fb327883c124fd83155c94db0804f823b805a12', 'sleep_before_teardown': 0, 'subset': '50/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing1-reef-2024-02-02-1152', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_0fb327883c124fd83155c94db0804f823b805a12/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '0fb327883c124fd83155c94db0804f823b805a12', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi161.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD8AQxeyGy1Ran+lsQkpIBYdni1Na9WVvUjOtv2uNm8OBPg5oQi+345XoPA33KN0dITYMzj8a+qAoky/LUIqErM=', 'smithi162.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOy+tkgV21E+41tQtUdhGX7YE3e/kTnTfWnDI1MPetjwsV4kyXD5V4DCJO+sC5rP0EnNNghhPIQ14wHpvZWHHw=', 'smithi177.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMetkB1DiD+2vxtyQikH8Ai3S6nK+r+lzjQOCt9ilykW5d8RP9vWy35ixSqHlFkEzx6LzKU28YYB3bUsvKYMPvY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd42140e628558a450ba1d39a9d0835a2fa62cda'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '0fb327883c124fd83155c94db0804f823b805a12'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '0fb327883c124fd83155c94db0804f823b805a12', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'd9fdb2209e15b39d9f061fd85399f352ce0f0894', 'timestamp': '2024-02-02_11:17:23', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-02T11:47:51.222 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-02T11:47:51.225 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-02T11:47:51.227 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-02T11:47:51.237 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2024-02-02T11:47:51.273 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/run/ceph 2024-02-02T11:47:51.276 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/run/ceph 2024-02-02T11:47:51.298 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:47:51.299 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2024-02-02T11:47:51.333 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-02T11:47:51.333 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 2024-02-02T11:47:51.381 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-02T11:47:51.381 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-02T11:47:51.381 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 880 Links: 1 2024-02-02T11:47:51.381 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-02T11:47:51.381 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-02-02 11:41:04.505733204 +0000 2024-02-02T11:47:51.381 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-02-02 11:41:04.249738563 +0000 2024-02-02T11:47:51.381 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-02-02 11:41:04.249738563 +0000 2024-02-02T11:47:51.381 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2024-02-02T11:47:51.382 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-02T11:47:51.435 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-02-02T11:47:51.436 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-02-02T11:47:51.436 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000583529 s, 877 kB/s 2024-02-02T11:47:51.437 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-02T11:47:51.486 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 2024-02-02T11:47:51.533 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-02T11:47:51.533 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-02T11:47:51.533 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 898 Links: 1 2024-02-02T11:47:51.533 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-02T11:47:51.533 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-02-02 11:41:05.069721466 +0000 2024-02-02T11:47:51.533 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-02-02 11:41:04.785727343 +0000 2024-02-02T11:47:51.533 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-02-02 11:41:04.785727343 +0000 2024-02-02T11:47:51.534 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2024-02-02T11:47:51.534 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-02T11:47:51.587 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-02-02T11:47:51.587 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-02-02T11:47:51.588 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000562599 s, 910 kB/s 2024-02-02T11:47:51.589 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-02T11:47:51.638 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 2024-02-02T11:47:51.685 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-02T11:47:51.685 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-02T11:47:51.685 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-02-02T11:47:51.685 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-02T11:47:51.685 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-02-02 11:41:05.581711261 +0000 2024-02-02T11:47:51.685 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-02-02 11:41:05.305716762 +0000 2024-02-02T11:47:51.685 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-02-02 11:41:05.305716762 +0000 2024-02-02T11:47:51.685 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2024-02-02T11:47:51.686 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-02T11:47:51.739 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-02-02T11:47:51.739 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-02-02T11:47:51.739 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000580774 s, 882 kB/s 2024-02-02T11:47:51.740 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-02T11:47:51.790 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 2024-02-02T11:47:51.837 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-02T11:47:51.837 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-02T11:47:51.837 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-02-02T11:47:51.837 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-02T11:47:51.837 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-02-02 11:41:06.113700657 +0000 2024-02-02T11:47:51.837 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-02-02 11:41:05.829706318 +0000 2024-02-02T11:47:51.837 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-02-02 11:41:05.829706318 +0000 2024-02-02T11:47:51.837 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2024-02-02T11:47:51.837 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-02T11:47:51.891 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-02-02T11:47:51.891 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-02-02T11:47:51.891 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000431938 s, 1.2 MB/s 2024-02-02T11:47:51.892 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-02T11:47:51.942 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-02T11:47:51.942 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:47:51.942 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-02-02T11:47:51.947 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-02T11:47:51.948 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-02-02T11:47:51.997 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-02T11:47:51.997 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-02T11:47:51.997 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-02-02T11:47:51.997 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-02T11:47:51.997 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-02-02 11:41:07.040223394 +0000 2024-02-02T11:47:51.997 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-02-02 11:41:06.772229233 +0000 2024-02-02T11:47:51.997 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-02-02 11:41:06.772229233 +0000 2024-02-02T11:47:51.997 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-02-02T11:47:51.998 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-02T11:47:52.048 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-02-02T11:47:52.048 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-02-02T11:47:52.049 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000560592 s, 913 kB/s 2024-02-02T11:47:52.051 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-02T11:47:52.104 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-02-02T11:47:52.154 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-02T11:47:52.154 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-02T11:47:52.154 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 900 Links: 1 2024-02-02T11:47:52.154 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-02T11:47:52.154 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-02-02 11:41:07.520213348 +0000 2024-02-02T11:47:52.155 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-02-02 11:41:07.264218706 +0000 2024-02-02T11:47:52.155 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-02-02 11:41:07.264218706 +0000 2024-02-02T11:47:52.155 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-02-02T11:47:52.155 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-02T11:47:52.209 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-02-02T11:47:52.209 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-02-02T11:47:52.209 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000484759 s, 1.1 MB/s 2024-02-02T11:47:52.211 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-02T11:47:52.260 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-02-02T11:47:52.306 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-02T11:47:52.306 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-02T11:47:52.307 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-02-02T11:47:52.307 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-02T11:47:52.307 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-02-02 11:41:08.000203299 +0000 2024-02-02T11:47:52.307 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-02-02 11:41:07.748208574 +0000 2024-02-02T11:47:52.307 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-02-02 11:41:07.748208574 +0000 2024-02-02T11:47:52.307 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-02-02T11:47:52.307 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-02T11:47:52.360 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-02-02T11:47:52.361 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-02-02T11:47:52.361 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000579949 s, 883 kB/s 2024-02-02T11:47:52.362 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-02T11:47:52.412 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-02-02T11:47:52.458 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-02T11:47:52.458 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-02T11:47:52.458 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 932 Links: 1 2024-02-02T11:47:52.459 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-02T11:47:52.459 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-02-02 11:41:08.496193414 +0000 2024-02-02T11:47:52.459 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-02-02 11:41:08.240198516 +0000 2024-02-02T11:47:52.459 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-02-02 11:41:08.240198516 +0000 2024-02-02T11:47:52.459 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-02-02T11:47:52.459 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-02T11:47:52.512 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-02-02T11:47:52.512 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-02-02T11:47:52.512 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000419378 s, 1.2 MB/s 2024-02-02T11:47:52.513 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-02T11:47:52.563 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-02T11:47:52.563 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-02T11:47:52.563 INFO:tasks.ceph:Generating config... 2024-02-02T11:47:52.565 INFO:tasks.ceph:[client] client mount timeout = 600 2024-02-02T11:47:52.565 INFO:tasks.ceph:[client] debug client = 20 2024-02-02T11:47:52.565 INFO:tasks.ceph:[client] debug ms = 1 2024-02-02T11:47:52.565 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-02-02T11:47:52.565 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-02-02T11:47:52.565 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2024-02-02T11:47:52.565 INFO:tasks.ceph:[mds] debug mds = 20 2024-02-02T11:47:52.565 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-02-02T11:47:52.565 INFO:tasks.ceph:[mds] debug ms = 1 2024-02-02T11:47:52.565 INFO:tasks.ceph:[mds] mds debug frag = True 2024-02-02T11:47:52.565 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-02-02T11:47:52.565 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-02-02T11:47:52.565 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-02-02T11:47:52.566 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-02-02T11:47:52.566 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-02-02T11:47:52.566 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-02-02T11:47:52.566 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-02T11:47:52.566 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-02T11:47:52.566 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-02T11:47:52.566 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-02T11:47:52.566 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-02T11:47:52.566 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-02-02T11:47:52.566 INFO:tasks.ceph:[osd] bdev async discard = True 2024-02-02T11:47:52.566 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-02-02T11:47:52.566 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-02-02T11:47:52.566 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-02T11:47:52.567 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-02T11:47:52.567 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-02-02T11:47:52.567 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-02-02T11:47:52.567 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-02T11:47:52.567 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-02T11:47:52.567 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-02-02T11:47:52.567 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-02T11:47:52.567 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-02T11:47:52.567 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-02T11:47:52.567 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-02T11:47:52.567 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-02T11:47:52.567 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-02-02T11:47:52.568 INFO:tasks.ceph:Setting up mon.a... 2024-02-02T11:47:52.568 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-02T11:47:52.602 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.keyring 2024-02-02T11:47:52.617 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-02T11:47:52.696 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-02T11:47:52.751 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.161'), ('mon.b', '172.21.15.162'), ('mon.c', '[v2:172.21.15.162:3301,v1:172.21.15.162:6790]')] 2024-02-02T11:47:52.752 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.161,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]', 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-02-02T11:47:52.753 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:47:52.753 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-02T11:47:52.800 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.161 --add b 172.21.15.162 --addv c '[v2:172.21.15.162:3301,v1:172.21.15.162:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-02-02T11:47:52.886 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-02T11:47:52.886 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: generated fsid 6072f293-dbe3-404b-82f1-eb0e17d96787 2024-02-02T11:47:52.886 INFO:teuthology.orchestra.run.smithi161.stdout:setting min_mon_release = pacific 2024-02-02T11:47:52.886 INFO:teuthology.orchestra.run.smithi161.stdout:epoch 0 2024-02-02T11:47:52.887 INFO:teuthology.orchestra.run.smithi161.stdout:fsid 6072f293-dbe3-404b-82f1-eb0e17d96787 2024-02-02T11:47:52.887 INFO:teuthology.orchestra.run.smithi161.stdout:last_changed 2024-02-02T11:47:52.887531+0000 2024-02-02T11:47:52.887 INFO:teuthology.orchestra.run.smithi161.stdout:created 2024-02-02T11:47:52.887531+0000 2024-02-02T11:47:52.887 INFO:teuthology.orchestra.run.smithi161.stdout:min_mon_release 16 (pacific) 2024-02-02T11:47:52.887 INFO:teuthology.orchestra.run.smithi161.stdout:election_strategy: 1 2024-02-02T11:47:52.887 INFO:teuthology.orchestra.run.smithi161.stdout:0: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.a 2024-02-02T11:47:52.887 INFO:teuthology.orchestra.run.smithi161.stdout:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-02-02T11:47:52.887 INFO:teuthology.orchestra.run.smithi161.stdout:2: [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] mon.c 2024-02-02T11:47:52.887 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-02-02T11:47:52.889 DEBUG:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-02T11:47:52.936 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6072f293-dbe3-404b-82f1-eb0e17d96787... 2024-02-02T11:47:52.937 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-02T11:47:52.982 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-02T11:47:52.984 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-02T11:47:53.010 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2024-02-02T11:47:53.010 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2024-02-02T11:47:53.010 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-02T11:47:53.010 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2024-02-02T11:47:53.010 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.010 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2024-02-02T11:47:53.011 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.011 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2024-02-02T11:47:53.011 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.011 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2024-02-02T11:47:53.011 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2024-02-02T11:47:53.011 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.011 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2024-02-02T11:47:53.011 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2024-02-02T11:47:53.011 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.011 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-02T11:47:53.011 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2024-02-02T11:47:53.011 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.011 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2024-02-02T11:47:53.011 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-02T11:47:53.012 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.012 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2024-02-02T11:47:53.012 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.012 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2024-02-02T11:47:53.012 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2024-02-02T11:47:53.012 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2024-02-02T11:47:53.012 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2024-02-02T11:47:53.012 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2024-02-02T11:47:53.012 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2024-02-02T11:47:53.012 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2024-02-02T11:47:53.012 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-02T11:47:53.012 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-02T11:47:53.012 INFO:teuthology.orchestra.run.smithi161.stdout: mon_allow_pool_size_one = true 2024-02-02T11:47:53.013 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.013 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-02T11:47:53.013 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.013 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2024-02-02T11:47:53.013 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.013 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2024-02-02T11:47:53.013 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.013 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2024-02-02T11:47:53.013 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2024-02-02T11:47:53.013 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2024-02-02T11:47:53.013 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = "172.21.15.161,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2024-02-02T11:47:53.013 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn min per osd = 0 2024-02-02T11:47:53.013 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = 6072f293-dbe3-404b-82f1-eb0e17d96787 2024-02-02T11:47:53.013 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.014 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2024-02-02T11:47:53.014 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2024-02-02T11:47:53.014 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.014 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2024-02-02T11:47:53.014 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2024-02-02T11:47:53.014 INFO:teuthology.orchestra.run.smithi161.stdout: osd mclock profile = high_recovery_ops 2024-02-02T11:47:53.014 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.014 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2024-02-02T11:47:53.014 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2024-02-02T11:47:53.014 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.014 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2024-02-02T11:47:53.014 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2024-02-02T11:47:53.014 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2024-02-02T11:47:53.015 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.015 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2024-02-02T11:47:53.015 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2024-02-02T11:47:53.015 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.015 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2024-02-02T11:47:53.015 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.015 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2024-02-02T11:47:53.015 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.015 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2024-02-02T11:47:53.015 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.015 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2024-02-02T11:47:53.015 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2024-02-02T11:47:53.015 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.016 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2024-02-02T11:47:53.016 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2024-02-02T11:47:53.016 INFO:teuthology.orchestra.run.smithi161.stdout: bdev async discard = True 2024-02-02T11:47:53.016 INFO:teuthology.orchestra.run.smithi161.stdout: bdev enable discard = True 2024-02-02T11:47:53.016 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore allocator = bitmap 2024-02-02T11:47:53.016 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore block size = 96636764160 2024-02-02T11:47:53.016 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore fsck on mount = True 2024-02-02T11:47:53.016 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluefs = 1/20 2024-02-02T11:47:53.016 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluestore = 1/20 2024-02-02T11:47:53.016 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-02-02T11:47:53.016 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2024-02-02T11:47:53.016 INFO:teuthology.orchestra.run.smithi161.stdout: debug rocksdb = 4/10 2024-02-02T11:47:53.016 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd backfillfull_ratio = 0.85 2024-02-02T11:47:53.017 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd full ratio = 0.9 2024-02-02T11:47:53.017 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd nearfull ratio = 0.8 2024-02-02T11:47:53.017 INFO:teuthology.orchestra.run.smithi161.stdout: osd failsafe full ratio = 0.95 2024-02-02T11:47:53.017 INFO:teuthology.orchestra.run.smithi161.stdout: osd objectstore = bluestore 2024-02-02T11:47:53.017 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2024-02-02T11:47:53.017 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.017 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2024-02-02T11:47:53.017 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-02-02T11:47:53.017 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2024-02-02T11:47:53.017 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2024-02-02T11:47:53.017 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2024-02-02T11:47:53.017 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2024-02-02T11:47:53.017 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2024-02-02T11:47:53.017 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2024-02-02T11:47:53.017 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.018 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2024-02-02T11:47:53.018 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-02-02T11:47:53.018 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2024-02-02T11:47:53.018 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2024-02-02T11:47:53.018 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2024-02-02T11:47:53.018 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2024-02-02T11:47:53.018 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2024-02-02T11:47:53.018 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2024-02-02T11:47:53.018 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2024-02-02T11:47:53.018 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2024-02-02T11:47:53.018 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2024-02-02T11:47:53.018 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.018 INFO:teuthology.orchestra.run.smithi161.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-02T11:47:53.018 INFO:teuthology.orchestra.run.smithi161.stdout: auth mon ticket ttl = 660 # 11m 2024-02-02T11:47:53.018 INFO:teuthology.orchestra.run.smithi161.stdout: auth service ticket ttl = 240 # 4m 2024-02-02T11:47:53.018 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.018 INFO:teuthology.orchestra.run.smithi161.stdout: # don't complain about insecure global_id in the test suite 2024-02-02T11:47:53.019 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-02T11:47:53.019 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-02T11:47:53.019 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.019 INFO:teuthology.orchestra.run.smithi161.stdout: # 1m isn't quite enough 2024-02-02T11:47:53.019 INFO:teuthology.orchestra.run.smithi161.stdout: mon_down_mkfs_grace = 2m 2024-02-02T11:47:53.019 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.019 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_filestore_osds = false 2024-02-02T11:47:53.019 INFO:teuthology.orchestra.run.smithi161.stdout: mon op complaint time = 120 2024-02-02T11:47:53.019 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:47:53.019 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2024-02-02T11:47:53.019 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2024-02-02T11:47:53.019 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2024-02-02T11:47:53.019 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2024-02-02T11:47:53.019 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-02T11:47:53.019 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-02T11:47:53.019 INFO:teuthology.orchestra.run.smithi161.stdout: client mount timeout = 600 2024-02-02T11:47:53.019 INFO:teuthology.orchestra.run.smithi161.stdout: debug client = 20 2024-02-02T11:47:53.020 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-02-02T11:47:53.020 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2024-02-02T11:47:53.020 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2024-02-02T11:47:53.020 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2024-02-02T11:47:53.020 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.b] 2024-02-02T11:47:53.020 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.c] 2024-02-02T11:47:53.020 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2024-02-02T11:47:53.020 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2024-02-02T11:47:53.020 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2024-02-02T11:47:53.020 INFO:teuthology.orchestra.run.smithi161.stdout:[mds] 2024-02-02T11:47:53.020 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds = 20 2024-02-02T11:47:53.020 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds balancer = 20 2024-02-02T11:47:53.020 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-02-02T11:47:53.020 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug frag = True 2024-02-02T11:47:53.020 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug scatterstat = True 2024-02-02T11:47:53.020 INFO:teuthology.orchestra.run.smithi161.stdout: mds op complaint time = 180 2024-02-02T11:47:53.021 INFO:teuthology.orchestra.run.smithi161.stdout: mds verify scatter = True 2024-02-02T11:47:53.021 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2024-02-02T11:47:53.021 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2024-02-02T11:47:53.021 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2024-02-02T11:47:53.021 INFO:teuthology.orchestra.run.smithi162.stdout:[global] 2024-02-02T11:47:53.021 INFO:teuthology.orchestra.run.smithi162.stdout: chdir = "" 2024-02-02T11:47:53.021 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-02T11:47:53.022 INFO:teuthology.orchestra.run.smithi162.stdout: auth supported = cephx 2024-02-02T11:47:53.022 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.022 INFO:teuthology.orchestra.run.smithi162.stdout: filestore xattr use omap = true 2024-02-02T11:47:53.022 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.022 INFO:teuthology.orchestra.run.smithi162.stdout: mon clock drift allowed = 1.000 2024-02-02T11:47:53.022 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.022 INFO:teuthology.orchestra.run.smithi162.stdout: osd crush chooseleaf type = 0 2024-02-02T11:47:53.022 INFO:teuthology.orchestra.run.smithi162.stdout: auth debug = true 2024-02-02T11:47:53.022 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.022 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on old message = true 2024-02-02T11:47:53.022 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on bug = true 2024-02-02T11:47:53.022 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.022 INFO:teuthology.orchestra.run.smithi162.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-02T11:47:53.022 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn max object skew = 0 2024-02-02T11:47:53.022 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.023 INFO:teuthology.orchestra.run.smithi162.stdout: # disable pg_autoscaler by default for new pools 2024-02-02T11:47:53.023 INFO:teuthology.orchestra.run.smithi162.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-02T11:47:53.023 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.023 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default size = 2 2024-02-02T11:47:53.023 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.023 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow primary affinity = true 2024-02-02T11:47:53.023 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow pg remap = true 2024-02-02T11:47:53.023 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on legacy crush tunables = false 2024-02-02T11:47:53.023 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on crush straw calc version zero = false 2024-02-02T11:47:53.023 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on no sortbitwise = false 2024-02-02T11:47:53.023 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on osd down out interval zero = false 2024-02-02T11:47:53.023 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on too few osds = false 2024-02-02T11:47:53.023 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-02T11:47:53.023 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-02T11:47:53.024 INFO:teuthology.orchestra.run.smithi162.stdout: mon_allow_pool_size_one = true 2024-02-02T11:47:53.024 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.024 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-02T11:47:53.024 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.024 INFO:teuthology.orchestra.run.smithi162.stdout: osd default data pool replay window = 5 2024-02-02T11:47:53.024 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.024 INFO:teuthology.orchestra.run.smithi162.stdout: mon allow pool delete = true 2024-02-02T11:47:53.024 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.024 INFO:teuthology.orchestra.run.smithi162.stdout: mon cluster log file level = debug 2024-02-02T11:47:53.024 INFO:teuthology.orchestra.run.smithi162.stdout: debug asserts on shutdown = true 2024-02-02T11:47:53.024 INFO:teuthology.orchestra.run.smithi162.stdout: mon health detail to clog = false 2024-02-02T11:47:53.024 INFO:teuthology.orchestra.run.smithi162.stdout: mon host = "172.21.15.161,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2024-02-02T11:47:53.025 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn min per osd = 0 2024-02-02T11:47:53.025 INFO:teuthology.orchestra.run.smithi162.stdout: fsid = 6072f293-dbe3-404b-82f1-eb0e17d96787 2024-02-02T11:47:53.025 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.025 INFO:teuthology.orchestra.run.smithi162.stdout:[osd] 2024-02-02T11:47:53.025 INFO:teuthology.orchestra.run.smithi162.stdout: osd journal size = 100 2024-02-02T11:47:53.025 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.025 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub load threshold = 5.0 2024-02-02T11:47:53.025 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub max interval = 600 2024-02-02T11:47:53.025 INFO:teuthology.orchestra.run.smithi162.stdout: osd mclock profile = high_recovery_ops 2024-02-02T11:47:53.025 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.025 INFO:teuthology.orchestra.run.smithi162.stdout: osd recover clone overlap = true 2024-02-02T11:47:53.025 INFO:teuthology.orchestra.run.smithi162.stdout: osd recovery max chunk = 1048576 2024-02-02T11:47:53.025 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.026 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug shutdown = true 2024-02-02T11:47:53.026 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug op order = true 2024-02-02T11:47:53.026 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug verify stray on activate = true 2024-02-02T11:47:53.026 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.026 INFO:teuthology.orchestra.run.smithi162.stdout: osd open classes on start = true 2024-02-02T11:47:53.026 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug pg log writeout = true 2024-02-02T11:47:53.026 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.026 INFO:teuthology.orchestra.run.smithi162.stdout: osd deep scrub update digest min age = 30 2024-02-02T11:47:53.026 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.026 INFO:teuthology.orchestra.run.smithi162.stdout: osd map max advance = 10 2024-02-02T11:47:53.026 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.026 INFO:teuthology.orchestra.run.smithi162.stdout: journal zero on create = true 2024-02-02T11:47:53.027 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.027 INFO:teuthology.orchestra.run.smithi162.stdout: filestore ondisk finisher threads = 3 2024-02-02T11:47:53.027 INFO:teuthology.orchestra.run.smithi162.stdout: filestore apply finisher threads = 3 2024-02-02T11:47:53.027 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.027 INFO:teuthology.orchestra.run.smithi162.stdout: bdev debug aio = true 2024-02-02T11:47:53.027 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug misdirected ops = true 2024-02-02T11:47:53.027 INFO:teuthology.orchestra.run.smithi162.stdout: bdev async discard = True 2024-02-02T11:47:53.027 INFO:teuthology.orchestra.run.smithi162.stdout: bdev enable discard = True 2024-02-02T11:47:53.027 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore allocator = bitmap 2024-02-02T11:47:53.027 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore block size = 96636764160 2024-02-02T11:47:53.027 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore fsck on mount = True 2024-02-02T11:47:53.027 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluefs = 1/20 2024-02-02T11:47:53.027 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluestore = 1/20 2024-02-02T11:47:53.027 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-02-02T11:47:53.028 INFO:teuthology.orchestra.run.smithi162.stdout: debug osd = 20 2024-02-02T11:47:53.028 INFO:teuthology.orchestra.run.smithi162.stdout: debug rocksdb = 4/10 2024-02-02T11:47:53.028 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull_ratio = 0.85 2024-02-02T11:47:53.028 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.9 2024-02-02T11:47:53.028 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.8 2024-02-02T11:47:53.028 INFO:teuthology.orchestra.run.smithi162.stdout: osd failsafe full ratio = 0.95 2024-02-02T11:47:53.028 INFO:teuthology.orchestra.run.smithi162.stdout: osd objectstore = bluestore 2024-02-02T11:47:53.028 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2024-02-02T11:47:53.028 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.028 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr] 2024-02-02T11:47:53.028 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-02-02T11:47:53.028 INFO:teuthology.orchestra.run.smithi162.stdout: debug mgr = 20 2024-02-02T11:47:53.028 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-02-02T11:47:53.029 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-02-02T11:47:53.029 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-02-02T11:47:53.029 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-02-02T11:47:53.029 INFO:teuthology.orchestra.run.smithi162.stdout: mgr/telemetry/nag = false 2024-02-02T11:47:53.029 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.029 INFO:teuthology.orchestra.run.smithi162.stdout:[mon] 2024-02-02T11:47:53.029 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-02-02T11:47:53.029 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-02-02T11:47:53.029 INFO:teuthology.orchestra.run.smithi162.stdout: debug paxos = 20 2024-02-02T11:47:53.029 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-02-02T11:47:53.029 INFO:teuthology.orchestra.run.smithi162.stdout: mon data avail warn = 5 2024-02-02T11:47:53.030 INFO:teuthology.orchestra.run.smithi162.stdout: mon mgr mkfs grace = 240 2024-02-02T11:47:53.030 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-02-02T11:47:53.030 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd reporter subtree level = osd 2024-02-02T11:47:53.030 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd prime pg temp = true 2024-02-02T11:47:53.030 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-02-02T11:47:53.030 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.030 INFO:teuthology.orchestra.run.smithi162.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-02T11:47:53.030 INFO:teuthology.orchestra.run.smithi162.stdout: auth mon ticket ttl = 660 # 11m 2024-02-02T11:47:53.030 INFO:teuthology.orchestra.run.smithi162.stdout: auth service ticket ttl = 240 # 4m 2024-02-02T11:47:53.030 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.030 INFO:teuthology.orchestra.run.smithi162.stdout: # don't complain about insecure global_id in the test suite 2024-02-02T11:47:53.031 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-02T11:47:53.031 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-02T11:47:53.031 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.031 INFO:teuthology.orchestra.run.smithi162.stdout: # 1m isn't quite enough 2024-02-02T11:47:53.031 INFO:teuthology.orchestra.run.smithi162.stdout: mon_down_mkfs_grace = 2m 2024-02-02T11:47:53.031 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.031 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_filestore_osds = false 2024-02-02T11:47:53.031 INFO:teuthology.orchestra.run.smithi162.stdout: mon op complaint time = 120 2024-02-02T11:47:53.031 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-02T11:47:53.031 INFO:teuthology.orchestra.run.smithi162.stdout:[client] 2024-02-02T11:47:53.031 INFO:teuthology.orchestra.run.smithi162.stdout: rgw cache enabled = true 2024-02-02T11:47:53.031 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable ops log = true 2024-02-02T11:47:53.031 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable usage log = true 2024-02-02T11:47:53.031 INFO:teuthology.orchestra.run.smithi162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-02T11:47:53.031 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-02T11:47:53.032 INFO:teuthology.orchestra.run.smithi162.stdout: client mount timeout = 600 2024-02-02T11:47:53.032 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2024-02-02T11:47:53.032 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-02-02T11:47:53.032 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2024-02-02T11:47:53.032 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2024-02-02T11:47:53.032 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.a] 2024-02-02T11:47:53.032 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.b] 2024-02-02T11:47:53.032 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.c] 2024-02-02T11:47:53.032 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-02-02T11:47:53.032 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2024-02-02T11:47:53.032 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-02-02T11:47:53.032 INFO:teuthology.orchestra.run.smithi162.stdout:[mds] 2024-02-02T11:47:53.032 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds = 20 2024-02-02T11:47:53.032 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds balancer = 20 2024-02-02T11:47:53.032 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-02-02T11:47:53.033 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug frag = True 2024-02-02T11:47:53.033 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug scatterstat = True 2024-02-02T11:47:53.033 INFO:teuthology.orchestra.run.smithi162.stdout: mds op complaint time = 180 2024-02-02T11:47:53.033 INFO:teuthology.orchestra.run.smithi162.stdout: mds verify scatter = True 2024-02-02T11:47:53.033 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2024-02-02T11:47:53.033 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2024-02-02T11:47:53.033 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2024-02-02T11:47:53.034 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2024-02-02T11:47:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2024-02-02T11:47:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-02T11:47:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2024-02-02T11:47:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2024-02-02T11:47:53.034 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2024-02-02T11:47:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2024-02-02T11:47:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2024-02-02T11:47:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2024-02-02T11:47:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2024-02-02T11:47:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-02T11:47:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2024-02-02T11:47:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2024-02-02T11:47:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-02T11:47:53.035 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2024-02-02T11:47:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2024-02-02T11:47:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2024-02-02T11:47:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2024-02-02T11:47:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2024-02-02T11:47:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2024-02-02T11:47:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2024-02-02T11:47:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2024-02-02T11:47:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-02T11:47:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-02T11:47:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: mon_allow_pool_size_one = true 2024-02-02T11:47:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-02T11:47:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2024-02-02T11:47:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2024-02-02T11:47:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2024-02-02T11:47:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2024-02-02T11:47:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: mon health detail to clog = false 2024-02-02T11:47:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = "172.21.15.161,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2024-02-02T11:47:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn min per osd = 0 2024-02-02T11:47:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = 6072f293-dbe3-404b-82f1-eb0e17d96787 2024-02-02T11:47:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.038 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2024-02-02T11:47:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2024-02-02T11:47:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2024-02-02T11:47:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2024-02-02T11:47:53.038 INFO:teuthology.orchestra.run.smithi177.stdout: osd mclock profile = high_recovery_ops 2024-02-02T11:47:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2024-02-02T11:47:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2024-02-02T11:47:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2024-02-02T11:47:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2024-02-02T11:47:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2024-02-02T11:47:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2024-02-02T11:47:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2024-02-02T11:47:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2024-02-02T11:47:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.039 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2024-02-02T11:47:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2024-02-02T11:47:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2024-02-02T11:47:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2024-02-02T11:47:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2024-02-02T11:47:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2024-02-02T11:47:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: bdev async discard = True 2024-02-02T11:47:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: bdev enable discard = True 2024-02-02T11:47:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore allocator = bitmap 2024-02-02T11:47:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore block size = 96636764160 2024-02-02T11:47:53.040 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore fsck on mount = True 2024-02-02T11:47:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluefs = 1/20 2024-02-02T11:47:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluestore = 1/20 2024-02-02T11:47:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-02-02T11:47:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 20 2024-02-02T11:47:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: debug rocksdb = 4/10 2024-02-02T11:47:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull_ratio = 0.85 2024-02-02T11:47:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.9 2024-02-02T11:47:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.8 2024-02-02T11:47:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: osd failsafe full ratio = 0.95 2024-02-02T11:47:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = bluestore 2024-02-02T11:47:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2024-02-02T11:47:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.041 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2024-02-02T11:47:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-02-02T11:47:53.041 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2024-02-02T11:47:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-02-02T11:47:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-02-02T11:47:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-02-02T11:47:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-02-02T11:47:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2024-02-02T11:47:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.042 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2024-02-02T11:47:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-02-02T11:47:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-02-02T11:47:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2024-02-02T11:47:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-02-02T11:47:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2024-02-02T11:47:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2024-02-02T11:47:53.042 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-02-02T11:47:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2024-02-02T11:47:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2024-02-02T11:47:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-02-02T11:47:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-02T11:47:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: auth mon ticket ttl = 660 # 11m 2024-02-02T11:47:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: auth service ticket ttl = 240 # 4m 2024-02-02T11:47:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: # don't complain about insecure global_id in the test suite 2024-02-02T11:47:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-02T11:47:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-02T11:47:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: # 1m isn't quite enough 2024-02-02T11:47:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: mon_down_mkfs_grace = 2m 2024-02-02T11:47:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.043 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_filestore_osds = false 2024-02-02T11:47:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: mon op complaint time = 120 2024-02-02T11:47:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:47:53.044 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2024-02-02T11:47:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2024-02-02T11:47:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2024-02-02T11:47:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2024-02-02T11:47:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-02T11:47:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-02T11:47:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: client mount timeout = 600 2024-02-02T11:47:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: debug client = 20 2024-02-02T11:47:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-02-02T11:47:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2024-02-02T11:47:53.044 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2024-02-02T11:47:53.044 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2024-02-02T11:47:53.045 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.b] 2024-02-02T11:47:53.045 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.c] 2024-02-02T11:47:53.045 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2024-02-02T11:47:53.045 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2024-02-02T11:47:53.045 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2024-02-02T11:47:53.045 INFO:teuthology.orchestra.run.smithi177.stdout:[mds] 2024-02-02T11:47:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds = 20 2024-02-02T11:47:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds balancer = 20 2024-02-02T11:47:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-02-02T11:47:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug frag = True 2024-02-02T11:47:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug scatterstat = True 2024-02-02T11:47:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: mds op complaint time = 180 2024-02-02T11:47:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: mds verify scatter = True 2024-02-02T11:47:53.045 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2024-02-02T11:47:53.046 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2024-02-02T11:47:53.046 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2024-02-02T11:47:53.047 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-02T11:47:53.047 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-02T11:47:53.125 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-02T11:47:53.125 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:47:53.126 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-02T11:47:53.130 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:47:53.130 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-02T11:47:53.177 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi161.front.sepia.ceph.com 2024-02-02T11:47:53.177 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:47:53.177 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-02T11:47:53.177 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-02T11:47:53.241 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:47:53.241 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-02T11:47:53.337 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi162.front.sepia.ceph.com 2024-02-02T11:47:53.353 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:47:53.353 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-02T11:47:53.353 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-02T11:47:53.377 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:47:53.377 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-02T11:47:53.427 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi177.front.sepia.ceph.com 2024-02-02T11:47:53.427 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T11:47:53.427 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-02T11:47:53.427 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-02T11:47:53.462 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T11:47:53.462 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-02T11:47:53.518 INFO:tasks.ceph:Setting up mon nodes... 2024-02-02T11:47:53.518 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-02T11:47:53.519 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-02-02T11:47:53.562 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-02-02T11:47:53.565 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-02T11:47:53.607 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-02T11:47:53.621 INFO:tasks.ceph:Setting up mds nodes... 2024-02-02T11:47:53.621 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-02-02T11:47:53.664 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-02-02T11:47:53.667 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-02-02T11:47:53.725 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-02-02T11:47:53.813 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-02-02T11:47:53.815 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-02-02T11:47:53.867 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-02-02T11:47:53.912 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-02-02T11:47:53.915 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-02-02T11:47:53.970 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-02T11:47:53.970 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-02T11:47:54.017 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-02T11:47:54.049 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-02T11:47:54.049 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-02T11:47:54.049 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-02T11:47:54.063 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-02T11:47:54.063 INFO:tasks.ceph:role: osd.0 2024-02-02T11:47:54.063 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com 2024-02-02T11:47:54.063 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-02T11:47:54.123 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-02T11:47:54.123 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-02T11:47:54.124 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-02T11:47:54.124 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-02T11:47:54.124 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-02T11:47:54.124 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-02-02T11:47:54.124 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-02T11:47:54.124 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-02T11:47:54.124 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-02T11:47:54.124 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-02T11:47:54.597 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-02-02T11:47:54.599 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-02-02T11:47:54.599 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-02T11:47:54.773 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-02T11:47:54.785 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-02T11:47:54.785 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2024-02-02T11:47:54.786 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-02T11:47:54.840 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-02T11:47:54.840 INFO:tasks.ceph:role: osd.1 2024-02-02T11:47:54.840 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com 2024-02-02T11:47:54.840 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-02T11:47:54.905 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-02T11:47:54.905 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-02T11:47:54.905 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-02T11:47:54.905 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-02T11:47:54.905 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-02T11:47:54.905 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-02-02T11:47:54.905 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-02T11:47:54.905 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-02T11:47:54.905 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-02T11:47:54.906 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-02T11:47:55.359 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-02-02T11:47:55.361 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-02-02T11:47:55.361 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-02-02T11:47:55.454 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-02T11:47:55.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-02T11:47:55.463 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2024-02-02T11:47:55.464 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-02T11:47:55.518 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-02T11:47:55.518 INFO:tasks.ceph:role: osd.2 2024-02-02T11:47:55.518 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com 2024-02-02T11:47:55.518 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-02T11:47:55.580 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-02T11:47:55.580 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-02T11:47:55.580 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-02T11:47:55.581 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-02T11:47:55.581 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-02T11:47:55.581 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-02-02T11:47:55.581 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-02T11:47:55.581 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-02T11:47:55.581 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-02T11:47:55.581 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-02T11:47:56.043 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-02-02T11:47:56.045 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-02-02T11:47:56.045 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-02-02T11:47:56.163 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-02T11:47:56.173 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2024-02-02T11:47:56.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-02T11:47:56.174 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-02T11:47:56.227 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-02T11:47:56.227 INFO:tasks.ceph:role: osd.3 2024-02-02T11:47:56.227 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com 2024-02-02T11:47:56.227 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-02T11:47:56.290 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-02T11:47:56.290 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-02T11:47:56.290 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-02T11:47:56.290 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-02T11:47:56.290 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-02T11:47:56.290 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-02-02T11:47:56.290 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-02T11:47:56.290 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-02T11:47:56.290 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-02T11:47:56.290 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-02T11:47:56.788 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-02-02T11:47:56.789 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-02-02T11:47:56.790 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-02-02T11:47:56.945 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-02T11:47:56.957 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-02T11:47:56.957 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2024-02-02T11:47:56.957 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-02T11:47:57.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:47:57.085+0000 7ff2abff9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-02T11:47:57.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:47:57.089+0000 7ff2abff9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-02T11:47:57.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:47:57.089+0000 7ff2abff9640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-02T11:47:57.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:47:57.089+0000 7ff2abff9640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-02T11:47:57.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:47:57.089+0000 7ff2abff9640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-02T11:47:57.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:47:57.089+0000 7ff2abff9640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-02T11:48:00.113 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-02T11:48:00.126 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-02T11:48:00.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:00.205+0000 7f10d0031640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-02T11:48:00.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:00.205+0000 7f10d0031640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-02T11:48:00.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:00.205+0000 7f10d0031640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-02T11:48:00.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:00.205+0000 7f10d0031640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-02T11:48:00.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:00.205+0000 7f10d0031640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-02T11:48:00.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:00.205+0000 7f10d0031640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-02T11:48:03.217 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-02T11:48:03.272 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-02T11:48:03.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:03.353+0000 7faf3da7f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-02T11:48:03.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:03.357+0000 7faf3da7f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-02T11:48:03.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:03.357+0000 7faf3da7f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-02T11:48:03.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:03.357+0000 7faf3da7f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-02T11:48:03.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:03.357+0000 7faf3da7f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-02T11:48:03.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:03.357+0000 7faf3da7f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-02T11:48:06.367 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-02T11:48:06.421 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-02T11:48:06.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:06.501+0000 7efcac14e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-02T11:48:06.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:06.501+0000 7efcac14e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-02T11:48:06.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:06.501+0000 7efcac14e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-02T11:48:06.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:06.501+0000 7efcac14e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-02T11:48:06.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:06.501+0000 7efcac14e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-02T11:48:06.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:06.501+0000 7efcac14e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-02T11:48:09.491 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-02T11:48:09.549 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-02-02T11:48:09.564 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-02T11:48:09.564 INFO:tasks.ceph:role: osd.4 2024-02-02T11:48:09.564 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com 2024-02-02T11:48:09.564 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-02T11:48:09.626 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-02T11:48:09.626 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-02T11:48:09.626 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-02T11:48:09.626 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-02T11:48:09.626 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-02T11:48:09.626 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-02-02T11:48:09.626 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-02T11:48:09.626 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-02T11:48:09.626 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-02T11:48:09.626 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-02T11:48:10.069 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-02-02T11:48:10.071 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-02-02T11:48:10.071 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-02-02T11:48:10.153 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-02-02T11:48:10.203 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-02T11:48:10.203 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: /sbin/restorecon: command not found 2024-02-02T11:48:10.203 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-02-02T11:48:10.257 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-02T11:48:10.258 INFO:tasks.ceph:role: osd.5 2024-02-02T11:48:10.258 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com 2024-02-02T11:48:10.258 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-02T11:48:10.322 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-02T11:48:10.322 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-02T11:48:10.323 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-02T11:48:10.323 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-02T11:48:10.323 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-02T11:48:10.323 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-02-02T11:48:10.323 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-02T11:48:10.323 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-02T11:48:10.323 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-02T11:48:10.323 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-02T11:48:10.795 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-02-02T11:48:10.797 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-02-02T11:48:10.798 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-02-02T11:48:10.972 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-02-02T11:48:10.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-02T11:48:10.984 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: /sbin/restorecon: command not found 2024-02-02T11:48:10.985 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-02-02T11:48:11.038 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-02T11:48:11.038 INFO:tasks.ceph:role: osd.6 2024-02-02T11:48:11.038 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com 2024-02-02T11:48:11.038 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-02T11:48:11.101 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-02T11:48:11.102 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-02T11:48:11.102 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-02T11:48:11.102 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-02T11:48:11.102 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-02T11:48:11.102 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-02-02T11:48:11.102 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-02T11:48:11.102 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-02T11:48:11.102 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-02T11:48:11.102 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-02T11:48:11.582 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-02-02T11:48:11.584 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-02-02T11:48:11.584 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-02-02T11:48:11.721 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-02-02T11:48:11.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-02T11:48:11.733 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: /sbin/restorecon: command not found 2024-02-02T11:48:11.733 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-02-02T11:48:11.785 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-02T11:48:11.785 INFO:tasks.ceph:role: osd.7 2024-02-02T11:48:11.785 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com 2024-02-02T11:48:11.785 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-02T11:48:11.849 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-02T11:48:11.849 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-02T11:48:11.849 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-02T11:48:11.849 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-02T11:48:11.849 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-02T11:48:11.849 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-02-02T11:48:11.849 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-02T11:48:11.849 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-02T11:48:11.849 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-02T11:48:11.849 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-02T11:48:12.268 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-02-02T11:48:12.270 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-02-02T11:48:12.271 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-02-02T11:48:12.355 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-02-02T11:48:12.406 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-02T11:48:12.407 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: /sbin/restorecon: command not found 2024-02-02T11:48:12.407 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-02T11:48:12.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:12.509+0000 7fb41964c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-02-02T11:48:12.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:12.513+0000 7fb41964c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-02-02T11:48:12.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:12.513+0000 7fb41964c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-02T11:48:12.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:12.513+0000 7fb41964c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-02T11:48:12.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:12.513+0000 7fb41964c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-02T11:48:12.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:12.517+0000 7fb41964c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-02-02T11:48:15.529 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-02T11:48:15.544 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-02T11:48:15.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:15.628+0000 7feb87993640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-02-02T11:48:15.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:15.628+0000 7feb87993640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-02-02T11:48:15.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:15.628+0000 7feb87993640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-02T11:48:15.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:15.628+0000 7feb87993640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-02T11:48:15.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:15.628+0000 7feb87993640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-02T11:48:15.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:15.628+0000 7feb87993640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-02-02T11:48:18.644 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-02T11:48:18.699 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-02T11:48:18.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:18.780+0000 7f4346cb0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-02-02T11:48:18.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:18.780+0000 7f4346cb0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-02-02T11:48:18.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:18.780+0000 7f4346cb0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-02T11:48:18.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:18.780+0000 7f4346cb0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-02T11:48:18.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:18.780+0000 7f4346cb0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-02T11:48:18.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:18.784+0000 7f4346cb0640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-02-02T11:48:21.223 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:48:21.226 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:48:21.228 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:48:21.798 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-02T11:48:21.812 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-02T11:48:21.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:21.892+0000 7f87480be640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-02-02T11:48:21.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:21.892+0000 7f87480be640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-02-02T11:48:21.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:21.892+0000 7f87480be640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-02T11:48:21.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:21.892+0000 7f87480be640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-02T11:48:21.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:21.892+0000 7f87480be640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-02T11:48:21.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:21.896+0000 7f87480be640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-02-02T11:48:24.906 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-02T11:48:24.960 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-02T11:48:24.960 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:48:24.960 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-02-02T11:48:24.974 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:48:24.974 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-02-02T11:48:25.028 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:48:25.028 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-02-02T11:48:25.083 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:48:25.083 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-02T11:48:25.135 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:48:25.136 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-02T11:48:25.192 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:48:25.192 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-02T11:48:25.247 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:48:25.247 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-02T11:48:25.300 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:48:25.300 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-02T11:48:25.314 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:48:25.314 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-02-02T11:48:25.370 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:48:25.370 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-02-02T11:48:25.421 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:48:25.421 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-02-02T11:48:25.473 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:48:25.473 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-02-02T11:48:25.526 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:48:25.526 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-02-02T11:48:25.581 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T11:48:25.581 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-02T11:48:25.591 INFO:tasks.ceph:Adding keys to all mons... 2024-02-02T11:48:25.591 DEBUG:teuthology.orchestra.run.smithi161:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-02T11:48:25.594 DEBUG:teuthology.orchestra.run.smithi162:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-02T11:48:25.625 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.y] 2024-02-02T11:48:25.625 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBp1rxl6AKeIRAA9stWSYjJgcwek6W7OP/Rhg== 2024-02-02T11:48:25.625 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2024-02-02T11:48:25.625 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBp1rxlxOawJxAAWSZawj3hS89wA1DPGE7yHg== 2024-02-02T11:48:25.625 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2024-02-02T11:48:25.625 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBp1rxlJaKPMBAAwUlSQGoRtA9BOYUiin0wPw== 2024-02-02T11:48:25.625 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.0] 2024-02-02T11:48:25.625 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBt1rxlYDpRBRAAaf9rBuQ+CXaL59M7j9xrNw== 2024-02-02T11:48:25.625 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.1] 2024-02-02T11:48:25.625 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBw1rxlG55oDBAACBKhNZqFQHR3ljkr4k9JwQ== 2024-02-02T11:48:25.625 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.2] 2024-02-02T11:48:25.626 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBz1rxllNJUFRAAU932UD89z/nyyuLZQ8Fjyw== 2024-02-02T11:48:25.626 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.3] 2024-02-02T11:48:25.626 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQB21rxlLe8QHhAAiWoWiIUOEdgT6DkemPzrcA== 2024-02-02T11:48:25.626 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.x] 2024-02-02T11:48:25.626 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBp1rxlVo5eJBAAHd9UNm1vBCM9RgVJT77dog== 2024-02-02T11:48:25.626 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2024-02-02T11:48:25.626 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBp1rxlCYiNNhAAGqk9Tlg8Ax72P7SD1HJ3qg== 2024-02-02T11:48:25.626 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.4] 2024-02-02T11:48:25.626 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQB81rxl5fyyHhAA6KPyf/xxUmu/eoY4VdNXGw== 2024-02-02T11:48:25.626 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.5] 2024-02-02T11:48:25.626 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQB/1rxlroG5JRAA0dXPT9pnOdKVCNpJoR4IdQ== 2024-02-02T11:48:25.626 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.6] 2024-02-02T11:48:25.626 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCC1rxlv922LhAA9K1LeUlZqdXuJwckWT7oQw== 2024-02-02T11:48:25.627 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.7] 2024-02-02T11:48:25.627 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCF1rxlwx9iNRAA27J1KGMoczm20Aa+zYOU8w== 2024-02-02T11:48:25.627 INFO:teuthology.orchestra.run.smithi161.stdout:[client.0] 2024-02-02T11:48:25.627 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBq1rxlnABLARAAW/Va1VLc/q9UBtLt0a0gKg== 2024-02-02T11:48:25.633 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.y] 2024-02-02T11:48:25.633 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBp1rxl6AKeIRAA9stWSYjJgcwek6W7OP/Rhg== 2024-02-02T11:48:25.633 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-02-02T11:48:25.633 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBp1rxlxOawJxAAWSZawj3hS89wA1DPGE7yHg== 2024-02-02T11:48:25.633 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2024-02-02T11:48:25.633 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBp1rxlJaKPMBAAwUlSQGoRtA9BOYUiin0wPw== 2024-02-02T11:48:25.633 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.0] 2024-02-02T11:48:25.633 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBt1rxlYDpRBRAAaf9rBuQ+CXaL59M7j9xrNw== 2024-02-02T11:48:25.633 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.1] 2024-02-02T11:48:25.633 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBw1rxlG55oDBAACBKhNZqFQHR3ljkr4k9JwQ== 2024-02-02T11:48:25.633 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.2] 2024-02-02T11:48:25.634 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBz1rxllNJUFRAAU932UD89z/nyyuLZQ8Fjyw== 2024-02-02T11:48:25.634 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.3] 2024-02-02T11:48:25.634 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB21rxlLe8QHhAAiWoWiIUOEdgT6DkemPzrcA== 2024-02-02T11:48:25.634 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.x] 2024-02-02T11:48:25.634 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBp1rxlVo5eJBAAHd9UNm1vBCM9RgVJT77dog== 2024-02-02T11:48:25.634 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-02-02T11:48:25.634 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBp1rxlCYiNNhAAGqk9Tlg8Ax72P7SD1HJ3qg== 2024-02-02T11:48:25.634 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.4] 2024-02-02T11:48:25.634 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB81rxl5fyyHhAA6KPyf/xxUmu/eoY4VdNXGw== 2024-02-02T11:48:25.634 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.5] 2024-02-02T11:48:25.634 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB/1rxlroG5JRAA0dXPT9pnOdKVCNpJoR4IdQ== 2024-02-02T11:48:25.634 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.6] 2024-02-02T11:48:25.634 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCC1rxlv922LhAA9K1LeUlZqdXuJwckWT7oQw== 2024-02-02T11:48:25.634 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.7] 2024-02-02T11:48:25.634 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCF1rxlwx9iNRAA27J1KGMoczm20Aa+zYOU8w== 2024-02-02T11:48:25.635 INFO:teuthology.orchestra.run.smithi162.stdout:[client.0] 2024-02-02T11:48:25.635 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBq1rxlnABLARAAW/Va1VLc/q9UBtLt0a0gKg== 2024-02-02T11:48:25.635 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-02T11:48:25.674 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-02T11:48:25.724 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-02T11:48:25.761 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-02T11:48:25.806 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-02T11:48:25.850 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-02T11:48:25.898 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-02T11:48:25.933 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-02T11:48:25.977 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-02T11:48:26.014 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-02T11:48:26.063 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-02T11:48:26.094 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-02T11:48:26.134 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-02T11:48:26.174 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-02T11:48:26.223 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-02T11:48:26.254 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-02T11:48:26.294 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-02T11:48:26.339 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-02T11:48:26.385 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-02T11:48:26.422 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-02T11:48:26.464 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-02T11:48:26.502 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-02T11:48:26.550 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-02T11:48:26.581 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-02T11:48:26.629 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-02T11:48:26.661 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-02T11:48:26.712 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-02T11:48:26.746 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-02T11:48:26.800 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-02T11:48:26.800 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-02T11:48:26.839 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-02T11:48:26.933 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-02T11:48:26.945 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-02-02T11:48:26.959 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-02T11:48:27.056 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-02-02T11:48:27.067 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-02-02T11:48:27.121 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-02T11:48:27.214 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-02-02T11:48:27.225 DEBUG:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-02T11:48:27.228 DEBUG:teuthology.orchestra.run.smithi162:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-02T11:48:27.275 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-02T11:48:27.275 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-02T11:48:27.275 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-02T11:48:27.277 INFO:tasks.ceph.mon.a:Started 2024-02-02T11:48:27.277 INFO:tasks.ceph.mon.b:Restarting daemon 2024-02-02T11:48:27.278 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-02-02T11:48:27.320 INFO:tasks.ceph.mon.b:Started 2024-02-02T11:48:27.320 INFO:tasks.ceph.mon.c:Restarting daemon 2024-02-02T11:48:27.320 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-02-02T11:48:27.322 INFO:tasks.ceph.mon.c:Started 2024-02-02T11:48:27.322 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-02T11:48:27.322 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-02-02T11:48:27.322 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-02-02T11:48:27.325 INFO:tasks.ceph.mgr.y:Started 2024-02-02T11:48:27.325 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-02T11:48:27.325 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-02T11:48:27.327 INFO:tasks.ceph.mgr.x:Started 2024-02-02T11:48:27.327 INFO:tasks.ceph:Setting crush tunables to default 2024-02-02T11:48:27.327 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd crush tunables default 2024-02-02T11:48:27.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.445+0000 7f73660da640 1 Processor -- start 2024-02-02T11:48:27.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.445+0000 7f73660da640 1 -- start start 2024-02-02T11:48:27.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.445+0000 7f73660da640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f736006f520 0x7f7360071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:27.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.445+0000 7f73660da640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73600b8350 con 0x7f7360147c20 2024-02-02T11:48:27.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.445+0000 7f73660da640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73600afd40 con 0x7f736006af90 2024-02-02T11:48:27.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.445+0000 7f73660da640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73600b8170 con 0x7f736006f520 2024-02-02T11:48:27.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.445+0000 7f735ffff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7360147c20 0x7f73601552d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:58936/0 (socket says 172.21.15.161:58936) 2024-02-02T11:48:27.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.445+0000 7f735ffff640 1 -- 172.21.15.161:0/3053056583 learned_addr learned my addr 172.21.15.161:0/3053056583 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:48:27.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.445+0000 7f735effd640 1 --2- 172.21.15.161:0/3053056583 >> v2:172.21.15.162:3300/0 conn(0x7f736006f520 0x7f7360071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:27.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.445+0000 7f735effd640 1 -- 172.21.15.161:0/3053056583 >> v2:172.21.15.162:3300/0 conn(0x7f736006f520 msgr2=0x7f7360071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-02T11:48:27.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.445+0000 7f735effd640 1 -- 172.21.15.161:0/3053056583 >> v2:172.21.15.162:3300/0 conn(0x7f736006f520 msgr2=0x7f7360071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-02T11:48:27.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.445+0000 7f735effd640 1 --2- 172.21.15.161:0/3053056583 >> v2:172.21.15.162:3300/0 conn(0x7f736006f520 0x7f7360071dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-02T11:48:27.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.445+0000 7f735effd640 1 --2- 172.21.15.161:0/3053056583 >> v2:172.21.15.162:3300/0 conn(0x7f736006f520 0x7f7360071dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-02T11:48:27.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.649+0000 7f735effd640 1 --2- 172.21.15.161:0/3053056583 >> v2:172.21.15.162:3300/0 conn(0x7f736006f520 0x7f7360071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:27.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.649+0000 7f735effd640 1 -- 172.21.15.161:0/3053056583 >> v2:172.21.15.162:3300/0 conn(0x7f736006f520 msgr2=0x7f7360071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-02T11:48:27.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.649+0000 7f735effd640 1 -- 172.21.15.161:0/3053056583 >> v2:172.21.15.162:3300/0 conn(0x7f736006f520 msgr2=0x7f7360071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-02T11:48:27.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.649+0000 7f735effd640 1 --2- 172.21.15.161:0/3053056583 >> v2:172.21.15.162:3300/0 conn(0x7f736006f520 0x7f7360071dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-02T11:48:27.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.649+0000 7f735effd640 1 --2- 172.21.15.161:0/3053056583 >> v2:172.21.15.162:3300/0 conn(0x7f736006f520 0x7f7360071dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-02T11:48:27.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.721+0000 7f735e7fc640 1 -- 172.21.15.161:0/3053056583 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359582367 0 0) 0x7f73600afd40 con 0x7f736006af90 2024-02-02T11:48:27.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.721+0000 7f735e7fc640 1 -- 172.21.15.161:0/3053056583 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7348003530 con 0x7f736006af90 2024-02-02T11:48:27.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.721+0000 7f735e7fc640 1 -- 172.21.15.161:0/3053056583 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141981408 0 0) 0x7f73600b8350 con 0x7f7360147c20 2024-02-02T11:48:27.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.721+0000 7f735e7fc640 1 -- 172.21.15.161:0/3053056583 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73600afd40 con 0x7f7360147c20 2024-02-02T11:48:27.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735e7fc640 1 -- 172.21.15.161:0/3053056583 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3891955059 0 0) 0x7f73600afd40 con 0x7f7360147c20 2024-02-02T11:48:27.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735e7fc640 1 -- 172.21.15.161:0/3053056583 >> v2:172.21.15.162:3300/0 conn(0x7f736006f520 msgr2=0x7f7360071dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-02T11:48:27.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735e7fc640 1 --2- 172.21.15.161:0/3053056583 >> v2:172.21.15.162:3300/0 conn(0x7f736006f520 0x7f7360071dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:27.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735e7fc640 1 -- 172.21.15.161:0/3053056583 >> v1:172.21.15.162:6789/0 conn(0x7f736006af90 legacy=0x7f7360070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:27.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735e7fc640 1 -- 172.21.15.161:0/3053056583 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736014dfa0 con 0x7f7360147c20 2024-02-02T11:48:27.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735e7fc640 1 -- 172.21.15.161:0/3053056583 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f7358001a00 con 0x7f7360147c20 2024-02-02T11:48:27.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735e7fc640 1 -- 172.21.15.161:0/3053056583 >> v1:172.21.15.161:6789/0 conn(0x7f7360147c20 legacy=0x7f73601552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:27.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735e7fc640 1 --2- 172.21.15.161:0/3053056583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7348004b70 0x7f7348004f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:27.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735e7fc640 1 --2- 172.21.15.161:0/3053056583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7348003770 0x7f7348003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:27.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735e7fc640 1 --2- 172.21.15.161:0/3053056583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7348004130 0x7f734800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:27.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735e7fc640 1 -- 172.21.15.161:0/3053056583 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73600b8170 con 0x7f7348003770 2024-02-02T11:48:27.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735e7fc640 1 -- 172.21.15.161:0/3053056583 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734800c0c0 con 0x7f7348004b70 2024-02-02T11:48:27.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735e7fc640 1 -- 172.21.15.161:0/3053056583 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734800c280 con 0x7f7348004130 2024-02-02T11:48:27.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735f7fe640 1 --2- 172.21.15.161:0/3053056583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7348004b70 0x7f7348004f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:27.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735effd640 1 --2- 172.21.15.161:0/3053056583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7348003770 0x7f7348003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:27.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735ffff640 1 --2- 172.21.15.161:0/3053056583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7348004130 0x7f734800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:27.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735effd640 1 -- 172.21.15.161:0/3053056583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7348004130 msgr2=0x7f734800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:27.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735effd640 1 --2- 172.21.15.161:0/3053056583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7348004130 0x7f734800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:27.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735effd640 1 -- 172.21.15.161:0/3053056583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7348004b70 msgr2=0x7f7348004f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:27.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735effd640 1 --2- 172.21.15.161:0/3053056583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7348004b70 0x7f7348004f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:27.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735effd640 1 -- 172.21.15.161:0/3053056583 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73600afd40 con 0x7f7348003770 2024-02-02T11:48:27.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.725+0000 7f735ffff640 1 -- 172.21.15.161:0/3053056583 reap_dead start 2024-02-02T11:48:27.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.729+0000 7f735effd640 1 --2- 172.21.15.161:0/3053056583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7348003770 0x7f7348003bf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7354000ee0 tx=0x7f735401c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64f6d9df810e594 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:27.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.729+0000 7f735e7fc640 1 -- 172.21.15.161:0/3053056583 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73540aa660 con 0x7f7348003770 2024-02-02T11:48:27.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.729+0000 7f735e7fc640 1 -- 172.21.15.161:0/3053056583 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73540aa7c0 con 0x7f7348003770 2024-02-02T11:48:27.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.729+0000 7f735e7fc640 1 -- 172.21.15.161:0/3053056583 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73540aabb0 con 0x7f7348003770 2024-02-02T11:48:27.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.729+0000 7f73660da640 1 -- 172.21.15.161:0/3053056583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7348003770 msgr2=0x7f7348003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:27.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.729+0000 7f73660da640 1 --2- 172.21.15.161:0/3053056583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7348003770 0x7f7348003bf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7354000ee0 tx=0x7f735401c7f0 comp rx=0 tx=0).stop 2024-02-02T11:48:27.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.729+0000 7f73660da640 1 -- 172.21.15.161:0/3053056583 shutdown_connections 2024-02-02T11:48:27.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.729+0000 7f73660da640 1 --2- 172.21.15.161:0/3053056583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7348003770 0x7f7348003bf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:27.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.729+0000 7f73660da640 1 -- 172.21.15.161:0/3053056583 >> 172.21.15.161:0/3053056583 conn(0x7f73600b9140 msgr2=0x7f73600b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:27.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.729+0000 7f73660da640 1 -- 172.21.15.161:0/3053056583 shutdown_connections 2024-02-02T11:48:27.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.729+0000 7f73660da640 1 -- 172.21.15.161:0/3053056583 wait complete. 2024-02-02T11:48:27.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.733+0000 7f73660da640 1 Processor -- start 2024-02-02T11:48:27.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.733+0000 7f73660da640 1 -- start start 2024-02-02T11:48:27.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.733+0000 7f73660da640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7348003770 0x7f736014d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.733+0000 7f73660da640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7360149a90 0x7f73601483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.733+0000 7f73660da640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7360148910 0x7f736013fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.733+0000 7f73660da640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73600b0020 con 0x7f7360148910 2024-02-02T11:48:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.733+0000 7f73660da640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73600afb60 con 0x7f7348003770 2024-02-02T11:48:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.733+0000 7f73660da640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736014d9f0 con 0x7f7360149a90 2024-02-02T11:48:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.733+0000 7f735ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7360148910 0x7f736013fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.733+0000 7f735ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7360148910 0x7f736013fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33478/0 (socket says 172.21.15.161:33478) 2024-02-02T11:48:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.733+0000 7f735ffff640 1 -- 172.21.15.161:0/3315178470 learned_addr learned my addr 172.21.15.161:0/3315178470 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.733+0000 7f735effd640 1 --2- 172.21.15.161:0/3315178470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7360149a90 0x7f73601483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.733+0000 7f735f7fe640 1 --2- 172.21.15.161:0/3315178470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7348003770 0x7f736014d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.733+0000 7f735ffff640 1 -- 172.21.15.161:0/3315178470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7360149a90 msgr2=0x7f73601483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.733+0000 7f735ffff640 1 --2- 172.21.15.161:0/3315178470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7360149a90 0x7f73601483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.733+0000 7f735ffff640 1 -- 172.21.15.161:0/3315178470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7348003770 msgr2=0x7f736014d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.733+0000 7f735ffff640 1 --2- 172.21.15.161:0/3315178470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7348003770 0x7f736014d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:27.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.733+0000 7f735ffff640 1 -- 172.21.15.161:0/3315178470 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7360148d90 con 0x7f7360148910 2024-02-02T11:48:27.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.737+0000 7f735ffff640 1 --2- 172.21.15.161:0/3315178470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7360148910 0x7f736013fda0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7360066870 tx=0x7f73580079b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:27.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.737+0000 7f7347fff640 1 -- 172.21.15.161:0/3315178470 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735800ae10 con 0x7f7360148910 2024-02-02T11:48:27.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.737+0000 7f7347fff640 1 -- 172.21.15.161:0/3315178470 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7358011720 con 0x7f7360148910 2024-02-02T11:48:27.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.737+0000 7f73660da640 1 -- 172.21.15.161:0/3315178470 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73600b14a0 con 0x7f7360148910 2024-02-02T11:48:27.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.737+0000 7f7347fff640 1 -- 172.21.15.161:0/3315178470 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7358011ad0 con 0x7f7360148910 2024-02-02T11:48:27.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.737+0000 7f73660da640 1 -- 172.21.15.161:0/3315178470 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f736014ac60 con 0x7f7360148910 2024-02-02T11:48:27.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.737+0000 7f7347fff640 1 -- 172.21.15.161:0/3315178470 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7358011c30 con 0x7f7360148910 2024-02-02T11:48:27.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.737+0000 7f7347fff640 1 -- 172.21.15.161:0/3315178470 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f73580167b0 con 0x7f7360148910 2024-02-02T11:48:27.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.737+0000 7f73660da640 1 -- 172.21.15.161:0/3315178470 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736004e000 con 0x7f7360148910 2024-02-02T11:48:27.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.741+0000 7f7347fff640 1 -- 172.21.15.161:0/3315178470 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f735801c070 con 0x7f7360148910 2024-02-02T11:48:27.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.805+0000 7f73660da640 1 -- 172.21.15.161:0/3315178470 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f736014a210 con 0x7f7360148910 2024-02-02T11:48:27.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.813+0000 7f7347fff640 1 -- 172.21.15.161:0/3315178470 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7358010040 con 0x7f7360148910 2024-02-02T11:48:27.816 INFO:teuthology.orchestra.run.smithi161.stderr:adjusted tunables profile to default 2024-02-02T11:48:27.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.813+0000 7f73660da640 1 -- 172.21.15.161:0/3315178470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7360148910 msgr2=0x7f736013fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:27.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.813+0000 7f73660da640 1 --2- 172.21.15.161:0/3315178470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7360148910 0x7f736013fda0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7360066870 tx=0x7f73580079b0 comp rx=0 tx=0).stop 2024-02-02T11:48:27.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.813+0000 7f73660da640 1 -- 172.21.15.161:0/3315178470 shutdown_connections 2024-02-02T11:48:27.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.813+0000 7f73660da640 1 --2- 172.21.15.161:0/3315178470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7360148910 0x7f736013fda0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:27.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.813+0000 7f73660da640 1 --2- 172.21.15.161:0/3315178470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7360149a90 0x7f73601483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:27.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.813+0000 7f73660da640 1 --2- 172.21.15.161:0/3315178470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7348003770 0x7f736014d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:27.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.813+0000 7f73660da640 1 -- 172.21.15.161:0/3315178470 >> 172.21.15.161:0/3315178470 conn(0x7f73600b9140 msgr2=0x7f73600708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:27.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.813+0000 7f73660da640 1 -- 172.21.15.161:0/3315178470 shutdown_connections 2024-02-02T11:48:27.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:27.813+0000 7f73660da640 1 -- 172.21.15.161:0/3315178470 wait complete. 2024-02-02T11:48:27.831 INFO:tasks.ceph:check_enable_crimson: False 2024-02-02T11:48:27.831 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-02T11:48:27.832 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:48:27.832 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-02T11:48:27.842 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:48:27.842 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-02T11:48:27.893 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:48:27.893 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-02T11:48:27.914 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:27.913+0000 7fd4180a3180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-02T11:48:27.923 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-02T11:48:27.923 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-02T11:48:27.979 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:48:27.979 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-02-02T11:48:27.993 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:48:27.993 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-02-02T11:48:28.016 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:28.016+0000 7f5fc42d3180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-02T11:48:28.028 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:48:28.028 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-02-02T11:48:28.081 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-02T11:48:28.081 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-02-02T11:48:28.134 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 073e0356-beb2-40f5-95b1-bc66245b728e 0 2024-02-02T11:48:28.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56fa5c640 1 Processor -- start 2024-02-02T11:48:28.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56fa5c640 1 -- start start 2024-02-02T11:48:28.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56fa5c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff56806b090 0x7ff568144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56fa5c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff56806f630 0x7ff56814b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56fa5c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff56806b8d0 0x7ff56814e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56fa5c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56814aad0 con 0x7ff56806b090 2024-02-02T11:48:28.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56fa5c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56814adb0 con 0x7ff56806b8d0 2024-02-02T11:48:28.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56fa5c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56806e6c0 con 0x7ff56806f630 2024-02-02T11:48:28.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56cff7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff56806f630 0x7ff56814b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56dff9640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff56806b8d0 0x7ff56814e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56cff7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff56806f630 0x7ff56814b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:55196/0 (socket says 172.21.15.162:55196) 2024-02-02T11:48:28.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56cff7640 1 -- 172.21.15.162:0/284712353 learned_addr learned my addr 172.21.15.162:0/284712353 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-02-02T11:48:28.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56d7f8640 1 --2- 172.21.15.162:0/284712353 >> v2:172.21.15.161:3300/0 conn(0x7ff56806b090 0x7ff568144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56cff7640 1 -- 172.21.15.162:0/284712353 >> v2:172.21.15.162:3300/0 conn(0x7ff56806b8d0 msgr2=0x7ff56814e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:28.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56cff7640 1 --2- 172.21.15.162:0/284712353 >> v2:172.21.15.162:3300/0 conn(0x7ff56806b8d0 0x7ff56814e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56cff7640 1 -- 172.21.15.162:0/284712353 >> v2:172.21.15.161:3300/0 conn(0x7ff56806b090 msgr2=0x7ff568144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:28.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56cff7640 1 --2- 172.21.15.162:0/284712353 >> v2:172.21.15.161:3300/0 conn(0x7ff56806b090 0x7ff568144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56cff7640 1 -- 172.21.15.162:0/284712353 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56806f0b0 con 0x7ff56806f630 2024-02-02T11:48:28.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56dff9640 1 --2- 172.21.15.162:0/284712353 >> v2:172.21.15.162:3300/0 conn(0x7ff56806b8d0 0x7ff56814e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-02T11:48:28.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.296+0000 7ff56d7f8640 1 --2- 172.21.15.162:0/284712353 >> v2:172.21.15.161:3300/0 conn(0x7ff56806b090 0x7ff568144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:48:28.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.300+0000 7ff56cff7640 1 --2- 172.21.15.162:0/284712353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff56806f630 0x7ff56814b1d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff558009870 tx=0x7ff55801ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f22247c188ab37d server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:28.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.300+0000 7ff55ffff640 1 -- 172.21.15.162:0/284712353 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5580a89b0 con 0x7ff56806f630 2024-02-02T11:48:28.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.300+0000 7ff55ffff640 1 -- 172.21.15.162:0/284712353 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5580a8b10 con 0x7ff56806f630 2024-02-02T11:48:28.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.300+0000 7ff55ffff640 1 -- 172.21.15.162:0/284712353 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5580a8ea0 con 0x7ff56806f630 2024-02-02T11:48:28.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.300+0000 7ff56fa5c640 1 -- 172.21.15.162:0/284712353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff56806f630 msgr2=0x7ff56814b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:28.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.300+0000 7ff56fa5c640 1 --2- 172.21.15.162:0/284712353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff56806f630 0x7ff56814b1d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff558009870 tx=0x7ff55801ecf0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.300+0000 7ff56fa5c640 1 -- 172.21.15.162:0/284712353 shutdown_connections 2024-02-02T11:48:28.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.300+0000 7ff56fa5c640 1 --2- 172.21.15.162:0/284712353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff56806f630 0x7ff56814b1d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.300+0000 7ff56fa5c640 1 --2- 172.21.15.162:0/284712353 >> v2:172.21.15.162:3300/0 conn(0x7ff56806b8d0 0x7ff56814e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.300+0000 7ff56fa5c640 1 --2- 172.21.15.162:0/284712353 >> v2:172.21.15.161:3300/0 conn(0x7ff56806b090 0x7ff568144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.300+0000 7ff56fa5c640 1 -- 172.21.15.162:0/284712353 >> 172.21.15.162:0/284712353 conn(0x7ff5680babc0 msgr2=0x7ff5680bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:28.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.300+0000 7ff56fa5c640 1 -- 172.21.15.162:0/284712353 shutdown_connections 2024-02-02T11:48:28.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.300+0000 7ff56fa5c640 1 -- 172.21.15.162:0/284712353 wait complete. 2024-02-02T11:48:28.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.300+0000 7ff56fa5c640 1 Processor -- start 2024-02-02T11:48:28.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.300+0000 7ff56fa5c640 1 -- start start 2024-02-02T11:48:28.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56fa5c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff56806b090 0x7ff5680b8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56fa5c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff56806b8d0 0x7ff5681e0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56fa5c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff56806f630 0x7ff5681e0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56fa5c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680b93f0 con 0x7ff56806b090 2024-02-02T11:48:28.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56fa5c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff568149b50 con 0x7ff56806f630 2024-02-02T11:48:28.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56fa5c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff568149e30 con 0x7ff56806b8d0 2024-02-02T11:48:28.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56cff7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff56806b8d0 0x7ff5681e0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56dff9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff56806f630 0x7ff5681e0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56cff7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff56806b8d0 0x7ff5681e0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:55212/0 (socket says 172.21.15.162:55212) 2024-02-02T11:48:28.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56cff7640 1 -- 172.21.15.162:0/1477123230 learned_addr learned my addr 172.21.15.162:0/1477123230 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-02-02T11:48:28.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56dff9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff56806f630 0x7ff5681e0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47220/0 (socket says 172.21.15.162:47220) 2024-02-02T11:48:28.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56d7f8640 1 --2- 172.21.15.162:0/1477123230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff56806b090 0x7ff5680b8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56dff9640 1 -- 172.21.15.162:0/1477123230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff56806b8d0 msgr2=0x7ff5681e0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:28.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56dff9640 1 --2- 172.21.15.162:0/1477123230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff56806b8d0 0x7ff5681e0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56dff9640 1 -- 172.21.15.162:0/1477123230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff56806b090 msgr2=0x7ff5680b8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:28.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56dff9640 1 --2- 172.21.15.162:0/1477123230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff56806b090 0x7ff5680b8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56dff9640 1 -- 172.21.15.162:0/1477123230 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff560009a70 con 0x7ff56806f630 2024-02-02T11:48:28.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56cff7640 1 --2- 172.21.15.162:0/1477123230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff56806b8d0 0x7ff5681e0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-02T11:48:28.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56dff9640 1 --2- 172.21.15.162:0/1477123230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff56806f630 0x7ff5681e0870 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff56000ef90 tx=0x7ff56000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:28.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff55dffb640 1 -- 172.21.15.162:0/1477123230 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56000cd30 con 0x7ff56806f630 2024-02-02T11:48:28.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff55dffb640 1 -- 172.21.15.162:0/1477123230 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56000f040 con 0x7ff56806f630 2024-02-02T11:48:28.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56fa5c640 1 -- 172.21.15.162:0/1477123230 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5580094d0 con 0x7ff56806f630 2024-02-02T11:48:28.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff55dffb640 1 -- 172.21.15.162:0/1477123230 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff560003be0 con 0x7ff56806f630 2024-02-02T11:48:28.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56fa5c640 1 -- 172.21.15.162:0/1477123230 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff568149080 con 0x7ff56806f630 2024-02-02T11:48:28.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff55dffb640 1 -- 172.21.15.162:0/1477123230 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff560014780 con 0x7ff56806f630 2024-02-02T11:48:28.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff55dffb640 1 -- 172.21.15.162:0/1477123230 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff56001dc30 con 0x7ff56806f630 2024-02-02T11:48:28.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.304+0000 7ff56fa5c640 1 -- 172.21.15.162:0/1477123230 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56814a350 con 0x7ff56806f630 2024-02-02T11:48:28.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.312+0000 7ff55dffb640 1 -- 172.21.15.162:0/1477123230 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7ff56814a350 con 0x7ff56806f630 2024-02-02T11:48:28.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.380+0000 7ff56fa5c640 1 -- 172.21.15.162:0/1477123230 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "073e0356-beb2-40f5-95b1-bc66245b728e", "id": 0} v 0) v1 -- 0x7ff56806f350 con 0x7ff56806f630 2024-02-02T11:48:28.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.388+0000 7ff55dffb640 1 -- 172.21.15.162:0/1477123230 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "073e0356-beb2-40f5-95b1-bc66245b728e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff560018030 con 0x7ff56806f630 2024-02-02T11:48:28.389 INFO:teuthology.orchestra.run.smithi162.stdout:0 2024-02-02T11:48:28.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.388+0000 7ff56fa5c640 1 -- 172.21.15.162:0/1477123230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff56806f630 msgr2=0x7ff5681e0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:28.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.388+0000 7ff56fa5c640 1 --2- 172.21.15.162:0/1477123230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff56806f630 0x7ff5681e0870 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff56000ef90 tx=0x7ff56000c490 comp rx=0 tx=0).stop 2024-02-02T11:48:28.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.388+0000 7ff56fa5c640 1 -- 172.21.15.162:0/1477123230 shutdown_connections 2024-02-02T11:48:28.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.388+0000 7ff56fa5c640 1 --2- 172.21.15.162:0/1477123230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff56806f630 0x7ff5681e0870 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.388+0000 7ff56fa5c640 1 --2- 172.21.15.162:0/1477123230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff56806b8d0 0x7ff5681e0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.388+0000 7ff56fa5c640 1 --2- 172.21.15.162:0/1477123230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff56806b090 0x7ff5680b8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.388+0000 7ff56fa5c640 1 -- 172.21.15.162:0/1477123230 >> 172.21.15.162:0/1477123230 conn(0x7ff5680babc0 msgr2=0x7ff5680a1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:28.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.392+0000 7ff56fa5c640 1 -- 172.21.15.162:0/1477123230 shutdown_connections 2024-02-02T11:48:28.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.392+0000 7ff56fa5c640 1 -- 172.21.15.162:0/1477123230 wait complete. 2024-02-02T11:48:28.407 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 847c3fa7-2db2-484c-b7f5-e0fceeb194fd 1 2024-02-02T11:48:28.412 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:28.413+0000 7fd4180a3180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-02T11:48:28.495 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:28.496+0000 7f5fc42d3180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-02T11:48:28.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.520+0000 7f3c4d399640 1 Processor -- start 2024-02-02T11:48:28.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.520+0000 7f3c4d399640 1 -- start start 2024-02-02T11:48:28.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.520+0000 7f3c4d399640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3c480b5060 0x7f3c48148f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.520+0000 7f3c4d399640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c480a0c90 0x7f3c48149460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.520+0000 7f3c4d399640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4806e220 con 0x7f3c480b44a0 2024-02-02T11:48:28.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.520+0000 7f3c4d399640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c480ba850 con 0x7f3c480b5060 2024-02-02T11:48:28.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.520+0000 7f3c4d399640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4806df40 con 0x7f3c480a0c90 2024-02-02T11:48:28.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.520+0000 7f3c46ffd640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f3c480b44a0 0x7f3c481427e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:41896/0 (socket says 172.21.15.162:41896) 2024-02-02T11:48:28.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.520+0000 7f3c46ffd640 1 -- 172.21.15.162:0/1629752419 learned_addr learned my addr 172.21.15.162:0/1629752419 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-02-02T11:48:28.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.520+0000 7f3c477fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c480a0c90 0x7f3c48149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.520+0000 7f3c467fc640 1 --2- 172.21.15.162:0/1629752419 >> v2:172.21.15.161:3300/0 conn(0x7f3c480b5060 0x7f3c48148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.520+0000 7f3c45ffb640 1 -- 172.21.15.162:0/1629752419 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346035595 0 0) 0x7f3c4806e220 con 0x7f3c480b44a0 2024-02-02T11:48:28.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.520+0000 7f3c45ffb640 1 -- 172.21.15.162:0/1629752419 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c30003530 con 0x7f3c480b44a0 2024-02-02T11:48:28.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.520+0000 7f3c477fe640 1 -- 172.21.15.162:0/1629752419 >> v2:172.21.15.161:3300/0 conn(0x7f3c480b5060 msgr2=0x7f3c48148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:28.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.520+0000 7f3c477fe640 1 --2- 172.21.15.162:0/1629752419 >> v2:172.21.15.161:3300/0 conn(0x7f3c480b5060 0x7f3c48148f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.520+0000 7f3c477fe640 1 -- 172.21.15.162:0/1629752419 >> v1:172.21.15.162:6789/0 conn(0x7f3c480b44a0 legacy=0x7f3c481427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:28.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.524+0000 7f3c477fe640 1 -- 172.21.15.162:0/1629752419 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48148a00 con 0x7f3c480a0c90 2024-02-02T11:48:28.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.524+0000 7f3c477fe640 1 --2- 172.21.15.162:0/1629752419 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c480a0c90 0x7f3c48149460 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3c40009dc0 tx=0x7f3c4001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3509afde49cc6b85 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:28.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.524+0000 7f3c45ffb640 1 -- 172.21.15.162:0/1629752419 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c400a5920 con 0x7f3c480a0c90 2024-02-02T11:48:28.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.524+0000 7f3c45ffb640 1 -- 172.21.15.162:0/1629752419 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c400a5a80 con 0x7f3c480a0c90 2024-02-02T11:48:28.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.524+0000 7f3c45ffb640 1 -- 172.21.15.162:0/1629752419 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c400a5e50 con 0x7f3c480a0c90 2024-02-02T11:48:28.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.524+0000 7f3c4d399640 1 -- 172.21.15.162:0/1629752419 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c480a0c90 msgr2=0x7f3c48149460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:28.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.524+0000 7f3c4d399640 1 --2- 172.21.15.162:0/1629752419 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c480a0c90 0x7f3c48149460 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3c40009dc0 tx=0x7f3c4001c950 comp rx=0 tx=0).stop 2024-02-02T11:48:28.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.524+0000 7f3c4d399640 1 -- 172.21.15.162:0/1629752419 shutdown_connections 2024-02-02T11:48:28.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.524+0000 7f3c4d399640 1 --2- 172.21.15.162:0/1629752419 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c480a0c90 0x7f3c48149460 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.524+0000 7f3c4d399640 1 --2- 172.21.15.162:0/1629752419 >> v2:172.21.15.161:3300/0 conn(0x7f3c480b5060 0x7f3c48148f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.524+0000 7f3c4d399640 1 -- 172.21.15.162:0/1629752419 >> 172.21.15.162:0/1629752419 conn(0x7f3c480babc0 msgr2=0x7f3c480bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:28.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.524+0000 7f3c4d399640 1 -- 172.21.15.162:0/1629752419 shutdown_connections 2024-02-02T11:48:28.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.524+0000 7f3c4d399640 1 -- 172.21.15.162:0/1629752419 wait complete. 2024-02-02T11:48:28.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c4d399640 1 Processor -- start 2024-02-02T11:48:28.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c4d399640 1 -- start start 2024-02-02T11:48:28.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c4d399640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c480a0c90 0x7f3c4806ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c4d399640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c480b44a0 0x7f3c481e63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c4d399640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c480b5060 0x7f3c480a25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c4d399640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480a1e30 con 0x7f3c480b5060 2024-02-02T11:48:28.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c4d399640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c481e6c20 con 0x7f3c480b44a0 2024-02-02T11:48:28.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c4d399640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c481e6f00 con 0x7f3c480a0c90 2024-02-02T11:48:28.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c467fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c480b44a0 0x7f3c481e63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c46ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c480a0c90 0x7f3c4806ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c467fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c480b44a0 0x7f3c481e63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47236/0 (socket says 172.21.15.162:47236) 2024-02-02T11:48:28.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c46ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c480a0c90 0x7f3c4806ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:55236/0 (socket says 172.21.15.162:55236) 2024-02-02T11:48:28.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c467fc640 1 -- 172.21.15.162:0/2315320841 learned_addr learned my addr 172.21.15.162:0/2315320841 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-02-02T11:48:28.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c477fe640 1 --2- 172.21.15.162:0/2315320841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c480b5060 0x7f3c480a25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c467fc640 1 -- 172.21.15.162:0/2315320841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c480a0c90 msgr2=0x7f3c4806ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:28.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c467fc640 1 --2- 172.21.15.162:0/2315320841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c480a0c90 0x7f3c4806ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c467fc640 1 -- 172.21.15.162:0/2315320841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c480b5060 msgr2=0x7f3c480a25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:28.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c467fc640 1 --2- 172.21.15.162:0/2315320841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c480b5060 0x7f3c480a25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c467fc640 1 -- 172.21.15.162:0/2315320841 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c40009a70 con 0x7f3c480b44a0 2024-02-02T11:48:28.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c46ffd640 1 --2- 172.21.15.162:0/2315320841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c480a0c90 0x7f3c4806ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-02T11:48:28.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c477fe640 1 --2- 172.21.15.162:0/2315320841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c480b5060 0x7f3c480a25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:48:28.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c467fc640 1 --2- 172.21.15.162:0/2315320841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c480b44a0 0x7f3c481e63f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00d5c0 tx=0x7f3c3c00da80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:28.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c2f7fe640 1 -- 172.21.15.162:0/2315320841 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c004240 con 0x7f3c480b44a0 2024-02-02T11:48:28.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c2f7fe640 1 -- 172.21.15.162:0/2315320841 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c0043a0 con 0x7f3c480b44a0 2024-02-02T11:48:28.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c2f7fe640 1 -- 172.21.15.162:0/2315320841 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c003840 con 0x7f3c480b44a0 2024-02-02T11:48:28.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c4d399640 1 -- 172.21.15.162:0/2315320841 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c480a2080 con 0x7f3c480b44a0 2024-02-02T11:48:28.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c4d399640 1 -- 172.21.15.162:0/2315320841 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c480b9b00 con 0x7f3c480b44a0 2024-02-02T11:48:28.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c2f7fe640 1 -- 172.21.15.162:0/2315320841 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3c3c003ca0 con 0x7f3c480b44a0 2024-02-02T11:48:28.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c2f7fe640 1 -- 172.21.15.162:0/2315320841 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f3c3c012d00 con 0x7f3c480b44a0 2024-02-02T11:48:28.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.528+0000 7f3c4d399640 1 -- 172.21.15.162:0/2315320841 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c480a2210 con 0x7f3c480b44a0 2024-02-02T11:48:28.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.532+0000 7f3c2f7fe640 1 -- 172.21.15.162:0/2315320841 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f3c3c012420 con 0x7f3c480b44a0 2024-02-02T11:48:28.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.600+0000 7f3c4d399640 1 -- 172.21.15.162:0/2315320841 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "847c3fa7-2db2-484c-b7f5-e0fceeb194fd", "id": 1} v 0) v1 -- 0x7f3c4804e000 con 0x7f3c480b44a0 2024-02-02T11:48:28.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.608+0000 7f3c2f7fe640 1 -- 172.21.15.162:0/2315320841 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "847c3fa7-2db2-484c-b7f5-e0fceeb194fd", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3c3c0125c0 con 0x7f3c480b44a0 2024-02-02T11:48:28.610 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-02-02T11:48:28.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.612+0000 7f3c4d399640 1 -- 172.21.15.162:0/2315320841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c480b44a0 msgr2=0x7f3c481e63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:28.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.612+0000 7f3c4d399640 1 --2- 172.21.15.162:0/2315320841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c480b44a0 0x7f3c481e63f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00d5c0 tx=0x7f3c3c00da80 comp rx=0 tx=0).stop 2024-02-02T11:48:28.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.612+0000 7f3c4d399640 1 -- 172.21.15.162:0/2315320841 shutdown_connections 2024-02-02T11:48:28.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.612+0000 7f3c4d399640 1 --2- 172.21.15.162:0/2315320841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c480b5060 0x7f3c480a25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.612+0000 7f3c4d399640 1 --2- 172.21.15.162:0/2315320841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c480b44a0 0x7f3c481e63f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.612+0000 7f3c4d399640 1 --2- 172.21.15.162:0/2315320841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c480a0c90 0x7f3c4806ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.612+0000 7f3c4d399640 1 -- 172.21.15.162:0/2315320841 >> 172.21.15.162:0/2315320841 conn(0x7f3c480babc0 msgr2=0x7f3c48147d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:28.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.612+0000 7f3c4d399640 1 -- 172.21.15.162:0/2315320841 shutdown_connections 2024-02-02T11:48:28.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.612+0000 7f3c4d399640 1 -- 172.21.15.162:0/2315320841 wait complete. 2024-02-02T11:48:28.617 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:28.617+0000 7fd4180a3180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-02T11:48:28.625 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new d0ce696a-711f-4e5c-a5c0-d78822b8f46e 2 2024-02-02T11:48:28.706 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:28.704+0000 7f5fc42d3180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-02T11:48:28.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.736+0000 7fd1d9c54640 1 Processor -- start 2024-02-02T11:48:28.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.736+0000 7fd1d9c54640 1 -- start start 2024-02-02T11:48:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d9c54640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd1d40b6540 0x7fd1d41477b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d9c54640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd1d4147cf0 0x7fd1d4151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d9c54640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d4070df0 con 0x7fd1d406af90 2024-02-02T11:48:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d9c54640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d40b4260 con 0x7fd1d4147cf0 2024-02-02T11:48:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d9c54640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d40b6a60 con 0x7fd1d40b6540 2024-02-02T11:48:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d2ffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd1d40b6540 0x7fd1d41477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d2ffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd1d40b6540 0x7fd1d41477b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47240/0 (socket says 172.21.15.162:47240) 2024-02-02T11:48:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d2ffd640 1 -- 172.21.15.162:0/1616001315 learned_addr learned my addr 172.21.15.162:0/1616001315 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-02-02T11:48:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d3fff640 1 --2- 172.21.15.162:0/1616001315 >> v2:172.21.15.161:3300/0 conn(0x7fd1d4147cf0 0x7fd1d4151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d2ffd640 1 -- 172.21.15.162:0/1616001315 >> v2:172.21.15.161:3300/0 conn(0x7fd1d4147cf0 msgr2=0x7fd1d4151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d2ffd640 1 --2- 172.21.15.162:0/1616001315 >> v2:172.21.15.161:3300/0 conn(0x7fd1d4147cf0 0x7fd1d4151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d2ffd640 1 -- 172.21.15.162:0/1616001315 >> v1:172.21.15.161:6789/0 conn(0x7fd1d406af90 legacy=0x7fd1d40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:28.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d2ffd640 1 -- 172.21.15.162:0/1616001315 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d40710f0 con 0x7fd1d40b6540 2024-02-02T11:48:28.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d2ffd640 1 --2- 172.21.15.162:0/1616001315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1d40b6540 0x7fd1d41477b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4070f80 tx=0x7fd1c801ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1857793dcc8b430 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:28.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d27fc640 1 -- 172.21.15.162:0/1616001315 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80a89b0 con 0x7fd1d40b6540 2024-02-02T11:48:28.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d27fc640 1 -- 172.21.15.162:0/1616001315 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c80a8b10 con 0x7fd1d40b6540 2024-02-02T11:48:28.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d27fc640 1 -- 172.21.15.162:0/1616001315 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80a8ea0 con 0x7fd1d40b6540 2024-02-02T11:48:28.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d9c54640 1 -- 172.21.15.162:0/1616001315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1d40b6540 msgr2=0x7fd1d41477b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:28.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d9c54640 1 --2- 172.21.15.162:0/1616001315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1d40b6540 0x7fd1d41477b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4070f80 tx=0x7fd1c801ecb0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d9c54640 1 -- 172.21.15.162:0/1616001315 shutdown_connections 2024-02-02T11:48:28.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d9c54640 1 --2- 172.21.15.162:0/1616001315 >> v2:172.21.15.161:3300/0 conn(0x7fd1d4147cf0 0x7fd1d4151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d9c54640 1 --2- 172.21.15.162:0/1616001315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1d40b6540 0x7fd1d41477b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.740+0000 7fd1d9c54640 1 -- 172.21.15.162:0/1616001315 >> 172.21.15.162:0/1616001315 conn(0x7fd1d40b9140 msgr2=0x7fd1d40b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:28.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d9c54640 1 -- 172.21.15.162:0/1616001315 shutdown_connections 2024-02-02T11:48:28.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d9c54640 1 -- 172.21.15.162:0/1616001315 wait complete. 2024-02-02T11:48:28.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d9c54640 1 Processor -- start 2024-02-02T11:48:28.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d9c54640 1 -- start start 2024-02-02T11:48:28.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d9c54640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1d406af90 0x7fd1d41e3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d9c54640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1d40b6540 0x7fd1d41dfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d9c54640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1d4147cf0 0x7fd1d40b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d9c54640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d40b32a0 con 0x7fd1d4147cf0 2024-02-02T11:48:28.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d9c54640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d4142fa0 con 0x7fd1d40b6540 2024-02-02T11:48:28.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d9c54640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d4143220 con 0x7fd1d406af90 2024-02-02T11:48:28.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1d40b6540 0x7fd1d41dfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d37fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1d406af90 0x7fd1d41e3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1d40b6540 0x7fd1d41dfa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47252/0 (socket says 172.21.15.162:47252) 2024-02-02T11:48:28.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d2ffd640 1 -- 172.21.15.162:0/2145196850 learned_addr learned my addr 172.21.15.162:0/2145196850 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-02-02T11:48:28.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d3fff640 1 --2- 172.21.15.162:0/2145196850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1d4147cf0 0x7fd1d40b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d2ffd640 1 -- 172.21.15.162:0/2145196850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1d406af90 msgr2=0x7fd1d41e3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:28.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d2ffd640 1 --2- 172.21.15.162:0/2145196850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1d406af90 0x7fd1d41e3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d2ffd640 1 -- 172.21.15.162:0/2145196850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1d4147cf0 msgr2=0x7fd1d40b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:28.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d2ffd640 1 --2- 172.21.15.162:0/2145196850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1d4147cf0 0x7fd1d40b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d2ffd640 1 -- 172.21.15.162:0/2145196850 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c80094d0 con 0x7fd1d40b6540 2024-02-02T11:48:28.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d37fe640 1 --2- 172.21.15.162:0/2145196850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1d406af90 0x7fd1d41e3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-02T11:48:28.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d2ffd640 1 --2- 172.21.15.162:0/2145196850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1d40b6540 0x7fd1d41dfa10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80b3040 tx=0x7fd1c801ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:28.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1bbfff640 1 -- 172.21.15.162:0/2145196850 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80b0e80 con 0x7fd1d40b6540 2024-02-02T11:48:28.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1bbfff640 1 -- 172.21.15.162:0/2145196850 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c80bb480 con 0x7fd1d40b6540 2024-02-02T11:48:28.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d9c54640 1 -- 172.21.15.162:0/2145196850 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d41e2fe0 con 0x7fd1d40b6540 2024-02-02T11:48:28.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1bbfff640 1 -- 172.21.15.162:0/2145196850 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80bb810 con 0x7fd1d40b6540 2024-02-02T11:48:28.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d9c54640 1 -- 172.21.15.162:0/2145196850 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d41e35a0 con 0x7fd1d40b6540 2024-02-02T11:48:28.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1bbfff640 1 -- 172.21.15.162:0/2145196850 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd1c80bbc70 con 0x7fd1d40b6540 2024-02-02T11:48:28.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1bbfff640 1 -- 172.21.15.162:0/2145196850 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fd1c80c5c30 con 0x7fd1d40b6540 2024-02-02T11:48:28.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.744+0000 7fd1d9c54640 1 -- 172.21.15.162:0/2145196850 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d404e000 con 0x7fd1d40b6540 2024-02-02T11:48:28.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.748+0000 7fd1bbfff640 1 -- 172.21.15.162:0/2145196850 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fd1c80b5070 con 0x7fd1d40b6540 2024-02-02T11:48:28.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.816+0000 7fd1d9c54640 1 -- 172.21.15.162:0/2145196850 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d0ce696a-711f-4e5c-a5c0-d78822b8f46e", "id": 2} v 0) v1 -- 0x7fd1d404e000 con 0x7fd1d40b6540 2024-02-02T11:48:28.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.828+0000 7fd1bbfff640 1 -- 172.21.15.162:0/2145196850 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d0ce696a-711f-4e5c-a5c0-d78822b8f46e", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd1c80c5530 con 0x7fd1d40b6540 2024-02-02T11:48:28.827 INFO:teuthology.orchestra.run.smithi162.stdout:2 2024-02-02T11:48:28.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.828+0000 7fd1d9c54640 1 -- 172.21.15.162:0/2145196850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1d40b6540 msgr2=0x7fd1d41dfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:28.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.828+0000 7fd1d9c54640 1 --2- 172.21.15.162:0/2145196850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1d40b6540 0x7fd1d41dfa10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80b3040 tx=0x7fd1c801ba50 comp rx=0 tx=0).stop 2024-02-02T11:48:28.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.828+0000 7fd1d9c54640 1 -- 172.21.15.162:0/2145196850 shutdown_connections 2024-02-02T11:48:28.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.828+0000 7fd1d9c54640 1 --2- 172.21.15.162:0/2145196850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1d4147cf0 0x7fd1d40b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.828+0000 7fd1d9c54640 1 --2- 172.21.15.162:0/2145196850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1d40b6540 0x7fd1d41dfa10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.828+0000 7fd1d9c54640 1 --2- 172.21.15.162:0/2145196850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1d406af90 0x7fd1d41e3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.828+0000 7fd1d9c54640 1 -- 172.21.15.162:0/2145196850 >> 172.21.15.162:0/2145196850 conn(0x7fd1d40b9140 msgr2=0x7fd1d40bb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:28.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.828+0000 7fd1d9c54640 1 -- 172.21.15.162:0/2145196850 shutdown_connections 2024-02-02T11:48:28.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.828+0000 7fd1d9c54640 1 -- 172.21.15.162:0/2145196850 wait complete. 2024-02-02T11:48:28.845 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 3ea1d08e-1e28-47d1-b218-74439c663087 3 2024-02-02T11:48:28.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.956+0000 7f3f8ea07640 1 Processor -- start 2024-02-02T11:48:28.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.956+0000 7f3f8ea07640 1 -- start start 2024-02-02T11:48:28.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8ea07640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f8806af90 0x7f3f88148900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8ea07640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3f881458f0 0x7f3f88145d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8ea07640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3f8814be30 0x7f3f8814c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8ea07640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f880b53f0 con 0x7f3f881458f0 2024-02-02T11:48:28.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8ea07640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f880b4720 con 0x7f3f8814be30 2024-02-02T11:48:28.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8ea07640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f88071850 con 0x7f3f8806af90 2024-02-02T11:48:28.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8cfa4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3f8814be30 0x7f3f8814c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f87fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f8806af90 0x7f3f88148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f87fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f8806af90 0x7f3f88148900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:55262/0 (socket says 172.21.15.162:55262) 2024-02-02T11:48:28.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8cfa4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3f8814be30 0x7f3f8814c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47264/0 (socket says 172.21.15.162:47264) 2024-02-02T11:48:28.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f87fff640 1 -- 172.21.15.162:0/2107788793 learned_addr learned my addr 172.21.15.162:0/2107788793 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-02-02T11:48:28.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f877fe640 1 --2- 172.21.15.162:0/2107788793 >> v2:172.21.15.161:3300/0 conn(0x7f3f881458f0 0x7f3f88145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8cfa4640 1 -- 172.21.15.162:0/2107788793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f8806af90 msgr2=0x7f3f88148900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:28.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8cfa4640 1 --2- 172.21.15.162:0/2107788793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f8806af90 0x7f3f88148900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8cfa4640 1 -- 172.21.15.162:0/2107788793 >> v2:172.21.15.161:3300/0 conn(0x7f3f881458f0 msgr2=0x7f3f88145d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:28.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8cfa4640 1 --2- 172.21.15.162:0/2107788793 >> v2:172.21.15.161:3300/0 conn(0x7f3f881458f0 0x7f3f88145d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8cfa4640 1 -- 172.21.15.162:0/2107788793 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f880b8950 con 0x7f3f8814be30 2024-02-02T11:48:28.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f87fff640 1 --2- 172.21.15.162:0/2107788793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f8806af90 0x7f3f88148900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-02T11:48:28.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8cfa4640 1 --2- 172.21.15.162:0/2107788793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f8814be30 0x7f3f8814c2c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3f88066870 tx=0x7f3f7801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da1f85c62e94af1c server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:28.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f86ffd640 1 -- 172.21.15.162:0/2107788793 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f780ac640 con 0x7f3f8814be30 2024-02-02T11:48:28.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f86ffd640 1 -- 172.21.15.162:0/2107788793 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f780ac7a0 con 0x7f3f8814be30 2024-02-02T11:48:28.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f86ffd640 1 -- 172.21.15.162:0/2107788793 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f780acb30 con 0x7f3f8814be30 2024-02-02T11:48:28.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8ea07640 1 -- 172.21.15.162:0/2107788793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f8814be30 msgr2=0x7f3f8814c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:28.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8ea07640 1 --2- 172.21.15.162:0/2107788793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f8814be30 0x7f3f8814c2c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3f88066870 tx=0x7f3f7801c460 comp rx=0 tx=0).stop 2024-02-02T11:48:28.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8ea07640 1 -- 172.21.15.162:0/2107788793 shutdown_connections 2024-02-02T11:48:28.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8ea07640 1 --2- 172.21.15.162:0/2107788793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f8814be30 0x7f3f8814c2c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8ea07640 1 --2- 172.21.15.162:0/2107788793 >> v2:172.21.15.161:3300/0 conn(0x7f3f881458f0 0x7f3f88145d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8ea07640 1 --2- 172.21.15.162:0/2107788793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f8806af90 0x7f3f88148900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8ea07640 1 -- 172.21.15.162:0/2107788793 >> 172.21.15.162:0/2107788793 conn(0x7f3f880b9140 msgr2=0x7f3f880b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:28.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8ea07640 1 -- 172.21.15.162:0/2107788793 shutdown_connections 2024-02-02T11:48:28.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.960+0000 7f3f8ea07640 1 -- 172.21.15.162:0/2107788793 wait complete. 2024-02-02T11:48:28.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f8ea07640 1 Processor -- start 2024-02-02T11:48:28.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f8ea07640 1 -- start start 2024-02-02T11:48:28.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f8ea07640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f8806af90 0x7f3f88143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f8ea07640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f881458f0 0x7f3f881e28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f8ea07640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f8814be30 0x7f3f881e2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:28.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f8ea07640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f88144250 con 0x7f3f881458f0 2024-02-02T11:48:28.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f8ea07640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f881476d0 con 0x7f3f8806af90 2024-02-02T11:48:28.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f8ea07640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8813efd0 con 0x7f3f8814be30 2024-02-02T11:48:28.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f87fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f8806af90 0x7f3f88143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f87fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f8806af90 0x7f3f88143d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47280/0 (socket says 172.21.15.162:47280) 2024-02-02T11:48:28.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f87fff640 1 -- 172.21.15.162:0/3216483788 learned_addr learned my addr 172.21.15.162:0/3216483788 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-02-02T11:48:28.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f8cfa4640 1 --2- 172.21.15.162:0/3216483788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f8814be30 0x7f3f881e2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f877fe640 1 --2- 172.21.15.162:0/3216483788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f881458f0 0x7f3f881e28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:28.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f87fff640 1 -- 172.21.15.162:0/3216483788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f8814be30 msgr2=0x7f3f881e2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:28.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f87fff640 1 --2- 172.21.15.162:0/3216483788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f8814be30 0x7f3f881e2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f87fff640 1 -- 172.21.15.162:0/3216483788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f881458f0 msgr2=0x7f3f881e28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:28.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f87fff640 1 --2- 172.21.15.162:0/3216483788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f881458f0 0x7f3f881e28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:28.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f87fff640 1 -- 172.21.15.162:0/3216483788 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f80009b30 con 0x7f3f8806af90 2024-02-02T11:48:28.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f87fff640 1 --2- 172.21.15.162:0/3216483788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f8806af90 0x7f3f88143d10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000efc0 tx=0x7f3f8000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:28.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f84ff9640 1 -- 172.21.15.162:0/3216483788 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f80014480 con 0x7f3f8806af90 2024-02-02T11:48:28.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f84ff9640 1 -- 172.21.15.162:0/3216483788 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8000f040 con 0x7f3f8806af90 2024-02-02T11:48:28.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f8ea07640 1 -- 172.21.15.162:0/3216483788 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f78009420 con 0x7f3f8806af90 2024-02-02T11:48:28.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f84ff9640 1 -- 172.21.15.162:0/3216483788 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f800147e0 con 0x7f3f8806af90 2024-02-02T11:48:28.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f8ea07640 1 -- 172.21.15.162:0/3216483788 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f88147f50 con 0x7f3f8806af90 2024-02-02T11:48:28.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f84ff9640 1 -- 172.21.15.162:0/3216483788 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3f80014c40 con 0x7f3f8806af90 2024-02-02T11:48:28.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f84ff9640 1 -- 172.21.15.162:0/3216483788 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f3f800073f0 con 0x7f3f8806af90 2024-02-02T11:48:28.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.964+0000 7f3f8ea07640 1 -- 172.21.15.162:0/3216483788 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f880b40c0 con 0x7f3f8806af90 2024-02-02T11:48:28.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:28.968+0000 7f3f84ff9640 1 -- 172.21.15.162:0/3216483788 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f3f8001d410 con 0x7f3f8806af90 2024-02-02T11:48:29.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.032+0000 7f3f8ea07640 1 -- 172.21.15.162:0/3216483788 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3ea1d08e-1e28-47d1-b218-74439c663087", "id": 3} v 0) v1 -- 0x7f3f8804e000 con 0x7f3f8806af90 2024-02-02T11:48:29.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.044+0000 7f3f84ff9640 1 -- 172.21.15.162:0/3216483788 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3ea1d08e-1e28-47d1-b218-74439c663087", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3f8001d630 con 0x7f3f8806af90 2024-02-02T11:48:29.045 INFO:teuthology.orchestra.run.smithi162.stdout:3 2024-02-02T11:48:29.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.044+0000 7f3f8ea07640 1 -- 172.21.15.162:0/3216483788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f8806af90 msgr2=0x7f3f88143d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.044+0000 7f3f8ea07640 1 --2- 172.21.15.162:0/3216483788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f8806af90 0x7f3f88143d10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000efc0 tx=0x7f3f8000c490 comp rx=0 tx=0).stop 2024-02-02T11:48:29.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.044+0000 7f3f8ea07640 1 -- 172.21.15.162:0/3216483788 shutdown_connections 2024-02-02T11:48:29.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.044+0000 7f3f8ea07640 1 --2- 172.21.15.162:0/3216483788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f8814be30 0x7f3f881e2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.044+0000 7f3f8ea07640 1 --2- 172.21.15.162:0/3216483788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f881458f0 0x7f3f881e28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.044+0000 7f3f8ea07640 1 --2- 172.21.15.162:0/3216483788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f8806af90 0x7f3f88143d10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.044+0000 7f3f8ea07640 1 -- 172.21.15.162:0/3216483788 >> 172.21.15.162:0/3216483788 conn(0x7f3f880b9140 msgr2=0x7f3f88145d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:29.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.044+0000 7f3f8ea07640 1 -- 172.21.15.162:0/3216483788 shutdown_connections 2024-02-02T11:48:29.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.044+0000 7f3f8ea07640 1 -- 172.21.15.162:0/3216483788 wait complete. 2024-02-02T11:48:29.061 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 4ee8a347-b3a8-4fc4-839d-85cac3becc12 4 2024-02-02T11:48:29.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.167+0000 7f92e5144640 1 Processor -- start 2024-02-02T11:48:29.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.167+0000 7f92e5144640 1 -- start start 2024-02-02T11:48:29.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.167+0000 7f92e5144640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f92e00b44a0 0x7f92e01427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.167+0000 7f92e5144640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f92e00a0c90 0x7f92e01531e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.167+0000 7f92e5144640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e006e220 con 0x7f92e00b5060 2024-02-02T11:48:29.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.167+0000 7f92e5144640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e00ba850 con 0x7f92e00a0c90 2024-02-02T11:48:29.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.167+0000 7f92e5144640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e006df40 con 0x7f92e00b44a0 2024-02-02T11:48:29.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.167+0000 7f92ded9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f92e00b44a0 0x7f92e01427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.167+0000 7f92ded9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f92e00b44a0 0x7f92e01427e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47282/0 (socket says 172.21.15.162:47282) 2024-02-02T11:48:29.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.167+0000 7f92ded9d640 1 -- 172.21.15.162:0/3416710798 learned_addr learned my addr 172.21.15.162:0/3416710798 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-02-02T11:48:29.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.167+0000 7f92df59e640 1 --2- 172.21.15.162:0/3416710798 >> v2:172.21.15.161:3300/0 conn(0x7f92e00a0c90 0x7f92e01531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.167+0000 7f92ded9d640 1 -- 172.21.15.162:0/3416710798 >> v2:172.21.15.161:3300/0 conn(0x7f92e00a0c90 msgr2=0x7f92e01531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:29.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.167+0000 7f92ded9d640 1 --2- 172.21.15.162:0/3416710798 >> v2:172.21.15.161:3300/0 conn(0x7f92e00a0c90 0x7f92e01531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.167+0000 7f92ded9d640 1 -- 172.21.15.162:0/3416710798 >> v1:172.21.15.162:6789/0 conn(0x7f92e00b5060 legacy=0x7f92e0148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.171 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.167+0000 7f92ded9d640 1 -- 172.21.15.162:0/3416710798 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e0148a00 con 0x7f92e00b44a0 2024-02-02T11:48:29.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.171+0000 7f92ded9d640 1 --2- 172.21.15.162:0/3416710798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92e00b44a0 0x7f92e01427e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009870 tx=0x7f92d001c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b32981b68762a738 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:29.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.171+0000 7f92ddd9b640 1 -- 172.21.15.162:0/3416710798 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d00ab610 con 0x7f92e00b44a0 2024-02-02T11:48:29.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.171+0000 7f92ddd9b640 1 -- 172.21.15.162:0/3416710798 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d00ab770 con 0x7f92e00b44a0 2024-02-02T11:48:29.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.171+0000 7f92ddd9b640 1 -- 172.21.15.162:0/3416710798 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d00abb00 con 0x7f92e00b44a0 2024-02-02T11:48:29.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.171+0000 7f92e5144640 1 -- 172.21.15.162:0/3416710798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92e00b44a0 msgr2=0x7f92e01427e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.171+0000 7f92e5144640 1 --2- 172.21.15.162:0/3416710798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92e00b44a0 0x7f92e01427e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009870 tx=0x7f92d001c500 comp rx=0 tx=0).stop 2024-02-02T11:48:29.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.171+0000 7f92e5144640 1 -- 172.21.15.162:0/3416710798 shutdown_connections 2024-02-02T11:48:29.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.171+0000 7f92e5144640 1 --2- 172.21.15.162:0/3416710798 >> v2:172.21.15.161:3300/0 conn(0x7f92e00a0c90 0x7f92e01531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.171+0000 7f92e5144640 1 --2- 172.21.15.162:0/3416710798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92e00b44a0 0x7f92e01427e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.171+0000 7f92e5144640 1 -- 172.21.15.162:0/3416710798 >> 172.21.15.162:0/3416710798 conn(0x7f92e00babc0 msgr2=0x7f92e00bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:29.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.171+0000 7f92e5144640 1 -- 172.21.15.162:0/3416710798 shutdown_connections 2024-02-02T11:48:29.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.171+0000 7f92e5144640 1 -- 172.21.15.162:0/3416710798 wait complete. 2024-02-02T11:48:29.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.171+0000 7f92e5144640 1 Processor -- start 2024-02-02T11:48:29.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.171+0000 7f92e5144640 1 -- start start 2024-02-02T11:48:29.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92e5144640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92e00a0c90 0x7f92e0143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92e5144640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92e00b44a0 0x7f92e0141510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92e5144640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92e00b5060 0x7f92e01e2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92e5144640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e0141a50 con 0x7f92e00a0c90 2024-02-02T11:48:29.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92e5144640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e01e6e90 con 0x7f92e00b5060 2024-02-02T11:48:29.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92e5144640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e0144090 con 0x7f92e00b44a0 2024-02-02T11:48:29.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92df59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92e00b5060 0x7f92e01e2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92de59c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92e00b44a0 0x7f92e0141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92df59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92e00b5060 0x7f92e01e2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47286/0 (socket says 172.21.15.162:47286) 2024-02-02T11:48:29.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92df59e640 1 -- 172.21.15.162:0/1699871995 learned_addr learned my addr 172.21.15.162:0/1699871995 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-02-02T11:48:29.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92ded9d640 1 --2- 172.21.15.162:0/1699871995 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92e00a0c90 0x7f92e0143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92de59c640 1 -- 172.21.15.162:0/1699871995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92e00b5060 msgr2=0x7f92e01e2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92de59c640 1 --2- 172.21.15.162:0/1699871995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92e00b5060 0x7f92e01e2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92de59c640 1 -- 172.21.15.162:0/1699871995 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92e00a0c90 msgr2=0x7f92e0143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92de59c640 1 --2- 172.21.15.162:0/1699871995 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92e00a0c90 0x7f92e0143a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92de59c640 1 -- 172.21.15.162:0/1699871995 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d00094d0 con 0x7f92e00b44a0 2024-02-02T11:48:29.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92df59e640 1 --2- 172.21.15.162:0/1699871995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92e00b5060 0x7f92e01e2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-02T11:48:29.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92de59c640 1 --2- 172.21.15.162:0/1699871995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92e00b44a0 0x7f92e0141510 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f92d4000f70 tx=0x7f92d400c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:29.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92c77fe640 1 -- 172.21.15.162:0/1699871995 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d40052d0 con 0x7f92e00b44a0 2024-02-02T11:48:29.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92c77fe640 1 -- 172.21.15.162:0/1699871995 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d4005430 con 0x7f92e00b44a0 2024-02-02T11:48:29.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92e5144640 1 -- 172.21.15.162:0/1699871995 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e01e6560 con 0x7f92e00b44a0 2024-02-02T11:48:29.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92c77fe640 1 -- 172.21.15.162:0/1699871995 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d4003840 con 0x7f92e00b44a0 2024-02-02T11:48:29.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92e5144640 1 -- 172.21.15.162:0/1699871995 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e01e6b20 con 0x7f92e00b44a0 2024-02-02T11:48:29.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92c77fe640 1 -- 172.21.15.162:0/1699871995 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f92d4003ca0 con 0x7f92e00b44a0 2024-02-02T11:48:29.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92c77fe640 1 -- 172.21.15.162:0/1699871995 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f92d4012930 con 0x7f92e00b44a0 2024-02-02T11:48:29.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.175+0000 7f92e5144640 1 -- 172.21.15.162:0/1699871995 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e004e000 con 0x7f92e00b44a0 2024-02-02T11:48:29.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.179+0000 7f92c77fe640 1 -- 172.21.15.162:0/1699871995 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f92d4017070 con 0x7f92e00b44a0 2024-02-02T11:48:29.206 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:29.205+0000 7fd4180a3180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-02T11:48:29.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.243+0000 7f92e5144640 1 -- 172.21.15.162:0/1699871995 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4ee8a347-b3a8-4fc4-839d-85cac3becc12", "id": 4} v 0) v1 -- 0x7f92e00b3460 con 0x7f92e00b44a0 2024-02-02T11:48:29.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.255+0000 7f92c77fe640 1 -- 172.21.15.162:0/1699871995 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4ee8a347-b3a8-4fc4-839d-85cac3becc12", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f92d4012bc0 con 0x7f92e00b44a0 2024-02-02T11:48:29.256 INFO:teuthology.orchestra.run.smithi162.stdout:4 2024-02-02T11:48:29.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.255+0000 7f92e5144640 1 -- 172.21.15.162:0/1699871995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92e00b44a0 msgr2=0x7f92e0141510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.255+0000 7f92e5144640 1 --2- 172.21.15.162:0/1699871995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92e00b44a0 0x7f92e0141510 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f92d4000f70 tx=0x7f92d400c820 comp rx=0 tx=0).stop 2024-02-02T11:48:29.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.255+0000 7f92e5144640 1 -- 172.21.15.162:0/1699871995 shutdown_connections 2024-02-02T11:48:29.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.255+0000 7f92e5144640 1 --2- 172.21.15.162:0/1699871995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92e00b5060 0x7f92e01e2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.255+0000 7f92e5144640 1 --2- 172.21.15.162:0/1699871995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92e00b44a0 0x7f92e0141510 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.255+0000 7f92e5144640 1 --2- 172.21.15.162:0/1699871995 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92e00a0c90 0x7f92e0143a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.255+0000 7f92e5144640 1 -- 172.21.15.162:0/1699871995 >> 172.21.15.162:0/1699871995 conn(0x7f92e00babc0 msgr2=0x7f92e0147570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:29.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.255+0000 7f92e5144640 1 -- 172.21.15.162:0/1699871995 shutdown_connections 2024-02-02T11:48:29.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.255+0000 7f92e5144640 1 -- 172.21.15.162:0/1699871995 wait complete. 2024-02-02T11:48:29.260 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:29.261+0000 7fd4180a3180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-02T11:48:29.273 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new a5309408-4099-458b-a625-d25fc567c9be 5 2024-02-02T11:48:29.311 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:29.311+0000 7f5fc42d3180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-02T11:48:29.312 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:29.312+0000 7fd4180a3180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-02T11:48:29.366 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:29.363+0000 7f5fc42d3180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-02T11:48:29.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.383+0000 7fdefe22f640 1 Processor -- start 2024-02-02T11:48:29.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.383+0000 7fdefe22f640 1 -- start start 2024-02-02T11:48:29.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.383+0000 7fdefe22f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdef80b44a0 0x7fdef81427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.383+0000 7fdefe22f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdef80b5060 0x7fdef8148f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdefe22f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef806e220 con 0x7fdef80a0c90 2024-02-02T11:48:29.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdefe22f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef80ba850 con 0x7fdef80b5060 2024-02-02T11:48:29.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdefe22f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef806df40 con 0x7fdef80b44a0 2024-02-02T11:48:29.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdef77fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdef80b44a0 0x7fdef81427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdef6ffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdef80b5060 0x7fdef8148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdef77fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdef80b44a0 0x7fdef81427e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:55296/0 (socket says 172.21.15.162:55296) 2024-02-02T11:48:29.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdef77fe640 1 -- 172.21.15.162:0/1854884200 learned_addr learned my addr 172.21.15.162:0/1854884200 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-02-02T11:48:29.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdef6ffd640 1 -- 172.21.15.162:0/1854884200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdef80b44a0 msgr2=0x7fdef81427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:29.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdef6ffd640 1 --2- 172.21.15.162:0/1854884200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdef80b44a0 0x7fdef81427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdef6ffd640 1 -- 172.21.15.162:0/1854884200 >> v1:172.21.15.161:6789/0 conn(0x7fdef80a0c90 legacy=0x7fdef814be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdef6ffd640 1 -- 172.21.15.162:0/1854884200 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef8148a00 con 0x7fdef80b5060 2024-02-02T11:48:29.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdef77fe640 1 --2- 172.21.15.162:0/1854884200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdef80b44a0 0x7fdef81427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-02T11:48:29.389 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:29.388+0000 7fd4180a3180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-02T11:48:29.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdef6ffd640 1 --2- 172.21.15.162:0/1854884200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdef80b5060 0x7fdef8148f20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0097c0 tx=0x7fdeec01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e68b4bddec1a46ca server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:29.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdef67fc640 1 -- 172.21.15.162:0/1854884200 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec0ad640 con 0x7fdef80b5060 2024-02-02T11:48:29.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdef67fc640 1 -- 172.21.15.162:0/1854884200 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeec0ad7a0 con 0x7fdef80b5060 2024-02-02T11:48:29.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdef67fc640 1 -- 172.21.15.162:0/1854884200 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec0adb30 con 0x7fdef80b5060 2024-02-02T11:48:29.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdefe22f640 1 -- 172.21.15.162:0/1854884200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdef80b5060 msgr2=0x7fdef8148f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdefe22f640 1 --2- 172.21.15.162:0/1854884200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdef80b5060 0x7fdef8148f20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0097c0 tx=0x7fdeec01c480 comp rx=0 tx=0).stop 2024-02-02T11:48:29.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdefe22f640 1 -- 172.21.15.162:0/1854884200 shutdown_connections 2024-02-02T11:48:29.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdefe22f640 1 --2- 172.21.15.162:0/1854884200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdef80b5060 0x7fdef8148f20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdefe22f640 1 --2- 172.21.15.162:0/1854884200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdef80b44a0 0x7fdef81427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdefe22f640 1 -- 172.21.15.162:0/1854884200 >> 172.21.15.162:0/1854884200 conn(0x7fdef80babc0 msgr2=0x7fdef80bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:29.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdefe22f640 1 -- 172.21.15.162:0/1854884200 shutdown_connections 2024-02-02T11:48:29.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.387+0000 7fdefe22f640 1 -- 172.21.15.162:0/1854884200 wait complete. 2024-02-02T11:48:29.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdefe22f640 1 Processor -- start 2024-02-02T11:48:29.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdefe22f640 1 -- start start 2024-02-02T11:48:29.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdefe22f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdef80a0c90 0x7fdef81476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdefe22f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdef80b44a0 0x7fdef80bd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdefe22f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdef80b5060 0x7fdef80bd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdefe22f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef813f3d0 con 0x7fdef80b5060 2024-02-02T11:48:29.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdefe22f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef806cc80 con 0x7fdef80b44a0 2024-02-02T11:48:29.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdefe22f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef8147c60 con 0x7fdef80a0c90 2024-02-02T11:48:29.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdef6ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdef80b44a0 0x7fdef80bd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdef77fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdef80a0c90 0x7fdef81476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdef6ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdef80b44a0 0x7fdef80bd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47308/0 (socket says 172.21.15.162:47308) 2024-02-02T11:48:29.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdef6ffd640 1 -- 172.21.15.162:0/2665878953 learned_addr learned my addr 172.21.15.162:0/2665878953 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-02-02T11:48:29.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdef77fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdef80a0c90 0x7fdef81476f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:55308/0 (socket says 172.21.15.162:55308) 2024-02-02T11:48:29.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdef7fff640 1 --2- 172.21.15.162:0/2665878953 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdef80b5060 0x7fdef80bd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdef77fe640 1 -- 172.21.15.162:0/2665878953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdef80b44a0 msgr2=0x7fdef80bd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdef77fe640 1 --2- 172.21.15.162:0/2665878953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdef80b44a0 0x7fdef80bd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdef77fe640 1 -- 172.21.15.162:0/2665878953 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdef80b5060 msgr2=0x7fdef80bd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdef77fe640 1 --2- 172.21.15.162:0/2665878953 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdef80b5060 0x7fdef80bd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdef77fe640 1 -- 172.21.15.162:0/2665878953 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee80094d0 con 0x7fdef80a0c90 2024-02-02T11:48:29.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdef6ffd640 1 --2- 172.21.15.162:0/2665878953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdef80b44a0 0x7fdef80bd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-02T11:48:29.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdef77fe640 1 --2- 172.21.15.162:0/2665878953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdef80a0c90 0x7fdef81476f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdee800e910 tx=0x7fdee800edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:29.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdedffff640 1 -- 172.21.15.162:0/2665878953 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee800ca00 con 0x7fdef80a0c90 2024-02-02T11:48:29.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdedffff640 1 -- 172.21.15.162:0/2665878953 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee800cb60 con 0x7fdef80a0c90 2024-02-02T11:48:29.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdedffff640 1 -- 172.21.15.162:0/2665878953 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8004030 con 0x7fdef80a0c90 2024-02-02T11:48:29.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdefe22f640 1 -- 172.21.15.162:0/2665878953 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeec009420 con 0x7fdef80a0c90 2024-02-02T11:48:29.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdefe22f640 1 -- 172.21.15.162:0/2665878953 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef8149870 con 0x7fdef80a0c90 2024-02-02T11:48:29.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdedffff640 1 -- 172.21.15.162:0/2665878953 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdee80059a0 con 0x7fdef80a0c90 2024-02-02T11:48:29.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdedffff640 1 -- 172.21.15.162:0/2665878953 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fdee8006020 con 0x7fdef80a0c90 2024-02-02T11:48:29.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.391+0000 7fdefe22f640 1 -- 172.21.15.162:0/2665878953 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef806c7e0 con 0x7fdef80a0c90 2024-02-02T11:48:29.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.395+0000 7fdedffff640 1 -- 172.21.15.162:0/2665878953 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fdee8020060 con 0x7fdef80a0c90 2024-02-02T11:48:29.422 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:29.419+0000 7f5fc42d3180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-02T11:48:29.440 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:29.440+0000 7fd4180a3180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-02T11:48:29.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.459+0000 7fdefe22f640 1 -- 172.21.15.162:0/2665878953 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a5309408-4099-458b-a625-d25fc567c9be", "id": 5} v 0) v1 -- 0x7fdef804e000 con 0x7fdef80a0c90 2024-02-02T11:48:29.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.471+0000 7fdedffff640 1 -- 172.21.15.162:0/2665878953 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a5309408-4099-458b-a625-d25fc567c9be", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdee8004490 con 0x7fdef80a0c90 2024-02-02T11:48:29.471 INFO:teuthology.orchestra.run.smithi162.stdout:5 2024-02-02T11:48:29.472 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.471+0000 7fdefe22f640 1 -- 172.21.15.162:0/2665878953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdef80a0c90 msgr2=0x7fdef81476f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.471+0000 7fdefe22f640 1 --2- 172.21.15.162:0/2665878953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdef80a0c90 0x7fdef81476f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdee800e910 tx=0x7fdee800edd0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.471+0000 7fdefe22f640 1 -- 172.21.15.162:0/2665878953 shutdown_connections 2024-02-02T11:48:29.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.471+0000 7fdefe22f640 1 --2- 172.21.15.162:0/2665878953 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdef80b5060 0x7fdef80bd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.471+0000 7fdefe22f640 1 --2- 172.21.15.162:0/2665878953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdef80b44a0 0x7fdef80bd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.471+0000 7fdefe22f640 1 --2- 172.21.15.162:0/2665878953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdef80a0c90 0x7fdef81476f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.471+0000 7fdefe22f640 1 -- 172.21.15.162:0/2665878953 >> 172.21.15.162:0/2665878953 conn(0x7fdef80babc0 msgr2=0x7fdef806e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:29.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.471+0000 7fdefe22f640 1 -- 172.21.15.162:0/2665878953 shutdown_connections 2024-02-02T11:48:29.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.471+0000 7fdefe22f640 1 -- 172.21.15.162:0/2665878953 wait complete. 2024-02-02T11:48:29.489 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 1e0f58c5-83a1-414e-9698-f3abd6c77545 6 2024-02-02T11:48:29.505 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:29.503+0000 7f5fc42d3180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-02T11:48:29.517 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:29.516+0000 7fd4180a3180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-02T11:48:29.562 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:29.559+0000 7f5fc42d3180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-02T11:48:29.568 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:29.568+0000 7fd4180a3180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-02T11:48:29.626 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.623+0000 7f6a37f14640 1 Processor -- start 2024-02-02T11:48:29.626 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.623+0000 7f6a37f14640 1 -- start start 2024-02-02T11:48:29.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.627+0000 7f6a37f14640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6a30146e00 0x7f6a3006b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.627+0000 7f6a37f14640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a300702c0 0x7f6a301516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.627+0000 7f6a37f14640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3006fa50 con 0x7f6a3006ad30 2024-02-02T11:48:29.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.627+0000 7f6a37f14640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a300711f0 con 0x7f6a30146e00 2024-02-02T11:48:29.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.627+0000 7f6a37f14640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a300af8b0 con 0x7f6a300702c0 2024-02-02T11:48:29.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.627+0000 7f6a35cb0640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f6a3006ad30 0x7f6a30070ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:41912/0 (socket says 172.21.15.162:41912) 2024-02-02T11:48:29.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.627+0000 7f6a35cb0640 1 -- 172.21.15.162:0/3838626735 learned_addr learned my addr 172.21.15.162:0/3838626735 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-02-02T11:48:29.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.627+0000 7f6a364b1640 1 --2- 172.21.15.162:0/3838626735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a300702c0 0x7f6a301516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.627+0000 7f6a354af640 1 --2- 172.21.15.162:0/3838626735 >> v2:172.21.15.161:3300/0 conn(0x7f6a30146e00 0x7f6a3006b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.627+0000 7f6a34cae640 1 -- 172.21.15.162:0/3838626735 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607138550 0 0) 0x7f6a3006fa50 con 0x7f6a3006ad30 2024-02-02T11:48:29.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.627+0000 7f6a34cae640 1 -- 172.21.15.162:0/3838626735 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a1c005740 con 0x7f6a3006ad30 2024-02-02T11:48:29.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.627+0000 7f6a364b1640 1 -- 172.21.15.162:0/3838626735 >> v2:172.21.15.161:3300/0 conn(0x7f6a30146e00 msgr2=0x7f6a3006b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:29.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.627+0000 7f6a364b1640 1 --2- 172.21.15.162:0/3838626735 >> v2:172.21.15.161:3300/0 conn(0x7f6a30146e00 0x7f6a3006b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.627+0000 7f6a364b1640 1 -- 172.21.15.162:0/3838626735 >> v1:172.21.15.162:6789/0 conn(0x7f6a3006ad30 legacy=0x7f6a30070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.627+0000 7f6a364b1640 1 -- 172.21.15.162:0/3838626735 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3006f6e0 con 0x7f6a300702c0 2024-02-02T11:48:29.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.627+0000 7f6a364b1640 1 --2- 172.21.15.162:0/3838626735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a300702c0 0x7f6a301516a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800aea0 tx=0x7f6a2801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fbfee830488af25 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:29.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.627+0000 7f6a34cae640 1 -- 172.21.15.162:0/3838626735 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2800a2d0 con 0x7f6a300702c0 2024-02-02T11:48:29.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.627+0000 7f6a34cae640 1 -- 172.21.15.162:0/3838626735 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a280a57b0 con 0x7f6a300702c0 2024-02-02T11:48:29.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.627+0000 7f6a34cae640 1 -- 172.21.15.162:0/3838626735 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a280a5b40 con 0x7f6a300702c0 2024-02-02T11:48:29.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a37f14640 1 -- 172.21.15.162:0/3838626735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a300702c0 msgr2=0x7f6a301516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a37f14640 1 --2- 172.21.15.162:0/3838626735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a300702c0 0x7f6a301516a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800aea0 tx=0x7f6a2801c950 comp rx=0 tx=0).stop 2024-02-02T11:48:29.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a37f14640 1 -- 172.21.15.162:0/3838626735 shutdown_connections 2024-02-02T11:48:29.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a37f14640 1 --2- 172.21.15.162:0/3838626735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a300702c0 0x7f6a301516a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a37f14640 1 --2- 172.21.15.162:0/3838626735 >> v2:172.21.15.161:3300/0 conn(0x7f6a30146e00 0x7f6a3006b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a37f14640 1 -- 172.21.15.162:0/3838626735 >> 172.21.15.162:0/3838626735 conn(0x7f6a300b9140 msgr2=0x7f6a300b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:29.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a37f14640 1 -- 172.21.15.162:0/3838626735 shutdown_connections 2024-02-02T11:48:29.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a37f14640 1 -- 172.21.15.162:0/3838626735 wait complete. 2024-02-02T11:48:29.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a37f14640 1 Processor -- start 2024-02-02T11:48:29.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a37f14640 1 -- start start 2024-02-02T11:48:29.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a37f14640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a3006ad30 0x7f6a300b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a37f14640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a300702c0 0x7f6a30135d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a37f14640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a30143f90 0x7f6a30142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a37f14640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a301362d0 con 0x7f6a30143f90 2024-02-02T11:48:29.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a37f14640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a30137df0 con 0x7f6a3006ad30 2024-02-02T11:48:29.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a37f14640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a30138070 con 0x7f6a300702c0 2024-02-02T11:48:29.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a35cb0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a3006ad30 0x7f6a300b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a354af640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a300702c0 0x7f6a30135d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a35cb0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a3006ad30 0x7f6a300b5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47318/0 (socket says 172.21.15.162:47318) 2024-02-02T11:48:29.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a354af640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a300702c0 0x7f6a30135d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:55320/0 (socket says 172.21.15.162:55320) 2024-02-02T11:48:29.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a35cb0640 1 -- 172.21.15.162:0/3477479249 learned_addr learned my addr 172.21.15.162:0/3477479249 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-02-02T11:48:29.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a364b1640 1 --2- 172.21.15.162:0/3477479249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a30143f90 0x7f6a30142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a354af640 1 -- 172.21.15.162:0/3477479249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a3006ad30 msgr2=0x7f6a300b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a354af640 1 --2- 172.21.15.162:0/3477479249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a3006ad30 0x7f6a300b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a354af640 1 -- 172.21.15.162:0/3477479249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a30143f90 msgr2=0x7f6a30142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a354af640 1 --2- 172.21.15.162:0/3477479249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a30143f90 0x7f6a30142d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a354af640 1 -- 172.21.15.162:0/3477479249 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2800ab80 con 0x7f6a300702c0 2024-02-02T11:48:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a364b1640 1 --2- 172.21.15.162:0/3477479249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a30143f90 0x7f6a30142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:48:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a354af640 1 --2- 172.21.15.162:0/3477479249 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a300702c0 0x7f6a30135d90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000e840 tx=0x7f6a2000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a267fc640 1 -- 172.21.15.162:0/3477479249 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2000c730 con 0x7f6a300702c0 2024-02-02T11:48:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a267fc640 1 -- 172.21.15.162:0/3477479249 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2000c890 con 0x7f6a300702c0 2024-02-02T11:48:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a267fc640 1 -- 172.21.15.162:0/3477479249 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2000cc20 con 0x7f6a300702c0 2024-02-02T11:48:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a37f14640 1 -- 172.21.15.162:0/3477479249 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a30142490 con 0x7f6a300702c0 2024-02-02T11:48:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a37f14640 1 -- 172.21.15.162:0/3477479249 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a30135970 con 0x7f6a300702c0 2024-02-02T11:48:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a267fc640 1 -- 172.21.15.162:0/3477479249 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6a20005ca0 con 0x7f6a300702c0 2024-02-02T11:48:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.631+0000 7f6a267fc640 1 -- 172.21.15.162:0/3477479249 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f6a20006700 con 0x7f6a300702c0 2024-02-02T11:48:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.635+0000 7f6a37f14640 1 -- 172.21.15.162:0/3477479249 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a301429b0 con 0x7f6a300702c0 2024-02-02T11:48:29.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.635+0000 7f6a267fc640 1 -- 172.21.15.162:0/3477479249 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f6a301429b0 con 0x7f6a300702c0 2024-02-02T11:48:29.650 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:29.647+0000 7f5fc42d3180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-02T11:48:29.702 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:29.699+0000 7f5fc42d3180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-02T11:48:29.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.703+0000 7f6a37f14640 1 -- 172.21.15.162:0/3477479249 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1e0f58c5-83a1-414e-9698-f3abd6c77545", "id": 6} v 0) v1 -- 0x7f6a3004e000 con 0x7f6a300702c0 2024-02-02T11:48:29.707 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:29.704+0000 7fd4180a3180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-02T11:48:29.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.715+0000 7f6a267fc640 1 -- 172.21.15.162:0/3477479249 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1e0f58c5-83a1-414e-9698-f3abd6c77545", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6a20021060 con 0x7f6a300702c0 2024-02-02T11:48:29.715 INFO:teuthology.orchestra.run.smithi162.stdout:6 2024-02-02T11:48:29.716 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.715+0000 7f6a37f14640 1 -- 172.21.15.162:0/3477479249 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a300702c0 msgr2=0x7f6a30135d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.716 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.715+0000 7f6a37f14640 1 --2- 172.21.15.162:0/3477479249 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a300702c0 0x7f6a30135d90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000e840 tx=0x7f6a2000ed00 comp rx=0 tx=0).stop 2024-02-02T11:48:29.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.715+0000 7f6a37f14640 1 -- 172.21.15.162:0/3477479249 shutdown_connections 2024-02-02T11:48:29.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.715+0000 7f6a37f14640 1 --2- 172.21.15.162:0/3477479249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a30143f90 0x7f6a30142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.715+0000 7f6a37f14640 1 --2- 172.21.15.162:0/3477479249 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a300702c0 0x7f6a30135d90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.715+0000 7f6a37f14640 1 --2- 172.21.15.162:0/3477479249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a3006ad30 0x7f6a300b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.715+0000 7f6a37f14640 1 -- 172.21.15.162:0/3477479249 >> 172.21.15.162:0/3477479249 conn(0x7f6a300b9140 msgr2=0x7f6a300bbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:29.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.715+0000 7f6a37f14640 1 -- 172.21.15.162:0/3477479249 shutdown_connections 2024-02-02T11:48:29.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.715+0000 7f6a37f14640 1 -- 172.21.15.162:0/3477479249 wait complete. 2024-02-02T11:48:29.733 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new cafcd8f5-d580-4eed-9049-631d35259e8e 7 2024-02-02T11:48:29.768 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:29.768+0000 7fd4180a3180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-02T11:48:29.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.839+0000 7fc3838a8640 1 Processor -- start 2024-02-02T11:48:29.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.839+0000 7fc3838a8640 1 -- start start 2024-02-02T11:48:29.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.839+0000 7fc3838a8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc37c06b090 0x7fc37c144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.839+0000 7fc3838a8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc37c06f630 0x7fc37c14b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.839+0000 7fc3838a8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37c06b8d0 0x7fc37c14e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.839+0000 7fc3838a8640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37c14aad0 con 0x7fc37c06b090 2024-02-02T11:48:29.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.839+0000 7fc3838a8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37c14adb0 con 0x7fc37c06f630 2024-02-02T11:48:29.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.839+0000 7fc3838a8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c06e6c0 con 0x7fc37c06b8d0 2024-02-02T11:48:29.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc381e45640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37c06b8d0 0x7fc37c14e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc380e43640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc37c06f630 0x7fc37c14b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc381e45640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37c06b8d0 0x7fc37c14e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:55326/0 (socket says 172.21.15.162:55326) 2024-02-02T11:48:29.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc380e43640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc37c06f630 0x7fc37c14b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47328/0 (socket says 172.21.15.162:47328) 2024-02-02T11:48:29.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc381e45640 1 -- 172.21.15.162:0/3519040219 learned_addr learned my addr 172.21.15.162:0/3519040219 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-02-02T11:48:29.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc381644640 1 --2- 172.21.15.162:0/3519040219 >> v2:172.21.15.161:3300/0 conn(0x7fc37c06b090 0x7fc37c144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc380e43640 1 -- 172.21.15.162:0/3519040219 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37c06b8d0 msgr2=0x7fc37c14e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:29.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc380e43640 1 --2- 172.21.15.162:0/3519040219 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37c06b8d0 0x7fc37c14e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc380e43640 1 -- 172.21.15.162:0/3519040219 >> v2:172.21.15.161:3300/0 conn(0x7fc37c06b090 msgr2=0x7fc37c144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:29.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc380e43640 1 --2- 172.21.15.162:0/3519040219 >> v2:172.21.15.161:3300/0 conn(0x7fc37c06b090 0x7fc37c144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc380e43640 1 -- 172.21.15.162:0/3519040219 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c06f0b0 con 0x7fc37c06f630 2024-02-02T11:48:29.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc381e45640 1 --2- 172.21.15.162:0/3519040219 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37c06b8d0 0x7fc37c14e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-02T11:48:29.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc381644640 1 --2- 172.21.15.162:0/3519040219 >> v2:172.21.15.161:3300/0 conn(0x7fc37c06b090 0x7fc37c144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:48:29.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc380e43640 1 --2- 172.21.15.162:0/3519040219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc37c06f630 0x7fc37c14b1d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0668e0 tx=0x7fc37801ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf393e62b17bd505 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:29.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc373fff640 1 -- 172.21.15.162:0/3519040219 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3780a88f0 con 0x7fc37c06f630 2024-02-02T11:48:29.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc373fff640 1 -- 172.21.15.162:0/3519040219 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3780a8a50 con 0x7fc37c06f630 2024-02-02T11:48:29.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc373fff640 1 -- 172.21.15.162:0/3519040219 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3780a8de0 con 0x7fc37c06f630 2024-02-02T11:48:29.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc3838a8640 1 -- 172.21.15.162:0/3519040219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc37c06f630 msgr2=0x7fc37c14b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc3838a8640 1 --2- 172.21.15.162:0/3519040219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc37c06f630 0x7fc37c14b1d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0668e0 tx=0x7fc37801ec30 comp rx=0 tx=0).stop 2024-02-02T11:48:29.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc3838a8640 1 -- 172.21.15.162:0/3519040219 shutdown_connections 2024-02-02T11:48:29.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc3838a8640 1 --2- 172.21.15.162:0/3519040219 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37c06b8d0 0x7fc37c14e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc3838a8640 1 --2- 172.21.15.162:0/3519040219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc37c06f630 0x7fc37c14b1d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc3838a8640 1 --2- 172.21.15.162:0/3519040219 >> v2:172.21.15.161:3300/0 conn(0x7fc37c06b090 0x7fc37c144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc3838a8640 1 -- 172.21.15.162:0/3519040219 >> 172.21.15.162:0/3519040219 conn(0x7fc37c0babc0 msgr2=0x7fc37c0bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:29.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc3838a8640 1 -- 172.21.15.162:0/3519040219 shutdown_connections 2024-02-02T11:48:29.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.843+0000 7fc3838a8640 1 -- 172.21.15.162:0/3519040219 wait complete. 2024-02-02T11:48:29.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc3838a8640 1 Processor -- start 2024-02-02T11:48:29.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc3838a8640 1 -- start start 2024-02-02T11:48:29.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc3838a8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37c06b090 0x7fc37c1e0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc3838a8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc37c06b8d0 0x7fc37c149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc3838a8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc37c06f630 0x7fc37c13ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:29.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc3838a8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c13f370 con 0x7fc37c06b8d0 2024-02-02T11:48:29.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc3838a8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0bddd0 con 0x7fc37c06f630 2024-02-02T11:48:29.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc3838a8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c13f9a0 con 0x7fc37c06b090 2024-02-02T11:48:29.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc381644640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37c06b090 0x7fc37c1e0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc381e45640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc37c06f630 0x7fc37c13ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc381644640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37c06b090 0x7fc37c1e0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:55342/0 (socket says 172.21.15.162:55342) 2024-02-02T11:48:29.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc381644640 1 -- 172.21.15.162:0/966223150 learned_addr learned my addr 172.21.15.162:0/966223150 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-02-02T11:48:29.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc380e43640 1 --2- 172.21.15.162:0/966223150 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc37c06b8d0 0x7fc37c149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:29.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc381e45640 1 -- 172.21.15.162:0/966223150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37c06b090 msgr2=0x7fc37c1e0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc381e45640 1 --2- 172.21.15.162:0/966223150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37c06b090 0x7fc37c1e0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc381e45640 1 -- 172.21.15.162:0/966223150 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc37c06b8d0 msgr2=0x7fc37c149b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc381e45640 1 --2- 172.21.15.162:0/966223150 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc37c06b8d0 0x7fc37c149b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc381e45640 1 -- 172.21.15.162:0/966223150 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc374009b30 con 0x7fc37c06f630 2024-02-02T11:48:29.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc381644640 1 --2- 172.21.15.162:0/966223150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37c06b090 0x7fc37c1e0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-02T11:48:29.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc380e43640 1 --2- 172.21.15.162:0/966223150 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc37c06b8d0 0x7fc37c149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:48:29.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc381e45640 1 --2- 172.21.15.162:0/966223150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc37c06f630 0x7fc37c13ee30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc37400efc0 tx=0x7fc37400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:29.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc371ffb640 1 -- 172.21.15.162:0/966223150 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374018070 con 0x7fc37c06f630 2024-02-02T11:48:29.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc371ffb640 1 -- 172.21.15.162:0/966223150 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37400f040 con 0x7fc37c06f630 2024-02-02T11:48:29.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc3838a8640 1 -- 172.21.15.162:0/966223150 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc378009420 con 0x7fc37c06f630 2024-02-02T11:48:29.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc371ffb640 1 -- 172.21.15.162:0/966223150 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37400cd40 con 0x7fc37c06f630 2024-02-02T11:48:29.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc3838a8640 1 -- 172.21.15.162:0/966223150 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37c149670 con 0x7fc37c06f630 2024-02-02T11:48:29.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc3838a8640 1 -- 172.21.15.162:0/966223150 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc37c149800 con 0x7fc37c06f630 2024-02-02T11:48:29.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc371ffb640 1 -- 172.21.15.162:0/966223150 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc374003ca0 con 0x7fc37c06f630 2024-02-02T11:48:29.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.847+0000 7fc371ffb640 1 -- 172.21.15.162:0/966223150 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fc374014ae0 con 0x7fc37c06f630 2024-02-02T11:48:29.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.851+0000 7fc371ffb640 1 -- 172.21.15.162:0/966223150 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fc374014cf0 con 0x7fc37c06f630 2024-02-02T11:48:29.852 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:29.851+0000 7f5fc42d3180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-02T11:48:29.912 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:29.911+0000 7f5fc42d3180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-02T11:48:29.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.915+0000 7fc3838a8640 1 -- 172.21.15.162:0/966223150 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cafcd8f5-d580-4eed-9049-631d35259e8e", "id": 7} v 0) v1 -- 0x7fc37c04e000 con 0x7fc37c06f630 2024-02-02T11:48:29.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.927+0000 7fc371ffb640 1 -- 172.21.15.162:0/966223150 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cafcd8f5-d580-4eed-9049-631d35259e8e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc37402b0b0 con 0x7fc37c06f630 2024-02-02T11:48:29.927 INFO:teuthology.orchestra.run.smithi162.stdout:7 2024-02-02T11:48:29.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.927+0000 7fc3838a8640 1 -- 172.21.15.162:0/966223150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc37c06f630 msgr2=0x7fc37c13ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:29.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.927+0000 7fc3838a8640 1 --2- 172.21.15.162:0/966223150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc37c06f630 0x7fc37c13ee30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc37400efc0 tx=0x7fc37400c490 comp rx=0 tx=0).stop 2024-02-02T11:48:29.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.927+0000 7fc3838a8640 1 -- 172.21.15.162:0/966223150 shutdown_connections 2024-02-02T11:48:29.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.927+0000 7fc3838a8640 1 --2- 172.21.15.162:0/966223150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc37c06f630 0x7fc37c13ee30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.927+0000 7fc3838a8640 1 --2- 172.21.15.162:0/966223150 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc37c06b8d0 0x7fc37c149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.927+0000 7fc3838a8640 1 --2- 172.21.15.162:0/966223150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc37c06b090 0x7fc37c1e0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:29.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.927+0000 7fc3838a8640 1 -- 172.21.15.162:0/966223150 >> 172.21.15.162:0/966223150 conn(0x7fc37c0babc0 msgr2=0x7fc37c0b9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:29.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.927+0000 7fc3838a8640 1 -- 172.21.15.162:0/966223150 shutdown_connections 2024-02-02T11:48:29.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-02T11:48:29.927+0000 7fc3838a8640 1 -- 172.21.15.162:0/966223150 wait complete. 2024-02-02T11:48:29.943 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-02T11:48:29.943 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-02T11:48:29.946 INFO:tasks.ceph.osd.0:Started 2024-02-02T11:48:29.946 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-02T11:48:29.946 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-02T11:48:29.948 INFO:tasks.ceph.osd.1:Started 2024-02-02T11:48:29.949 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-02T11:48:29.949 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-02T11:48:29.951 INFO:tasks.ceph.osd.2:Started 2024-02-02T11:48:29.951 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-02T11:48:29.951 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-02T11:48:29.954 INFO:tasks.ceph.osd.3:Started 2024-02-02T11:48:29.954 INFO:tasks.ceph.osd.4:Restarting daemon 2024-02-02T11:48:29.954 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-02-02T11:48:29.956 INFO:tasks.ceph.osd.4:Started 2024-02-02T11:48:29.956 INFO:tasks.ceph.osd.5:Restarting daemon 2024-02-02T11:48:29.956 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-02-02T11:48:29.958 INFO:tasks.ceph.osd.5:Started 2024-02-02T11:48:29.958 INFO:tasks.ceph.osd.6:Restarting daemon 2024-02-02T11:48:29.958 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-02-02T11:48:29.960 INFO:tasks.ceph.osd.6:Started 2024-02-02T11:48:29.960 INFO:tasks.ceph.osd.7:Restarting daemon 2024-02-02T11:48:29.960 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-02-02T11:48:29.962 INFO:tasks.ceph.osd.7:Started 2024-02-02T11:48:29.963 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:48:30.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.088+0000 7f2ea1806640 1 Processor -- start 2024-02-02T11:48:30.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.088+0000 7f2ea1806640 1 -- start start 2024-02-02T11:48:30.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.092+0000 7f2ea1806640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e9c0b7950 0x7f2e9c0b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:30.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.092+0000 7f2ea1806640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2e9c0b7d30 0x7f2e9c149f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:30.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.092+0000 7f2ea1806640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9c0b8170 con 0x7f2e9c146fe0 2024-02-02T11:48:30.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.092+0000 7f2ea1806640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c06c7d0 con 0x7f2e9c0b7d30 2024-02-02T11:48:30.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.092+0000 7f2ea1806640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c06c340 con 0x7f2e9c0b7950 2024-02-02T11:48:30.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.092+0000 7f2e9b7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f2e9c146fe0 0x7f2e9c147430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:58974/0 (socket says 172.21.15.161:58974) 2024-02-02T11:48:30.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.092+0000 7f2e9b7fe640 1 -- 172.21.15.161:0/597953839 learned_addr learned my addr 172.21.15.161:0/597953839 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:48:30.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.092+0000 7f2e9a7fc640 1 --2- 172.21.15.161:0/597953839 >> v2:172.21.15.162:3300/0 conn(0x7f2e9c0b7d30 0x7f2e9c149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:30.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.092+0000 7f2e9affd640 1 --2- 172.21.15.161:0/597953839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e9c0b7950 0x7f2e9c0b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:30.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.092+0000 7f2e9a7fc640 1 -- 172.21.15.161:0/597953839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e9c0b7950 msgr2=0x7f2e9c0b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:30.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.092+0000 7f2e9a7fc640 1 --2- 172.21.15.161:0/597953839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e9c0b7950 0x7f2e9c0b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:30.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.092+0000 7f2e9a7fc640 1 -- 172.21.15.161:0/597953839 >> v1:172.21.15.161:6789/0 conn(0x7f2e9c146fe0 legacy=0x7f2e9c147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:30.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.092+0000 7f2e9a7fc640 1 -- 172.21.15.161:0/597953839 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c06bcf0 con 0x7f2e9c0b7d30 2024-02-02T11:48:30.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.096+0000 7f2e9a7fc640 1 --2- 172.21.15.161:0/597953839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e9c0b7d30 0x7f2e9c149f40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0097c0 tx=0x7f2e8c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cc0e18dc32d9eaa server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:30.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.096+0000 7f2e99ffb640 1 -- 172.21.15.161:0/597953839 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0ab600 con 0x7f2e9c0b7d30 2024-02-02T11:48:30.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.096+0000 7f2e99ffb640 1 -- 172.21.15.161:0/597953839 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c0a7050 con 0x7f2e9c0b7d30 2024-02-02T11:48:30.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.096+0000 7f2e99ffb640 1 -- 172.21.15.161:0/597953839 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0ab9c0 con 0x7f2e9c0b7d30 2024-02-02T11:48:30.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.100+0000 7f2ea1806640 1 -- 172.21.15.161:0/597953839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e9c0b7d30 msgr2=0x7f2e9c149f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:30.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.100+0000 7f2ea1806640 1 --2- 172.21.15.161:0/597953839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e9c0b7d30 0x7f2e9c149f40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0097c0 tx=0x7f2e8c01c3c0 comp rx=0 tx=0).stop 2024-02-02T11:48:30.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.100+0000 7f2ea1806640 1 -- 172.21.15.161:0/597953839 shutdown_connections 2024-02-02T11:48:30.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.100+0000 7f2ea1806640 1 --2- 172.21.15.161:0/597953839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e9c0b7d30 0x7f2e9c149f40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:30.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.100+0000 7f2ea1806640 1 --2- 172.21.15.161:0/597953839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e9c0b7950 0x7f2e9c0b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:30.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.100+0000 7f2ea1806640 1 -- 172.21.15.161:0/597953839 >> 172.21.15.161:0/597953839 conn(0x7f2e9c0bbd20 msgr2=0x7f2e9c0bc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:30.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.100+0000 7f2ea1806640 1 -- 172.21.15.161:0/597953839 shutdown_connections 2024-02-02T11:48:30.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.100+0000 7f2ea1806640 1 -- 172.21.15.161:0/597953839 wait complete. 2024-02-02T11:48:30.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.100+0000 7f2ea1806640 1 Processor -- start 2024-02-02T11:48:30.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.100+0000 7f2ea1806640 1 -- start start 2024-02-02T11:48:30.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2ea1806640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e9c0b7950 0x7f2e9c0b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:30.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2ea1806640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e9c146fe0 0x7f2e9c153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:30.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2ea1806640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e9c0b2f90 0x7f2e9c0b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:30.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2ea1806640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0b4c10 con 0x7f2e9c0b7950 2024-02-02T11:48:30.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2ea1806640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0b5f60 con 0x7f2e9c146fe0 2024-02-02T11:48:30.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2ea1806640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c153f70 con 0x7f2e9c0b2f90 2024-02-02T11:48:30.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2e9affd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e9c0b7950 0x7f2e9c0b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:30.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2e9affd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e9c0b7950 0x7f2e9c0b5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33524/0 (socket says 172.21.15.161:33524) 2024-02-02T11:48:30.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2e9affd640 1 -- 172.21.15.161:0/756951140 learned_addr learned my addr 172.21.15.161:0/756951140 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:30.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2e9a7fc640 1 --2- 172.21.15.161:0/756951140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e9c146fe0 0x7f2e9c153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:30.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2e9b7fe640 1 --2- 172.21.15.161:0/756951140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e9c0b2f90 0x7f2e9c0b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:30.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2e9affd640 1 -- 172.21.15.161:0/756951140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e9c0b2f90 msgr2=0x7f2e9c0b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:30.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2e9affd640 1 --2- 172.21.15.161:0/756951140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e9c0b2f90 0x7f2e9c0b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:30.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2e9affd640 1 -- 172.21.15.161:0/756951140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e9c146fe0 msgr2=0x7f2e9c153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:30.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2e9affd640 1 --2- 172.21.15.161:0/756951140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e9c146fe0 0x7f2e9c153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:30.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2e9affd640 1 -- 172.21.15.161:0/756951140 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c009420 con 0x7f2e9c0b7950 2024-02-02T11:48:30.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2e9affd640 1 --2- 172.21.15.161:0/756951140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e9c0b7950 0x7f2e9c0b5a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000d800 tx=0x7f2e9000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:30.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2e83fff640 1 -- 172.21.15.161:0/756951140 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9000b6c0 con 0x7f2e9c0b7950 2024-02-02T11:48:30.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2e83fff640 1 -- 172.21.15.161:0/756951140 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9000b820 con 0x7f2e9c0b7950 2024-02-02T11:48:30.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2ea1806640 1 -- 172.21.15.161:0/756951140 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9c1e7bd0 con 0x7f2e9c0b7950 2024-02-02T11:48:30.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2ea1806640 1 -- 172.21.15.161:0/756951140 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c1e7580 con 0x7f2e9c0b7950 2024-02-02T11:48:30.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.104+0000 7f2e83fff640 1 -- 172.21.15.161:0/756951140 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9000bb90 con 0x7f2e9c0b7950 2024-02-02T11:48:30.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.108+0000 7f2e83fff640 1 -- 172.21.15.161:0/756951140 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2e9001e460 con 0x7f2e9c0b7950 2024-02-02T11:48:30.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.108+0000 7f2e83fff640 1 -- 172.21.15.161:0/756951140 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2e90014ce0 con 0x7f2e9c0b7950 2024-02-02T11:48:30.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.108+0000 7f2ea1806640 1 -- 172.21.15.161:0/756951140 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9c0b8650 con 0x7f2e9c0b7950 2024-02-02T11:48:30.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.108+0000 7f2e83fff640 1 -- 172.21.15.161:0/756951140 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f2e90014610 con 0x7f2e9c0b7950 2024-02-02T11:48:30.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.184+0000 7f2ea1806640 1 -- 172.21.15.161:0/756951140 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e9c1e8040 con 0x7f2e9c0b7950 2024-02-02T11:48:30.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.184+0000 7f2e83fff640 1 -- 172.21.15.161:0/756951140 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f2e9c1e8040 con 0x7f2e9c0b7950 2024-02-02T11:48:30.187 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:48:30.187 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":10,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:29.921989+0000","last_up_change":"0.000000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:48:30.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.184+0000 7f2ea1806640 1 -- 172.21.15.161:0/756951140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e9c0b7950 msgr2=0x7f2e9c0b5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:30.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.184+0000 7f2ea1806640 1 --2- 172.21.15.161:0/756951140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e9c0b7950 0x7f2e9c0b5a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000d800 tx=0x7f2e9000dcc0 comp rx=0 tx=0).stop 2024-02-02T11:48:30.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.184+0000 7f2ea1806640 1 -- 172.21.15.161:0/756951140 shutdown_connections 2024-02-02T11:48:30.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.184+0000 7f2ea1806640 1 --2- 172.21.15.161:0/756951140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e9c0b2f90 0x7f2e9c0b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:30.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.184+0000 7f2ea1806640 1 --2- 172.21.15.161:0/756951140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e9c146fe0 0x7f2e9c153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:30.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.184+0000 7f2ea1806640 1 --2- 172.21.15.161:0/756951140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e9c0b7950 0x7f2e9c0b5a20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:30.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.184+0000 7f2ea1806640 1 -- 172.21.15.161:0/756951140 >> 172.21.15.161:0/756951140 conn(0x7f2e9c0bbd20 msgr2=0x7f2e9c06fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:30.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.184+0000 7f2ea1806640 1 -- 172.21.15.161:0/756951140 shutdown_connections 2024-02-02T11:48:30.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:30.184+0000 7f2ea1806640 1 -- 172.21.15.161:0/756951140 wait complete. 2024-02-02T11:48:30.203 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-02T11:48:30.203 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-02T11:48:30.391 INFO:tasks.ceph.mgr.y.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-02-02T11:48:30.391 INFO:tasks.ceph.mgr.y.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-02-02T11:48:30.391 INFO:tasks.ceph.mgr.y.smithi161.stderr: from numpy import show_config as show_numpy_config 2024-02-02T11:48:30.428 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:30.428+0000 7fd4180a3180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-02T11:48:30.549 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:30.548+0000 7fd4180a3180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-02T11:48:30.556 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-02-02T11:48:30.555+0000 7f679a930640 -1 Falling back to public interface 2024-02-02T11:48:30.561 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-02-02T11:48:30.560+0000 7f734a3cd640 -1 Falling back to public interface 2024-02-02T11:48:30.568 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-02-02T11:48:30.567+0000 7f15220b3640 -1 Falling back to public interface 2024-02-02T11:48:30.577 INFO:tasks.ceph.osd.0.smithi161.stderr:2024-02-02T11:48:30.576+0000 7fe3433aa640 -1 Falling back to public interface 2024-02-02T11:48:30.580 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-02-02T11:48:30.579+0000 7ff22b6ef640 -1 Falling back to public interface 2024-02-02T11:48:30.581 INFO:tasks.ceph.osd.2.smithi161.stderr:2024-02-02T11:48:30.580+0000 7f44b8072640 -1 Falling back to public interface 2024-02-02T11:48:30.596 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-02-02T11:48:30.595+0000 7fca08d39640 -1 Falling back to public interface 2024-02-02T11:48:30.613 INFO:tasks.ceph.osd.3.smithi161.stderr:2024-02-02T11:48:30.612+0000 7fdc31e65640 -1 Falling back to public interface 2024-02-02T11:48:30.694 INFO:tasks.ceph.mgr.x.smithi162.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-02-02T11:48:30.694 INFO:tasks.ceph.mgr.x.smithi162.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-02-02T11:48:30.694 INFO:tasks.ceph.mgr.x.smithi162.stderr: from numpy import show_config as show_numpy_config 2024-02-02T11:48:30.713 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:30.712+0000 7fd4180a3180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-02T11:48:30.740 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:30.739+0000 7f5fc42d3180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-02T11:48:30.777 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:30.776+0000 7fd4180a3180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-02T11:48:30.888 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:30.887+0000 7f5fc42d3180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-02T11:48:30.901 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:30.900+0000 7fd4180a3180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-02T11:48:31.009 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-02T11:48:31.064 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:31.063+0000 7f5fc42d3180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-02T11:48:31.120 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.120+0000 7f1bda440640 1 Processor -- start 2024-02-02T11:48:31.121 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.120+0000 7f1bda440640 1 -- start start 2024-02-02T11:48:31.122 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.120+0000 7f1bda440640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1bd406b040 0x7f1bd4070310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:31.122 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.120+0000 7f1bda440640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1bd4148220 0x7f1bd4152240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:31.122 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.120+0000 7f1bda440640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd4071560 con 0x7f1bd41419e0 2024-02-02T11:48:31.122 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.120+0000 7f1bda440640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd4070f10 con 0x7f1bd4148220 2024-02-02T11:48:31.123 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.120+0000 7f1bda440640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd40711f0 con 0x7f1bd406b040 2024-02-02T11:48:31.123 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.120+0000 7f1bd89dd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1bd4148220 0x7f1bd4152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:31.123 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.120+0000 7f1bd89dd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1bd4148220 0x7f1bd4152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33528/0 (socket says 172.21.15.161:33528) 2024-02-02T11:48:31.123 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.120+0000 7f1bd89dd640 1 -- 172.21.15.161:0/994398559 learned_addr learned my addr 172.21.15.161:0/994398559 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:31.123 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.120+0000 7f1bd3fff640 1 --2- 172.21.15.161:0/994398559 >> v2:172.21.15.162:3300/0 conn(0x7f1bd406b040 0x7f1bd4070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:31.123 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.120+0000 7f1bd89dd640 1 -- 172.21.15.161:0/994398559 >> v2:172.21.15.162:3300/0 conn(0x7f1bd406b040 msgr2=0x7f1bd4070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:31.123 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.120+0000 7f1bd89dd640 1 --2- 172.21.15.161:0/994398559 >> v2:172.21.15.162:3300/0 conn(0x7f1bd406b040 0x7f1bd4070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:31.123 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.120+0000 7f1bd89dd640 1 -- 172.21.15.161:0/994398559 >> v1:172.21.15.161:6789/0 conn(0x7f1bd41419e0 legacy=0x7f1bd4147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:31.123 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.120+0000 7f1bd89dd640 1 -- 172.21.15.161:0/994398559 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd406b420 con 0x7f1bd4148220 2024-02-02T11:48:31.123 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.120+0000 7f1bd3fff640 1 --2- 172.21.15.161:0/994398559 >> v2:172.21.15.162:3300/0 conn(0x7f1bd406b040 0x7f1bd4070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:48:31.126 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bd89dd640 1 --2- 172.21.15.161:0/994398559 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bd4148220 0x7f1bd4152240 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1bd406bd10 tx=0x7f1bcc0213c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e675c048df726cfc server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:31.126 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bd37fe640 1 -- 172.21.15.161:0/994398559 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc00b2d0 con 0x7f1bd4148220 2024-02-02T11:48:31.126 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bd37fe640 1 -- 172.21.15.161:0/994398559 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc0ad050 con 0x7f1bd4148220 2024-02-02T11:48:31.126 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bd37fe640 1 -- 172.21.15.161:0/994398559 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc009820 con 0x7f1bd4148220 2024-02-02T11:48:31.127 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bda440640 1 -- 172.21.15.161:0/994398559 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bd4148220 msgr2=0x7f1bd4152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:31.127 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bda440640 1 --2- 172.21.15.161:0/994398559 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bd4148220 0x7f1bd4152240 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1bd406bd10 tx=0x7f1bcc0213c0 comp rx=0 tx=0).stop 2024-02-02T11:48:31.127 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bda440640 1 -- 172.21.15.161:0/994398559 shutdown_connections 2024-02-02T11:48:31.127 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bda440640 1 --2- 172.21.15.161:0/994398559 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bd4148220 0x7f1bd4152240 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:31.127 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bda440640 1 --2- 172.21.15.161:0/994398559 >> v2:172.21.15.162:3300/0 conn(0x7f1bd406b040 0x7f1bd4070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:31.127 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bda440640 1 -- 172.21.15.161:0/994398559 >> 172.21.15.161:0/994398559 conn(0x7f1bd40bd0a0 msgr2=0x7f1bd40bd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:31.127 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bda440640 1 -- 172.21.15.161:0/994398559 shutdown_connections 2024-02-02T11:48:31.127 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bda440640 1 -- 172.21.15.161:0/994398559 wait complete. 2024-02-02T11:48:31.130 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bda440640 1 Processor -- start 2024-02-02T11:48:31.130 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bda440640 1 -- start start 2024-02-02T11:48:31.130 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bda440640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bd406b040 0x7f1bd4139050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:31.130 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bda440640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bd41419e0 0x7f1bd41df2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:31.130 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bda440640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bd4148220 0x7f1bd4145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:31.130 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bda440640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd41df810 con 0x7f1bd4148220 2024-02-02T11:48:31.130 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bda440640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd4145810 con 0x7f1bd406b040 2024-02-02T11:48:31.130 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bda440640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd41d3b30 con 0x7f1bd41419e0 2024-02-02T11:48:31.130 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bd89dd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bd4148220 0x7f1bd4145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:31.130 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bd89dd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bd4148220 0x7f1bd4145c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33542/0 (socket says 172.21.15.161:33542) 2024-02-02T11:48:31.130 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.124+0000 7f1bd89dd640 1 -- 172.21.15.161:0/3786064917 learned_addr learned my addr 172.21.15.161:0/3786064917 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:31.130 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.128+0000 7f1bd3fff640 1 --2- 172.21.15.161:0/3786064917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bd406b040 0x7f1bd4139050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:31.130 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.128+0000 7f1bcbfff640 1 --2- 172.21.15.161:0/3786064917 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bd41419e0 0x7f1bd41df2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:31.131 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.128+0000 7f1bd89dd640 1 -- 172.21.15.161:0/3786064917 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bd41419e0 msgr2=0x7f1bd41df2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:31.131 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.128+0000 7f1bd89dd640 1 --2- 172.21.15.161:0/3786064917 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bd41419e0 0x7f1bd41df2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:31.131 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.128+0000 7f1bd89dd640 1 -- 172.21.15.161:0/3786064917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bd406b040 msgr2=0x7f1bd4139050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:31.131 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.128+0000 7f1bd89dd640 1 --2- 172.21.15.161:0/3786064917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bd406b040 0x7f1bd4139050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:31.131 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.128+0000 7f1bd89dd640 1 -- 172.21.15.161:0/3786064917 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc00bd40 con 0x7f1bd4148220 2024-02-02T11:48:31.131 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.128+0000 7f1bd89dd640 1 --2- 172.21.15.161:0/3786064917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bd4148220 0x7f1bd4145c60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0b4040 tx=0x7f1bcc01e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:31.131 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.128+0000 7f1bd17fa640 1 -- 172.21.15.161:0/3786064917 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0c2070 con 0x7f1bd4148220 2024-02-02T11:48:31.131 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.128+0000 7f1bd17fa640 1 -- 172.21.15.161:0/3786064917 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc0098d0 con 0x7f1bd4148220 2024-02-02T11:48:31.131 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.128+0000 7f1bda440640 1 -- 172.21.15.161:0/3786064917 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd41d0fd0 con 0x7f1bd4148220 2024-02-02T11:48:31.131 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.128+0000 7f1bd17fa640 1 -- 172.21.15.161:0/3786064917 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc009c80 con 0x7f1bd4148220 2024-02-02T11:48:31.131 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.128+0000 7f1bda440640 1 -- 172.21.15.161:0/3786064917 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd413bf60 con 0x7f1bd4148220 2024-02-02T11:48:31.131 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.128+0000 7f1bd17fa640 1 -- 172.21.15.161:0/3786064917 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1bcc0b8040 con 0x7f1bd4148220 2024-02-02T11:48:31.131 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.128+0000 7f1bd17fa640 1 -- 172.21.15.161:0/3786064917 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1bcc009de0 con 0x7f1bd4148220 2024-02-02T11:48:31.131 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.128+0000 7f1bda440640 1 -- 172.21.15.161:0/3786064917 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd4145980 con 0x7f1bd4148220 2024-02-02T11:48:31.132 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:31.127+0000 7f5fc42d3180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-02T11:48:31.132 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.128+0000 7f1bd17fa640 1 -- 172.21.15.161:0/3786064917 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f1bd4145980 con 0x7f1bd4148220 2024-02-02T11:48:31.189 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.188+0000 7f1bda440640 1 -- 172.21.15.161:0/3786064917 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bd4073790 con 0x7f1bd4148220 2024-02-02T11:48:31.189 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.188+0000 7f1bd17fa640 1 -- 172.21.15.161:0/3786064917 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f1bcc0b6070 con 0x7f1bd4148220 2024-02-02T11:48:31.189 INFO:teuthology.misc.health.smithi161.stdout: 2024-02-02T11:48:31.190 INFO:teuthology.misc.health.smithi161.stdout:{"epoch":10,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:29.921989+0000","last_up_change":"0.000000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:48:31.190 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.188+0000 7f1bda440640 1 -- 172.21.15.161:0/3786064917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bd4148220 msgr2=0x7f1bd4145c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:31.191 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.188+0000 7f1bda440640 1 --2- 172.21.15.161:0/3786064917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bd4148220 0x7f1bd4145c60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0b4040 tx=0x7f1bcc01e160 comp rx=0 tx=0).stop 2024-02-02T11:48:31.191 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.188+0000 7f1bda440640 1 -- 172.21.15.161:0/3786064917 shutdown_connections 2024-02-02T11:48:31.191 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.188+0000 7f1bda440640 1 --2- 172.21.15.161:0/3786064917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bd4148220 0x7f1bd4145c60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:31.191 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.188+0000 7f1bda440640 1 --2- 172.21.15.161:0/3786064917 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bd41419e0 0x7f1bd41df2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:31.191 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.188+0000 7f1bda440640 1 --2- 172.21.15.161:0/3786064917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bd406b040 0x7f1bd4139050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:31.191 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.188+0000 7f1bda440640 1 -- 172.21.15.161:0/3786064917 >> 172.21.15.161:0/3786064917 conn(0x7f1bd40bd0a0 msgr2=0x7f1bd40bb310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:31.191 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.188+0000 7f1bda440640 1 -- 172.21.15.161:0/3786064917 shutdown_connections 2024-02-02T11:48:31.191 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:31.188+0000 7f1bda440640 1 -- 172.21.15.161:0/3786064917 wait complete. 2024-02-02T11:48:31.204 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-02-02T11:48:31.252 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:31.251+0000 7f5fc42d3180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-02T11:48:31.547 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:31.544+0000 7fd4180a3180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-02T11:48:31.623 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:31.620+0000 7fd4180a3180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-02T11:48:31.794 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:31.792+0000 7fd4180a3180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-02T11:48:31.861 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:31.859+0000 7f5fc42d3180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-02T11:48:31.868 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:31.864+0000 7fd4180a3180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-02T11:48:31.935 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:31.935+0000 7f5fc42d3180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-02T11:48:32.104 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:32.103+0000 7f5fc42d3180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-02T11:48:32.158 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:32.156+0000 7fd4180a3180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-02T11:48:32.177 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:32.175+0000 7f5fc42d3180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-02T11:48:32.217 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:32.216+0000 7fd4180a3180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-02T11:48:32.474 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:32.471+0000 7f5fc42d3180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-02T11:48:32.533 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-02-02T11:48:32.531+0000 7f5fc42d3180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-02T11:48:33.255 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:33.252+0000 7fd3bf962640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-02T11:48:33.255 INFO:tasks.ceph.mgr.y.smithi161.stderr:2024-02-02T11:48:33.252+0000 7fd3bf962640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-02-02T11:48:34.381 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-02-02T11:48:34.379+0000 7f679a930640 -1 osd.6 0 log_to_monitors true 2024-02-02T11:48:34.385 INFO:tasks.ceph.osd.0.smithi161.stderr:2024-02-02T11:48:34.384+0000 7fe3433aa640 -1 osd.0 0 log_to_monitors true 2024-02-02T11:48:34.401 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-02-02T11:48:34.400+0000 7f734a3cd640 -1 osd.1 0 log_to_monitors true 2024-02-02T11:48:34.471 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-02-02T11:48:34.471+0000 7f15220b3640 -1 osd.7 0 log_to_monitors true 2024-02-02T11:48:34.474 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-02-02T11:48:34.471+0000 7ff22b6ef640 -1 osd.4 0 log_to_monitors true 2024-02-02T11:48:34.501 INFO:tasks.ceph.osd.2.smithi161.stderr:2024-02-02T11:48:34.500+0000 7f44b8072640 -1 osd.2 0 log_to_monitors true 2024-02-02T11:48:34.549 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-02-02T11:48:34.547+0000 7fca08d39640 -1 osd.5 0 log_to_monitors true 2024-02-02T11:48:34.584 INFO:tasks.ceph.osd.3.smithi161.stderr:2024-02-02T11:48:34.580+0000 7fdc31e65640 -1 osd.3 0 log_to_monitors true 2024-02-02T11:48:38.013 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-02T11:48:38.168 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.164+0000 7f8e33fff640 1 Processor -- start 2024-02-02T11:48:38.168 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.168+0000 7f8e33fff640 1 -- start start 2024-02-02T11:48:38.170 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.168+0000 7f8e33fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8e340b8330 0x7f8e3406f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:38.171 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.168+0000 7f8e33fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e3406f9d0 0x7f8e34159570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:38.171 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.168+0000 7f8e33fff640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e34152c60 con 0x7f8e340b5aa0 2024-02-02T11:48:38.171 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.168+0000 7f8e33fff640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e340708c0 con 0x7f8e340b8330 2024-02-02T11:48:38.171 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.168+0000 7f8e33fff640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e34071aa0 con 0x7f8e3406f9d0 2024-02-02T11:48:38.171 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.168+0000 7f8e32ffd640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f8e340b5aa0 0x7f8e341521f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.161:40494/0 (socket says 172.21.15.161:40494) 2024-02-02T11:48:38.171 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.168+0000 7f8e32ffd640 1 -- 172.21.15.161:0/3979589492 learned_addr learned my addr 172.21.15.161:0/3979589492 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:48:38.171 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.168+0000 7f8e337fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e3406f9d0 0x7f8e34159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:38.171 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.168+0000 7f8e327fc640 1 --2- 172.21.15.161:0/3979589492 >> v2:172.21.15.162:3300/0 conn(0x7f8e340b8330 0x7f8e3406f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:38.171 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.168+0000 7f8e327fc640 1 -- 172.21.15.161:0/3979589492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e3406f9d0 msgr2=0x7f8e34159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:38.171 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.168+0000 7f8e327fc640 1 --2- 172.21.15.161:0/3979589492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e3406f9d0 0x7f8e34159570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:38.171 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.168+0000 7f8e327fc640 1 -- 172.21.15.161:0/3979589492 >> v1:172.21.15.162:6789/0 conn(0x7f8e340b5aa0 legacy=0x7f8e341521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:38.171 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.168+0000 7f8e327fc640 1 -- 172.21.15.161:0/3979589492 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e34152900 con 0x7f8e340b8330 2024-02-02T11:48:38.171 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.168+0000 7f8e31ffb640 1 -- 172.21.15.161:0/3979589492 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2898177464 0 0) 0x7f8e34152c60 con 0x7f8e340b5aa0 2024-02-02T11:48:38.172 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.168+0000 7f8e337fe640 1 --2- 172.21.15.161:0/3979589492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e3406f9d0 0x7f8e34159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-02T11:48:38.173 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.172+0000 7f8e327fc640 1 --2- 172.21.15.161:0/3979589492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e340b8330 0x7f8e3406f490 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8e240097c0 tx=0x7f8e2401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3554bdd7c7a52271 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:38.174 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.172+0000 7f8e31ffb640 1 -- 172.21.15.161:0/3979589492 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240ab650 con 0x7f8e340b8330 2024-02-02T11:48:38.174 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.172+0000 7f8e31ffb640 1 -- 172.21.15.161:0/3979589492 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e240ab7b0 con 0x7f8e340b8330 2024-02-02T11:48:38.175 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.172+0000 7f8e33fff640 1 -- 172.21.15.161:0/3979589492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e340b8330 msgr2=0x7f8e3406f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:38.175 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.172+0000 7f8e31ffb640 1 -- 172.21.15.161:0/3979589492 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240ab650 con 0x7f8e340b8330 2024-02-02T11:48:38.175 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.172+0000 7f8e33fff640 1 --2- 172.21.15.161:0/3979589492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e340b8330 0x7f8e3406f490 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8e240097c0 tx=0x7f8e2401c450 comp rx=0 tx=0).stop 2024-02-02T11:48:38.175 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.172+0000 7f8e33fff640 1 -- 172.21.15.161:0/3979589492 shutdown_connections 2024-02-02T11:48:38.175 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.172+0000 7f8e33fff640 1 --2- 172.21.15.161:0/3979589492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e3406f9d0 0x7f8e34159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:38.176 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.172+0000 7f8e33fff640 1 --2- 172.21.15.161:0/3979589492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e340b8330 0x7f8e3406f490 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:38.176 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.172+0000 7f8e33fff640 1 -- 172.21.15.161:0/3979589492 >> 172.21.15.161:0/3979589492 conn(0x7f8e340b8820 msgr2=0x7f8e340b8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:38.176 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.172+0000 7f8e33fff640 1 -- 172.21.15.161:0/3979589492 shutdown_connections 2024-02-02T11:48:38.176 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.172+0000 7f8e33fff640 1 -- 172.21.15.161:0/3979589492 wait complete. 2024-02-02T11:48:38.177 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e33fff640 1 Processor -- start 2024-02-02T11:48:38.177 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e33fff640 1 -- start start 2024-02-02T11:48:38.178 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e33fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e3406f9d0 0x7f8e34150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:38.178 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e33fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e340b5aa0 0x7f8e34140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:38.178 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e33fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e340b8330 0x7f8e34141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:38.178 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e33fff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e341513c0 con 0x7f8e340b8330 2024-02-02T11:48:38.178 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e33fff640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e341436e0 con 0x7f8e3406f9d0 2024-02-02T11:48:38.178 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e33fff640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e341515b0 con 0x7f8e340b5aa0 2024-02-02T11:48:38.178 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e32ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e3406f9d0 0x7f8e34150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:38.179 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e327fc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e340b5aa0 0x7f8e34140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:38.179 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e32ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e3406f9d0 0x7f8e34150e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.161:50678/0 (socket says 172.21.15.161:50678) 2024-02-02T11:48:38.179 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e327fc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e340b5aa0 0x7f8e34140e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.161:43014/0 (socket says 172.21.15.161:43014) 2024-02-02T11:48:38.179 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e32ffd640 1 -- 172.21.15.161:0/432090798 learned_addr learned my addr 172.21.15.161:0/432090798 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:38.179 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e337fe640 1 --2- 172.21.15.161:0/432090798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e340b8330 0x7f8e34141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:38.180 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e32ffd640 1 -- 172.21.15.161:0/432090798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e340b5aa0 msgr2=0x7f8e34140e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:38.180 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e32ffd640 1 --2- 172.21.15.161:0/432090798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e340b5aa0 0x7f8e34140e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:38.180 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e32ffd640 1 -- 172.21.15.161:0/432090798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e340b8330 msgr2=0x7f8e34141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:38.180 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e32ffd640 1 --2- 172.21.15.161:0/432090798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e340b8330 0x7f8e34141360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:38.180 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e32ffd640 1 -- 172.21.15.161:0/432090798 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e28009420 con 0x7f8e3406f9d0 2024-02-02T11:48:38.180 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e327fc640 1 --2- 172.21.15.161:0/432090798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e340b5aa0 0x7f8e34140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-02T11:48:38.180 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e32ffd640 1 --2- 172.21.15.161:0/432090798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e3406f9d0 0x7f8e34150e80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00c8f0 tx=0x7f8e2c00ccf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:38.180 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e1b7fe640 1 -- 172.21.15.161:0/432090798 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c00a640 con 0x7f8e3406f9d0 2024-02-02T11:48:38.180 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e33fff640 1 -- 172.21.15.161:0/432090798 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e24009420 con 0x7f8e3406f9d0 2024-02-02T11:48:38.180 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.176+0000 7f8e33fff640 1 -- 172.21.15.161:0/432090798 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e34150620 con 0x7f8e3406f9d0 2024-02-02T11:48:38.181 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.180+0000 7f8e1b7fe640 1 -- 172.21.15.161:0/432090798 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c00a7a0 con 0x7f8e3406f9d0 2024-02-02T11:48:38.181 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.180+0000 7f8e1b7fe640 1 -- 172.21.15.161:0/432090798 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c00ab50 con 0x7f8e3406f9d0 2024-02-02T11:48:38.182 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.180+0000 7f8e33fff640 1 -- 172.21.15.161:0/432090798 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e34140b40 con 0x7f8e3406f9d0 2024-02-02T11:48:38.182 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.180+0000 7f8e1b7fe640 1 -- 172.21.15.161:0/432090798 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 4) v1 ==== 85172+0+0 (secure 0 0 0) 0x7f8e2c00acb0 con 0x7f8e3406f9d0 2024-02-02T11:48:38.182 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.180+0000 7f8e1b7fe640 1 --2- 172.21.15.161:0/432090798 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8e200659d0 0x7f8e20067e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:38.182 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.180+0000 7f8e1b7fe640 1 -- 172.21.15.161:0/432090798 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f8e2c081c10 con 0x7f8e3406f9d0 2024-02-02T11:48:38.183 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.180+0000 7f8e327fc640 1 --2- 172.21.15.161:0/432090798 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8e200659d0 0x7f8e20067e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:38.183 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.180+0000 7f8e327fc640 1 --2- 172.21.15.161:0/432090798 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8e200659d0 0x7f8e20067e90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8e240af000 tx=0x7f8e24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:38.190 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.188+0000 7f8e1b7fe640 1 -- 172.21.15.161:0/432090798 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8e2c050660 con 0x7f8e3406f9d0 2024-02-02T11:48:38.504 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-02-02T11:48:38.503+0000 7f151d835640 -1 osd.7 0 waiting for initial osdmap 2024-02-02T11:48:38.529 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-02-02T11:48:38.527+0000 7f67978ed640 -1 osd.6 0 waiting for initial osdmap 2024-02-02T11:48:38.532 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.528+0000 7f8e33fff640 1 -- 172.21.15.161:0/432090798 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e3404e000 con 0x7f8e3406f9d0 2024-02-02T11:48:38.535 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-02-02T11:48:38.535+0000 7f1515e7a640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-02T11:48:38.537 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.536+0000 7f8e1b7fe640 1 -- 172.21.15.161:0/432090798 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f8e2c018020 con 0x7f8e3406f9d0 2024-02-02T11:48:38.537 INFO:teuthology.misc.health.smithi161.stdout: 2024-02-02T11:48:38.537 INFO:teuthology.misc.health.smithi161.stdout:{"epoch":12,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:36.264685+0000","last_up_change":"0.000000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:48:38.540 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.536+0000 7f8e33fff640 1 -- 172.21.15.161:0/432090798 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8e200659d0 msgr2=0x7f8e20067e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:38.540 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.536+0000 7f8e33fff640 1 --2- 172.21.15.161:0/432090798 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8e200659d0 0x7f8e20067e90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8e240af000 tx=0x7f8e24008040 comp rx=0 tx=0).stop 2024-02-02T11:48:38.540 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.536+0000 7f8e33fff640 1 -- 172.21.15.161:0/432090798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e3406f9d0 msgr2=0x7f8e34150e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:38.540 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.536+0000 7f8e33fff640 1 --2- 172.21.15.161:0/432090798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e3406f9d0 0x7f8e34150e80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00c8f0 tx=0x7f8e2c00ccf0 comp rx=0 tx=0).stop 2024-02-02T11:48:38.540 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.536+0000 7f8e33fff640 1 -- 172.21.15.161:0/432090798 shutdown_connections 2024-02-02T11:48:38.540 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.536+0000 7f8e33fff640 1 --2- 172.21.15.161:0/432090798 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8e200659d0 0x7f8e20067e90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:38.540 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.536+0000 7f8e33fff640 1 --2- 172.21.15.161:0/432090798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e340b8330 0x7f8e34141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:38.540 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.536+0000 7f8e33fff640 1 --2- 172.21.15.161:0/432090798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e340b5aa0 0x7f8e34140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:38.540 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.536+0000 7f8e33fff640 1 --2- 172.21.15.161:0/432090798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e3406f9d0 0x7f8e34150e80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:38.540 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.536+0000 7f8e33fff640 1 -- 172.21.15.161:0/432090798 >> 172.21.15.161:0/432090798 conn(0x7f8e340b8820 msgr2=0x7f8e340b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:38.541 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.536+0000 7f8e33fff640 1 -- 172.21.15.161:0/432090798 shutdown_connections 2024-02-02T11:48:38.541 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:38.536+0000 7f8e33fff640 1 -- 172.21.15.161:0/432090798 wait complete. 2024-02-02T11:48:38.555 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-02-02T11:48:38.555+0000 7f678e6f7640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-02T11:48:38.562 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-02-02T11:48:38.562 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-02-02T11:48:38.559+0000 7ff2286ac640 -1 osd.4 0 waiting for initial osdmap 2024-02-02T11:48:38.583 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-02-02T11:48:38.580+0000 7f7345b4f640 -1 osd.1 0 waiting for initial osdmap 2024-02-02T11:48:38.595 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-02-02T11:48:38.595+0000 7ff21f4b6640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-02T11:48:38.617 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-02-02T11:48:38.616+0000 7f733e194640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-02T11:48:38.619 INFO:tasks.ceph.osd.3.smithi161.stderr:2024-02-02T11:48:38.616+0000 7fdc2d5e7640 -1 osd.3 0 waiting for initial osdmap 2024-02-02T11:48:38.635 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-02-02T11:48:38.635+0000 7fca044bb640 -1 osd.5 0 waiting for initial osdmap 2024-02-02T11:48:38.640 INFO:tasks.ceph.osd.0.smithi161.stderr:2024-02-02T11:48:38.640+0000 7fe33eb2c640 -1 osd.0 0 waiting for initial osdmap 2024-02-02T11:48:38.652 INFO:tasks.ceph.osd.3.smithi161.stderr:2024-02-02T11:48:38.652+0000 7fdc25c2c640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-02T11:48:38.676 INFO:tasks.ceph.osd.0.smithi161.stderr:2024-02-02T11:48:38.676+0000 7fe337171640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-02T11:48:38.679 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-02-02T11:48:38.679+0000 7fc9fcb00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-02T11:48:38.792 INFO:tasks.ceph.osd.2.smithi161.stderr:2024-02-02T11:48:38.788+0000 7f44b37f4640 -1 osd.2 0 waiting for initial osdmap 2024-02-02T11:48:38.813 INFO:tasks.ceph.osd.2.smithi161.stderr:2024-02-02T11:48:38.812+0000 7f44abe39640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-02T11:48:45.368 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-02T11:48:45.488 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c43604640 1 Processor -- start 2024-02-02T11:48:45.489 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c43604640 1 -- start start 2024-02-02T11:48:45.491 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c43604640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7c3c0b55a0 0x7f7c3c06f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:45.491 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c43604640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c3c06fdc0 0x7f7c3c0b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:45.492 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c43604640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3c148160 con 0x7f7c3c14acf0 2024-02-02T11:48:45.492 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c43604640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3c141f50 con 0x7f7c3c0b55a0 2024-02-02T11:48:45.492 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c43604640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c147830 con 0x7f7c3c06fdc0 2024-02-02T11:48:45.492 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c41ba1640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7c3c14acf0 0x7f7c3c069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50716/0 (socket says 172.21.15.161:50716) 2024-02-02T11:48:45.492 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c41ba1640 1 -- 172.21.15.161:0/959065910 learned_addr learned my addr 172.21.15.161:0/959065910 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:48:45.492 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c33fff640 1 -- 172.21.15.161:0/959065910 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1401016308 0 0) 0x7f7c3c148160 con 0x7f7c3c14acf0 2024-02-02T11:48:45.492 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c33fff640 1 -- 172.21.15.161:0/959065910 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c28005740 con 0x7f7c3c14acf0 2024-02-02T11:48:45.492 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c40b9f640 1 --2- 172.21.15.161:0/959065910 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c3c06fdc0 0x7f7c3c0b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:45.492 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c413a0640 1 --2- 172.21.15.161:0/959065910 >> v2:172.21.15.162:3300/0 conn(0x7f7c3c0b55a0 0x7f7c3c06f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:45.492 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c33fff640 1 -- 172.21.15.161:0/959065910 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3882593 0 0) 0x7f7c28005740 con 0x7f7c3c14acf0 2024-02-02T11:48:45.492 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c33fff640 1 -- 172.21.15.161:0/959065910 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c3c06fdc0 msgr2=0x7f7c3c0b7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:45.492 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c33fff640 1 --2- 172.21.15.161:0/959065910 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c3c06fdc0 0x7f7c3c0b7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.492 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c33fff640 1 -- 172.21.15.161:0/959065910 >> v2:172.21.15.162:3300/0 conn(0x7f7c3c0b55a0 msgr2=0x7f7c3c06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:45.493 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c33fff640 1 --2- 172.21.15.161:0/959065910 >> v2:172.21.15.162:3300/0 conn(0x7f7c3c0b55a0 0x7f7c3c06f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.493 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c33fff640 1 -- 172.21.15.161:0/959065910 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c147b10 con 0x7f7c3c14acf0 2024-02-02T11:48:45.493 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c33fff640 1 -- 172.21.15.161:0/959065910 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f7c34001a00 con 0x7f7c3c14acf0 2024-02-02T11:48:45.493 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c33fff640 1 -- 172.21.15.161:0/959065910 >> v1:172.21.15.161:6789/0 conn(0x7f7c3c14acf0 legacy=0x7f7c3c069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:45.493 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c33fff640 1 --2- 172.21.15.161:0/959065910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c28005b90 0x7f7c28005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:45.493 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c33fff640 1 --2- 172.21.15.161:0/959065910 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c3c06fdc0 0x7f7c280069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:45.493 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c33fff640 1 --2- 172.21.15.161:0/959065910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c28006f20 0x7f7c280073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:45.493 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c33fff640 1 -- 172.21.15.161:0/959065910 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c141f50 con 0x7f7c28005b90 2024-02-02T11:48:45.493 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c33fff640 1 -- 172.21.15.161:0/959065910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c147830 con 0x7f7c28006f20 2024-02-02T11:48:45.493 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c33fff640 1 -- 172.21.15.161:0/959065910 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2800dc50 con 0x7f7c3c06fdc0 2024-02-02T11:48:45.493 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c413a0640 1 --2- 172.21.15.161:0/959065910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c28005b90 0x7f7c28005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:45.493 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c40b9f640 1 --2- 172.21.15.161:0/959065910 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c3c06fdc0 0x7f7c280069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:45.493 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c41ba1640 1 --2- 172.21.15.161:0/959065910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c28006f20 0x7f7c280073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:45.493 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c413a0640 1 -- 172.21.15.161:0/959065910 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c3c06fdc0 msgr2=0x7f7c280069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:45.494 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c413a0640 1 --2- 172.21.15.161:0/959065910 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c3c06fdc0 0x7f7c280069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.494 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c413a0640 1 -- 172.21.15.161:0/959065910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c28006f20 msgr2=0x7f7c280073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:45.494 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c413a0640 1 --2- 172.21.15.161:0/959065910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c28006f20 0x7f7c280073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.494 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c413a0640 1 -- 172.21.15.161:0/959065910 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c28005740 con 0x7f7c28005b90 2024-02-02T11:48:45.494 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.488+0000 7f7c41ba1640 1 --2- 172.21.15.161:0/959065910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c28006f20 0x7f7c280073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:48:45.495 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c413a0640 1 --2- 172.21.15.161:0/959065910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c28005b90 0x7f7c28005fb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800ba60 tx=0x7f7c3801c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22988df290bcc662 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:45.495 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c33fff640 1 -- 172.21.15.161:0/959065910 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c380ad640 con 0x7f7c28005b90 2024-02-02T11:48:45.495 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c33fff640 1 -- 172.21.15.161:0/959065910 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c380ad7a0 con 0x7f7c28005b90 2024-02-02T11:48:45.495 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c33fff640 1 -- 172.21.15.161:0/959065910 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c380adb50 con 0x7f7c28005b90 2024-02-02T11:48:45.495 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c43604640 1 -- 172.21.15.161:0/959065910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c28005b90 msgr2=0x7f7c28005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:45.496 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c43604640 1 --2- 172.21.15.161:0/959065910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c28005b90 0x7f7c28005fb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800ba60 tx=0x7f7c3801c6a0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.496 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c41ba1640 1 -- 172.21.15.161:0/959065910 reap_dead start 2024-02-02T11:48:45.496 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c43604640 1 -- 172.21.15.161:0/959065910 shutdown_connections 2024-02-02T11:48:45.496 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c43604640 1 -- 172.21.15.161:0/959065910 >> 172.21.15.161:0/959065910 conn(0x7f7c3c0bbf80 msgr2=0x7f7c3c0bc390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:45.496 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c43604640 1 -- 172.21.15.161:0/959065910 shutdown_connections 2024-02-02T11:48:45.496 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c43604640 1 -- 172.21.15.161:0/959065910 wait complete. 2024-02-02T11:48:45.496 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c43604640 1 Processor -- start 2024-02-02T11:48:45.496 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c43604640 1 -- start start 2024-02-02T11:48:45.499 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c43604640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c28005b90 0x7f7c3c0a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:45.499 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c43604640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c3c0a82a0 0x7f7c3c140510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:45.499 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c43604640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c3c1e6150 0x7f7c3c13e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:45.499 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c43604640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0a77f0 con 0x7f7c3c1e6150 2024-02-02T11:48:45.499 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c43604640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0a9360 con 0x7f7c3c0a82a0 2024-02-02T11:48:45.499 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c43604640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c140a50 con 0x7f7c28005b90 2024-02-02T11:48:45.499 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c41ba1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c3c1e6150 0x7f7c3c13e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:45.499 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c41ba1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c3c1e6150 0x7f7c3c13e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52694/0 (socket says 172.21.15.161:52694) 2024-02-02T11:48:45.499 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c41ba1640 1 -- 172.21.15.161:0/1331792470 learned_addr learned my addr 172.21.15.161:0/1331792470 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:45.499 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c413a0640 1 --2- 172.21.15.161:0/1331792470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c28005b90 0x7f7c3c0a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:45.499 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c40b9f640 1 --2- 172.21.15.161:0/1331792470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c3c0a82a0 0x7f7c3c140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:45.499 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.492+0000 7f7c41ba1640 1 -- 172.21.15.161:0/1331792470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c28005b90 msgr2=0x7f7c3c0a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:45.500 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.496+0000 7f7c41ba1640 1 --2- 172.21.15.161:0/1331792470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c28005b90 0x7f7c3c0a8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.500 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.496+0000 7f7c41ba1640 1 -- 172.21.15.161:0/1331792470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c3c0a82a0 msgr2=0x7f7c3c140510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:45.500 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.496+0000 7f7c41ba1640 1 --2- 172.21.15.161:0/1331792470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c3c0a82a0 0x7f7c3c140510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.500 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.496+0000 7f7c41ba1640 1 -- 172.21.15.161:0/1331792470 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c1e65e0 con 0x7f7c3c1e6150 2024-02-02T11:48:45.500 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.496+0000 7f7c40b9f640 1 --2- 172.21.15.161:0/1331792470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c3c0a82a0 0x7f7c3c140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:48:45.500 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.496+0000 7f7c41ba1640 1 --2- 172.21.15.161:0/1331792470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c3c1e6150 0x7f7c3c13e2b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c14b0d0 tx=0x7f7c3400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:45.500 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.496+0000 7f7c31ffb640 1 -- 172.21.15.161:0/1331792470 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3400bb20 con 0x7f7c3c1e6150 2024-02-02T11:48:45.500 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.496+0000 7f7c31ffb640 1 -- 172.21.15.161:0/1331792470 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3400bc80 con 0x7f7c3c1e6150 2024-02-02T11:48:45.500 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.496+0000 7f7c43604640 1 -- 172.21.15.161:0/1331792470 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3c0a86c0 con 0x7f7c3c1e6150 2024-02-02T11:48:45.500 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.496+0000 7f7c31ffb640 1 -- 172.21.15.161:0/1331792470 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34007070 con 0x7f7c3c1e6150 2024-02-02T11:48:45.500 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.496+0000 7f7c43604640 1 -- 172.21.15.161:0/1331792470 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3c147090 con 0x7f7c3c1e6150 2024-02-02T11:48:45.500 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.496+0000 7f7c43604640 1 -- 172.21.15.161:0/1331792470 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3c146ed0 con 0x7f7c3c1e6150 2024-02-02T11:48:45.500 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.496+0000 7f7c31ffb640 1 -- 172.21.15.161:0/1331792470 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7c340071f0 con 0x7f7c3c1e6150 2024-02-02T11:48:45.501 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.496+0000 7f7c31ffb640 1 --2- 172.21.15.161:0/1331792470 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7c20065a90 0x7f7c20067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:45.501 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.496+0000 7f7c413a0640 1 --2- 172.21.15.161:0/1331792470 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7c20065a90 0x7f7c20067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:45.501 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.496+0000 7f7c31ffb640 1 -- 172.21.15.161:0/1331792470 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7c340832c0 con 0x7f7c3c1e6150 2024-02-02T11:48:45.501 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.496+0000 7f7c413a0640 1 --2- 172.21.15.161:0/1331792470 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7c20065a90 0x7f7c20067f50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c380af000 tx=0x7f7c380046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:45.520 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.516+0000 7f7c31ffb640 1 -- 172.21.15.161:0/1331792470 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7c34050f30 con 0x7f7c3c1e6150 2024-02-02T11:48:45.676 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.672+0000 7f7c43604640 1 -- 172.21.15.161:0/1331792470 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c3c0a88b0 con 0x7f7c3c1e6150 2024-02-02T11:48:45.678 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.676+0000 7f7c31ffb640 1 -- 172.21.15.161:0/1331792470 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f7c34054550 con 0x7f7c3c1e6150 2024-02-02T11:48:45.678 INFO:teuthology.misc.health.smithi161.stdout: 2024-02-02T11:48:45.678 INFO:teuthology.misc.health.smithi161.stdout:{"epoch":16,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:42.556025+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:48:45.680 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.676+0000 7f7c43604640 1 -- 172.21.15.161:0/1331792470 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7c20065a90 msgr2=0x7f7c20067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:45.680 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.676+0000 7f7c43604640 1 --2- 172.21.15.161:0/1331792470 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7c20065a90 0x7f7c20067f50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c380af000 tx=0x7f7c380046d0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.681 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.676+0000 7f7c43604640 1 -- 172.21.15.161:0/1331792470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c3c1e6150 msgr2=0x7f7c3c13e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:45.681 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.676+0000 7f7c43604640 1 --2- 172.21.15.161:0/1331792470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c3c1e6150 0x7f7c3c13e2b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c14b0d0 tx=0x7f7c3400b4a0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.681 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.676+0000 7f7c43604640 1 -- 172.21.15.161:0/1331792470 shutdown_connections 2024-02-02T11:48:45.681 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.676+0000 7f7c43604640 1 --2- 172.21.15.161:0/1331792470 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7c20065a90 0x7f7c20067f50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.681 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.676+0000 7f7c43604640 1 --2- 172.21.15.161:0/1331792470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c3c1e6150 0x7f7c3c13e2b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.681 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.676+0000 7f7c43604640 1 --2- 172.21.15.161:0/1331792470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c3c0a82a0 0x7f7c3c140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.681 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.676+0000 7f7c43604640 1 --2- 172.21.15.161:0/1331792470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c28005b90 0x7f7c3c0a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.681 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.676+0000 7f7c43604640 1 -- 172.21.15.161:0/1331792470 >> 172.21.15.161:0/1331792470 conn(0x7f7c3c0bbf80 msgr2=0x7f7c3c0b6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:45.681 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.676+0000 7f7c43604640 1 -- 172.21.15.161:0/1331792470 shutdown_connections 2024-02-02T11:48:45.681 INFO:teuthology.misc.health.smithi161.stderr:2024-02-02T11:48:45.676+0000 7f7c43604640 1 -- 172.21.15.161:0/1331792470 wait complete. 2024-02-02T11:48:45.696 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-02-02T11:48:45.696 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-02T11:48:45.696 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-02T11:48:45.697 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-02T11:48:45.699 INFO:tasks.ceph.mds.a:Started 2024-02-02T11:48:45.699 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-02T11:48:45.699 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-02T11:48:45.701 INFO:tasks.ceph.mds.c:Started 2024-02-02T11:48:45.701 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-02T11:48:45.701 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-02T11:48:45.704 INFO:tasks.ceph.mds.b:Started 2024-02-02T11:48:45.704 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-02-02T11:48:45.704 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:48:45.771 INFO:tasks.ceph.mds.a.smithi161.stdout:starting mds.a at 2024-02-02T11:48:45.773 INFO:tasks.ceph.mds.c.smithi161.stdout:starting mds.c at 2024-02-02T11:48:45.797 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-02-02T11:48:45.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.816+0000 7fd82ddd8640 1 Processor -- start 2024-02-02T11:48:45.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.816+0000 7fd82ddd8640 1 -- start start 2024-02-02T11:48:45.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.816+0000 7fd82ddd8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd82814b540 0x7fd8280bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:45.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.816+0000 7fd82ddd8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd82806a900 0x7fd82814e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:45.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.816+0000 7fd82ddd8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82806ad50 con 0x7fd82806a4c0 2024-02-02T11:48:45.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.816+0000 7fd82ddd8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8280bc320 con 0x7fd82814b540 2024-02-02T11:48:45.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.816+0000 7fd82ddd8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8280bb650 con 0x7fd82806a900 2024-02-02T11:48:45.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.816+0000 7fd8277fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd82814b540 0x7fd8280bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:45.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.816+0000 7fd827fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd82806a900 0x7fd82814e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:45.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.816+0000 7fd81ffff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fd82806a4c0 0x7fd82814dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.161:41498/0 (socket says 172.21.15.161:41498) 2024-02-02T11:48:45.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.816+0000 7fd81ffff640 1 -- 172.21.15.161:0/849775339 learned_addr learned my addr 172.21.15.161:0/849775339 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:48:45.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.816+0000 7fd8277fe640 1 -- 172.21.15.161:0/849775339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd82806a900 msgr2=0x7fd82814e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:45.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.816+0000 7fd8277fe640 1 --2- 172.21.15.161:0/849775339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd82806a900 0x7fd82814e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.816+0000 7fd8277fe640 1 -- 172.21.15.161:0/849775339 >> v1:172.21.15.162:6789/0 conn(0x7fd82806a4c0 legacy=0x7fd82814dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:45.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.816+0000 7fd8277fe640 1 -- 172.21.15.161:0/849775339 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8280bc590 con 0x7fd82814b540 2024-02-02T11:48:45.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd8277fe640 1 --2- 172.21.15.161:0/849775339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd82814b540 0x7fd8280bac60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd8180097f0 tx=0x7fd81801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e295edfc38321e0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:45.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd826ffd640 1 -- 172.21.15.161:0/849775339 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8180ab600 con 0x7fd82814b540 2024-02-02T11:48:45.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd826ffd640 1 -- 172.21.15.161:0/849775339 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8180a7050 con 0x7fd82814b540 2024-02-02T11:48:45.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd826ffd640 1 -- 172.21.15.161:0/849775339 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8180ab980 con 0x7fd82814b540 2024-02-02T11:48:45.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd82ddd8640 1 -- 172.21.15.161:0/849775339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd82814b540 msgr2=0x7fd8280bac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:45.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd82ddd8640 1 --2- 172.21.15.161:0/849775339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd82814b540 0x7fd8280bac60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd8180097f0 tx=0x7fd81801c3a0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd82ddd8640 1 -- 172.21.15.161:0/849775339 shutdown_connections 2024-02-02T11:48:45.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd82ddd8640 1 --2- 172.21.15.161:0/849775339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd82806a900 0x7fd82814e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd82ddd8640 1 --2- 172.21.15.161:0/849775339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd82814b540 0x7fd8280bac60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd82ddd8640 1 -- 172.21.15.161:0/849775339 >> 172.21.15.161:0/849775339 conn(0x7fd8280c02e0 msgr2=0x7fd8280c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:45.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd82ddd8640 1 -- 172.21.15.161:0/849775339 shutdown_connections 2024-02-02T11:48:45.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd82ddd8640 1 -- 172.21.15.161:0/849775339 wait complete. 2024-02-02T11:48:45.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd82ddd8640 1 Processor -- start 2024-02-02T11:48:45.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd82ddd8640 1 -- start start 2024-02-02T11:48:45.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd82ddd8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd82806a4c0 0x7fd8281d75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:45.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd82ddd8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd82806a900 0x7fd8280b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:45.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd82ddd8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd82814b540 0x7fd8280b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:45.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd82ddd8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8281d7b10 con 0x7fd82814b540 2024-02-02T11:48:45.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd82ddd8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8280ba280 con 0x7fd82806a4c0 2024-02-02T11:48:45.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd82ddd8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8280b4be0 con 0x7fd82806a900 2024-02-02T11:48:45.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd827fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd82814b540 0x7fd8280b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:45.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd827fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd82814b540 0x7fd8280b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52712/0 (socket says 172.21.15.161:52712) 2024-02-02T11:48:45.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd827fff640 1 -- 172.21.15.161:0/2711059299 learned_addr learned my addr 172.21.15.161:0/2711059299 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:45.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd81ffff640 1 --2- 172.21.15.161:0/2711059299 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd82806a900 0x7fd8280b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:45.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd8277fe640 1 --2- 172.21.15.161:0/2711059299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd82806a4c0 0x7fd8281d75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:45.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd827fff640 1 -- 172.21.15.161:0/2711059299 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd82806a900 msgr2=0x7fd8280b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:45.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd827fff640 1 --2- 172.21.15.161:0/2711059299 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd82806a900 0x7fd8280b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd827fff640 1 -- 172.21.15.161:0/2711059299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd82806a4c0 msgr2=0x7fd8281d75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:45.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd827fff640 1 --2- 172.21.15.161:0/2711059299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd82806a4c0 0x7fd8281d75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.820+0000 7fd827fff640 1 -- 172.21.15.161:0/2711059299 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd818009420 con 0x7fd82814b540 2024-02-02T11:48:45.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.824+0000 7fd827fff640 1 --2- 172.21.15.161:0/2711059299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd82814b540 0x7fd8280b5000 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd820009dd0 tx=0x7fd82000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:45.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.824+0000 7fd824ff9640 1 -- 172.21.15.161:0/2711059299 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd820014480 con 0x7fd82814b540 2024-02-02T11:48:45.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.824+0000 7fd824ff9640 1 -- 172.21.15.161:0/2711059299 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82000f040 con 0x7fd82814b540 2024-02-02T11:48:45.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.824+0000 7fd824ff9640 1 -- 172.21.15.161:0/2711059299 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd820014840 con 0x7fd82814b540 2024-02-02T11:48:45.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.824+0000 7fd82ddd8640 1 -- 172.21.15.161:0/2711059299 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd828147b40 con 0x7fd82814b540 2024-02-02T11:48:45.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.824+0000 7fd82ddd8640 1 -- 172.21.15.161:0/2711059299 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8280b48f0 con 0x7fd82814b540 2024-02-02T11:48:45.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.824+0000 7fd82ddd8640 1 -- 172.21.15.161:0/2711059299 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8280b9600 con 0x7fd82814b540 2024-02-02T11:48:45.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.824+0000 7fd824ff9640 1 -- 172.21.15.161:0/2711059299 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd8200149a0 con 0x7fd82814b540 2024-02-02T11:48:45.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.824+0000 7fd824ff9640 1 --2- 172.21.15.161:0/2711059299 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd808065a60 0x7fd808067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:45.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.824+0000 7fd824ff9640 1 -- 172.21.15.161:0/2711059299 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd820083830 con 0x7fd82814b540 2024-02-02T11:48:45.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.824+0000 7fd8277fe640 1 --2- 172.21.15.161:0/2711059299 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd808065a60 0x7fd808067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:45.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.824+0000 7fd8277fe640 1 --2- 172.21.15.161:0/2711059299 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd808065a60 0x7fd808067f20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd8280c1040 tx=0x7fd8180a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:45.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.828+0000 7fd824ff9640 1 -- 172.21.15.161:0/2711059299 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd8280b9600 con 0x7fd82814b540 2024-02-02T11:48:45.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.976+0000 7fd82ddd8640 1 -- 172.21.15.161:0/2711059299 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8280b9600 con 0x7fd82814b540 2024-02-02T11:48:45.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.976+0000 7fd824ff9640 1 -- 172.21.15.161:0/2711059299 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7fd8280b9600 con 0x7fd82814b540 2024-02-02T11:48:45.979 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:48:45.979 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":16,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:42.556025+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:48:45.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.980+0000 7fd82ddd8640 1 -- 172.21.15.161:0/2711059299 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd808065a60 msgr2=0x7fd808067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:45.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.980+0000 7fd82ddd8640 1 --2- 172.21.15.161:0/2711059299 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd808065a60 0x7fd808067f20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd8280c1040 tx=0x7fd8180a6000 comp rx=0 tx=0).stop 2024-02-02T11:48:45.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.980+0000 7fd82ddd8640 1 -- 172.21.15.161:0/2711059299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd82814b540 msgr2=0x7fd8280b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:45.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.980+0000 7fd82ddd8640 1 --2- 172.21.15.161:0/2711059299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd82814b540 0x7fd8280b5000 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd820009dd0 tx=0x7fd82000c490 comp rx=0 tx=0).stop 2024-02-02T11:48:45.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.980+0000 7fd82ddd8640 1 -- 172.21.15.161:0/2711059299 shutdown_connections 2024-02-02T11:48:45.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.980+0000 7fd82ddd8640 1 --2- 172.21.15.161:0/2711059299 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd808065a60 0x7fd808067f20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.980+0000 7fd82ddd8640 1 --2- 172.21.15.161:0/2711059299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd82814b540 0x7fd8280b5000 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.980+0000 7fd82ddd8640 1 --2- 172.21.15.161:0/2711059299 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd82806a900 0x7fd8280b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.980+0000 7fd82ddd8640 1 --2- 172.21.15.161:0/2711059299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd82806a4c0 0x7fd8281d75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:45.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.980+0000 7fd82ddd8640 1 -- 172.21.15.161:0/2711059299 >> 172.21.15.161:0/2711059299 conn(0x7fd8280c02e0 msgr2=0x7fd82814a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:45.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.980+0000 7fd82ddd8640 1 -- 172.21.15.161:0/2711059299 shutdown_connections 2024-02-02T11:48:45.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:45.980+0000 7fd82ddd8640 1 -- 172.21.15.161:0/2711059299 wait complete. 2024-02-02T11:48:45.997 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-02T11:48:40.330782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-02T11:48:45.998 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-02T11:48:46.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.116+0000 7f760d846640 1 Processor -- start 2024-02-02T11:48:46.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.116+0000 7f760d846640 1 -- start start 2024-02-02T11:48:46.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.116+0000 7f760d846640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f760806fc30 0x7f76080709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:46.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.116+0000 7f760d846640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7608144100 0x7f7608144560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:46.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.116+0000 7f760d846640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7608070ef0 con 0x7f76081474b0 2024-02-02T11:48:46.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.116+0000 7f760d846640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7608071640 con 0x7f7608144100 2024-02-02T11:48:46.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.116+0000 7f760d846640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760806ecc0 con 0x7f760806fc30 2024-02-02T11:48:46.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.116+0000 7f76077fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7608144100 0x7f7608144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:46.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.116+0000 7f76077fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7608144100 0x7f7608144560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52720/0 (socket says 172.21.15.161:52720) 2024-02-02T11:48:46.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.116+0000 7f76077fe640 1 -- 172.21.15.161:0/1716165985 learned_addr learned my addr 172.21.15.161:0/1716165985 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:46.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.116+0000 7f7606ffd640 1 --2- 172.21.15.161:0/1716165985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f760806fc30 0x7f76080709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:46.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.116+0000 7f76077fe640 1 -- 172.21.15.161:0/1716165985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f760806fc30 msgr2=0x7f76080709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:46.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.116+0000 7f76077fe640 1 --2- 172.21.15.161:0/1716165985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f760806fc30 0x7f76080709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.116+0000 7f76077fe640 1 -- 172.21.15.161:0/1716165985 >> v1:172.21.15.162:6789/0 conn(0x7f76081474b0 legacy=0x7f76081478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:46.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.116+0000 7f76077fe640 1 -- 172.21.15.161:0/1716165985 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760806ef30 con 0x7f7608144100 2024-02-02T11:48:46.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f76077fe640 1 --2- 172.21.15.161:0/1716165985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7608144100 0x7f7608144560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7600009e50 tx=0x7f760001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd599edd183613f2 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:46.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f7605ffb640 1 -- 172.21.15.161:0/1716165985 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76000a57a0 con 0x7f7608144100 2024-02-02T11:48:46.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f7605ffb640 1 -- 172.21.15.161:0/1716165985 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76000a5900 con 0x7f7608144100 2024-02-02T11:48:46.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f7605ffb640 1 -- 172.21.15.161:0/1716165985 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76000a5c90 con 0x7f7608144100 2024-02-02T11:48:46.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f760d846640 1 -- 172.21.15.161:0/1716165985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7608144100 msgr2=0x7f7608144560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:46.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f760d846640 1 --2- 172.21.15.161:0/1716165985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7608144100 0x7f7608144560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7600009e50 tx=0x7f760001c9a0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f760d846640 1 -- 172.21.15.161:0/1716165985 shutdown_connections 2024-02-02T11:48:46.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f760d846640 1 --2- 172.21.15.161:0/1716165985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7608144100 0x7f7608144560 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f760d846640 1 --2- 172.21.15.161:0/1716165985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f760806fc30 0x7f76080709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f760d846640 1 -- 172.21.15.161:0/1716165985 >> 172.21.15.161:0/1716165985 conn(0x7f760806a120 msgr2=0x7f760806a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:46.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f760d846640 1 -- 172.21.15.161:0/1716165985 shutdown_connections 2024-02-02T11:48:46.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f760d846640 1 -- 172.21.15.161:0/1716165985 wait complete. 2024-02-02T11:48:46.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f760d846640 1 Processor -- start 2024-02-02T11:48:46.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f760d846640 1 -- start start 2024-02-02T11:48:46.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f760d846640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f760806fc30 0x7f7608138230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:46.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f760d846640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7608144100 0x7f76081313c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:46.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f760d846640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76081474b0 0x7f7608152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:46.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f760d846640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760813b840 con 0x7f76081474b0 2024-02-02T11:48:46.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f760d846640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7608138770 con 0x7f760806fc30 2024-02-02T11:48:46.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f760d846640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7608135110 con 0x7f7608144100 2024-02-02T11:48:46.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f76077fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76081474b0 0x7f7608152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:46.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f76077fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76081474b0 0x7f7608152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52724/0 (socket says 172.21.15.161:52724) 2024-02-02T11:48:46.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f76077fe640 1 -- 172.21.15.161:0/1127151724 learned_addr learned my addr 172.21.15.161:0/1127151724 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:46.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f7606ffd640 1 --2- 172.21.15.161:0/1127151724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f760806fc30 0x7f7608138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:46.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f76067fc640 1 --2- 172.21.15.161:0/1127151724 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7608144100 0x7f76081313c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:46.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f76077fe640 1 -- 172.21.15.161:0/1127151724 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7608144100 msgr2=0x7f76081313c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:46.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f76077fe640 1 --2- 172.21.15.161:0/1127151724 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7608144100 0x7f76081313c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f76077fe640 1 -- 172.21.15.161:0/1127151724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f760806fc30 msgr2=0x7f7608138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:46.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f76077fe640 1 --2- 172.21.15.161:0/1127151724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f760806fc30 0x7f7608138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f76077fe640 1 -- 172.21.15.161:0/1127151724 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7600009b30 con 0x7f76081474b0 2024-02-02T11:48:46.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f76077fe640 1 --2- 172.21.15.161:0/1127151724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76081474b0 0x7f7608152910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f760001b050 tx=0x7f7600019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:46.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f75effff640 1 -- 172.21.15.161:0/1127151724 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76000bd070 con 0x7f76081474b0 2024-02-02T11:48:46.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f75effff640 1 -- 172.21.15.161:0/1127151724 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76000b8470 con 0x7f76081474b0 2024-02-02T11:48:46.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f760d846640 1 -- 172.21.15.161:0/1127151724 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7608132360 con 0x7f76081474b0 2024-02-02T11:48:46.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f75effff640 1 -- 172.21.15.161:0/1127151724 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76000b8840 con 0x7f76081474b0 2024-02-02T11:48:46.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.120+0000 7f760d846640 1 -- 172.21.15.161:0/1127151724 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760813bb50 con 0x7f76081474b0 2024-02-02T11:48:46.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.124+0000 7f760d846640 1 -- 172.21.15.161:0/1127151724 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760804e000 con 0x7f76081474b0 2024-02-02T11:48:46.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.124+0000 7f75effff640 1 -- 172.21.15.161:0/1127151724 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f76000b89a0 con 0x7f76081474b0 2024-02-02T11:48:46.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.124+0000 7f75effff640 1 --2- 172.21.15.161:0/1127151724 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f75f4065a60 0x7f75f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:46.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.124+0000 7f75effff640 1 -- 172.21.15.161:0/1127151724 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f760011dc30 con 0x7f76081474b0 2024-02-02T11:48:46.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.124+0000 7f7606ffd640 1 --2- 172.21.15.161:0/1127151724 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f75f4065a60 0x7f75f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:46.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.124+0000 7f7606ffd640 1 --2- 172.21.15.161:0/1127151724 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f75f4065a60 0x7f75f4067f20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f75f800b9d0 tx=0x7f75f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:46.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.128+0000 7f75effff640 1 -- 172.21.15.161:0/1127151724 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f76000ebbb0 con 0x7f76081474b0 2024-02-02T11:48:46.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.280+0000 7f760d846640 1 -- 172.21.15.161:0/1127151724 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7608070ef0 con 0x7f76081474b0 2024-02-02T11:48:46.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.280+0000 7f75effff640 1 -- 172.21.15.161:0/1127151724 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7608070ef0 con 0x7f76081474b0 2024-02-02T11:48:46.283 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-02-02T11:48:46.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.280+0000 7f760d846640 1 -- 172.21.15.161:0/1127151724 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f75f4065a60 msgr2=0x7f75f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:46.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.280+0000 7f760d846640 1 --2- 172.21.15.161:0/1127151724 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f75f4065a60 0x7f75f4067f20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f75f800b9d0 tx=0x7f75f8008040 comp rx=0 tx=0).stop 2024-02-02T11:48:46.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.280+0000 7f760d846640 1 -- 172.21.15.161:0/1127151724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76081474b0 msgr2=0x7f7608152910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:46.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.280+0000 7f760d846640 1 --2- 172.21.15.161:0/1127151724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76081474b0 0x7f7608152910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f760001b050 tx=0x7f7600019740 comp rx=0 tx=0).stop 2024-02-02T11:48:46.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.284+0000 7f760d846640 1 -- 172.21.15.161:0/1127151724 shutdown_connections 2024-02-02T11:48:46.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.284+0000 7f760d846640 1 --2- 172.21.15.161:0/1127151724 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f75f4065a60 0x7f75f4067f20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.284+0000 7f760d846640 1 --2- 172.21.15.161:0/1127151724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76081474b0 0x7f7608152910 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.284+0000 7f760d846640 1 --2- 172.21.15.161:0/1127151724 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7608144100 0x7f76081313c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.284+0000 7f760d846640 1 --2- 172.21.15.161:0/1127151724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f760806fc30 0x7f7608138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.284+0000 7f760d846640 1 -- 172.21.15.161:0/1127151724 >> 172.21.15.161:0/1127151724 conn(0x7f760806a120 msgr2=0x7f76080b3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:46.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.284+0000 7f760d846640 1 -- 172.21.15.161:0/1127151724 shutdown_connections 2024-02-02T11:48:46.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.284+0000 7f760d846640 1 -- 172.21.15.161:0/1127151724 wait complete. 2024-02-02T11:48:46.301 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-02T11:48:46.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae83b7e640 1 Processor -- start 2024-02-02T11:48:46.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae83b7e640 1 -- start start 2024-02-02T11:48:46.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae83b7e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fae7c144b60 0x7fae7c0658e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:46.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae83b7e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae7c06acd0 0x7fae7c155450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:46.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae83b7e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7c065f50 con 0x7fae7c06a840 2024-02-02T11:48:46.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae83b7e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c071000 con 0x7fae7c144b60 2024-02-02T11:48:46.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae83b7e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c071cf0 con 0x7fae7c06acd0 2024-02-02T11:48:46.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae81119640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fae7c06a840 0x7fae7c14e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50756/0 (socket says 172.21.15.161:50756) 2024-02-02T11:48:46.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae81119640 1 -- 172.21.15.161:0/2985680096 learned_addr learned my addr 172.21.15.161:0/2985680096 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:48:46.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae8191a640 1 --2- 172.21.15.161:0/2985680096 >> v2:172.21.15.162:3300/0 conn(0x7fae7c144b60 0x7fae7c0658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:46.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae8211b640 1 --2- 172.21.15.161:0/2985680096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae7c06acd0 0x7fae7c155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:46.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae80918640 1 -- 172.21.15.161:0/2985680096 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984663365 0 0) 0x7fae70001120 con 0x7fae7c06a840 2024-02-02T11:48:46.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae80918640 1 -- 172.21.15.161:0/2985680096 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae64003530 con 0x7fae7c06a840 2024-02-02T11:48:46.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae80918640 1 -- 172.21.15.161:0/2985680096 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3040533827 0 0) 0x7fae64003530 con 0x7fae7c06a840 2024-02-02T11:48:46.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae80918640 1 -- 172.21.15.161:0/2985680096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae7c06acd0 msgr2=0x7fae7c155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:46.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae80918640 1 --2- 172.21.15.161:0/2985680096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae7c06acd0 0x7fae7c155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae80918640 1 -- 172.21.15.161:0/2985680096 >> v2:172.21.15.162:3300/0 conn(0x7fae7c144b60 msgr2=0x7fae7c0658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:46.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae80918640 1 --2- 172.21.15.161:0/2985680096 >> v2:172.21.15.162:3300/0 conn(0x7fae7c144b60 0x7fae7c0658e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae80918640 1 -- 172.21.15.161:0/2985680096 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c070760 con 0x7fae7c06a840 2024-02-02T11:48:46.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae80918640 1 -- 172.21.15.161:0/2985680096 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7fae70001810 con 0x7fae7c06a840 2024-02-02T11:48:46.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae80918640 1 -- 172.21.15.161:0/2985680096 >> v1:172.21.15.161:6789/0 conn(0x7fae7c06a840 legacy=0x7fae7c14e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae80918640 1 --2- 172.21.15.161:0/2985680096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae7c06acd0 0x7fae64003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae80918640 1 --2- 172.21.15.161:0/2985680096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae64003f00 0x7fae640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae80918640 1 --2- 172.21.15.161:0/2985680096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae64004d10 0x7fae64005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae80918640 1 -- 172.21.15.161:0/2985680096 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c071000 con 0x7fae64003f00 2024-02-02T11:48:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae80918640 1 -- 172.21.15.161:0/2985680096 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c071cf0 con 0x7fae64004d10 2024-02-02T11:48:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae80918640 1 -- 172.21.15.161:0/2985680096 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6400b9e0 con 0x7fae7c06acd0 2024-02-02T11:48:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae81119640 1 --2- 172.21.15.161:0/2985680096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae64003f00 0x7fae640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae81119640 1 -- 172.21.15.161:0/2985680096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae7c06acd0 msgr2=0x7fae64003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae8191a640 1 --2- 172.21.15.161:0/2985680096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae7c06acd0 0x7fae64003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae81119640 1 --2- 172.21.15.161:0/2985680096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae7c06acd0 0x7fae64003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae81119640 1 -- 172.21.15.161:0/2985680096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae64004d10 msgr2=0x7fae64005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae81119640 1 --2- 172.21.15.161:0/2985680096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae64004d10 0x7fae64005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.416+0000 7fae81119640 1 -- 172.21.15.161:0/2985680096 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae64003530 con 0x7fae64003f00 2024-02-02T11:48:46.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.420+0000 7fae81119640 1 --2- 172.21.15.161:0/2985680096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae64003f00 0x7fae640047d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fae7000c240 tx=0x7fae7001cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3018fca2b080e31b server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:46.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.420+0000 7fae80918640 1 -- 172.21.15.161:0/2985680096 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae700058e0 con 0x7fae64003f00 2024-02-02T11:48:46.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.420+0000 7fae80918640 1 -- 172.21.15.161:0/2985680096 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae70005a40 con 0x7fae64003f00 2024-02-02T11:48:46.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.420+0000 7fae80918640 1 -- 172.21.15.161:0/2985680096 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70005df0 con 0x7fae64003f00 2024-02-02T11:48:46.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.420+0000 7fae83b7e640 1 -- 172.21.15.161:0/2985680096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae64003f00 msgr2=0x7fae640047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:46.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.420+0000 7fae83b7e640 1 --2- 172.21.15.161:0/2985680096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae64003f00 0x7fae640047d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fae7000c240 tx=0x7fae7001cbf0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.420+0000 7fae8211b640 1 -- 172.21.15.161:0/2985680096 reap_dead start 2024-02-02T11:48:46.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.420+0000 7fae83b7e640 1 -- 172.21.15.161:0/2985680096 shutdown_connections 2024-02-02T11:48:46.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.420+0000 7fae83b7e640 1 -- 172.21.15.161:0/2985680096 >> 172.21.15.161:0/2985680096 conn(0x7fae7c069d20 msgr2=0x7fae7c06a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:46.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.420+0000 7fae83b7e640 1 -- 172.21.15.161:0/2985680096 shutdown_connections 2024-02-02T11:48:46.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.420+0000 7fae83b7e640 1 -- 172.21.15.161:0/2985680096 wait complete. 2024-02-02T11:48:46.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.420+0000 7fae83b7e640 1 Processor -- start 2024-02-02T11:48:46.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.420+0000 7fae83b7e640 1 -- start start 2024-02-02T11:48:46.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.420+0000 7fae83b7e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae64003f00 0x7fae7c0baab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:46.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.420+0000 7fae83b7e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae7c0bba60 0x7fae7c1e32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:46.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.420+0000 7fae83b7e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae7c1e37e0 0x7fae7c133830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:46.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae83b7e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0baff0 con 0x7fae7c0bba60 2024-02-02T11:48:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae83b7e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c14bc90 con 0x7fae7c1e37e0 2024-02-02T11:48:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae83b7e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c1e3c60 con 0x7fae64003f00 2024-02-02T11:48:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae81119640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae7c0bba60 0x7fae7c1e32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae81119640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae7c0bba60 0x7fae7c1e32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52738/0 (socket says 172.21.15.161:52738) 2024-02-02T11:48:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae81119640 1 -- 172.21.15.161:0/1235442851 learned_addr learned my addr 172.21.15.161:0/1235442851 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae81119640 1 -- 172.21.15.161:0/1235442851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae64003f00 msgr2=0x7fae7c0baab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae8191a640 1 --2- 172.21.15.161:0/1235442851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae64003f00 0x7fae7c0baab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae8211b640 1 --2- 172.21.15.161:0/1235442851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae7c1e37e0 0x7fae7c133830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae81119640 1 --2- 172.21.15.161:0/1235442851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae64003f00 0x7fae7c0baab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae81119640 1 -- 172.21.15.161:0/1235442851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae7c1e37e0 msgr2=0x7fae7c133830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae81119640 1 --2- 172.21.15.161:0/1235442851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae7c1e37e0 0x7fae7c133830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae81119640 1 -- 172.21.15.161:0/1235442851 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c14cff0 con 0x7fae7c0bba60 2024-02-02T11:48:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae8191a640 1 --2- 172.21.15.161:0/1235442851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae64003f00 0x7fae7c0baab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:48:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae81119640 1 --2- 172.21.15.161:0/1235442851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae7c0bba60 0x7fae7c1e32a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fae7000c240 tx=0x7fae64005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:46.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae7a7fc640 1 -- 172.21.15.161:0/1235442851 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae700a5ad0 con 0x7fae7c0bba60 2024-02-02T11:48:46.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae7a7fc640 1 -- 172.21.15.161:0/1235442851 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae70001260 con 0x7fae7c0bba60 2024-02-02T11:48:46.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae7a7fc640 1 -- 172.21.15.161:0/1235442851 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae700a5e70 con 0x7fae7c0bba60 2024-02-02T11:48:46.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae83b7e640 1 -- 172.21.15.161:0/1235442851 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7c14d2d0 con 0x7fae7c0bba60 2024-02-02T11:48:46.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae83b7e640 1 -- 172.21.15.161:0/1235442851 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7c0bbec0 con 0x7fae7c0bba60 2024-02-02T11:48:46.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae83b7e640 1 -- 172.21.15.161:0/1235442851 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7c14ce20 con 0x7fae7c0bba60 2024-02-02T11:48:46.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae7a7fc640 1 -- 172.21.15.161:0/1235442851 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fae700047f0 con 0x7fae7c0bba60 2024-02-02T11:48:46.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae7a7fc640 1 --2- 172.21.15.161:0/1235442851 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fae68065a60 0x7fae68067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:46.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae7a7fc640 1 -- 172.21.15.161:0/1235442851 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fae7011c370 con 0x7fae7c0bba60 2024-02-02T11:48:46.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae8191a640 1 --2- 172.21.15.161:0/1235442851 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fae68065a60 0x7fae68067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:46.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.424+0000 7fae8191a640 1 --2- 172.21.15.161:0/1235442851 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fae68065a60 0x7fae68067f20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fae74009a00 tx=0x7fae74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:46.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.428+0000 7fae7a7fc640 1 -- 172.21.15.161:0/1235442851 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fae700ea110 con 0x7fae7c0bba60 2024-02-02T11:48:46.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.604+0000 7fae83b7e640 1 -- 172.21.15.161:0/1235442851 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae7c065f50 con 0x7fae7c0bba60 2024-02-02T11:48:46.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.604+0000 7fae7a7fc640 1 -- 172.21.15.161:0/1235442851 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7fae7c065f50 con 0x7fae7c0bba60 2024-02-02T11:48:46.607 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:48:46.607 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/2509813318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":2509813318},{"type":"v1","addr":"172.21.15.161:6837","nonce":2509813318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-02-02T11:48:46.607 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 2 2024-02-02T11:48:46.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.604+0000 7fae83b7e640 1 -- 172.21.15.161:0/1235442851 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fae68065a60 msgr2=0x7fae68067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:46.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.604+0000 7fae83b7e640 1 --2- 172.21.15.161:0/1235442851 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fae68065a60 0x7fae68067f20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fae74009a00 tx=0x7fae74008040 comp rx=0 tx=0).stop 2024-02-02T11:48:46.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.604+0000 7fae83b7e640 1 -- 172.21.15.161:0/1235442851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae7c0bba60 msgr2=0x7fae7c1e32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:46.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.604+0000 7fae83b7e640 1 --2- 172.21.15.161:0/1235442851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae7c0bba60 0x7fae7c1e32a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fae7000c240 tx=0x7fae64005800 comp rx=0 tx=0).stop 2024-02-02T11:48:46.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.604+0000 7fae83b7e640 1 -- 172.21.15.161:0/1235442851 shutdown_connections 2024-02-02T11:48:46.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.604+0000 7fae83b7e640 1 --2- 172.21.15.161:0/1235442851 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fae68065a60 0x7fae68067f20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.604+0000 7fae83b7e640 1 --2- 172.21.15.161:0/1235442851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae7c1e37e0 0x7fae7c133830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.604+0000 7fae83b7e640 1 --2- 172.21.15.161:0/1235442851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae7c0bba60 0x7fae7c1e32a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.604+0000 7fae83b7e640 1 --2- 172.21.15.161:0/1235442851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae64003f00 0x7fae7c0baab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:46.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.604+0000 7fae83b7e640 1 -- 172.21.15.161:0/1235442851 >> 172.21.15.161:0/1235442851 conn(0x7fae7c069d20 msgr2=0x7fae7c136c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:46.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.608+0000 7fae83b7e640 1 -- 172.21.15.161:0/1235442851 shutdown_connections 2024-02-02T11:48:46.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:46.608+0000 7fae83b7e640 1 -- 172.21.15.161:0/1235442851 wait complete. 2024-02-02T11:48:48.624 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-02T11:48:48.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.752+0000 7f080a57d640 1 Processor -- start 2024-02-02T11:48:48.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f080a57d640 1 -- start start 2024-02-02T11:48:48.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f080a57d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08040bc340 0x7f08041415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f080a57d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0804071550 con 0x7f08040b8020 2024-02-02T11:48:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f080a57d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0804071810 con 0x7f0804141b30 2024-02-02T11:48:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f080a57d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08040bc720 con 0x7f08040bc340 2024-02-02T11:48:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0808b1a640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f08040b8020 0x7f0804151f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50768/0 (socket says 172.21.15.161:50768) 2024-02-02T11:48:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0808b1a640 1 -- 172.21.15.161:0/2910957949 learned_addr learned my addr 172.21.15.161:0/2910957949 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:48:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0803fff640 1 --2- 172.21.15.161:0/2910957949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08040bc340 0x7f08041415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0802ffd640 1 -- 172.21.15.161:0/2910957949 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410423090 0 0) 0x7f0804071550 con 0x7f08040b8020 2024-02-02T11:48:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0802ffd640 1 -- 172.21.15.161:0/2910957949 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07ec003530 con 0x7f08040b8020 2024-02-02T11:48:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0802ffd640 1 -- 172.21.15.161:0/2910957949 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1378133151 0 0) 0x7f07ec003530 con 0x7f08040b8020 2024-02-02T11:48:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0802ffd640 1 -- 172.21.15.161:0/2910957949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08040bc340 msgr2=0x7f08041415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0802ffd640 1 --2- 172.21.15.161:0/2910957949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08040bc340 0x7f08041415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0802ffd640 1 -- 172.21.15.161:0/2910957949 >> v1:172.21.15.162:6789/0 conn(0x7f0804141b30 legacy=0x7f0804147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0802ffd640 1 -- 172.21.15.161:0/2910957949 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08040b2d90 con 0x7f08040b8020 2024-02-02T11:48:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0802ffd640 1 -- 172.21.15.161:0/2910957949 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f07fc001a00 con 0x7f08040b8020 2024-02-02T11:48:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0802ffd640 1 -- 172.21.15.161:0/2910957949 >> v1:172.21.15.161:6789/0 conn(0x7f08040b8020 legacy=0x7f0804151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0802ffd640 1 --2- 172.21.15.161:0/2910957949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07ec0039b0 0x7f07ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0802ffd640 1 --2- 172.21.15.161:0/2910957949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08040bc340 0x7f07ec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0802ffd640 1 --2- 172.21.15.161:0/2910957949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07ec004d10 0x7f07ec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0802ffd640 1 -- 172.21.15.161:0/2910957949 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08040bc720 con 0x7f07ec0039b0 2024-02-02T11:48:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0802ffd640 1 -- 172.21.15.161:0/2910957949 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec00bac0 con 0x7f07ec004d10 2024-02-02T11:48:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0802ffd640 1 -- 172.21.15.161:0/2910957949 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec00bc80 con 0x7f08040bc340 2024-02-02T11:48:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0803fff640 1 --2- 172.21.15.161:0/2910957949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07ec0039b0 0x7f07ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f08037fe640 1 --2- 172.21.15.161:0/2910957949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08040bc340 0x7f07ec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0808b1a640 1 --2- 172.21.15.161:0/2910957949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07ec004d10 0x7f07ec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0803fff640 1 -- 172.21.15.161:0/2910957949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08040bc340 msgr2=0x7f07ec0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0803fff640 1 --2- 172.21.15.161:0/2910957949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08040bc340 0x7f07ec0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0803fff640 1 -- 172.21.15.161:0/2910957949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07ec004d10 msgr2=0x7f07ec005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0803fff640 1 --2- 172.21.15.161:0/2910957949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07ec004d10 0x7f07ec005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:48.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f0803fff640 1 -- 172.21.15.161:0/2910957949 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec003530 con 0x7f07ec0039b0 2024-02-02T11:48:48.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.756+0000 7f08037fe640 1 --2- 172.21.15.161:0/2910957949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08040bc340 0x7f07ec0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:48:48.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f0803fff640 1 --2- 172.21.15.161:0/2910957949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07ec0039b0 0x7f07ec003dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009ae0 tx=0x7f07f401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e693acc0383c097 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:48.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f0802ffd640 1 -- 172.21.15.161:0/2910957949 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f40a9470 con 0x7f07ec0039b0 2024-02-02T11:48:48.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f0802ffd640 1 -- 172.21.15.161:0/2910957949 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f40a95d0 con 0x7f07ec0039b0 2024-02-02T11:48:48.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f0802ffd640 1 -- 172.21.15.161:0/2910957949 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f40a9980 con 0x7f07ec0039b0 2024-02-02T11:48:48.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f080a57d640 1 -- 172.21.15.161:0/2910957949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07ec0039b0 msgr2=0x7f07ec003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:48.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f080a57d640 1 --2- 172.21.15.161:0/2910957949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07ec0039b0 0x7f07ec003dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009ae0 tx=0x7f07f401c990 comp rx=0 tx=0).stop 2024-02-02T11:48:48.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f0808b1a640 1 -- 172.21.15.161:0/2910957949 reap_dead start 2024-02-02T11:48:48.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f080a57d640 1 -- 172.21.15.161:0/2910957949 shutdown_connections 2024-02-02T11:48:48.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f080a57d640 1 -- 172.21.15.161:0/2910957949 >> 172.21.15.161:0/2910957949 conn(0x7f0804069ef0 msgr2=0x7f080406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:48.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f080a57d640 1 -- 172.21.15.161:0/2910957949 shutdown_connections 2024-02-02T11:48:48.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f080a57d640 1 -- 172.21.15.161:0/2910957949 wait complete. 2024-02-02T11:48:48.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f080a57d640 1 Processor -- start 2024-02-02T11:48:48.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f080a57d640 1 -- start start 2024-02-02T11:48:48.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f080a57d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07ec0039b0 0x7f080414a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:48.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f080a57d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f080414b3d0 0x7f08041e4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:48.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f080a57d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f080413d2b0 0x7f0804145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:48.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f080a57d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080414a210 con 0x7f080414b3d0 2024-02-02T11:48:48.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f080a57d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080414b830 con 0x7f07ec0039b0 2024-02-02T11:48:48.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f080a57d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0804149b90 con 0x7f080413d2b0 2024-02-02T11:48:48.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f08037fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f080414b3d0 0x7f08041e4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:48.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f08037fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f080414b3d0 0x7f08041e4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52748/0 (socket says 172.21.15.161:52748) 2024-02-02T11:48:48.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f08037fe640 1 -- 172.21.15.161:0/243572912 learned_addr learned my addr 172.21.15.161:0/243572912 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:48.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f0808b1a640 1 --2- 172.21.15.161:0/243572912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f080413d2b0 0x7f0804145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:48.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f0803fff640 1 --2- 172.21.15.161:0/243572912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07ec0039b0 0x7f080414a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:48.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f08037fe640 1 -- 172.21.15.161:0/243572912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f080413d2b0 msgr2=0x7f0804145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:48.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f08037fe640 1 --2- 172.21.15.161:0/243572912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f080413d2b0 0x7f0804145450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:48.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f08037fe640 1 -- 172.21.15.161:0/243572912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07ec0039b0 msgr2=0x7f080414a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:48.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f08037fe640 1 --2- 172.21.15.161:0/243572912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07ec0039b0 0x7f080414a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:48.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f08037fe640 1 -- 172.21.15.161:0/243572912 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080413d730 con 0x7f080414b3d0 2024-02-02T11:48:48.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.760+0000 7f0803fff640 1 --2- 172.21.15.161:0/243572912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07ec0039b0 0x7f080414a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:48:48.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.764+0000 7f08037fe640 1 --2- 172.21.15.161:0/243572912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f080414b3d0 0x7f08041e4630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f07f800d7a0 tx=0x7f07f800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:48.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.764+0000 7f0800ff9640 1 -- 172.21.15.161:0/243572912 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f8005270 con 0x7f080414b3d0 2024-02-02T11:48:48.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.764+0000 7f0800ff9640 1 -- 172.21.15.161:0/243572912 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f80053d0 con 0x7f080414b3d0 2024-02-02T11:48:48.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.764+0000 7f080a57d640 1 -- 172.21.15.161:0/243572912 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0804147400 con 0x7f080414b3d0 2024-02-02T11:48:48.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.764+0000 7f0800ff9640 1 -- 172.21.15.161:0/243572912 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f800b890 con 0x7f080414b3d0 2024-02-02T11:48:48.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.764+0000 7f080a57d640 1 -- 172.21.15.161:0/243572912 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0804153010 con 0x7f080414b3d0 2024-02-02T11:48:48.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.764+0000 7f080a57d640 1 -- 172.21.15.161:0/243572912 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f080414a350 con 0x7f080414b3d0 2024-02-02T11:48:48.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.764+0000 7f0800ff9640 1 -- 172.21.15.161:0/243572912 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f07f800b9f0 con 0x7f080414b3d0 2024-02-02T11:48:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.764+0000 7f0800ff9640 1 --2- 172.21.15.161:0/243572912 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f07f0065a60 0x7f07f0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.764+0000 7f0800ff9640 1 -- 172.21.15.161:0/243572912 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f07f8082c20 con 0x7f080414b3d0 2024-02-02T11:48:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.764+0000 7f0803fff640 1 --2- 172.21.15.161:0/243572912 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f07f0065a60 0x7f07f0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.764+0000 7f0803fff640 1 --2- 172.21.15.161:0/243572912 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f07f0065a60 0x7f07f0067f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f07f40ae000 tx=0x7f07f40b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:48.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.768+0000 7f0800ff9640 1 -- 172.21.15.161:0/243572912 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f080414a350 con 0x7f080414b3d0 2024-02-02T11:48:48.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.948+0000 7f080a57d640 1 -- 172.21.15.161:0/243572912 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f080414a350 con 0x7f080414b3d0 2024-02-02T11:48:48.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.952+0000 7f0800ff9640 1 -- 172.21.15.161:0/243572912 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2774 (secure 0 0 0) 0x7f080414a350 con 0x7f080414b3d0 2024-02-02T11:48:48.953 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:48:48.953 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3677988163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3677988163},{"type":"v1","addr":"172.21.15.162:6833","nonce":3677988163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/456037269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":456037269},{"type":"v1","addr":"172.21.15.161:6835","nonce":456037269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/2509813318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":2509813318},{"type":"v1","addr":"172.21.15.161:6837","nonce":2509813318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-02-02T11:48:48.953 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 3 2024-02-02T11:48:48.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.952+0000 7f080a57d640 1 -- 172.21.15.161:0/243572912 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f07f0065a60 msgr2=0x7f07f0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:48.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.952+0000 7f080a57d640 1 --2- 172.21.15.161:0/243572912 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f07f0065a60 0x7f07f0067f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f07f40ae000 tx=0x7f07f40b3040 comp rx=0 tx=0).stop 2024-02-02T11:48:48.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.952+0000 7f080a57d640 1 -- 172.21.15.161:0/243572912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f080414b3d0 msgr2=0x7f08041e4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:48.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.952+0000 7f080a57d640 1 --2- 172.21.15.161:0/243572912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f080414b3d0 0x7f08041e4630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f07f800d7a0 tx=0x7f07f800dc60 comp rx=0 tx=0).stop 2024-02-02T11:48:48.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.952+0000 7f080a57d640 1 -- 172.21.15.161:0/243572912 shutdown_connections 2024-02-02T11:48:48.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.952+0000 7f080a57d640 1 --2- 172.21.15.161:0/243572912 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f07f0065a60 0x7f07f0067f20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:48.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.952+0000 7f080a57d640 1 --2- 172.21.15.161:0/243572912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f080413d2b0 0x7f0804145450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:48.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.952+0000 7f080a57d640 1 --2- 172.21.15.161:0/243572912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f080414b3d0 0x7f08041e4630 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:48.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.952+0000 7f080a57d640 1 --2- 172.21.15.161:0/243572912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07ec0039b0 0x7f080414a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:48.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.952+0000 7f080a57d640 1 -- 172.21.15.161:0/243572912 >> 172.21.15.161:0/243572912 conn(0x7f0804069ef0 msgr2=0x7f08040b90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:48.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.952+0000 7f080a57d640 1 -- 172.21.15.161:0/243572912 shutdown_connections 2024-02-02T11:48:48.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:48.952+0000 7f080a57d640 1 -- 172.21.15.161:0/243572912 wait complete. 2024-02-02T11:48:48.970 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:48:49.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.088+0000 7f645f739640 1 Processor -- start 2024-02-02T11:48:49.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.088+0000 7f645f739640 1 -- start start 2024-02-02T11:48:49.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.088+0000 7f645f739640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f645814b540 0x7f64580bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.088+0000 7f645f739640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f645806a900 0x7f645814e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.088+0000 7f645f739640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64580bc590 con 0x7f645806a4c0 2024-02-02T11:48:49.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.088+0000 7f645f739640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64580bc320 con 0x7f645814b540 2024-02-02T11:48:49.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.088+0000 7f645f739640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64580bb650 con 0x7f645806a900 2024-02-02T11:48:49.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.088+0000 7f645d4d5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f645814b540 0x7f64580bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.088+0000 7f645d4d5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f645814b540 0x7f64580bac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52756/0 (socket says 172.21.15.161:52756) 2024-02-02T11:48:49.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.088+0000 7f645d4d5640 1 -- 172.21.15.161:0/3749134045 learned_addr learned my addr 172.21.15.161:0/3749134045 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:49.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.088+0000 7f645dcd6640 1 --2- 172.21.15.161:0/3749134045 >> v2:172.21.15.162:3300/0 conn(0x7f645806a900 0x7f645814e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.088+0000 7f645d4d5640 1 -- 172.21.15.161:0/3749134045 >> v2:172.21.15.162:3300/0 conn(0x7f645806a900 msgr2=0x7f645814e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:49.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.088+0000 7f645d4d5640 1 --2- 172.21.15.161:0/3749134045 >> v2:172.21.15.162:3300/0 conn(0x7f645806a900 0x7f645814e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.088+0000 7f645d4d5640 1 -- 172.21.15.161:0/3749134045 >> v1:172.21.15.162:6789/0 conn(0x7f645806a4c0 legacy=0x7f645814dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:49.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.088+0000 7f645d4d5640 1 -- 172.21.15.161:0/3749134045 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64580b3a10 con 0x7f645814b540 2024-02-02T11:48:49.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.088+0000 7f645d4d5640 1 --2- 172.21.15.161:0/3749134045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f645814b540 0x7f64580bac60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f645806bd70 tx=0x7f645401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c97ecfbe26934b server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:49.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f644ffff640 1 -- 172.21.15.161:0/3749134045 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64540a89b0 con 0x7f645814b540 2024-02-02T11:48:49.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f644ffff640 1 -- 172.21.15.161:0/3749134045 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64540a8b10 con 0x7f645814b540 2024-02-02T11:48:49.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f644ffff640 1 -- 172.21.15.161:0/3749134045 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64540a8ea0 con 0x7f645814b540 2024-02-02T11:48:49.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645f739640 1 -- 172.21.15.161:0/3749134045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f645814b540 msgr2=0x7f64580bac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645f739640 1 --2- 172.21.15.161:0/3749134045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f645814b540 0x7f64580bac60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f645806bd70 tx=0x7f645401ecb0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645f739640 1 -- 172.21.15.161:0/3749134045 shutdown_connections 2024-02-02T11:48:49.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645f739640 1 --2- 172.21.15.161:0/3749134045 >> v2:172.21.15.162:3300/0 conn(0x7f645806a900 0x7f645814e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645f739640 1 --2- 172.21.15.161:0/3749134045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f645814b540 0x7f64580bac60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645f739640 1 -- 172.21.15.161:0/3749134045 >> 172.21.15.161:0/3749134045 conn(0x7f64580c02e0 msgr2=0x7f64580c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:49.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645f739640 1 -- 172.21.15.161:0/3749134045 shutdown_connections 2024-02-02T11:48:49.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645f739640 1 -- 172.21.15.161:0/3749134045 wait complete. 2024-02-02T11:48:49.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645f739640 1 Processor -- start 2024-02-02T11:48:49.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645f739640 1 -- start start 2024-02-02T11:48:49.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645f739640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f645806a4c0 0x7f64580a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645f739640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f645806a900 0x7f64581e3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645f739640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f645814b540 0x7f6458142f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645f739640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64580a5dc0 con 0x7f645814b540 2024-02-02T11:48:49.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645f739640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645806b890 con 0x7f645806a900 2024-02-02T11:48:49.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645f739640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64580a1130 con 0x7f645806a4c0 2024-02-02T11:48:49.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645dcd6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f645814b540 0x7f6458142f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645dcd6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f645814b540 0x7f6458142f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52772/0 (socket says 172.21.15.161:52772) 2024-02-02T11:48:49.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645dcd6640 1 -- 172.21.15.161:0/3105516245 learned_addr learned my addr 172.21.15.161:0/3105516245 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:49.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645d4d5640 1 --2- 172.21.15.161:0/3105516245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f645806a4c0 0x7f64580a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645ccd4640 1 --2- 172.21.15.161:0/3105516245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f645806a900 0x7f64581e3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645dcd6640 1 -- 172.21.15.161:0/3105516245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f645806a4c0 msgr2=0x7f64580a5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645dcd6640 1 --2- 172.21.15.161:0/3105516245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f645806a4c0 0x7f64580a5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645dcd6640 1 -- 172.21.15.161:0/3105516245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f645806a900 msgr2=0x7f64581e3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645dcd6640 1 --2- 172.21.15.161:0/3105516245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f645806a900 0x7f64581e3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645dcd6640 1 -- 172.21.15.161:0/3105516245 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64540094d0 con 0x7f645814b540 2024-02-02T11:48:49.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645d4d5640 1 --2- 172.21.15.161:0/3105516245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f645806a4c0 0x7f64580a5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:48:49.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f645dcd6640 1 --2- 172.21.15.161:0/3105516245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f645814b540 0x7f6458142f10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f645000cd70 tx=0x7f645000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:49.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f644dffb640 1 -- 172.21.15.161:0/3105516245 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6450003ba0 con 0x7f645814b540 2024-02-02T11:48:49.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f644dffb640 1 -- 172.21.15.161:0/3105516245 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6450003d00 con 0x7f645814b540 2024-02-02T11:48:49.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.092+0000 7f644dffb640 1 -- 172.21.15.161:0/3105516245 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6450004240 con 0x7f645814b540 2024-02-02T11:48:49.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.096+0000 7f645f739640 1 -- 172.21.15.161:0/3105516245 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64580b5ba0 con 0x7f645814b540 2024-02-02T11:48:49.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.096+0000 7f645f739640 1 -- 172.21.15.161:0/3105516245 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64580b6440 con 0x7f645814b540 2024-02-02T11:48:49.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.096+0000 7f645f739640 1 -- 172.21.15.161:0/3105516245 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64580b6630 con 0x7f645814b540 2024-02-02T11:48:49.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.096+0000 7f644dffb640 1 -- 172.21.15.161:0/3105516245 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f64500043a0 con 0x7f645814b540 2024-02-02T11:48:49.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.096+0000 7f644dffb640 1 --2- 172.21.15.161:0/3105516245 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f643c065a60 0x7f643c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.096+0000 7f644dffb640 1 -- 172.21.15.161:0/3105516245 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6450012070 con 0x7f645814b540 2024-02-02T11:48:49.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.096+0000 7f645d4d5640 1 --2- 172.21.15.161:0/3105516245 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f643c065a60 0x7f643c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.096+0000 7f645d4d5640 1 --2- 172.21.15.161:0/3105516245 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f643c065a60 0x7f643c067f20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f64540b2000 tx=0x7f64540aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:49.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.100+0000 7f644dffb640 1 -- 172.21.15.161:0/3105516245 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6450051560 con 0x7f645814b540 2024-02-02T11:48:49.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.248+0000 7f645f739640 1 -- 172.21.15.161:0/3105516245 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f645804e000 con 0x7f645814b540 2024-02-02T11:48:49.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.248+0000 7f644dffb640 1 -- 172.21.15.161:0/3105516245 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f6450054b80 con 0x7f645814b540 2024-02-02T11:48:49.252 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:48:49.252 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":16,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:42.556025+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:48:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.252+0000 7f645f739640 1 -- 172.21.15.161:0/3105516245 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f643c065a60 msgr2=0x7f643c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.252+0000 7f645f739640 1 --2- 172.21.15.161:0/3105516245 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f643c065a60 0x7f643c067f20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f64540b2000 tx=0x7f64540aa070 comp rx=0 tx=0).stop 2024-02-02T11:48:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.252+0000 7f645f739640 1 -- 172.21.15.161:0/3105516245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f645814b540 msgr2=0x7f6458142f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.252+0000 7f645f739640 1 --2- 172.21.15.161:0/3105516245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f645814b540 0x7f6458142f10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f645000cd70 tx=0x7f645000a660 comp rx=0 tx=0).stop 2024-02-02T11:48:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.252+0000 7f645f739640 1 -- 172.21.15.161:0/3105516245 shutdown_connections 2024-02-02T11:48:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.252+0000 7f645f739640 1 --2- 172.21.15.161:0/3105516245 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f643c065a60 0x7f643c067f20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.252+0000 7f645f739640 1 --2- 172.21.15.161:0/3105516245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f645814b540 0x7f6458142f10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.252+0000 7f645f739640 1 --2- 172.21.15.161:0/3105516245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f645806a900 0x7f64581e3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.252+0000 7f645f739640 1 --2- 172.21.15.161:0/3105516245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f645806a4c0 0x7f64580a5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.252+0000 7f645f739640 1 -- 172.21.15.161:0/3105516245 >> 172.21.15.161:0/3105516245 conn(0x7f64580c02e0 msgr2=0x7f64580c06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:49.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.252+0000 7f645f739640 1 -- 172.21.15.161:0/3105516245 shutdown_connections 2024-02-02T11:48:49.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.252+0000 7f645f739640 1 -- 172.21.15.161:0/3105516245 wait complete. 2024-02-02T11:48:49.270 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-02T11:48:40.330782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-02T11:48:49.270 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-02T11:48:49.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.388+0000 7f2311c77640 1 Processor -- start 2024-02-02T11:48:49.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.388+0000 7f2311c77640 1 -- start start 2024-02-02T11:48:49.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.388+0000 7f2311c77640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f230c0b8b40 0x7f230c0b8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.388+0000 7f2311c77640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f230c144a80 0x7f230c14ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.388+0000 7f2311c77640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f230c144ee0 0x7f230c14b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.388+0000 7f2311c77640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230c0b6e80 con 0x7f230c144ee0 2024-02-02T11:48:49.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.388+0000 7f2311c77640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230c0b7160 con 0x7f230c144a80 2024-02-02T11:48:49.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.388+0000 7f2311c77640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c0bc6c0 con 0x7f230c0b8b40 2024-02-02T11:48:49.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.388+0000 7f230bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f230c144ee0 0x7f230c14b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.388+0000 7f230bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f230c144ee0 0x7f230c14b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52776/0 (socket says 172.21.15.161:52776) 2024-02-02T11:48:49.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.388+0000 7f230bfff640 1 -- 172.21.15.161:0/3047650960 learned_addr learned my addr 172.21.15.161:0/3047650960 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:49.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.388+0000 7f230b7fe640 1 --2- 172.21.15.161:0/3047650960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f230c0b8b40 0x7f230c0b8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.388+0000 7f230affd640 1 --2- 172.21.15.161:0/3047650960 >> v2:172.21.15.162:3300/0 conn(0x7f230c144a80 0x7f230c14ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.388+0000 7f230bfff640 1 -- 172.21.15.161:0/3047650960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f230c0b8b40 msgr2=0x7f230c0b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:49.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.388+0000 7f230bfff640 1 --2- 172.21.15.161:0/3047650960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f230c0b8b40 0x7f230c0b8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.388+0000 7f230bfff640 1 -- 172.21.15.161:0/3047650960 >> v2:172.21.15.162:3300/0 conn(0x7f230c144a80 msgr2=0x7f230c14ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:49.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.388+0000 7f230bfff640 1 --2- 172.21.15.161:0/3047650960 >> v2:172.21.15.162:3300/0 conn(0x7f230c144a80 0x7f230c14ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.388+0000 7f230bfff640 1 -- 172.21.15.161:0/3047650960 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c0bc9a0 con 0x7f230c144ee0 2024-02-02T11:48:49.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f230bfff640 1 --2- 172.21.15.161:0/3047650960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c144ee0 0x7f230c14b1a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f230c06aef0 tx=0x7f230401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a96fd7db35d7fd2 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:49.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f230a7fc640 1 -- 172.21.15.161:0/3047650960 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23040af400 con 0x7f230c144ee0 2024-02-02T11:48:49.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f230a7fc640 1 -- 172.21.15.161:0/3047650960 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23040ab050 con 0x7f230c144ee0 2024-02-02T11:48:49.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f230a7fc640 1 -- 172.21.15.161:0/3047650960 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23040af780 con 0x7f230c144ee0 2024-02-02T11:48:49.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f2311c77640 1 -- 172.21.15.161:0/3047650960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c144ee0 msgr2=0x7f230c14b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f2311c77640 1 --2- 172.21.15.161:0/3047650960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c144ee0 0x7f230c14b1a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f230c06aef0 tx=0x7f230401f1c0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f2311c77640 1 -- 172.21.15.161:0/3047650960 shutdown_connections 2024-02-02T11:48:49.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f2311c77640 1 --2- 172.21.15.161:0/3047650960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c144ee0 0x7f230c14b1a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f2311c77640 1 --2- 172.21.15.161:0/3047650960 >> v2:172.21.15.162:3300/0 conn(0x7f230c144a80 0x7f230c14ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f2311c77640 1 --2- 172.21.15.161:0/3047650960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f230c0b8b40 0x7f230c0b8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f2311c77640 1 -- 172.21.15.161:0/3047650960 >> 172.21.15.161:0/3047650960 conn(0x7f230c0c02f0 msgr2=0x7f230c0c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:49.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f2311c77640 1 -- 172.21.15.161:0/3047650960 shutdown_connections 2024-02-02T11:48:49.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f2311c77640 1 -- 172.21.15.161:0/3047650960 wait complete. 2024-02-02T11:48:49.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f2311c77640 1 Processor -- start 2024-02-02T11:48:49.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f2311c77640 1 -- start start 2024-02-02T11:48:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f2311c77640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f230c0b8b40 0x7f230c1d2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f2311c77640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f230c144a80 0x7f230c1d3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f2311c77640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c144ee0 0x7f230c1d48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f2311c77640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c1d1d00 con 0x7f230c144ee0 2024-02-02T11:48:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f2311c77640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c1d3370 con 0x7f230c0b8b40 2024-02-02T11:48:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f2311c77640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c1d42b0 con 0x7f230c144a80 2024-02-02T11:48:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f230bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c144ee0 0x7f230c1d48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f230bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c144ee0 0x7f230c1d48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52786/0 (socket says 172.21.15.161:52786) 2024-02-02T11:48:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f230bfff640 1 -- 172.21.15.161:0/2699695707 learned_addr learned my addr 172.21.15.161:0/2699695707 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f230bfff640 1 -- 172.21.15.161:0/2699695707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f230c144a80 msgr2=0x7f230c1d3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f230bfff640 1 --2- 172.21.15.161:0/2699695707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f230c144a80 0x7f230c1d3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f230bfff640 1 -- 172.21.15.161:0/2699695707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f230c0b8b40 msgr2=0x7f230c1d2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f230b7fe640 1 --2- 172.21.15.161:0/2699695707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f230c0b8b40 0x7f230c1d2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f230bfff640 1 --2- 172.21.15.161:0/2699695707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f230c0b8b40 0x7f230c1d2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.392+0000 7f230bfff640 1 -- 172.21.15.161:0/2699695707 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2304009b30 con 0x7f230c144ee0 2024-02-02T11:48:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.396+0000 7f230bfff640 1 --2- 172.21.15.161:0/2699695707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c144ee0 0x7f230c1d48f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f230401d870 tx=0x7f230401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.396+0000 7f22f3fff640 1 -- 172.21.15.161:0/2699695707 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23040afd30 con 0x7f230c144ee0 2024-02-02T11:48:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.396+0000 7f22f3fff640 1 -- 172.21.15.161:0/2699695707 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23040afe90 con 0x7f230c144ee0 2024-02-02T11:48:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.396+0000 7f22f3fff640 1 -- 172.21.15.161:0/2699695707 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23040ba660 con 0x7f230c144ee0 2024-02-02T11:48:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.396+0000 7f2311c77640 1 -- 172.21.15.161:0/2699695707 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230c1d44d0 con 0x7f230c144ee0 2024-02-02T11:48:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.396+0000 7f2311c77640 1 -- 172.21.15.161:0/2699695707 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230c1d1360 con 0x7f230c144ee0 2024-02-02T11:48:49.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.396+0000 7f2311c77640 1 -- 172.21.15.161:0/2699695707 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230c1d1e40 con 0x7f230c144ee0 2024-02-02T11:48:49.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.396+0000 7f22f3fff640 1 -- 172.21.15.161:0/2699695707 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f23040b6040 con 0x7f230c144ee0 2024-02-02T11:48:49.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.396+0000 7f22f3fff640 1 --2- 172.21.15.161:0/2699695707 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f22f8065a30 0x7f22f8067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.396+0000 7f22f3fff640 1 -- 172.21.15.161:0/2699695707 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2304121000 con 0x7f230c144ee0 2024-02-02T11:48:49.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.396+0000 7f230b7fe640 1 --2- 172.21.15.161:0/2699695707 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f22f8065a30 0x7f22f8067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.396+0000 7f230b7fe640 1 --2- 172.21.15.161:0/2699695707 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f22f8065a30 0x7f22f8067ef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009710 tx=0x7f22fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:49.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.400+0000 7f22f3fff640 1 -- 172.21.15.161:0/2699695707 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f230c1d1e40 con 0x7f230c144ee0 2024-02-02T11:48:49.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.544+0000 7f2311c77640 1 -- 172.21.15.161:0/2699695707 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f230c1d1e40 con 0x7f230c144ee0 2024-02-02T11:48:49.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.544+0000 7f22f3fff640 1 -- 172.21.15.161:0/2699695707 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f230c1d1e40 con 0x7f230c144ee0 2024-02-02T11:48:49.546 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-02-02T11:48:49.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.544+0000 7f2311c77640 1 -- 172.21.15.161:0/2699695707 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f22f8065a30 msgr2=0x7f22f8067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.544+0000 7f2311c77640 1 --2- 172.21.15.161:0/2699695707 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f22f8065a30 0x7f22f8067ef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009710 tx=0x7f22fc008040 comp rx=0 tx=0).stop 2024-02-02T11:48:49.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.544+0000 7f2311c77640 1 -- 172.21.15.161:0/2699695707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c144ee0 msgr2=0x7f230c1d48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.544+0000 7f2311c77640 1 --2- 172.21.15.161:0/2699695707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c144ee0 0x7f230c1d48f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f230401d870 tx=0x7f230401bf60 comp rx=0 tx=0).stop 2024-02-02T11:48:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.544+0000 7f2311c77640 1 -- 172.21.15.161:0/2699695707 shutdown_connections 2024-02-02T11:48:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.544+0000 7f2311c77640 1 --2- 172.21.15.161:0/2699695707 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f22f8065a30 0x7f22f8067ef0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.544+0000 7f2311c77640 1 --2- 172.21.15.161:0/2699695707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c144ee0 0x7f230c1d48f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.544+0000 7f2311c77640 1 --2- 172.21.15.161:0/2699695707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f230c144a80 0x7f230c1d3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.544+0000 7f2311c77640 1 --2- 172.21.15.161:0/2699695707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f230c0b8b40 0x7f230c1d2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.544+0000 7f2311c77640 1 -- 172.21.15.161:0/2699695707 >> 172.21.15.161:0/2699695707 conn(0x7f230c0c02f0 msgr2=0x7f230c0bebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.544+0000 7f2311c77640 1 -- 172.21.15.161:0/2699695707 shutdown_connections 2024-02-02T11:48:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.544+0000 7f2311c77640 1 -- 172.21.15.161:0/2699695707 wait complete. 2024-02-02T11:48:49.564 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-02T11:48:49.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.668+0000 7f983f7c9640 1 Processor -- start 2024-02-02T11:48:49.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.668+0000 7f983f7c9640 1 -- start start 2024-02-02T11:48:49.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.668+0000 7f983f7c9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98380bc340 0x7f983806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.668+0000 7f983f7c9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f98380b6920 0x7f98380b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.668+0000 7f983f7c9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98380b72b0 con 0x7f98380b7fd0 2024-02-02T11:48:49.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.668+0000 7f983f7c9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983814f150 con 0x7f98380b6920 2024-02-02T11:48:49.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.668+0000 7f983f7c9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983814f430 con 0x7f98380bc340 2024-02-02T11:48:49.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.668+0000 7f983dd66640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f98380b6920 0x7f98380b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.668+0000 7f983cd64640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f98380b7fd0 0x7f9838148cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50780/0 (socket says 172.21.15.161:50780) 2024-02-02T11:48:49.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.668+0000 7f983dd66640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f98380b6920 0x7f98380b6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52800/0 (socket says 172.21.15.161:52800) 2024-02-02T11:48:49.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.668+0000 7f983cd64640 1 -- 172.21.15.161:0/284690452 learned_addr learned my addr 172.21.15.161:0/284690452 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:48:49.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.668+0000 7f983d565640 1 --2- 172.21.15.161:0/284690452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98380bc340 0x7f983806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.668+0000 7f983dd66640 1 -- 172.21.15.161:0/284690452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98380bc340 msgr2=0x7f983806eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:49.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.668+0000 7f983dd66640 1 --2- 172.21.15.161:0/284690452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98380bc340 0x7f983806eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.668+0000 7f983dd66640 1 -- 172.21.15.161:0/284690452 >> v1:172.21.15.161:6789/0 conn(0x7f98380b7fd0 legacy=0x7f9838148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.668+0000 7f983dd66640 1 -- 172.21.15.161:0/284690452 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983814f710 con 0x7f98380b6920 2024-02-02T11:48:49.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.668+0000 7f9837fff640 1 -- 172.21.15.161:0/284690452 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3480907657 0 0) 0x7f98380b72b0 con 0x7f98380b7fd0 2024-02-02T11:48:49.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983dd66640 1 --2- 172.21.15.161:0/284690452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98380b6920 0x7f98380b6d70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f98300097c0 tx=0x7f983001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0928eab096180bd server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:49.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f9837fff640 1 -- 172.21.15.161:0/284690452 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98300ab670 con 0x7f98380b6920 2024-02-02T11:48:49.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f9837fff640 1 -- 172.21.15.161:0/284690452 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98300ab7d0 con 0x7f98380b6920 2024-02-02T11:48:49.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f9837fff640 1 -- 172.21.15.161:0/284690452 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98300abb60 con 0x7f98380b6920 2024-02-02T11:48:49.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983f7c9640 1 -- 172.21.15.161:0/284690452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98380b6920 msgr2=0x7f98380b6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983f7c9640 1 --2- 172.21.15.161:0/284690452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98380b6920 0x7f98380b6d70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f98300097c0 tx=0x7f983001c450 comp rx=0 tx=0).stop 2024-02-02T11:48:49.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983f7c9640 1 -- 172.21.15.161:0/284690452 shutdown_connections 2024-02-02T11:48:49.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983f7c9640 1 --2- 172.21.15.161:0/284690452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98380b6920 0x7f98380b6d70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983f7c9640 1 --2- 172.21.15.161:0/284690452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98380bc340 0x7f983806eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983f7c9640 1 -- 172.21.15.161:0/284690452 >> 172.21.15.161:0/284690452 conn(0x7f9838069ef0 msgr2=0x7f983806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983f7c9640 1 -- 172.21.15.161:0/284690452 shutdown_connections 2024-02-02T11:48:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983f7c9640 1 -- 172.21.15.161:0/284690452 wait complete. 2024-02-02T11:48:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983f7c9640 1 Processor -- start 2024-02-02T11:48:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983f7c9640 1 -- start start 2024-02-02T11:48:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983f7c9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98380b6920 0x7f98381ea070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983f7c9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98380b7fd0 0x7f9838150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983f7c9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98380bc340 0x7f9838152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983f7c9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9838152e80 con 0x7f98380b7fd0 2024-02-02T11:48:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983f7c9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98381502f0 con 0x7f98380bc340 2024-02-02T11:48:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983f7c9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9838150870 con 0x7f98380b6920 2024-02-02T11:48:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983cd64640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98380b7fd0 0x7f9838150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983cd64640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98380b7fd0 0x7f9838150d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52804/0 (socket says 172.21.15.161:52804) 2024-02-02T11:48:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983cd64640 1 -- 172.21.15.161:0/1903616390 learned_addr learned my addr 172.21.15.161:0/1903616390 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983cd64640 1 -- 172.21.15.161:0/1903616390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98380b6920 msgr2=0x7f98381ea070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983cd64640 1 --2- 172.21.15.161:0/1903616390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98380b6920 0x7f98381ea070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983cd64640 1 -- 172.21.15.161:0/1903616390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98380bc340 msgr2=0x7f9838152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983cd64640 1 --2- 172.21.15.161:0/1903616390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98380bc340 0x7f9838152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983cd64640 1 -- 172.21.15.161:0/1903616390 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9830009420 con 0x7f98380b7fd0 2024-02-02T11:48:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983cd64640 1 --2- 172.21.15.161:0/1903616390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98380b7fd0 0x7f9838150d00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9828001570 tx=0x7f982800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f9835ffb640 1 -- 172.21.15.161:0/1903616390 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982800a640 con 0x7f98380b7fd0 2024-02-02T11:48:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f9835ffb640 1 -- 172.21.15.161:0/1903616390 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982800a7c0 con 0x7f98380b7fd0 2024-02-02T11:48:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f983f7c9640 1 -- 172.21.15.161:0/1903616390 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9838141190 con 0x7f98380b7fd0 2024-02-02T11:48:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.672+0000 7f9835ffb640 1 -- 172.21.15.161:0/1903616390 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982800ab70 con 0x7f98380b7fd0 2024-02-02T11:48:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.676+0000 7f983f7c9640 1 -- 172.21.15.161:0/1903616390 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983813f270 con 0x7f98380b7fd0 2024-02-02T11:48:49.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.676+0000 7f983f7c9640 1 -- 172.21.15.161:0/1903616390 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983804e000 con 0x7f98380b7fd0 2024-02-02T11:48:49.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.676+0000 7f9835ffb640 1 -- 172.21.15.161:0/1903616390 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f982800acd0 con 0x7f98380b7fd0 2024-02-02T11:48:49.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.676+0000 7f9835ffb640 1 --2- 172.21.15.161:0/1903616390 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9824065a60 0x7f9824067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.676+0000 7f9835ffb640 1 -- 172.21.15.161:0/1903616390 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9828082410 con 0x7f98380b7fd0 2024-02-02T11:48:49.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.676+0000 7f983d565640 1 --2- 172.21.15.161:0/1903616390 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9824065a60 0x7f9824067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.676+0000 7f983d565640 1 --2- 172.21.15.161:0/1903616390 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9824065a60 0x7f9824067f20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f982c00a810 tx=0x7f982c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:49.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.680+0000 7f9835ffb640 1 -- 172.21.15.161:0/1903616390 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f98280501b0 con 0x7f98380b7fd0 2024-02-02T11:48:49.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.832+0000 7f983f7c9640 1 -- 172.21.15.161:0/1903616390 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f98381509b0 con 0x7f98380b7fd0 2024-02-02T11:48:49.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.832+0000 7f9835ffb640 1 -- 172.21.15.161:0/1903616390 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f98381509b0 con 0x7f98380b7fd0 2024-02-02T11:48:49.834 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:48:49.834 INFO:teuthology.orchestra.run.smithi161.stdout:[ 2024-02-02T11:48:49.835 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:48:49.835 INFO:teuthology.orchestra.run.smithi161.stdout: "poolnum": 1, 2024-02-02T11:48:49.835 INFO:teuthology.orchestra.run.smithi161.stdout: "poolname": ".mgr" 2024-02-02T11:48:49.835 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:48:49.835 INFO:teuthology.orchestra.run.smithi161.stdout:] 2024-02-02T11:48:49.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.832+0000 7f983f7c9640 1 -- 172.21.15.161:0/1903616390 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9824065a60 msgr2=0x7f9824067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.832+0000 7f983f7c9640 1 --2- 172.21.15.161:0/1903616390 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9824065a60 0x7f9824067f20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f982c00a810 tx=0x7f982c008040 comp rx=0 tx=0).stop 2024-02-02T11:48:49.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.832+0000 7f983f7c9640 1 -- 172.21.15.161:0/1903616390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98380b7fd0 msgr2=0x7f9838150d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.832+0000 7f983f7c9640 1 --2- 172.21.15.161:0/1903616390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98380b7fd0 0x7f9838150d00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9828001570 tx=0x7f982800cd20 comp rx=0 tx=0).stop 2024-02-02T11:48:49.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.832+0000 7f983f7c9640 1 -- 172.21.15.161:0/1903616390 shutdown_connections 2024-02-02T11:48:49.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.832+0000 7f983f7c9640 1 --2- 172.21.15.161:0/1903616390 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9824065a60 0x7f9824067f20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.832+0000 7f983f7c9640 1 --2- 172.21.15.161:0/1903616390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98380bc340 0x7f9838152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.832+0000 7f983f7c9640 1 --2- 172.21.15.161:0/1903616390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98380b7fd0 0x7f9838150d00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.832+0000 7f983f7c9640 1 --2- 172.21.15.161:0/1903616390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98380b6920 0x7f98381ea070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.832+0000 7f983f7c9640 1 -- 172.21.15.161:0/1903616390 >> 172.21.15.161:0/1903616390 conn(0x7f9838069ef0 msgr2=0x7f98380b6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:49.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.836+0000 7f983f7c9640 1 -- 172.21.15.161:0/1903616390 shutdown_connections 2024-02-02T11:48:49.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.836+0000 7f983f7c9640 1 -- 172.21.15.161:0/1903616390 wait complete. 2024-02-02T11:48:49.851 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-02T11:48:49.851 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-02T11:48:49.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a7a131640 1 Processor -- start 2024-02-02T11:48:49.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a7a131640 1 -- start start 2024-02-02T11:48:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a7a131640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0a7406af90 0x7f0a74071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a7a131640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a740b8350 con 0x7f0a74147c20 2024-02-02T11:48:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a7a131640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a740afd40 con 0x7f0a7406f520 2024-02-02T11:48:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a7a131640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a740b8170 con 0x7f0a7406af90 2024-02-02T11:48:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a73fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0a74147c20 0x7f0a741552d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50784/0 (socket says 172.21.15.161:50784) 2024-02-02T11:48:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a73fff640 1 -- 172.21.15.161:0/2547370653 learned_addr learned my addr 172.21.15.161:0/2547370653 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:48:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a737fe640 1 --2- 172.21.15.161:0/2547370653 >> v2:172.21.15.162:3300/0 conn(0x7f0a7406af90 0x7f0a74071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a727fc640 1 -- 172.21.15.161:0/2547370653 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716378296 0 0) 0x7f0a740b8350 con 0x7f0a74147c20 2024-02-02T11:48:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a727fc640 1 -- 172.21.15.161:0/2547370653 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a5c003530 con 0x7f0a74147c20 2024-02-02T11:48:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a727fc640 1 -- 172.21.15.161:0/2547370653 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3620379226 0 0) 0x7f0a5c003530 con 0x7f0a74147c20 2024-02-02T11:48:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a727fc640 1 -- 172.21.15.161:0/2547370653 >> v2:172.21.15.162:3300/0 conn(0x7f0a7406af90 msgr2=0x7f0a74071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a727fc640 1 --2- 172.21.15.161:0/2547370653 >> v2:172.21.15.162:3300/0 conn(0x7f0a7406af90 0x7f0a74071dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a727fc640 1 -- 172.21.15.161:0/2547370653 >> v1:172.21.15.162:6789/0 conn(0x7f0a7406f520 legacy=0x7f0a74070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a727fc640 1 -- 172.21.15.161:0/2547370653 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7414dfa0 con 0x7f0a74147c20 2024-02-02T11:48:49.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a727fc640 1 -- 172.21.15.161:0/2547370653 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f0a6c001a00 con 0x7f0a74147c20 2024-02-02T11:48:49.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a727fc640 1 -- 172.21.15.161:0/2547370653 >> v1:172.21.15.161:6789/0 conn(0x7f0a74147c20 legacy=0x7f0a741552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a727fc640 1 --2- 172.21.15.161:0/2547370653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a5c003980 0x7f0a5c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a727fc640 1 --2- 172.21.15.161:0/2547370653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a5c0047d0 0x7f0a5c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a727fc640 1 --2- 172.21.15.161:0/2547370653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a5c005190 0x7f0a5c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a727fc640 1 -- 172.21.15.161:0/2547370653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740b8170 con 0x7f0a5c0047d0 2024-02-02T11:48:49.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a727fc640 1 -- 172.21.15.161:0/2547370653 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c00c030 con 0x7f0a5c003980 2024-02-02T11:48:49.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a727fc640 1 -- 172.21.15.161:0/2547370653 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c00c1f0 con 0x7f0a5c005190 2024-02-02T11:48:49.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a72ffd640 1 --2- 172.21.15.161:0/2547370653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a5c0047d0 0x7f0a5c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a737fe640 1 --2- 172.21.15.161:0/2547370653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a5c003980 0x7f0a5c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a73fff640 1 --2- 172.21.15.161:0/2547370653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a5c005190 0x7f0a5c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a72ffd640 1 -- 172.21.15.161:0/2547370653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a5c005190 msgr2=0x7f0a5c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:49.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a72ffd640 1 --2- 172.21.15.161:0/2547370653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a5c005190 0x7f0a5c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a72ffd640 1 -- 172.21.15.161:0/2547370653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a5c003980 msgr2=0x7f0a5c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:49.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a72ffd640 1 --2- 172.21.15.161:0/2547370653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a5c003980 0x7f0a5c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a72ffd640 1 -- 172.21.15.161:0/2547370653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c003530 con 0x7f0a5c0047d0 2024-02-02T11:48:49.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.960+0000 7f0a73fff640 1 -- 172.21.15.161:0/2547370653 reap_dead start 2024-02-02T11:48:49.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.964+0000 7f0a72ffd640 1 --2- 172.21.15.161:0/2547370653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a5c0047d0 0x7f0a5c004c50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a64001780 tx=0x7f0a6401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff94041a9ef7010 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:49.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.964+0000 7f0a727fc640 1 -- 172.21.15.161:0/2547370653 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a640a4ea0 con 0x7f0a5c0047d0 2024-02-02T11:48:49.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.964+0000 7f0a727fc640 1 -- 172.21.15.161:0/2547370653 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a640a7050 con 0x7f0a5c0047d0 2024-02-02T11:48:49.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.964+0000 7f0a727fc640 1 -- 172.21.15.161:0/2547370653 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a64003600 con 0x7f0a5c0047d0 2024-02-02T11:48:49.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.964+0000 7f0a7a131640 1 -- 172.21.15.161:0/2547370653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a5c0047d0 msgr2=0x7f0a5c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.964+0000 7f0a7a131640 1 --2- 172.21.15.161:0/2547370653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a5c0047d0 0x7f0a5c004c50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a64001780 tx=0x7f0a6401c3e0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.964+0000 7f0a7a131640 1 -- 172.21.15.161:0/2547370653 shutdown_connections 2024-02-02T11:48:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.964+0000 7f0a7a131640 1 --2- 172.21.15.161:0/2547370653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a5c0047d0 0x7f0a5c004c50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.964+0000 7f0a7a131640 1 -- 172.21.15.161:0/2547370653 >> 172.21.15.161:0/2547370653 conn(0x7f0a740b9140 msgr2=0x7f0a740b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.964+0000 7f0a7a131640 1 -- 172.21.15.161:0/2547370653 shutdown_connections 2024-02-02T11:48:49.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.964+0000 7f0a7a131640 1 -- 172.21.15.161:0/2547370653 wait complete. 2024-02-02T11:48:49.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.964+0000 7f0a7a131640 1 Processor -- start 2024-02-02T11:48:49.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.964+0000 7f0a7a131640 1 -- start start 2024-02-02T11:48:49.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a7a131640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a5c0047d0 0x7f0a741e3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a7a131640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a740b5890 0x7f0a74147470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a7a131640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a74142050 0x7f0a7413a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a7a131640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740b0020 con 0x7f0a5c0047d0 2024-02-02T11:48:49.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a7a131640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740afb60 con 0x7f0a74142050 2024-02-02T11:48:49.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a7a131640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740b5d10 con 0x7f0a740b5890 2024-02-02T11:48:49.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a737fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a5c0047d0 0x7f0a741e3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a737fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a5c0047d0 0x7f0a741e3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52828/0 (socket says 172.21.15.161:52828) 2024-02-02T11:48:49.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a737fe640 1 -- 172.21.15.161:0/4164760509 learned_addr learned my addr 172.21.15.161:0/4164760509 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:49.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a73fff640 1 --2- 172.21.15.161:0/4164760509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a74142050 0x7f0a7413a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a72ffd640 1 --2- 172.21.15.161:0/4164760509 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a740b5890 0x7f0a74147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a737fe640 1 -- 172.21.15.161:0/4164760509 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a740b5890 msgr2=0x7f0a74147470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a737fe640 1 --2- 172.21.15.161:0/4164760509 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a740b5890 0x7f0a74147470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a737fe640 1 -- 172.21.15.161:0/4164760509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a74142050 msgr2=0x7f0a7413a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:49.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a737fe640 1 --2- 172.21.15.161:0/4164760509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a74142050 0x7f0a7413a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:49.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a737fe640 1 -- 172.21.15.161:0/4164760509 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a741424d0 con 0x7f0a5c0047d0 2024-02-02T11:48:49.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a72ffd640 1 --2- 172.21.15.161:0/4164760509 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a740b5890 0x7f0a74147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:48:49.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a737fe640 1 --2- 172.21.15.161:0/4164760509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a5c0047d0 0x7f0a741e3540 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a68011660 tx=0x7f0a68011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:49.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a5bfff640 1 -- 172.21.15.161:0/4164760509 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6800f960 con 0x7f0a5c0047d0 2024-02-02T11:48:49.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a5bfff640 1 -- 172.21.15.161:0/4164760509 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6800fac0 con 0x7f0a5c0047d0 2024-02-02T11:48:49.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a5bfff640 1 -- 172.21.15.161:0/4164760509 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6800fe30 con 0x7f0a5c0047d0 2024-02-02T11:48:49.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a7a131640 1 -- 172.21.15.161:0/4164760509 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a740b5f10 con 0x7f0a5c0047d0 2024-02-02T11:48:49.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a7a131640 1 -- 172.21.15.161:0/4164760509 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a740b6960 con 0x7f0a5c0047d0 2024-02-02T11:48:49.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a7a131640 1 -- 172.21.15.161:0/4164760509 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a7404e000 con 0x7f0a5c0047d0 2024-02-02T11:48:49.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a5bfff640 1 -- 172.21.15.161:0/4164760509 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0a68015460 con 0x7f0a5c0047d0 2024-02-02T11:48:49.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a5bfff640 1 --2- 172.21.15.161:0/4164760509 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0a60065a60 0x7f0a60067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:49.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a5bfff640 1 -- 172.21.15.161:0/4164760509 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0a680836c0 con 0x7f0a5c0047d0 2024-02-02T11:48:49.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a72ffd640 1 --2- 172.21.15.161:0/4164760509 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0a60065a60 0x7f0a60067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:49.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.968+0000 7f0a72ffd640 1 --2- 172.21.15.161:0/4164760509 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0a60065a60 0x7f0a60067f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0a64001750 tx=0x7f0a640011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:49.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:49.972+0000 7f0a5bfff640 1 -- 172.21.15.161:0/4164760509 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0a68051480 con 0x7f0a5c0047d0 2024-02-02T11:48:50.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.116+0000 7f0a7a131640 1 -- 172.21.15.161:0/4164760509 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0a74067000 con 0x7f0a5c0047d0 2024-02-02T11:48:50.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.436+0000 7f0a5bfff640 1 -- 172.21.15.161:0/4164760509 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0a68054aa0 con 0x7f0a5c0047d0 2024-02-02T11:48:50.437 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_metadata' created 2024-02-02T11:48:50.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.440+0000 7f0a7a131640 1 -- 172.21.15.161:0/4164760509 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0a60065a60 msgr2=0x7f0a60067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:50.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.440+0000 7f0a7a131640 1 --2- 172.21.15.161:0/4164760509 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0a60065a60 0x7f0a60067f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0a64001750 tx=0x7f0a640011a0 comp rx=0 tx=0).stop 2024-02-02T11:48:50.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.440+0000 7f0a7a131640 1 -- 172.21.15.161:0/4164760509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a5c0047d0 msgr2=0x7f0a741e3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:50.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.440+0000 7f0a7a131640 1 --2- 172.21.15.161:0/4164760509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a5c0047d0 0x7f0a741e3540 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a68011660 tx=0x7f0a68011b20 comp rx=0 tx=0).stop 2024-02-02T11:48:50.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.440+0000 7f0a7a131640 1 -- 172.21.15.161:0/4164760509 shutdown_connections 2024-02-02T11:48:50.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.440+0000 7f0a7a131640 1 --2- 172.21.15.161:0/4164760509 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0a60065a60 0x7f0a60067f20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:50.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.440+0000 7f0a7a131640 1 --2- 172.21.15.161:0/4164760509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a74142050 0x7f0a7413a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:50.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.440+0000 7f0a7a131640 1 --2- 172.21.15.161:0/4164760509 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a740b5890 0x7f0a74147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:50.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.440+0000 7f0a7a131640 1 --2- 172.21.15.161:0/4164760509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a5c0047d0 0x7f0a741e3540 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:50.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.440+0000 7f0a7a131640 1 -- 172.21.15.161:0/4164760509 >> 172.21.15.161:0/4164760509 conn(0x7f0a740b9140 msgr2=0x7f0a74070670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:50.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.440+0000 7f0a7a131640 1 -- 172.21.15.161:0/4164760509 shutdown_connections 2024-02-02T11:48:50.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.440+0000 7f0a7a131640 1 -- 172.21.15.161:0/4164760509 wait complete. 2024-02-02T11:48:50.467 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-02T11:48:50.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.592+0000 7fa00e24c640 1 Processor -- start 2024-02-02T11:48:50.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.592+0000 7fa00e24c640 1 -- start start 2024-02-02T11:48:50.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.592+0000 7fa00e24c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa0080b8240 0x7fa0080ba140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:50.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.592+0000 7fa00e24c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa00814a910 0x7fa008144460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:50.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.592+0000 7fa00e24c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0080b7e30 con 0x7fa0080b76c0 2024-02-02T11:48:50.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.592+0000 7fa00e24c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0080bbd30 con 0x7fa0080b8240 2024-02-02T11:48:50.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.592+0000 7fa00e24c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0080ba680 con 0x7fa00814a910 2024-02-02T11:48:50.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.592+0000 7fa0077fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa0080b8240 0x7fa0080ba140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:50.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.592+0000 7fa0077fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa0080b8240 0x7fa0080ba140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52830/0 (socket says 172.21.15.161:52830) 2024-02-02T11:48:50.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.592+0000 7fa006ffd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fa0080b76c0 0x7fa00814e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50792/0 (socket says 172.21.15.161:50792) 2024-02-02T11:48:50.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.592+0000 7fa0077fe640 1 -- 172.21.15.161:0/1814817339 learned_addr learned my addr 172.21.15.161:0/1814817339 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:50.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.592+0000 7fa007fff640 1 --2- 172.21.15.161:0/1814817339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa00814a910 0x7fa008144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:50.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.592+0000 7fa0077fe640 1 -- 172.21.15.161:0/1814817339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa00814a910 msgr2=0x7fa008144460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:50.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.592+0000 7fa0077fe640 1 --2- 172.21.15.161:0/1814817339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa00814a910 0x7fa008144460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:50.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.592+0000 7fa0077fe640 1 -- 172.21.15.161:0/1814817339 >> v1:172.21.15.161:6789/0 conn(0x7fa0080b76c0 legacy=0x7fa00814e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:50.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.592+0000 7fa0077fe640 1 -- 172.21.15.161:0/1814817339 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0080b7b50 con 0x7fa0080b8240 2024-02-02T11:48:50.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.592+0000 7fa0067fc640 1 -- 172.21.15.161:0/1814817339 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931529652 0 0) 0x7fa0080b7e30 con 0x7fa0080b76c0 2024-02-02T11:48:50.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa0077fe640 1 --2- 172.21.15.161:0/1814817339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0080b8240 0x7fa0080ba140 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009870 tx=0x7f9ff801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0930f76eb6f71c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:50.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa0067fc640 1 -- 172.21.15.161:0/1814817339 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff80ab600 con 0x7fa0080b8240 2024-02-02T11:48:50.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa0067fc640 1 -- 172.21.15.161:0/1814817339 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff80a7050 con 0x7fa0080b8240 2024-02-02T11:48:50.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa0067fc640 1 -- 172.21.15.161:0/1814817339 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff80ab980 con 0x7fa0080b8240 2024-02-02T11:48:50.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa00e24c640 1 -- 172.21.15.161:0/1814817339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0080b8240 msgr2=0x7fa0080ba140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:50.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa00e24c640 1 --2- 172.21.15.161:0/1814817339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0080b8240 0x7fa0080ba140 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009870 tx=0x7f9ff801c540 comp rx=0 tx=0).stop 2024-02-02T11:48:50.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa00e24c640 1 -- 172.21.15.161:0/1814817339 shutdown_connections 2024-02-02T11:48:50.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa00e24c640 1 --2- 172.21.15.161:0/1814817339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa00814a910 0x7fa008144460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:50.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa00e24c640 1 --2- 172.21.15.161:0/1814817339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0080b8240 0x7fa0080ba140 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:50.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa00e24c640 1 -- 172.21.15.161:0/1814817339 >> 172.21.15.161:0/1814817339 conn(0x7fa0080c0280 msgr2=0x7fa0080c0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:50.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa00e24c640 1 -- 172.21.15.161:0/1814817339 shutdown_connections 2024-02-02T11:48:50.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa00e24c640 1 -- 172.21.15.161:0/1814817339 wait complete. 2024-02-02T11:48:50.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa00e24c640 1 Processor -- start 2024-02-02T11:48:50.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa00e24c640 1 -- start start 2024-02-02T11:48:50.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa00e24c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0080b8240 0x7fa0080be580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:50.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa00e24c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa00814a910 0x7fa0080bfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:50.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa00e24c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa008132be0 0x7fa008133060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:50.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa00e24c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0080beac0 con 0x7fa0080b8240 2024-02-02T11:48:50.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa00e24c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa008136bf0 con 0x7fa008132be0 2024-02-02T11:48:50.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa00e24c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa008135be0 con 0x7fa00814a910 2024-02-02T11:48:50.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa0077fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0080b8240 0x7fa0080be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:50.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa0077fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0080b8240 0x7fa0080be580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52844/0 (socket says 172.21.15.161:52844) 2024-02-02T11:48:50.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa0077fe640 1 -- 172.21.15.161:0/868920246 learned_addr learned my addr 172.21.15.161:0/868920246 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:50.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa006ffd640 1 --2- 172.21.15.161:0/868920246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa00814a910 0x7fa0080bfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:50.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa007fff640 1 --2- 172.21.15.161:0/868920246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa008132be0 0x7fa008133060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:50.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa0077fe640 1 -- 172.21.15.161:0/868920246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa00814a910 msgr2=0x7fa0080bfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:50.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa0077fe640 1 --2- 172.21.15.161:0/868920246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa00814a910 0x7fa0080bfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa0077fe640 1 -- 172.21.15.161:0/868920246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa008132be0 msgr2=0x7fa008133060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa0077fe640 1 --2- 172.21.15.161:0/868920246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa008132be0 0x7fa008133060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa0077fe640 1 -- 172.21.15.161:0/868920246 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff80094d0 con 0x7fa0080b8240 2024-02-02T11:48:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa0077fe640 1 --2- 172.21.15.161:0/868920246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0080b8240 0x7fa0080be580 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ff801a170 tx=0x7f9ff80192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7f9feffff640 1 -- 172.21.15.161:0/868920246 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff80b6640 con 0x7fa0080b8240 2024-02-02T11:48:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7f9feffff640 1 -- 172.21.15.161:0/868920246 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff80b67c0 con 0x7fa0080b8240 2024-02-02T11:48:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa00e24c640 1 -- 172.21.15.161:0/868920246 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa008136760 con 0x7fa0080b8240 2024-02-02T11:48:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7f9feffff640 1 -- 172.21.15.161:0/868920246 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff80b6b70 con 0x7fa0080b8240 2024-02-02T11:48:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.596+0000 7fa00e24c640 1 -- 172.21.15.161:0/868920246 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0080c0000 con 0x7fa0080b8240 2024-02-02T11:48:50.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.600+0000 7fa00e24c640 1 -- 172.21.15.161:0/868920246 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00804e000 con 0x7fa0080b8240 2024-02-02T11:48:50.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.600+0000 7f9feffff640 1 -- 172.21.15.161:0/868920246 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9ff80b2040 con 0x7fa0080b8240 2024-02-02T11:48:50.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.600+0000 7f9feffff640 1 --2- 172.21.15.161:0/868920246 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9ff4065a60 0x7f9ff4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:50.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.600+0000 7f9feffff640 1 -- 172.21.15.161:0/868920246 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f9ff811d070 con 0x7fa0080b8240 2024-02-02T11:48:50.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.600+0000 7fa006ffd640 1 --2- 172.21.15.161:0/868920246 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9ff4065a60 0x7f9ff4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:50.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.600+0000 7fa006ffd640 1 --2- 172.21.15.161:0/868920246 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9ff4065a60 0x7f9ff4067f20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa0081347c0 tx=0x7f9ffc007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:50.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.604+0000 7f9feffff640 1 -- 172.21.15.161:0/868920246 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9ff814e0a0 con 0x7fa0080b8240 2024-02-02T11:48:50.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:50.752+0000 7fa00e24c640 1 -- 172.21.15.161:0/868920246 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa0080bad50 con 0x7fa0080b8240 2024-02-02T11:48:51.303 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:48:51.305 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:48:51.308 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:48:51.453 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data' created 2024-02-02T11:48:51.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.448+0000 7f9feffff640 1 -- 172.21.15.161:0/868920246 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9ff80eac00 con 0x7fa0080b8240 2024-02-02T11:48:51.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.456+0000 7fa00e24c640 1 -- 172.21.15.161:0/868920246 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9ff4065a60 msgr2=0x7f9ff4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:51.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.456+0000 7fa00e24c640 1 --2- 172.21.15.161:0/868920246 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9ff4065a60 0x7f9ff4067f20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa0081347c0 tx=0x7f9ffc007c10 comp rx=0 tx=0).stop 2024-02-02T11:48:51.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.456+0000 7fa00e24c640 1 -- 172.21.15.161:0/868920246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0080b8240 msgr2=0x7fa0080be580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:51.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.456+0000 7fa00e24c640 1 --2- 172.21.15.161:0/868920246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0080b8240 0x7fa0080be580 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ff801a170 tx=0x7f9ff80192e0 comp rx=0 tx=0).stop 2024-02-02T11:48:51.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.456+0000 7fa00e24c640 1 -- 172.21.15.161:0/868920246 shutdown_connections 2024-02-02T11:48:51.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.456+0000 7fa00e24c640 1 --2- 172.21.15.161:0/868920246 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9ff4065a60 0x7f9ff4067f20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:51.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.456+0000 7fa00e24c640 1 --2- 172.21.15.161:0/868920246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa008132be0 0x7fa008133060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:51.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.456+0000 7fa00e24c640 1 --2- 172.21.15.161:0/868920246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa00814a910 0x7fa0080bfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:51.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.456+0000 7fa00e24c640 1 --2- 172.21.15.161:0/868920246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0080b8240 0x7fa0080be580 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:51.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.456+0000 7fa00e24c640 1 -- 172.21.15.161:0/868920246 >> 172.21.15.161:0/868920246 conn(0x7fa0080c0280 msgr2=0x7fa0080c0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:51.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.460+0000 7fa00e24c640 1 -- 172.21.15.161:0/868920246 shutdown_connections 2024-02-02T11:48:51.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.460+0000 7fa00e24c640 1 -- 172.21.15.161:0/868920246 wait complete. 2024-02-02T11:48:51.491 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-02T11:48:51.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f466bc0c640 1 Processor -- start 2024-02-02T11:48:51.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f466bc0c640 1 -- start start 2024-02-02T11:48:51.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f466bc0c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f46640b8540 0x7f4664148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:51.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f466bc0c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4664148a80 con 0x7f46640b8df0 2024-02-02T11:48:51.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f466bc0c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46640b3890 con 0x7f46640b3320 2024-02-02T11:48:51.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f466bc0c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46640b3b70 con 0x7f46640b8540 2024-02-02T11:48:51.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46699a8640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f46640b8df0 0x7f4664142840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50806/0 (socket says 172.21.15.161:50806) 2024-02-02T11:48:51.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46699a8640 1 -- 172.21.15.161:0/1674509864 learned_addr learned my addr 172.21.15.161:0/1674509864 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:48:51.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46691a7640 1 --2- 172.21.15.161:0/1674509864 >> v2:172.21.15.162:3300/0 conn(0x7f46640b8540 0x7f4664148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:51.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46689a6640 1 -- 172.21.15.161:0/1674509864 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895613880 0 0) 0x7f4664148a80 con 0x7f46640b8df0 2024-02-02T11:48:51.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46689a6640 1 -- 172.21.15.161:0/1674509864 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4650003530 con 0x7f46640b8df0 2024-02-02T11:48:51.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46689a6640 1 -- 172.21.15.161:0/1674509864 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3850910545 0 0) 0x7f4650003530 con 0x7f46640b8df0 2024-02-02T11:48:51.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46689a6640 1 -- 172.21.15.161:0/1674509864 >> v2:172.21.15.162:3300/0 conn(0x7f46640b8540 msgr2=0x7f4664148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:51.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46689a6640 1 --2- 172.21.15.161:0/1674509864 >> v2:172.21.15.162:3300/0 conn(0x7f46640b8540 0x7f4664148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:51.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46689a6640 1 -- 172.21.15.161:0/1674509864 >> v1:172.21.15.162:6789/0 conn(0x7f46640b3320 legacy=0x7f46641531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:51.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46689a6640 1 -- 172.21.15.161:0/1674509864 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46640b3e50 con 0x7f46640b8df0 2024-02-02T11:48:51.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46689a6640 1 -- 172.21.15.161:0/1674509864 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f4660001680 con 0x7f46640b8df0 2024-02-02T11:48:51.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46689a6640 1 -- 172.21.15.161:0/1674509864 >> v1:172.21.15.161:6789/0 conn(0x7f46640b8df0 legacy=0x7f4664142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:51.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46689a6640 1 --2- 172.21.15.161:0/1674509864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4650003980 0x7f4650003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:51.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46689a6640 1 --2- 172.21.15.161:0/1674509864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46500047d0 0x7f4650004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:51.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46689a6640 1 --2- 172.21.15.161:0/1674509864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4650005190 0x7f465000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:51.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46689a6640 1 -- 172.21.15.161:0/1674509864 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46640b3b70 con 0x7f4650003980 2024-02-02T11:48:51.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46689a6640 1 -- 172.21.15.161:0/1674509864 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465000c030 con 0x7f46500047d0 2024-02-02T11:48:51.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46689a6640 1 -- 172.21.15.161:0/1674509864 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465000c1f0 con 0x7f4650005190 2024-02-02T11:48:51.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46699a8640 1 --2- 172.21.15.161:0/1674509864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4650003980 0x7f4650003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:51.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46691a7640 1 --2- 172.21.15.161:0/1674509864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46500047d0 0x7f4650004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:51.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f466a1a9640 1 --2- 172.21.15.161:0/1674509864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4650005190 0x7f465000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:51.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46699a8640 1 -- 172.21.15.161:0/1674509864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4650005190 msgr2=0x7f465000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:51.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46699a8640 1 --2- 172.21.15.161:0/1674509864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4650005190 0x7f465000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:51.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46699a8640 1 -- 172.21.15.161:0/1674509864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46500047d0 msgr2=0x7f4650004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:51.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46699a8640 1 --2- 172.21.15.161:0/1674509864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46500047d0 0x7f4650004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:51.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f46699a8640 1 -- 172.21.15.161:0/1674509864 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4650003530 con 0x7f4650003980 2024-02-02T11:48:51.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f466a1a9640 1 --2- 172.21.15.161:0/1674509864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4650005190 0x7f465000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:48:51.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.608+0000 7f466a1a9640 1 -- 172.21.15.161:0/1674509864 reap_dead start 2024-02-02T11:48:51.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f46699a8640 1 --2- 172.21.15.161:0/1674509864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4650003980 0x7f4650003da0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f466000c210 tx=0x7f466001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f5919e6a85d17 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:51.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f46689a6640 1 -- 172.21.15.161:0/1674509864 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4664071930 con 0x7f4650003980 2024-02-02T11:48:51.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f46689a6640 1 -- 172.21.15.161:0/1674509864 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46600a5900 con 0x7f4650003980 2024-02-02T11:48:51.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f46689a6640 1 -- 172.21.15.161:0/1674509864 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46600a5cd0 con 0x7f4650003980 2024-02-02T11:48:51.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f466bc0c640 1 -- 172.21.15.161:0/1674509864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4650003980 msgr2=0x7f4650003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:51.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f466bc0c640 1 --2- 172.21.15.161:0/1674509864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4650003980 0x7f4650003da0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f466000c210 tx=0x7f466001cc00 comp rx=0 tx=0).stop 2024-02-02T11:48:51.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f466bc0c640 1 -- 172.21.15.161:0/1674509864 shutdown_connections 2024-02-02T11:48:51.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f466bc0c640 1 --2- 172.21.15.161:0/1674509864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4650003980 0x7f4650003da0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:51.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f466bc0c640 1 -- 172.21.15.161:0/1674509864 >> 172.21.15.161:0/1674509864 conn(0x7f466406a120 msgr2=0x7f466406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:51.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f466bc0c640 1 -- 172.21.15.161:0/1674509864 shutdown_connections 2024-02-02T11:48:51.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f466bc0c640 1 -- 172.21.15.161:0/1674509864 wait complete. 2024-02-02T11:48:51.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f466bc0c640 1 Processor -- start 2024-02-02T11:48:51.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f466bc0c640 1 -- start start 2024-02-02T11:48:51.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f466bc0c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4650003980 0x7f46640bbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:51.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f466bc0c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46641e5e10 0x7f46640b7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:51.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f466bc0c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46640bc280 0x7f46640bc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:51.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f466bc0c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46640b7760 con 0x7f4650003980 2024-02-02T11:48:51.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f466bc0c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46640ba260 con 0x7f46640bc280 2024-02-02T11:48:51.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f466bc0c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46640bb720 con 0x7f46641e5e10 2024-02-02T11:48:51.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f46699a8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4650003980 0x7f46640bbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:51.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f46699a8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4650003980 0x7f46640bbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52864/0 (socket says 172.21.15.161:52864) 2024-02-02T11:48:51.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f46699a8640 1 -- 172.21.15.161:0/2232664250 learned_addr learned my addr 172.21.15.161:0/2232664250 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:51.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f46691a7640 1 --2- 172.21.15.161:0/2232664250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46641e5e10 0x7f46640b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:51.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f466a1a9640 1 --2- 172.21.15.161:0/2232664250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46640bc280 0x7f46640bc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:51.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f46699a8640 1 -- 172.21.15.161:0/2232664250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46641e5e10 msgr2=0x7f46640b7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:51.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f46699a8640 1 --2- 172.21.15.161:0/2232664250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46641e5e10 0x7f46640b7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:51.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f46699a8640 1 -- 172.21.15.161:0/2232664250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46640bc280 msgr2=0x7f46640bc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:51.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f46699a8640 1 --2- 172.21.15.161:0/2232664250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46640bc280 0x7f46640bc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:51.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f46699a8640 1 -- 172.21.15.161:0/2232664250 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46641e6250 con 0x7f4650003980 2024-02-02T11:48:51.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f46699a8640 1 --2- 172.21.15.161:0/2232664250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4650003980 0x7f46640bbbb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4660001940 tx=0x7f4650005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:51.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f465a7fc640 1 -- 172.21.15.161:0/2232664250 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46600a5d70 con 0x7f4650003980 2024-02-02T11:48:51.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f465a7fc640 1 -- 172.21.15.161:0/2232664250 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46600047f0 con 0x7f4650003980 2024-02-02T11:48:51.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f466bc0c640 1 -- 172.21.15.161:0/2232664250 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46640b9f80 con 0x7f4650003980 2024-02-02T11:48:51.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.612+0000 7f465a7fc640 1 -- 172.21.15.161:0/2232664250 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660004b80 con 0x7f4650003980 2024-02-02T11:48:51.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.616+0000 7f466bc0c640 1 -- 172.21.15.161:0/2232664250 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466406ff70 con 0x7f4650003980 2024-02-02T11:48:51.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.616+0000 7f466bc0c640 1 -- 172.21.15.161:0/2232664250 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46640bb210 con 0x7f4650003980 2024-02-02T11:48:51.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.616+0000 7f465a7fc640 1 -- 172.21.15.161:0/2232664250 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4660004ce0 con 0x7f4650003980 2024-02-02T11:48:51.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.616+0000 7f465a7fc640 1 --2- 172.21.15.161:0/2232664250 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4648065a60 0x7f4648067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:51.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.616+0000 7f465a7fc640 1 -- 172.21.15.161:0/2232664250 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f466011c9b0 con 0x7f4650003980 2024-02-02T11:48:51.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.616+0000 7f46691a7640 1 --2- 172.21.15.161:0/2232664250 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4648065a60 0x7f4648067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:51.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.616+0000 7f46691a7640 1 --2- 172.21.15.161:0/2232664250 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4648065a60 0x7f4648067f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f46640b7b50 tx=0x7f4654008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:51.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.620+0000 7f465a7fc640 1 -- 172.21.15.161:0/2232664250 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f46640bb210 con 0x7f4650003980 2024-02-02T11:48:51.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.808+0000 7f466bc0c640 1 -- 172.21.15.161:0/2232664250 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f46640bb210 con 0x7f4650003980 2024-02-02T11:48:51.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.820+0000 7f465a7fc640 1 -- 172.21.15.161:0/2232664250 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f46640bb210 con 0x7f4650003980 2024-02-02T11:48:51.822 INFO:teuthology.orchestra.run.smithi161.stderr:new fs with metadata pool 2 and data pool 3 2024-02-02T11:48:51.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.824+0000 7f466bc0c640 1 -- 172.21.15.161:0/2232664250 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4648065a60 msgr2=0x7f4648067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:51.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.824+0000 7f466bc0c640 1 --2- 172.21.15.161:0/2232664250 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4648065a60 0x7f4648067f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f46640b7b50 tx=0x7f4654008040 comp rx=0 tx=0).stop 2024-02-02T11:48:51.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.824+0000 7f466bc0c640 1 -- 172.21.15.161:0/2232664250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4650003980 msgr2=0x7f46640bbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:51.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.824+0000 7f466bc0c640 1 --2- 172.21.15.161:0/2232664250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4650003980 0x7f46640bbbb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4660001940 tx=0x7f4650005800 comp rx=0 tx=0).stop 2024-02-02T11:48:51.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.824+0000 7f466bc0c640 1 -- 172.21.15.161:0/2232664250 shutdown_connections 2024-02-02T11:48:51.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.824+0000 7f466bc0c640 1 --2- 172.21.15.161:0/2232664250 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4648065a60 0x7f4648067f20 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f46640b7b50 tx=0x7f4654008040 comp rx=0 tx=0).stop 2024-02-02T11:48:51.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.824+0000 7f466bc0c640 1 --2- 172.21.15.161:0/2232664250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46640bc280 0x7f46640bc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:51.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.824+0000 7f466bc0c640 1 --2- 172.21.15.161:0/2232664250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46641e5e10 0x7f46640b7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:51.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.824+0000 7f466bc0c640 1 --2- 172.21.15.161:0/2232664250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4650003980 0x7f46640bbbb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:51.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.824+0000 7f466bc0c640 1 -- 172.21.15.161:0/2232664250 >> 172.21.15.161:0/2232664250 conn(0x7f466406a120 msgr2=0x7f46641404f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:51.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.828+0000 7f466bc0c640 1 -- 172.21.15.161:0/2232664250 shutdown_connections 2024-02-02T11:48:51.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.828+0000 7f466bc0c640 1 -- 172.21.15.161:0/2232664250 wait complete. 2024-02-02T11:48:51.856 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:48:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.964+0000 7f83ff2c8640 1 Processor -- start 2024-02-02T11:48:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.964+0000 7f83ff2c8640 1 -- start start 2024-02-02T11:48:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.964+0000 7f83ff2c8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f83f80bc340 0x7f83f8142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.964+0000 7f83ff2c8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f83f8142d50 0x7f83f8148d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.964+0000 7f83ff2c8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f8071770 con 0x7f83f81492a0 2024-02-02T11:48:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.964+0000 7f83ff2c8640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f81496d0 con 0x7f83f8142d50 2024-02-02T11:48:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.964+0000 7f83ff2c8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f80b37e0 con 0x7f83f80bc340 2024-02-02T11:48:51.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.964+0000 7f83fd865640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f83f81492a0 0x7f83f80b53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50820/0 (socket says 172.21.15.161:50820) 2024-02-02T11:48:51.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.964+0000 7f83fd865640 1 -- 172.21.15.161:0/2960456659 learned_addr learned my addr 172.21.15.161:0/2960456659 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:48:51.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.964+0000 7f83fc863640 1 --2- 172.21.15.161:0/2960456659 >> v2:172.21.15.161:3300/0 conn(0x7f83f8142d50 0x7f83f8148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.968+0000 7f83effff640 1 -- 172.21.15.161:0/2960456659 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767029536 0 0) 0x7f83f8071770 con 0x7f83f81492a0 2024-02-02T11:48:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.968+0000 7f83fd064640 1 --2- 172.21.15.161:0/2960456659 >> v2:172.21.15.162:3300/0 conn(0x7f83f80bc340 0x7f83f8142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.968+0000 7f83effff640 1 -- 172.21.15.161:0/2960456659 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83e4003530 con 0x7f83f81492a0 2024-02-02T11:48:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.968+0000 7f83fc863640 1 -- 172.21.15.161:0/2960456659 >> v2:172.21.15.162:3300/0 conn(0x7f83f80bc340 msgr2=0x7f83f8142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.968+0000 7f83fc863640 1 --2- 172.21.15.161:0/2960456659 >> v2:172.21.15.162:3300/0 conn(0x7f83f80bc340 0x7f83f8142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.968+0000 7f83fc863640 1 -- 172.21.15.161:0/2960456659 >> v1:172.21.15.161:6789/0 conn(0x7f83f81492a0 legacy=0x7f83f80b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.968+0000 7f83fc863640 1 -- 172.21.15.161:0/2960456659 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f80b3ac0 con 0x7f83f8142d50 2024-02-02T11:48:51.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.968+0000 7f83fc863640 1 --2- 172.21.15.161:0/2960456659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f8142d50 0x7f83f8148d60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f83f806d110 tx=0x7f83f401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435c729fc7620c4c server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:51.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.968+0000 7f83effff640 1 -- 172.21.15.161:0/2960456659 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f40a8950 con 0x7f83f8142d50 2024-02-02T11:48:51.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.968+0000 7f83effff640 1 -- 172.21.15.161:0/2960456659 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f40a8ab0 con 0x7f83f8142d50 2024-02-02T11:48:51.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.968+0000 7f83effff640 1 -- 172.21.15.161:0/2960456659 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f40a8e40 con 0x7f83f8142d50 2024-02-02T11:48:51.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.968+0000 7f83ff2c8640 1 -- 172.21.15.161:0/2960456659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f8142d50 msgr2=0x7f83f8148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:51.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.968+0000 7f83ff2c8640 1 --2- 172.21.15.161:0/2960456659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f8142d50 0x7f83f8148d60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f83f806d110 tx=0x7f83f401ec50 comp rx=0 tx=0).stop 2024-02-02T11:48:51.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.968+0000 7f83ff2c8640 1 -- 172.21.15.161:0/2960456659 shutdown_connections 2024-02-02T11:48:51.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.968+0000 7f83ff2c8640 1 --2- 172.21.15.161:0/2960456659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f8142d50 0x7f83f8148d60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:51.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.968+0000 7f83ff2c8640 1 --2- 172.21.15.161:0/2960456659 >> v2:172.21.15.162:3300/0 conn(0x7f83f80bc340 0x7f83f8142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:51.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.968+0000 7f83ff2c8640 1 -- 172.21.15.161:0/2960456659 >> 172.21.15.161:0/2960456659 conn(0x7f83f8069ef0 msgr2=0x7f83f806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:51.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.968+0000 7f83ff2c8640 1 -- 172.21.15.161:0/2960456659 shutdown_connections 2024-02-02T11:48:51.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.968+0000 7f83ff2c8640 1 -- 172.21.15.161:0/2960456659 wait complete. 2024-02-02T11:48:51.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83ff2c8640 1 Processor -- start 2024-02-02T11:48:51.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83ff2c8640 1 -- start start 2024-02-02T11:48:51.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83ff2c8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83f80bc340 0x7f83f81e1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:51.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83ff2c8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f81492a0 0x7f83f81de000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:51.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83ff2c8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83f80b8990 0x7f83f81cf880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83ff2c8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f81d0f20 con 0x7f83f81492a0 2024-02-02T11:48:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83ff2c8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f813dec0 con 0x7f83f80bc340 2024-02-02T11:48:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83ff2c8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f81d4880 con 0x7f83f80b8990 2024-02-02T11:48:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83fc863640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f81492a0 0x7f83f81de000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83fc863640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f81492a0 0x7f83f81de000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52874/0 (socket says 172.21.15.161:52874) 2024-02-02T11:48:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83fc863640 1 -- 172.21.15.161:0/786447015 learned_addr learned my addr 172.21.15.161:0/786447015 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83fd064640 1 --2- 172.21.15.161:0/786447015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83f80bc340 0x7f83f81e1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83fd865640 1 --2- 172.21.15.161:0/786447015 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83f80b8990 0x7f83f81cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83fc863640 1 -- 172.21.15.161:0/786447015 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83f80b8990 msgr2=0x7f83f81cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83fc863640 1 --2- 172.21.15.161:0/786447015 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83f80b8990 0x7f83f81cf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83fc863640 1 -- 172.21.15.161:0/786447015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83f80bc340 msgr2=0x7f83f81e1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83fc863640 1 --2- 172.21.15.161:0/786447015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83f80bc340 0x7f83f81e1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83fc863640 1 -- 172.21.15.161:0/786447015 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4009420 con 0x7f83f81492a0 2024-02-02T11:48:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83fc863640 1 --2- 172.21.15.161:0/786447015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f81492a0 0x7f83f81de000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f83f40b3040 tx=0x7f83f401b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:51.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83edffb640 1 -- 172.21.15.161:0/786447015 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f40b0dd0 con 0x7f83f81492a0 2024-02-02T11:48:51.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83edffb640 1 -- 172.21.15.161:0/786447015 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f40b9430 con 0x7f83f81492a0 2024-02-02T11:48:51.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83ff2c8640 1 -- 172.21.15.161:0/786447015 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f81d1400 con 0x7f83f81492a0 2024-02-02T11:48:51.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83edffb640 1 -- 172.21.15.161:0/786447015 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f40b97e0 con 0x7f83f81492a0 2024-02-02T11:48:51.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83ff2c8640 1 -- 172.21.15.161:0/786447015 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f81e1500 con 0x7f83f81492a0 2024-02-02T11:48:51.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83ff2c8640 1 -- 172.21.15.161:0/786447015 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f804e000 con 0x7f83f81492a0 2024-02-02T11:48:51.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.972+0000 7f83edffb640 1 -- 172.21.15.161:0/786447015 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f83f40b7040 con 0x7f83f81492a0 2024-02-02T11:48:51.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.976+0000 7f83edffb640 1 --2- 172.21.15.161:0/786447015 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f83dc065a60 0x7f83dc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:51.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.976+0000 7f83fd064640 1 --2- 172.21.15.161:0/786447015 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f83dc065a60 0x7f83dc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:51.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.976+0000 7f83edffb640 1 -- 172.21.15.161:0/786447015 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83f4120d70 con 0x7f83f81492a0 2024-02-02T11:48:51.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.976+0000 7f83fd064640 1 --2- 172.21.15.161:0/786447015 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f83dc065a60 0x7f83dc067f20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f83e800b930 tx=0x7f83e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:51.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:51.980+0000 7f83edffb640 1 -- 172.21.15.161:0/786447015 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f83f40ee730 con 0x7f83f81492a0 2024-02-02T11:48:52.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.136+0000 7f83ff2c8640 1 -- 172.21.15.161:0/786447015 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83f8146170 con 0x7f83f81492a0 2024-02-02T11:48:52.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.136+0000 7f83edffb640 1 -- 172.21.15.161:0/786447015 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16098 (secure 0 0 0) 0x7f83f40f1d50 con 0x7f83f81492a0 2024-02-02T11:48:52.139 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:48:52.139 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":19,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:51.812421+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:48:50.155565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-02T11:48:50.795158+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:48:52.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.140+0000 7f83ff2c8640 1 -- 172.21.15.161:0/786447015 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f83dc065a60 msgr2=0x7f83dc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:52.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.140+0000 7f83ff2c8640 1 --2- 172.21.15.161:0/786447015 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f83dc065a60 0x7f83dc067f20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f83e800b930 tx=0x7f83e8008040 comp rx=0 tx=0).stop 2024-02-02T11:48:52.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.140+0000 7f83ff2c8640 1 -- 172.21.15.161:0/786447015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f81492a0 msgr2=0x7f83f81de000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:52.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.140+0000 7f83ff2c8640 1 --2- 172.21.15.161:0/786447015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f81492a0 0x7f83f81de000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f83f40b3040 tx=0x7f83f401b9f0 comp rx=0 tx=0).stop 2024-02-02T11:48:52.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.140+0000 7f83ff2c8640 1 -- 172.21.15.161:0/786447015 shutdown_connections 2024-02-02T11:48:52.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.140+0000 7f83ff2c8640 1 --2- 172.21.15.161:0/786447015 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f83dc065a60 0x7f83dc067f20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:52.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.140+0000 7f83ff2c8640 1 --2- 172.21.15.161:0/786447015 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83f80b8990 0x7f83f81cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:52.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.140+0000 7f83ff2c8640 1 --2- 172.21.15.161:0/786447015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83f81492a0 0x7f83f81de000 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:52.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.140+0000 7f83ff2c8640 1 --2- 172.21.15.161:0/786447015 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83f80bc340 0x7f83f81e1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:52.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.140+0000 7f83ff2c8640 1 -- 172.21.15.161:0/786447015 >> 172.21.15.161:0/786447015 conn(0x7f83f8069ef0 msgr2=0x7f83f80bab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:52.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.140+0000 7f83ff2c8640 1 -- 172.21.15.161:0/786447015 shutdown_connections 2024-02-02T11:48:52.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.140+0000 7f83ff2c8640 1 -- 172.21.15.161:0/786447015 wait complete. 2024-02-02T11:48:52.158 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:48:52.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f91083a5640 1 Processor -- start 2024-02-02T11:48:52.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f91083a5640 1 -- start start 2024-02-02T11:48:52.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f91083a5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9100141b70 0x7f9100070db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:52.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f91083a5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f910006a840 0x7f9100147940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:52.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f91083a5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9100071e60 con 0x7f910006ac80 2024-02-02T11:48:52.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f91083a5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91000723a0 con 0x7f910006a840 2024-02-02T11:48:52.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f91083a5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9100071510 con 0x7f9100141b70 2024-02-02T11:48:52.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f9105940640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f910006a840 0x7f9100147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:52.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f9106942640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f910006ac80 0x7f910014ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50832/0 (socket says 172.21.15.161:50832) 2024-02-02T11:48:52.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f9106942640 1 -- 172.21.15.161:0/2336708795 learned_addr learned my addr 172.21.15.161:0/2336708795 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:48:52.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f9106141640 1 --2- 172.21.15.161:0/2336708795 >> v2:172.21.15.162:3300/0 conn(0x7f9100141b70 0x7f9100070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:52.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f9105940640 1 -- 172.21.15.161:0/2336708795 >> v2:172.21.15.162:3300/0 conn(0x7f9100141b70 msgr2=0x7f9100070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:52.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f9105940640 1 --2- 172.21.15.161:0/2336708795 >> v2:172.21.15.162:3300/0 conn(0x7f9100141b70 0x7f9100070db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:52.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f9105940640 1 -- 172.21.15.161:0/2336708795 >> v1:172.21.15.161:6789/0 conn(0x7f910006ac80 legacy=0x7f910014ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:52.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f9105940640 1 -- 172.21.15.161:0/2336708795 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9100071850 con 0x7f910006a840 2024-02-02T11:48:52.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f910513f640 1 -- 172.21.15.161:0/2336708795 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582204540 0 0) 0x7f9100071e60 con 0x7f910006ac80 2024-02-02T11:48:52.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f9105940640 1 --2- 172.21.15.161:0/2336708795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f910006a840 0x7f9100147940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f910006bf70 tx=0x7f90f001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb8b216fa88a328 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:52.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f910513f640 1 -- 172.21.15.161:0/2336708795 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f00a8930 con 0x7f910006a840 2024-02-02T11:48:52.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f910513f640 1 -- 172.21.15.161:0/2336708795 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f00a8a90 con 0x7f910006a840 2024-02-02T11:48:52.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.280+0000 7f910513f640 1 -- 172.21.15.161:0/2336708795 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f00a8e20 con 0x7f910006a840 2024-02-02T11:48:52.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f91083a5640 1 -- 172.21.15.161:0/2336708795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f910006a840 msgr2=0x7f9100147940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:52.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f91083a5640 1 --2- 172.21.15.161:0/2336708795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f910006a840 0x7f9100147940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f910006bf70 tx=0x7f90f001ec30 comp rx=0 tx=0).stop 2024-02-02T11:48:52.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f91083a5640 1 -- 172.21.15.161:0/2336708795 shutdown_connections 2024-02-02T11:48:52.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f91083a5640 1 --2- 172.21.15.161:0/2336708795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f910006a840 0x7f9100147940 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:52.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f91083a5640 1 --2- 172.21.15.161:0/2336708795 >> v2:172.21.15.162:3300/0 conn(0x7f9100141b70 0x7f9100070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:52.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f91083a5640 1 -- 172.21.15.161:0/2336708795 >> 172.21.15.161:0/2336708795 conn(0x7f9100069d20 msgr2=0x7f910006a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:52.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f91083a5640 1 -- 172.21.15.161:0/2336708795 shutdown_connections 2024-02-02T11:48:52.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f91083a5640 1 -- 172.21.15.161:0/2336708795 wait complete. 2024-02-02T11:48:52.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f91083a5640 1 Processor -- start 2024-02-02T11:48:52.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f91083a5640 1 -- start start 2024-02-02T11:48:52.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f91083a5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f910006a840 0x7f91000b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:52.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f91083a5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f910006ac80 0x7f91000a8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:52.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f91083a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9100141b70 0x7f91000a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:52.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f91083a5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91000a9cf0 con 0x7f910006ac80 2024-02-02T11:48:52.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f91083a5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91000b3870 con 0x7f9100141b70 2024-02-02T11:48:52.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f91083a5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91000a76c0 con 0x7f910006a840 2024-02-02T11:48:52.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f9105940640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f910006ac80 0x7f91000a8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:52.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f9105940640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f910006ac80 0x7f91000a8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52902/0 (socket says 172.21.15.161:52902) 2024-02-02T11:48:52.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f9105940640 1 -- 172.21.15.161:0/4199752195 learned_addr learned my addr 172.21.15.161:0/4199752195 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:52.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f9106942640 1 --2- 172.21.15.161:0/4199752195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9100141b70 0x7f91000a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:52.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f9106141640 1 --2- 172.21.15.161:0/4199752195 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f910006a840 0x7f91000b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:52.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f9105940640 1 -- 172.21.15.161:0/4199752195 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f910006a840 msgr2=0x7f91000b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:52.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f9105940640 1 --2- 172.21.15.161:0/4199752195 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f910006a840 0x7f91000b3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:52.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f9105940640 1 -- 172.21.15.161:0/4199752195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9100141b70 msgr2=0x7f91000a8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:52.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f9105940640 1 --2- 172.21.15.161:0/4199752195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9100141b70 0x7f91000a8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:52.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f9105940640 1 -- 172.21.15.161:0/4199752195 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f0009420 con 0x7f910006ac80 2024-02-02T11:48:52.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f9106942640 1 --2- 172.21.15.161:0/4199752195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9100141b70 0x7f91000a8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:48:52.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f9105940640 1 --2- 172.21.15.161:0/4199752195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f910006ac80 0x7f91000a8160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f90f001b840 tx=0x7f90f001b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:52.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f90f6ffd640 1 -- 172.21.15.161:0/4199752195 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f00a8930 con 0x7f910006ac80 2024-02-02T11:48:52.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f90f6ffd640 1 -- 172.21.15.161:0/4199752195 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f00b9410 con 0x7f910006ac80 2024-02-02T11:48:52.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f91083a5640 1 -- 172.21.15.161:0/4199752195 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91000a7960 con 0x7f910006ac80 2024-02-02T11:48:52.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f90f6ffd640 1 -- 172.21.15.161:0/4199752195 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f00b97a0 con 0x7f910006ac80 2024-02-02T11:48:52.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.284+0000 7f91083a5640 1 -- 172.21.15.161:0/4199752195 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9100148420 con 0x7f910006ac80 2024-02-02T11:48:52.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.288+0000 7f91083a5640 1 -- 172.21.15.161:0/4199752195 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91000a7520 con 0x7f910006ac80 2024-02-02T11:48:52.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.288+0000 7f90f6ffd640 1 -- 172.21.15.161:0/4199752195 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f90f00b7040 con 0x7f910006ac80 2024-02-02T11:48:52.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.288+0000 7f90f6ffd640 1 --2- 172.21.15.161:0/4199752195 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f90e4065a60 0x7f90e4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:52.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.288+0000 7f9106141640 1 --2- 172.21.15.161:0/4199752195 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f90e4065a60 0x7f90e4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:52.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.288+0000 7f90f6ffd640 1 -- 172.21.15.161:0/4199752195 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90f0120d80 con 0x7f910006ac80 2024-02-02T11:48:52.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.288+0000 7f9106141640 1 --2- 172.21.15.161:0/4199752195 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f90e4065a60 0x7f90e4067f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0096f0 tx=0x7f90fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:52.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.292+0000 7f90f6ffd640 1 -- 172.21.15.161:0/4199752195 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f91000a7520 con 0x7f910006ac80 2024-02-02T11:48:52.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.448+0000 7f91083a5640 1 -- 172.21.15.161:0/4199752195 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91000a7e80 con 0x7f910006ac80 2024-02-02T11:48:52.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.452+0000 7f90f6ffd640 1 -- 172.21.15.161:0/4199752195 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16098 (secure 0 0 0) 0x7f91000a7e80 con 0x7f910006ac80 2024-02-02T11:48:52.454 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:48:52.454 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":19,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:51.812421+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:48:50.155565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-02T11:48:50.795158+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:48:52.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.452+0000 7f91083a5640 1 -- 172.21.15.161:0/4199752195 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f90e4065a60 msgr2=0x7f90e4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:52.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.452+0000 7f91083a5640 1 --2- 172.21.15.161:0/4199752195 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f90e4065a60 0x7f90e4067f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0096f0 tx=0x7f90fc008040 comp rx=0 tx=0).stop 2024-02-02T11:48:52.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.452+0000 7f91083a5640 1 -- 172.21.15.161:0/4199752195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f910006ac80 msgr2=0x7f91000a8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:52.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.452+0000 7f91083a5640 1 --2- 172.21.15.161:0/4199752195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f910006ac80 0x7f91000a8160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f90f001b840 tx=0x7f90f001b9d0 comp rx=0 tx=0).stop 2024-02-02T11:48:52.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.452+0000 7f91083a5640 1 -- 172.21.15.161:0/4199752195 shutdown_connections 2024-02-02T11:48:52.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.452+0000 7f91083a5640 1 --2- 172.21.15.161:0/4199752195 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f90e4065a60 0x7f90e4067f20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:52.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.452+0000 7f91083a5640 1 --2- 172.21.15.161:0/4199752195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9100141b70 0x7f91000a8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:52.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.452+0000 7f91083a5640 1 --2- 172.21.15.161:0/4199752195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f910006ac80 0x7f91000a8160 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:52.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.452+0000 7f91083a5640 1 --2- 172.21.15.161:0/4199752195 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f910006a840 0x7f91000b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:52.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.452+0000 7f91083a5640 1 -- 172.21.15.161:0/4199752195 >> 172.21.15.161:0/4199752195 conn(0x7f9100069d20 msgr2=0x7f910006a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:52.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.452+0000 7f91083a5640 1 -- 172.21.15.161:0/4199752195 shutdown_connections 2024-02-02T11:48:52.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.452+0000 7f91083a5640 1 -- 172.21.15.161:0/4199752195 wait complete. 2024-02-02T11:48:52.473 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-02T11:48:52.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.592+0000 7fb5fb7ca640 1 Processor -- start 2024-02-02T11:48:52.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.592+0000 7fb5fb7ca640 1 -- start start 2024-02-02T11:48:52.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.592+0000 7fb5fb7ca640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb5f4144a80 0x7fb5f414ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:52.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.592+0000 7fb5fb7ca640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f40b6e80 con 0x7fb5f40b8b40 2024-02-02T11:48:52.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.592+0000 7fb5fb7ca640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f40b7160 con 0x7fb5f4144f10 2024-02-02T11:48:52.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.592+0000 7fb5fb7ca640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f40bc6c0 con 0x7fb5f4144a80 2024-02-02T11:48:52.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.592+0000 7fb5f9566640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb5f40b8b40 0x7fb5f40b8f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39940/0 (socket says 172.21.15.161:39940) 2024-02-02T11:48:52.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.592+0000 7fb5f9566640 1 -- 172.21.15.161:0/3241317324 learned_addr learned my addr 172.21.15.161:0/3241317324 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:48:52.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.592+0000 7fb5f8d65640 1 --2- 172.21.15.161:0/3241317324 >> v2:172.21.15.161:3300/0 conn(0x7fb5f4144a80 0x7fb5f414ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:52.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.592+0000 7fb5e7fff640 1 -- 172.21.15.161:0/3241317324 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680196361 0 0) 0x7fb5f40b6e80 con 0x7fb5f40b8b40 2024-02-02T11:48:52.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.592+0000 7fb5e7fff640 1 -- 172.21.15.161:0/3241317324 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5e0003530 con 0x7fb5f40b8b40 2024-02-02T11:48:52.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.592+0000 7fb5f8d65640 1 -- 172.21.15.161:0/3241317324 >> v1:172.21.15.162:6789/0 conn(0x7fb5f4144f10 legacy=0x7fb5f41552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:52.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.592+0000 7fb5f8d65640 1 -- 172.21.15.161:0/3241317324 >> v1:172.21.15.161:6789/0 conn(0x7fb5f40b8b40 legacy=0x7fb5f40b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:52.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.592+0000 7fb5f8d65640 1 -- 172.21.15.161:0/3241317324 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f40bc9a0 con 0x7fb5f4144a80 2024-02-02T11:48:52.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5f8d65640 1 --2- 172.21.15.161:0/3241317324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f4144a80 0x7fb5f414ac60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80097c0 tx=0x7fb5e801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a900ad5932e96145 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:52.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5e7fff640 1 -- 172.21.15.161:0/3241317324 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e80a8930 con 0x7fb5f4144a80 2024-02-02T11:48:52.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5e7fff640 1 -- 172.21.15.161:0/3241317324 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e80a8a90 con 0x7fb5f4144a80 2024-02-02T11:48:52.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5e7fff640 1 -- 172.21.15.161:0/3241317324 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e80a8e20 con 0x7fb5f4144a80 2024-02-02T11:48:52.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5fb7ca640 1 -- 172.21.15.161:0/3241317324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f4144a80 msgr2=0x7fb5f414ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:52.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5fb7ca640 1 --2- 172.21.15.161:0/3241317324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f4144a80 0x7fb5f414ac60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80097c0 tx=0x7fb5e801ec30 comp rx=0 tx=0).stop 2024-02-02T11:48:52.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5fb7ca640 1 -- 172.21.15.161:0/3241317324 shutdown_connections 2024-02-02T11:48:52.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5fb7ca640 1 --2- 172.21.15.161:0/3241317324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f4144a80 0x7fb5f414ac60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:52.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5fb7ca640 1 -- 172.21.15.161:0/3241317324 >> 172.21.15.161:0/3241317324 conn(0x7fb5f40c02f0 msgr2=0x7fb5f40c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:52.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5fb7ca640 1 -- 172.21.15.161:0/3241317324 shutdown_connections 2024-02-02T11:48:52.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5fb7ca640 1 -- 172.21.15.161:0/3241317324 wait complete. 2024-02-02T11:48:52.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5fb7ca640 1 Processor -- start 2024-02-02T11:48:52.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5fb7ca640 1 -- start start 2024-02-02T11:48:52.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5fb7ca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f40b8b40 0x7fb5f41d4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:52.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5fb7ca640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5f4144a80 0x7fb5f41d46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:52.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5fb7ca640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5f4144f10 0x7fb5f41dfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:52.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5fb7ca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f41d2aa0 con 0x7fb5f40b8b40 2024-02-02T11:48:52.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5fb7ca640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f41d3770 con 0x7fb5f4144f10 2024-02-02T11:48:52.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5fb7ca640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f41d0b60 con 0x7fb5f4144a80 2024-02-02T11:48:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5f9566640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f40b8b40 0x7fb5f41d4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5f9566640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f40b8b40 0x7fb5f41d4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36436/0 (socket says 172.21.15.161:36436) 2024-02-02T11:48:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5f9566640 1 -- 172.21.15.161:0/1916672825 learned_addr learned my addr 172.21.15.161:0/1916672825 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5f9d67640 1 --2- 172.21.15.161:0/1916672825 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5f4144f10 0x7fb5f41dfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5f8d65640 1 --2- 172.21.15.161:0/1916672825 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5f4144a80 0x7fb5f41d46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5f9566640 1 -- 172.21.15.161:0/1916672825 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5f4144a80 msgr2=0x7fb5f41d46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5f9566640 1 --2- 172.21.15.161:0/1916672825 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5f4144a80 0x7fb5f41d46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5f9566640 1 -- 172.21.15.161:0/1916672825 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5f4144f10 msgr2=0x7fb5f41dfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5f9566640 1 --2- 172.21.15.161:0/1916672825 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5f4144f10 0x7fb5f41dfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.596+0000 7fb5f9566640 1 -- 172.21.15.161:0/1916672825 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e8009420 con 0x7fb5f40b8b40 2024-02-02T11:48:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.600+0000 7fb5f9566640 1 --2- 172.21.15.161:0/1916672825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f40b8b40 0x7fb5f41d4160 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000c4d0 tx=0x7fb5f000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.600+0000 7fb5e5ffb640 1 -- 172.21.15.161:0/1916672825 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0005cf0 con 0x7fb5f40b8b40 2024-02-02T11:48:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.600+0000 7fb5e5ffb640 1 -- 172.21.15.161:0/1916672825 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f0005e50 con 0x7fb5f40b8b40 2024-02-02T11:48:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.600+0000 7fb5fb7ca640 1 -- 172.21.15.161:0/1916672825 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f41d0e00 con 0x7fb5f40b8b40 2024-02-02T11:48:52.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.600+0000 7fb5e5ffb640 1 -- 172.21.15.161:0/1916672825 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0007270 con 0x7fb5f40b8b40 2024-02-02T11:48:52.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.600+0000 7fb5fb7ca640 1 -- 172.21.15.161:0/1916672825 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f41d13c0 con 0x7fb5f40b8b40 2024-02-02T11:48:52.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.600+0000 7fb5fb7ca640 1 -- 172.21.15.161:0/1916672825 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f404e000 con 0x7fb5f40b8b40 2024-02-02T11:48:52.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.600+0000 7fb5e5ffb640 1 -- 172.21.15.161:0/1916672825 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb5f00073d0 con 0x7fb5f40b8b40 2024-02-02T11:48:52.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.600+0000 7fb5e5ffb640 1 --2- 172.21.15.161:0/1916672825 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb5d8065a60 0x7fb5d8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:52.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.600+0000 7fb5e5ffb640 1 -- 172.21.15.161:0/1916672825 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5f0082aa0 con 0x7fb5f40b8b40 2024-02-02T11:48:52.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.600+0000 7fb5f8d65640 1 --2- 172.21.15.161:0/1916672825 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb5d8065a60 0x7fb5d8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:52.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.600+0000 7fb5f8d65640 1 --2- 172.21.15.161:0/1916672825 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb5d8065a60 0x7fb5d8067f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80b2000 tx=0x7fb5e80aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:52.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.604+0000 7fb5e5ffb640 1 -- 172.21.15.161:0/1916672825 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb5f00505f0 con 0x7fb5f40b8b40 2024-02-02T11:48:52.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:52.792+0000 7fb5fb7ca640 1 -- 172.21.15.161:0/1916672825 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb5f40b6990 con 0x7fb5f40b8b40 2024-02-02T11:48:53.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.484+0000 7fb5e5ffb640 1 -- 172.21.15.161:0/1916672825 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb5f0053c10 con 0x7fb5f40b8b40 2024-02-02T11:48:53.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.488+0000 7fb5fb7ca640 1 -- 172.21.15.161:0/1916672825 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb5d8065a60 msgr2=0x7fb5d8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:53.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.488+0000 7fb5fb7ca640 1 --2- 172.21.15.161:0/1916672825 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb5d8065a60 0x7fb5d8067f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80b2000 tx=0x7fb5e80aa070 comp rx=0 tx=0).stop 2024-02-02T11:48:53.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.488+0000 7fb5fb7ca640 1 -- 172.21.15.161:0/1916672825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f40b8b40 msgr2=0x7fb5f41d4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:53.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.488+0000 7fb5fb7ca640 1 --2- 172.21.15.161:0/1916672825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f40b8b40 0x7fb5f41d4160 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000c4d0 tx=0x7fb5f000c990 comp rx=0 tx=0).stop 2024-02-02T11:48:53.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.488+0000 7fb5fb7ca640 1 -- 172.21.15.161:0/1916672825 shutdown_connections 2024-02-02T11:48:53.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.488+0000 7fb5fb7ca640 1 --2- 172.21.15.161:0/1916672825 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb5d8065a60 0x7fb5d8067f20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:53.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.488+0000 7fb5fb7ca640 1 --2- 172.21.15.161:0/1916672825 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5f4144f10 0x7fb5f41dfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:53.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.488+0000 7fb5fb7ca640 1 --2- 172.21.15.161:0/1916672825 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5f4144a80 0x7fb5f41d46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:53.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.488+0000 7fb5fb7ca640 1 --2- 172.21.15.161:0/1916672825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f40b8b40 0x7fb5f41d4160 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:53.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.488+0000 7fb5fb7ca640 1 -- 172.21.15.161:0/1916672825 >> 172.21.15.161:0/1916672825 conn(0x7fb5f40c02f0 msgr2=0x7fb5f40bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:53.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.488+0000 7fb5fb7ca640 1 -- 172.21.15.161:0/1916672825 shutdown_connections 2024-02-02T11:48:53.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.488+0000 7fb5fb7ca640 1 -- 172.21.15.161:0/1916672825 wait complete. 2024-02-02T11:48:53.510 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-02-02T11:48:53.510 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-02T11:48:53.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.632+0000 7f2ae8376640 1 Processor -- start 2024-02-02T11:48:53.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.632+0000 7f2ae8376640 1 -- start start 2024-02-02T11:48:53.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.632+0000 7f2ae8376640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2ae006f520 0x7f2ae0071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:53.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.632+0000 7f2ae8376640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae0147c20 0x7f2ae0148090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:53.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.632+0000 7f2ae8376640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae00b8350 con 0x7f2ae006af90 2024-02-02T11:48:53.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.632+0000 7f2ae8376640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae00b8170 con 0x7f2ae006f520 2024-02-02T11:48:53.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.632+0000 7f2ae8376640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae00b0020 con 0x7f2ae0147c20 2024-02-02T11:48:53.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.632+0000 7f2ae5911640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2ae006f520 0x7f2ae0071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.632+0000 7f2ae5911640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2ae006f520 0x7f2ae0071dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36450/0 (socket says 172.21.15.161:36450) 2024-02-02T11:48:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.632+0000 7f2ae5911640 1 -- 172.21.15.161:0/1975158671 learned_addr learned my addr 172.21.15.161:0/1975158671 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.632+0000 7f2ae6913640 1 --2- 172.21.15.161:0/1975158671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae0147c20 0x7f2ae0148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.632+0000 7f2ae5911640 1 -- 172.21.15.161:0/1975158671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae0147c20 msgr2=0x7f2ae0148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.632+0000 7f2ae5911640 1 --2- 172.21.15.161:0/1975158671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae0147c20 0x7f2ae0148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.632+0000 7f2ae5911640 1 -- 172.21.15.161:0/1975158671 >> v1:172.21.15.162:6789/0 conn(0x7f2ae006af90 legacy=0x7f2ae0070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.632+0000 7f2ae5911640 1 -- 172.21.15.161:0/1975158671 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae00afd40 con 0x7f2ae006f520 2024-02-02T11:48:53.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.632+0000 7f2ae5911640 1 --2- 172.21.15.161:0/1975158671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae006f520 0x7f2ae0071dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009870 tx=0x7f2ad001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12fc2fa28970d34 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae5110640 1 -- 172.21.15.161:0/1975158671 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad00ab650 con 0x7f2ae006f520 2024-02-02T11:48:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae5110640 1 -- 172.21.15.161:0/1975158671 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad00ab7b0 con 0x7f2ae006f520 2024-02-02T11:48:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae5110640 1 -- 172.21.15.161:0/1975158671 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad00abb40 con 0x7f2ae006f520 2024-02-02T11:48:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae8376640 1 -- 172.21.15.161:0/1975158671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae006f520 msgr2=0x7f2ae0071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae8376640 1 --2- 172.21.15.161:0/1975158671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae006f520 0x7f2ae0071dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009870 tx=0x7f2ad001c540 comp rx=0 tx=0).stop 2024-02-02T11:48:53.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae8376640 1 -- 172.21.15.161:0/1975158671 shutdown_connections 2024-02-02T11:48:53.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae8376640 1 --2- 172.21.15.161:0/1975158671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae0147c20 0x7f2ae0148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:53.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae8376640 1 --2- 172.21.15.161:0/1975158671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae006f520 0x7f2ae0071dd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:53.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae8376640 1 -- 172.21.15.161:0/1975158671 >> 172.21.15.161:0/1975158671 conn(0x7f2ae00b9140 msgr2=0x7f2ae00b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:53.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae8376640 1 -- 172.21.15.161:0/1975158671 shutdown_connections 2024-02-02T11:48:53.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae8376640 1 -- 172.21.15.161:0/1975158671 wait complete. 2024-02-02T11:48:53.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae8376640 1 Processor -- start 2024-02-02T11:48:53.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae8376640 1 -- start start 2024-02-02T11:48:53.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae8376640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae006af90 0x7f2ae013f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:53.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae8376640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ae006f520 0x7f2ae00b2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:53.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae8376640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae0147c20 0x7f2ae00b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae8376640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae00afb60 con 0x7f2ae0147c20 2024-02-02T11:48:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae8376640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae013fc10 con 0x7f2ae006f520 2024-02-02T11:48:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae8376640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae01e6950 con 0x7f2ae006af90 2024-02-02T11:48:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae6913640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae0147c20 0x7f2ae00b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae6913640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae0147c20 0x7f2ae00b2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36464/0 (socket says 172.21.15.161:36464) 2024-02-02T11:48:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae6913640 1 -- 172.21.15.161:0/877878696 learned_addr learned my addr 172.21.15.161:0/877878696 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae6112640 1 --2- 172.21.15.161:0/877878696 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae006af90 0x7f2ae013f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae5911640 1 --2- 172.21.15.161:0/877878696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ae006f520 0x7f2ae00b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae6913640 1 -- 172.21.15.161:0/877878696 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae006af90 msgr2=0x7f2ae013f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae6913640 1 --2- 172.21.15.161:0/877878696 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae006af90 0x7f2ae013f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae6913640 1 -- 172.21.15.161:0/877878696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ae006f520 msgr2=0x7f2ae00b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae6913640 1 --2- 172.21.15.161:0/877878696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ae006f520 0x7f2ae00b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae6913640 1 -- 172.21.15.161:0/877878696 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad00094d0 con 0x7f2ae0147c20 2024-02-02T11:48:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae6112640 1 --2- 172.21.15.161:0/877878696 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae006af90 0x7f2ae013f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:48:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae6913640 1 --2- 172.21.15.161:0/877878696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae0147c20 0x7f2ae00b2b70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8009d30 tx=0x7f2ad800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ad6ffd640 1 -- 172.21.15.161:0/877878696 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8009ba0 con 0x7f2ae0147c20 2024-02-02T11:48:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ad6ffd640 1 -- 172.21.15.161:0/877878696 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad800f040 con 0x7f2ae0147c20 2024-02-02T11:48:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae8376640 1 -- 172.21.15.161:0/877878696 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae01e6340 con 0x7f2ae0147c20 2024-02-02T11:48:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ad6ffd640 1 -- 172.21.15.161:0/877878696 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad80146c0 con 0x7f2ae0147c20 2024-02-02T11:48:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.636+0000 7f2ae8376640 1 -- 172.21.15.161:0/877878696 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae01404d0 con 0x7f2ae0147c20 2024-02-02T11:48:53.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.640+0000 7f2ae8376640 1 -- 172.21.15.161:0/877878696 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae01e6b00 con 0x7f2ae0147c20 2024-02-02T11:48:53.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.640+0000 7f2ad6ffd640 1 -- 172.21.15.161:0/877878696 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2ad8014820 con 0x7f2ae0147c20 2024-02-02T11:48:53.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.640+0000 7f2ad6ffd640 1 --2- 172.21.15.161:0/877878696 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ac4065a60 0x7f2ac4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:53.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.640+0000 7f2ad6ffd640 1 -- 172.21.15.161:0/877878696 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ad80843d0 con 0x7f2ae0147c20 2024-02-02T11:48:53.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.640+0000 7f2ae6112640 1 --2- 172.21.15.161:0/877878696 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ac4065a60 0x7f2ac4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:53.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.640+0000 7f2ae6112640 1 --2- 172.21.15.161:0/877878696 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ac4065a60 0x7f2ac4067f20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2adc000f70 tx=0x7f2adc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:53.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.644+0000 7f2ad6ffd640 1 -- 172.21.15.161:0/877878696 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2ad8051ce0 con 0x7f2ae0147c20 2024-02-02T11:48:53.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:53.832+0000 7f2ae8376640 1 -- 172.21.15.161:0/877878696 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2ae01e6b00 con 0x7f2ae0147c20 2024-02-02T11:48:54.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.508+0000 7f2ad6ffd640 1 -- 172.21.15.161:0/877878696 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2ae01e6b00 con 0x7f2ae0147c20 2024-02-02T11:48:54.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.508+0000 7f2ae8376640 1 -- 172.21.15.161:0/877878696 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ac4065a60 msgr2=0x7f2ac4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:54.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.508+0000 7f2ae8376640 1 --2- 172.21.15.161:0/877878696 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ac4065a60 0x7f2ac4067f20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2adc000f70 tx=0x7f2adc009040 comp rx=0 tx=0).stop 2024-02-02T11:48:54.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.508+0000 7f2ae8376640 1 -- 172.21.15.161:0/877878696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae0147c20 msgr2=0x7f2ae00b2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:54.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.508+0000 7f2ae8376640 1 --2- 172.21.15.161:0/877878696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae0147c20 0x7f2ae00b2b70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8009d30 tx=0x7f2ad800c490 comp rx=0 tx=0).stop 2024-02-02T11:48:54.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.508+0000 7f2ae8376640 1 -- 172.21.15.161:0/877878696 shutdown_connections 2024-02-02T11:48:54.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.508+0000 7f2ae8376640 1 --2- 172.21.15.161:0/877878696 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ac4065a60 0x7f2ac4067f20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:54.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.508+0000 7f2ae8376640 1 --2- 172.21.15.161:0/877878696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae0147c20 0x7f2ae00b2b70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:54.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.508+0000 7f2ae8376640 1 --2- 172.21.15.161:0/877878696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ae006f520 0x7f2ae00b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:54.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.508+0000 7f2ae8376640 1 --2- 172.21.15.161:0/877878696 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae006af90 0x7f2ae013f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:54.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.508+0000 7f2ae8376640 1 -- 172.21.15.161:0/877878696 >> 172.21.15.161:0/877878696 conn(0x7f2ae00b9140 msgr2=0x7f2ae00bb060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:54.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.508+0000 7f2ae8376640 1 -- 172.21.15.161:0/877878696 shutdown_connections 2024-02-02T11:48:54.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.508+0000 7f2ae8376640 1 -- 172.21.15.161:0/877878696 wait complete. 2024-02-02T11:48:54.533 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-02-02T11:48:54.533 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-02T11:48:54.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.652+0000 7fb2a9ff0640 1 Processor -- start 2024-02-02T11:48:54.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.652+0000 7fb2a9ff0640 1 -- start start 2024-02-02T11:48:54.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.656+0000 7fb2a9ff0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a40bc340 0x7fb2a41415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:54.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.656+0000 7fb2a9ff0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb2a4141b30 0x7fb2a4147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:54.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.656+0000 7fb2a9ff0640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a4071550 con 0x7fb2a40b8020 2024-02-02T11:48:54.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.656+0000 7fb2a9ff0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a4071810 con 0x7fb2a4141b30 2024-02-02T11:48:54.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.656+0000 7fb2a9ff0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a4071950 con 0x7fb2a40bc340 2024-02-02T11:48:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.656+0000 7fb2a2ffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb2a4141b30 0x7fb2a4147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.656+0000 7fb2a2ffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb2a4141b30 0x7fb2a4147c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36476/0 (socket says 172.21.15.161:36476) 2024-02-02T11:48:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.656+0000 7fb2a2ffd640 1 -- 172.21.15.161:0/3720015719 learned_addr learned my addr 172.21.15.161:0/3720015719 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.656+0000 7fb2a37fe640 1 --2- 172.21.15.161:0/3720015719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a40bc340 0x7fb2a41415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.656+0000 7fb2a2ffd640 1 -- 172.21.15.161:0/3720015719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a40bc340 msgr2=0x7fb2a41415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.656+0000 7fb2a2ffd640 1 --2- 172.21.15.161:0/3720015719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a40bc340 0x7fb2a41415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.656+0000 7fb2a2ffd640 1 -- 172.21.15.161:0/3720015719 >> v1:172.21.15.162:6789/0 conn(0x7fb2a40b8020 legacy=0x7fb2a414abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.656+0000 7fb2a2ffd640 1 -- 172.21.15.161:0/3720015719 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a40bc720 con 0x7fb2a4141b30 2024-02-02T11:48:54.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.656+0000 7fb2a2ffd640 1 --2- 172.21.15.161:0/3720015719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a4141b30 0x7fb2a4147c60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009e50 tx=0x7fb28c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a137f7843dd8cab7 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:54.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.656+0000 7fb2a27fc640 1 -- 172.21.15.161:0/3720015719 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c0a55c0 con 0x7fb2a4141b30 2024-02-02T11:48:54.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.656+0000 7fb2a27fc640 1 -- 172.21.15.161:0/3720015719 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a41485b0 con 0x7fb2a4141b30 2024-02-02T11:48:54.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.656+0000 7fb2a27fc640 1 -- 172.21.15.161:0/3720015719 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c0a5940 con 0x7fb2a4141b30 2024-02-02T11:48:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a9ff0640 1 -- 172.21.15.161:0/3720015719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a4141b30 msgr2=0x7fb2a4147c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a9ff0640 1 --2- 172.21.15.161:0/3720015719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a4141b30 0x7fb2a4147c60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009e50 tx=0x7fb28c01c940 comp rx=0 tx=0).stop 2024-02-02T11:48:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a9ff0640 1 -- 172.21.15.161:0/3720015719 shutdown_connections 2024-02-02T11:48:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a9ff0640 1 --2- 172.21.15.161:0/3720015719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a4141b30 0x7fb2a4147c60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a9ff0640 1 --2- 172.21.15.161:0/3720015719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a40bc340 0x7fb2a41415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a9ff0640 1 -- 172.21.15.161:0/3720015719 >> 172.21.15.161:0/3720015719 conn(0x7fb2a4069ef0 msgr2=0x7fb2a406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a9ff0640 1 -- 172.21.15.161:0/3720015719 shutdown_connections 2024-02-02T11:48:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a9ff0640 1 -- 172.21.15.161:0/3720015719 wait complete. 2024-02-02T11:48:54.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a9ff0640 1 Processor -- start 2024-02-02T11:48:54.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a9ff0640 1 -- start start 2024-02-02T11:48:54.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a9ff0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a40b8020 0x7fb2a40b7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:54.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a9ff0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a40bc340 0x7fb2a40b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:54.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a9ff0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2a4141b30 0x7fb2a41e68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:54.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a9ff0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40b7860 con 0x7fb2a40b8020 2024-02-02T11:48:54.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a9ff0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a41e6460 con 0x7fb2a4141b30 2024-02-02T11:48:54.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a9ff0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40b4970 con 0x7fb2a40bc340 2024-02-02T11:48:54.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a37fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a40b8020 0x7fb2a40b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:54.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a37fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a40b8020 0x7fb2a40b7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36486/0 (socket says 172.21.15.161:36486) 2024-02-02T11:48:54.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a37fe640 1 -- 172.21.15.161:0/841708925 learned_addr learned my addr 172.21.15.161:0/841708925 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:54.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a3fff640 1 --2- 172.21.15.161:0/841708925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2a4141b30 0x7fb2a41e68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:54.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a37fe640 1 -- 172.21.15.161:0/841708925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a40bc340 msgr2=0x7fb2a40b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:54.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a2ffd640 1 --2- 172.21.15.161:0/841708925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a40bc340 0x7fb2a40b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:54.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a37fe640 1 --2- 172.21.15.161:0/841708925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a40bc340 0x7fb2a40b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:54.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a37fe640 1 -- 172.21.15.161:0/841708925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2a4141b30 msgr2=0x7fb2a41e68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:54.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a37fe640 1 --2- 172.21.15.161:0/841708925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2a4141b30 0x7fb2a41e68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:54.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a37fe640 1 -- 172.21.15.161:0/841708925 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c009b30 con 0x7fb2a40b8020 2024-02-02T11:48:54.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a3fff640 1 --2- 172.21.15.161:0/841708925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2a4141b30 0x7fb2a41e68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:48:54.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a37fe640 1 --2- 172.21.15.161:0/841708925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a40b8020 0x7fb2a40b7320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb29400c7f0 tx=0x7fb29400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:54.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb29bfff640 1 -- 172.21.15.161:0/841708925 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294004220 con 0x7fb2a40b8020 2024-02-02T11:48:54.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb29bfff640 1 -- 172.21.15.161:0/841708925 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2940043a0 con 0x7fb2a40b8020 2024-02-02T11:48:54.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb29bfff640 1 -- 172.21.15.161:0/841708925 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294004510 con 0x7fb2a40b8020 2024-02-02T11:48:54.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a9ff0640 1 -- 172.21.15.161:0/841708925 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a40b4c10 con 0x7fb2a40b8020 2024-02-02T11:48:54.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.660+0000 7fb2a9ff0640 1 -- 172.21.15.161:0/841708925 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a40b51d0 con 0x7fb2a40b8020 2024-02-02T11:48:54.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.664+0000 7fb2a9ff0640 1 -- 172.21.15.161:0/841708925 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a404e000 con 0x7fb2a40b8020 2024-02-02T11:48:54.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.664+0000 7fb29bfff640 1 -- 172.21.15.161:0/841708925 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb294003a70 con 0x7fb2a40b8020 2024-02-02T11:48:54.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.664+0000 7fb29bfff640 1 --2- 172.21.15.161:0/841708925 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb284065a60 0x7fb284067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:54.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.664+0000 7fb2a2ffd640 1 --2- 172.21.15.161:0/841708925 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb284065a60 0x7fb284067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:54.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.664+0000 7fb29bfff640 1 -- 172.21.15.161:0/841708925 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb294083230 con 0x7fb2a40b8020 2024-02-02T11:48:54.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.664+0000 7fb2a2ffd640 1 --2- 172.21.15.161:0/841708925 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb284065a60 0x7fb284067f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0ae000 tx=0x7fb28c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:54.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.668+0000 7fb29bfff640 1 -- 172.21.15.161:0/841708925 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb294050b50 con 0x7fb2a40b8020 2024-02-02T11:48:54.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.852+0000 7fb2a9ff0640 1 -- 172.21.15.161:0/841708925 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2a406af20 con 0x7fb2a40b8020 2024-02-02T11:48:54.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.852+0000 7fb29bfff640 1 -- 172.21.15.161:0/841708925 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3953 (secure 0 0 0) 0x7fb294054170 con 0x7fb2a40b8020 2024-02-02T11:48:54.855 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:48:54.855 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3677988163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3677988163},{"type":"v1","addr":"172.21.15.162:6833","nonce":3677988163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/456037269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":456037269},{"type":"v1","addr":"172.21.15.161:6835","nonce":456037269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-02T11:48:51.812809+0000","modified":"2024-02-02T11:48:54.494091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/2509813318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":2509813318},{"type":"v1","addr":"172.21.15.161:6837","nonce":2509813318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-02T11:48:54.855 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 7 2024-02-02T11:48:54.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.856+0000 7fb2a9ff0640 1 -- 172.21.15.161:0/841708925 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb284065a60 msgr2=0x7fb284067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:54.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.856+0000 7fb2a9ff0640 1 --2- 172.21.15.161:0/841708925 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb284065a60 0x7fb284067f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0ae000 tx=0x7fb28c0a7070 comp rx=0 tx=0).stop 2024-02-02T11:48:54.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.856+0000 7fb2a9ff0640 1 -- 172.21.15.161:0/841708925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a40b8020 msgr2=0x7fb2a40b7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:54.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.856+0000 7fb2a9ff0640 1 --2- 172.21.15.161:0/841708925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a40b8020 0x7fb2a40b7320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb29400c7f0 tx=0x7fb29400ccb0 comp rx=0 tx=0).stop 2024-02-02T11:48:54.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.856+0000 7fb2a9ff0640 1 -- 172.21.15.161:0/841708925 shutdown_connections 2024-02-02T11:48:54.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.856+0000 7fb2a9ff0640 1 --2- 172.21.15.161:0/841708925 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb284065a60 0x7fb284067f20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:54.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.856+0000 7fb2a9ff0640 1 --2- 172.21.15.161:0/841708925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2a4141b30 0x7fb2a41e68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:54.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.856+0000 7fb2a9ff0640 1 --2- 172.21.15.161:0/841708925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a40bc340 0x7fb2a40b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:54.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.856+0000 7fb2a9ff0640 1 --2- 172.21.15.161:0/841708925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a40b8020 0x7fb2a40b7320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:54.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.856+0000 7fb2a9ff0640 1 -- 172.21.15.161:0/841708925 >> 172.21.15.161:0/841708925 conn(0x7fb2a4069ef0 msgr2=0x7fb2a413f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:54.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.856+0000 7fb2a9ff0640 1 -- 172.21.15.161:0/841708925 shutdown_connections 2024-02-02T11:48:54.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.856+0000 7fb2a9ff0640 1 -- 172.21.15.161:0/841708925 wait complete. 2024-02-02T11:48:54.872 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:48:54.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.976+0000 7f3b42bd7640 1 Processor -- start 2024-02-02T11:48:54.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.976+0000 7f3b42bd7640 1 -- start start 2024-02-02T11:48:54.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.980+0000 7f3b42bd7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3b3c148f90 0x7f3b3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:54.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.980+0000 7f3b42bd7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b3c14f740 0x7f3b3c1597d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:54.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.980+0000 7f3b42bd7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3c149370 con 0x7f3b3c152440 2024-02-02T11:48:54.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.980+0000 7f3b42bd7640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3c071f60 con 0x7f3b3c148f90 2024-02-02T11:48:54.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.980+0000 7f3b42bd7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c152920 con 0x7f3b3c14f740 2024-02-02T11:48:54.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.980+0000 7f3b40973640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3b3c148f90 0x7f3b3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:54.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.980+0000 7f3b40973640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3b3c148f90 0x7f3b3c06a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36490/0 (socket says 172.21.15.161:36490) 2024-02-02T11:48:54.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.980+0000 7f3b40973640 1 -- 172.21.15.161:0/1743719946 learned_addr learned my addr 172.21.15.161:0/1743719946 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:54.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.980+0000 7f3b41174640 1 --2- 172.21.15.161:0/1743719946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b3c14f740 0x7f3b3c1597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:54.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.980+0000 7f3b40973640 1 -- 172.21.15.161:0/1743719946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b3c14f740 msgr2=0x7f3b3c1597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:54.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.980+0000 7f3b40973640 1 --2- 172.21.15.161:0/1743719946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b3c14f740 0x7f3b3c1597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:54.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.980+0000 7f3b40973640 1 -- 172.21.15.161:0/1743719946 >> v1:172.21.15.162:6789/0 conn(0x7f3b3c152440 legacy=0x7f3b3c14f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:54.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.980+0000 7f3b40973640 1 -- 172.21.15.161:0/1743719946 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c152c00 con 0x7f3b3c148f90 2024-02-02T11:48:54.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b40973640 1 --2- 172.21.15.161:0/1743719946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b3c148f90 0x7f3b3c06a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009e50 tx=0x7f3b3401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c642eaf58ef67c server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:54.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b3b7fe640 1 -- 172.21.15.161:0/1743719946 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b340a57d0 con 0x7f3b3c148f90 2024-02-02T11:48:54.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b3b7fe640 1 -- 172.21.15.161:0/1743719946 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b340a5930 con 0x7f3b3c148f90 2024-02-02T11:48:54.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b3b7fe640 1 -- 172.21.15.161:0/1743719946 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b340a5cc0 con 0x7f3b3c148f90 2024-02-02T11:48:54.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b42bd7640 1 -- 172.21.15.161:0/1743719946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b3c148f90 msgr2=0x7f3b3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:54.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b42bd7640 1 --2- 172.21.15.161:0/1743719946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b3c148f90 0x7f3b3c06a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009e50 tx=0x7f3b3401ca10 comp rx=0 tx=0).stop 2024-02-02T11:48:54.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b42bd7640 1 -- 172.21.15.161:0/1743719946 shutdown_connections 2024-02-02T11:48:54.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b42bd7640 1 --2- 172.21.15.161:0/1743719946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b3c14f740 0x7f3b3c1597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:54.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b42bd7640 1 --2- 172.21.15.161:0/1743719946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b3c148f90 0x7f3b3c06a840 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:54.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b42bd7640 1 -- 172.21.15.161:0/1743719946 >> 172.21.15.161:0/1743719946 conn(0x7f3b3c069d20 msgr2=0x7f3b3c06a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:54.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b42bd7640 1 -- 172.21.15.161:0/1743719946 shutdown_connections 2024-02-02T11:48:54.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b42bd7640 1 -- 172.21.15.161:0/1743719946 wait complete. 2024-02-02T11:48:54.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b42bd7640 1 Processor -- start 2024-02-02T11:48:54.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b42bd7640 1 -- start start 2024-02-02T11:48:54.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b42bd7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b3c148f90 0x7f3b3c1484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:54.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b42bd7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b3c14f740 0x7f3b3c14afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:54.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b42bd7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3c152440 0x7f3b3c1ea550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:54.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b42bd7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c148a30 con 0x7f3b3c14f740 2024-02-02T11:48:54.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b42bd7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c14dd00 con 0x7f3b3c152440 2024-02-02T11:48:54.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b42bd7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c0b5910 con 0x7f3b3c148f90 2024-02-02T11:48:54.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b3bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b3c14f740 0x7f3b3c14afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:54.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b3bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b3c14f740 0x7f3b3c14afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36502/0 (socket says 172.21.15.161:36502) 2024-02-02T11:48:54.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b3bfff640 1 -- 172.21.15.161:0/827602443 learned_addr learned my addr 172.21.15.161:0/827602443 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:54.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b40973640 1 --2- 172.21.15.161:0/827602443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b3c148f90 0x7f3b3c1484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:54.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b3bfff640 1 -- 172.21.15.161:0/827602443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b3c148f90 msgr2=0x7f3b3c1484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:54.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b41174640 1 --2- 172.21.15.161:0/827602443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3c152440 0x7f3b3c1ea550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:54.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b3bfff640 1 --2- 172.21.15.161:0/827602443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b3c148f90 0x7f3b3c1484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:54.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b3bfff640 1 -- 172.21.15.161:0/827602443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3c152440 msgr2=0x7f3b3c1ea550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:54.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b3bfff640 1 --2- 172.21.15.161:0/827602443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3c152440 0x7f3b3c1ea550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:54.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b3bfff640 1 -- 172.21.15.161:0/827602443 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b34009b30 con 0x7f3b3c14f740 2024-02-02T11:48:54.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b40973640 1 --2- 172.21.15.161:0/827602443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b3c148f90 0x7f3b3c1484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:48:54.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b3bfff640 1 --2- 172.21.15.161:0/827602443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b3c14f740 0x7f3b3c14afa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400c3c0 tx=0x7f3b2400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:54.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b397fa640 1 -- 172.21.15.161:0/827602443 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b240052d0 con 0x7f3b3c14f740 2024-02-02T11:48:54.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b397fa640 1 -- 172.21.15.161:0/827602443 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b24005430 con 0x7f3b3c14f740 2024-02-02T11:48:54.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b42bd7640 1 -- 172.21.15.161:0/827602443 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3c0b8840 con 0x7f3b3c14f740 2024-02-02T11:48:54.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b397fa640 1 -- 172.21.15.161:0/827602443 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24003840 con 0x7f3b3c14f740 2024-02-02T11:48:54.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.984+0000 7f3b42bd7640 1 -- 172.21.15.161:0/827602443 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3c14ba90 con 0x7f3b3c14f740 2024-02-02T11:48:54.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.988+0000 7f3b42bd7640 1 -- 172.21.15.161:0/827602443 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b3c0b5aa0 con 0x7f3b3c14f740 2024-02-02T11:48:54.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.988+0000 7f3b397fa640 1 -- 172.21.15.161:0/827602443 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3b240039a0 con 0x7f3b3c14f740 2024-02-02T11:48:54.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.988+0000 7f3b397fa640 1 --2- 172.21.15.161:0/827602443 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3b1c065a60 0x7f3b1c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:54.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.988+0000 7f3b397fa640 1 -- 172.21.15.161:0/827602443 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b24082470 con 0x7f3b3c14f740 2024-02-02T11:48:54.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.988+0000 7f3b40973640 1 --2- 172.21.15.161:0/827602443 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3b1c065a60 0x7f3b1c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:54.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.988+0000 7f3b40973640 1 --2- 172.21.15.161:0/827602443 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3b1c065a60 0x7f3b1c067f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3b340ae000 tx=0x7f3b340a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:54.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:54.992+0000 7f3b397fa640 1 -- 172.21.15.161:0/827602443 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3b2404fec0 con 0x7f3b3c14f740 2024-02-02T11:48:55.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.136+0000 7f3b42bd7640 1 -- 172.21.15.161:0/827602443 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b3c149370 con 0x7f3b3c14f740 2024-02-02T11:48:55.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.136+0000 7f3b397fa640 1 -- 172.21.15.161:0/827602443 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f3b3c149370 con 0x7f3b3c14f740 2024-02-02T11:48:55.140 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:48:55.141 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":20,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:52.816101+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:48:50.155565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-02T11:48:50.795158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:48:55.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.140+0000 7f3b42bd7640 1 -- 172.21.15.161:0/827602443 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3b1c065a60 msgr2=0x7f3b1c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:55.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.140+0000 7f3b42bd7640 1 --2- 172.21.15.161:0/827602443 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3b1c065a60 0x7f3b1c067f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3b340ae000 tx=0x7f3b340a7070 comp rx=0 tx=0).stop 2024-02-02T11:48:55.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.140+0000 7f3b42bd7640 1 -- 172.21.15.161:0/827602443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b3c14f740 msgr2=0x7f3b3c14afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:55.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.140+0000 7f3b42bd7640 1 --2- 172.21.15.161:0/827602443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b3c14f740 0x7f3b3c14afa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400c3c0 tx=0x7f3b2400c880 comp rx=0 tx=0).stop 2024-02-02T11:48:55.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.140+0000 7f3b42bd7640 1 -- 172.21.15.161:0/827602443 shutdown_connections 2024-02-02T11:48:55.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.140+0000 7f3b42bd7640 1 --2- 172.21.15.161:0/827602443 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3b1c065a60 0x7f3b1c067f20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.140+0000 7f3b42bd7640 1 --2- 172.21.15.161:0/827602443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b3c152440 0x7f3b3c1ea550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.140+0000 7f3b42bd7640 1 --2- 172.21.15.161:0/827602443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b3c14f740 0x7f3b3c14afa0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.140+0000 7f3b42bd7640 1 --2- 172.21.15.161:0/827602443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b3c148f90 0x7f3b3c1484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.140+0000 7f3b42bd7640 1 -- 172.21.15.161:0/827602443 >> 172.21.15.161:0/827602443 conn(0x7f3b3c069d20 msgr2=0x7f3b3c14e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:55.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.140+0000 7f3b42bd7640 1 -- 172.21.15.161:0/827602443 shutdown_connections 2024-02-02T11:48:55.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.140+0000 7f3b42bd7640 1 -- 172.21.15.161:0/827602443 wait complete. 2024-02-02T11:48:55.158 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-02T11:48:55.158 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-02T11:48:55.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17919f640 1 Processor -- start 2024-02-02T11:48:55.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17919f640 1 -- start start 2024-02-02T11:48:55.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17919f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa1740b6880 0x7fa17414bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:55.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17919f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1740b3e40 0x7fa174153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:55.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17919f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa17406fed0 con 0x7fa1740b9270 2024-02-02T11:48:55.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17919f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1740b8de0 con 0x7fa1740b6880 2024-02-02T11:48:55.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17919f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1740b8ae0 con 0x7fa1740b3e40 2024-02-02T11:48:55.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa16bfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fa1740b9270 0x7fa174142680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39948/0 (socket says 172.21.15.161:39948) 2024-02-02T11:48:55.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa16bfff640 1 -- 172.21.15.161:0/291675596 learned_addr learned my addr 172.21.15.161:0/291675596 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:48:55.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17259c640 1 -- 172.21.15.161:0/291675596 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216348051 0 0) 0x7fa164001120 con 0x7fa1740b9270 2024-02-02T11:48:55.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa172d9d640 1 --2- 172.21.15.161:0/291675596 >> v2:172.21.15.162:3300/0 conn(0x7fa1740b6880 0x7fa17414bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:55.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17359e640 1 --2- 172.21.15.161:0/291675596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1740b3e40 0x7fa174153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:55.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17259c640 1 -- 172.21.15.161:0/291675596 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa160003530 con 0x7fa1740b9270 2024-02-02T11:48:55.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17259c640 1 -- 172.21.15.161:0/291675596 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2567435601 0 0) 0x7fa160003530 con 0x7fa1740b9270 2024-02-02T11:48:55.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17259c640 1 -- 172.21.15.161:0/291675596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1740b3e40 msgr2=0x7fa174153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:55.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17259c640 1 --2- 172.21.15.161:0/291675596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1740b3e40 0x7fa174153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17259c640 1 -- 172.21.15.161:0/291675596 >> v2:172.21.15.162:3300/0 conn(0x7fa1740b6880 msgr2=0x7fa17414bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:55.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17259c640 1 --2- 172.21.15.161:0/291675596 >> v2:172.21.15.162:3300/0 conn(0x7fa1740b6880 0x7fa17414bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17259c640 1 -- 172.21.15.161:0/291675596 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1740b7d30 con 0x7fa1740b9270 2024-02-02T11:48:55.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17259c640 1 -- 172.21.15.161:0/291675596 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7fa164001810 con 0x7fa1740b9270 2024-02-02T11:48:55.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17259c640 1 -- 172.21.15.161:0/291675596 >> v1:172.21.15.161:6789/0 conn(0x7fa1740b9270 legacy=0x7fa174142680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:55.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17259c640 1 --2- 172.21.15.161:0/291675596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa160003980 0x7fa160003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:55.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17259c640 1 --2- 172.21.15.161:0/291675596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1600047d0 0x7fa160004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:55.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17259c640 1 --2- 172.21.15.161:0/291675596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1740b3e40 0x7fa160005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:55.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17259c640 1 -- 172.21.15.161:0/291675596 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1740b8de0 con 0x7fa1600047d0 2024-02-02T11:48:55.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17259c640 1 -- 172.21.15.161:0/291675596 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1740b8ae0 con 0x7fa160003980 2024-02-02T11:48:55.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa17259c640 1 -- 172.21.15.161:0/291675596 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16000b990 con 0x7fa1740b3e40 2024-02-02T11:48:55.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa16bfff640 1 --2- 172.21.15.161:0/291675596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1600047d0 0x7fa160004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:55.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa16bfff640 1 -- 172.21.15.161:0/291675596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1740b3e40 msgr2=0x7fa160005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:55.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa16bfff640 1 --2- 172.21.15.161:0/291675596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1740b3e40 0x7fa160005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa16bfff640 1 -- 172.21.15.161:0/291675596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa160003980 msgr2=0x7fa160003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:55.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa16bfff640 1 --2- 172.21.15.161:0/291675596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa160003980 0x7fa160003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.264+0000 7fa16bfff640 1 -- 172.21.15.161:0/291675596 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa160003530 con 0x7fa1600047d0 2024-02-02T11:48:55.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa16bfff640 1 --2- 172.21.15.161:0/291675596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1600047d0 0x7fa160004c50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa16400c240 tx=0x7fa16401f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c09a3e989b4c00 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:55.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17259c640 1 -- 172.21.15.161:0/291675596 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1640058e0 con 0x7fa1600047d0 2024-02-02T11:48:55.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17259c640 1 -- 172.21.15.161:0/291675596 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa164005a40 con 0x7fa1600047d0 2024-02-02T11:48:55.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17259c640 1 -- 172.21.15.161:0/291675596 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa164005df0 con 0x7fa1600047d0 2024-02-02T11:48:55.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17919f640 1 -- 172.21.15.161:0/291675596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1600047d0 msgr2=0x7fa160004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:55.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17919f640 1 --2- 172.21.15.161:0/291675596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1600047d0 0x7fa160004c50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa16400c240 tx=0x7fa16401f3d0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17359e640 1 -- 172.21.15.161:0/291675596 reap_dead start 2024-02-02T11:48:55.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17919f640 1 -- 172.21.15.161:0/291675596 shutdown_connections 2024-02-02T11:48:55.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17919f640 1 -- 172.21.15.161:0/291675596 >> 172.21.15.161:0/291675596 conn(0x7fa17406ae30 msgr2=0x7fa17406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:55.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17919f640 1 -- 172.21.15.161:0/291675596 shutdown_connections 2024-02-02T11:48:55.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17919f640 1 -- 172.21.15.161:0/291675596 wait complete. 2024-02-02T11:48:55.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17919f640 1 Processor -- start 2024-02-02T11:48:55.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17919f640 1 -- start start 2024-02-02T11:48:55.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17919f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1600047d0 0x7fa17413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:55.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17919f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa17413b2c0 0x7fa17413b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:55.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17919f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1741432e0 0x7fa174143760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:55.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17919f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa174145340 con 0x7fa17413b2c0 2024-02-02T11:48:55.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17919f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17413ef20 con 0x7fa1600047d0 2024-02-02T11:48:55.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17919f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa174149630 con 0x7fa1741432e0 2024-02-02T11:48:55.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa16bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa17413b2c0 0x7fa17413b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:55.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa16bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa17413b2c0 0x7fa17413b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36506/0 (socket says 172.21.15.161:36506) 2024-02-02T11:48:55.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa16bfff640 1 -- 172.21.15.161:0/2391295706 learned_addr learned my addr 172.21.15.161:0/2391295706 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:55.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17359e640 1 --2- 172.21.15.161:0/2391295706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1741432e0 0x7fa174143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:55.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa16bfff640 1 -- 172.21.15.161:0/2391295706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1741432e0 msgr2=0x7fa174143760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:55.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa16bfff640 1 --2- 172.21.15.161:0/2391295706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1741432e0 0x7fa174143760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa16bfff640 1 -- 172.21.15.161:0/2391295706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1600047d0 msgr2=0x7fa17413e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:55.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa16bfff640 1 --2- 172.21.15.161:0/2391295706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1600047d0 0x7fa17413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa16bfff640 1 -- 172.21.15.161:0/2391295706 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa174143ca0 con 0x7fa17413b2c0 2024-02-02T11:48:55.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa16bfff640 1 --2- 172.21.15.161:0/2391295706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa17413b2c0 0x7fa17413b720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa16400c240 tx=0x7fa160005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:55.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa16b7fe640 1 -- 172.21.15.161:0/2391295706 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1640b7070 con 0x7fa17413b2c0 2024-02-02T11:48:55.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa16b7fe640 1 -- 172.21.15.161:0/2391295706 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa164001690 con 0x7fa17413b2c0 2024-02-02T11:48:55.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa17919f640 1 -- 172.21.15.161:0/2391295706 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa174144c80 con 0x7fa17413b2c0 2024-02-02T11:48:55.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.268+0000 7fa16b7fe640 1 -- 172.21.15.161:0/2391295706 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1640049f0 con 0x7fa17413b2c0 2024-02-02T11:48:55.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.272+0000 7fa17919f640 1 -- 172.21.15.161:0/2391295706 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa174144140 con 0x7fa17413b2c0 2024-02-02T11:48:55.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.272+0000 7fa17919f640 1 -- 172.21.15.161:0/2391295706 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17404e000 con 0x7fa17413b2c0 2024-02-02T11:48:55.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.272+0000 7fa16b7fe640 1 -- 172.21.15.161:0/2391295706 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa164007070 con 0x7fa17413b2c0 2024-02-02T11:48:55.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.272+0000 7fa16b7fe640 1 --2- 172.21.15.161:0/2391295706 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa154065a60 0x7fa154067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:55.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.272+0000 7fa16b7fe640 1 -- 172.21.15.161:0/2391295706 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa164120190 con 0x7fa17413b2c0 2024-02-02T11:48:55.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.272+0000 7fa172d9d640 1 --2- 172.21.15.161:0/2391295706 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa154065a60 0x7fa154067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:55.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.272+0000 7fa172d9d640 1 --2- 172.21.15.161:0/2391295706 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa154065a60 0x7fa154067f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa15c006aa0 tx=0x7fa15c006a30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:55.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.276+0000 7fa16b7fe640 1 -- 172.21.15.161:0/2391295706 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa1640edb50 con 0x7fa17413b2c0 2024-02-02T11:48:55.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.416+0000 7fa17919f640 1 -- 172.21.15.161:0/2391295706 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1740b8010 con 0x7fa154065a60 2024-02-02T11:48:55.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.436+0000 7fa16b7fe640 1 -- 172.21.15.161:0/2391295706 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249730 (secure 0 0 0) 0x7fa15c00e810 con 0x7fa154065a60 2024-02-02T11:48:55.439 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:48:55.442 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-02-02T11:48:55.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.440+0000 7fa17919f640 1 -- 172.21.15.161:0/2391295706 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa154065a60 msgr2=0x7fa154067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:55.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.440+0000 7fa17919f640 1 --2- 172.21.15.161:0/2391295706 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa154065a60 0x7fa154067f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa15c006aa0 tx=0x7fa15c006a30 comp rx=0 tx=0).stop 2024-02-02T11:48:55.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.440+0000 7fa17919f640 1 -- 172.21.15.161:0/2391295706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa17413b2c0 msgr2=0x7fa17413b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:55.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.440+0000 7fa17919f640 1 --2- 172.21.15.161:0/2391295706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa17413b2c0 0x7fa17413b720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa16400c240 tx=0x7fa160005800 comp rx=0 tx=0).stop 2024-02-02T11:48:55.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.440+0000 7fa17919f640 1 -- 172.21.15.161:0/2391295706 shutdown_connections 2024-02-02T11:48:55.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.440+0000 7fa17919f640 1 --2- 172.21.15.161:0/2391295706 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa154065a60 0x7fa154067f20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.440+0000 7fa17919f640 1 --2- 172.21.15.161:0/2391295706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1741432e0 0x7fa174143760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.440+0000 7fa17919f640 1 --2- 172.21.15.161:0/2391295706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa17413b2c0 0x7fa17413b720 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.440+0000 7fa17919f640 1 --2- 172.21.15.161:0/2391295706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1600047d0 0x7fa17413e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.440+0000 7fa17919f640 1 -- 172.21.15.161:0/2391295706 >> 172.21.15.161:0/2391295706 conn(0x7fa17406ae30 msgr2=0x7fa174140de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:55.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.440+0000 7fa17919f640 1 -- 172.21.15.161:0/2391295706 shutdown_connections 2024-02-02T11:48:55.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.440+0000 7fa17919f640 1 -- 172.21.15.161:0/2391295706 wait complete. 2024-02-02T11:48:55.457 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-02-02T11:48:54.253116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218556,"kb_used_data":2376,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754756164,"statfs":{"total":773094113280,"available":772870311936,"internally_reserved":0,"allocated":2433024,"data_stored":1546584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000888"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-02T11:48:43.179833+0000","last_change":"2024-02-02T11:48:41.563754+0000","last_active":"2024-02-02T11:48:43.179833+0000","last_peered":"2024-02-02T11:48:43.179833+0000","last_clean":"2024-02-02T11:48:43.179833+0000","last_became_active":"2024-02-02T11:48:41.562629+0000","last_became_peered":"2024-02-02T11:48:41.562629+0000","last_unstale":"2024-02-02T11:48:43.179833+0000","last_undegraded":"2024-02-02T11:48:43.179833+0000","last_fullsized":"2024-02-02T11:48:43.179833+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_clean_scrub_stamp":"2024-02-02T11:48:40.536978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:22:02.923582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-02T11:48:55.462 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-02T11:48:55.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.620+0000 7fcd82826640 1 Processor -- start 2024-02-02T11:48:55.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.620+0000 7fcd82826640 1 -- start start 2024-02-02T11:48:55.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.620+0000 7fcd82826640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcd7c0bc340 0x7fcd7c1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:55.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.620+0000 7fcd82826640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcd7c0b8020 0x7fcd7c151f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:55.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.620+0000 7fcd82826640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c071550 con 0x7fcd7c141b30 2024-02-02T11:48:55.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.620+0000 7fcd82826640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c071810 con 0x7fcd7c0bc340 2024-02-02T11:48:55.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.620+0000 7fcd82826640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c071950 con 0x7fcd7c0b8020 2024-02-02T11:48:55.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd7bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcd7c0bc340 0x7fcd7c1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:55.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd7b7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fcd7c141b30 0x7fcd7c147c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39958/0 (socket says 172.21.15.161:39958) 2024-02-02T11:48:55.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd7bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcd7c0bc340 0x7fcd7c1415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36510/0 (socket says 172.21.15.161:36510) 2024-02-02T11:48:55.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd7b7fe640 1 -- 172.21.15.161:0/2484440015 learned_addr learned my addr 172.21.15.161:0/2484440015 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:48:55.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd80dc3640 1 --2- 172.21.15.161:0/2484440015 >> v2:172.21.15.162:3300/0 conn(0x7fcd7c0b8020 0x7fcd7c151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:55.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd7bfff640 1 -- 172.21.15.161:0/2484440015 >> v2:172.21.15.162:3300/0 conn(0x7fcd7c0b8020 msgr2=0x7fcd7c151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:55.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd7bfff640 1 --2- 172.21.15.161:0/2484440015 >> v2:172.21.15.162:3300/0 conn(0x7fcd7c0b8020 0x7fcd7c151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd7bfff640 1 -- 172.21.15.161:0/2484440015 >> v1:172.21.15.161:6789/0 conn(0x7fcd7c141b30 legacy=0x7fcd7c147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:55.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd7bfff640 1 -- 172.21.15.161:0/2484440015 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c0bc720 con 0x7fcd7c0bc340 2024-02-02T11:48:55.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd7affd640 1 -- 172.21.15.161:0/2484440015 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551420154 0 0) 0x7fcd7c071550 con 0x7fcd7c141b30 2024-02-02T11:48:55.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd7bfff640 1 --2- 172.21.15.161:0/2484440015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd7c0bc340 0x7fcd7c1415f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c070590 tx=0x7fcd6c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ada1bc9bf4e303 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:55.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd7affd640 1 -- 172.21.15.161:0/2484440015 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c0ab600 con 0x7fcd7c0bc340 2024-02-02T11:48:55.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd7affd640 1 -- 172.21.15.161:0/2484440015 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c0a7050 con 0x7fcd7c0bc340 2024-02-02T11:48:55.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd7affd640 1 -- 172.21.15.161:0/2484440015 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c0ab980 con 0x7fcd7c0bc340 2024-02-02T11:48:55.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd82826640 1 -- 172.21.15.161:0/2484440015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd7c0bc340 msgr2=0x7fcd7c1415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:55.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd82826640 1 --2- 172.21.15.161:0/2484440015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd7c0bc340 0x7fcd7c1415f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c070590 tx=0x7fcd6c01c3b0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd82826640 1 -- 172.21.15.161:0/2484440015 shutdown_connections 2024-02-02T11:48:55.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd82826640 1 --2- 172.21.15.161:0/2484440015 >> v2:172.21.15.162:3300/0 conn(0x7fcd7c0b8020 0x7fcd7c151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd82826640 1 --2- 172.21.15.161:0/2484440015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd7c0bc340 0x7fcd7c1415f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd82826640 1 -- 172.21.15.161:0/2484440015 >> 172.21.15.161:0/2484440015 conn(0x7fcd7c069ef0 msgr2=0x7fcd7c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:55.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd82826640 1 -- 172.21.15.161:0/2484440015 shutdown_connections 2024-02-02T11:48:55.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.624+0000 7fcd82826640 1 -- 172.21.15.161:0/2484440015 wait complete. 2024-02-02T11:48:55.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd82826640 1 Processor -- start 2024-02-02T11:48:55.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd82826640 1 -- start start 2024-02-02T11:48:55.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd82826640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd7c0b8020 0x7fcd7c143790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:55.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd82826640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd7c0bc340 0x7fcd7c0baf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:55.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd82826640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd7c141b30 0x7fcd7c14b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:55.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd82826640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c142d70 con 0x7fcd7c141b30 2024-02-02T11:48:55.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd82826640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0bb4a0 con 0x7fcd7c0bc340 2024-02-02T11:48:55.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd82826640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c1487a0 con 0x7fcd7c0b8020 2024-02-02T11:48:55.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd80dc3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd7c141b30 0x7fcd7c14b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:55.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd80dc3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd7c141b30 0x7fcd7c14b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36514/0 (socket says 172.21.15.161:36514) 2024-02-02T11:48:55.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd80dc3640 1 -- 172.21.15.161:0/3643527363 learned_addr learned my addr 172.21.15.161:0/3643527363 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:55.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd7b7fe640 1 --2- 172.21.15.161:0/3643527363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd7c0bc340 0x7fcd7c0baf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:55.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd80dc3640 1 -- 172.21.15.161:0/3643527363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd7c0b8020 msgr2=0x7fcd7c143790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:55.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd80dc3640 1 --2- 172.21.15.161:0/3643527363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd7c0b8020 0x7fcd7c143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd80dc3640 1 -- 172.21.15.161:0/3643527363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd7c0bc340 msgr2=0x7fcd7c0baf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:55.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd80dc3640 1 --2- 172.21.15.161:0/3643527363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd7c0bc340 0x7fcd7c0baf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd80dc3640 1 -- 172.21.15.161:0/3643527363 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c009420 con 0x7fcd7c141b30 2024-02-02T11:48:55.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd7b7fe640 1 --2- 172.21.15.161:0/3643527363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd7c0bc340 0x7fcd7c0baf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:48:55.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd80dc3640 1 --2- 172.21.15.161:0/3643527363 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd7c141b30 0x7fcd7c14b010 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcd74009fd0 tx=0x7fcd7400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:55.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd78ff9640 1 -- 172.21.15.161:0/3643527363 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74014420 con 0x7fcd7c141b30 2024-02-02T11:48:55.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd78ff9640 1 -- 172.21.15.161:0/3643527363 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd74014580 con 0x7fcd7c141b30 2024-02-02T11:48:55.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd82826640 1 -- 172.21.15.161:0/3643527363 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c142a90 con 0x7fcd7c141b30 2024-02-02T11:48:55.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd78ff9640 1 -- 172.21.15.161:0/3643527363 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74014930 con 0x7fcd7c141b30 2024-02-02T11:48:55.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd82826640 1 -- 172.21.15.161:0/3643527363 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c14aaf0 con 0x7fcd7c141b30 2024-02-02T11:48:55.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd82826640 1 -- 172.21.15.161:0/3643527363 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c14a670 con 0x7fcd7c141b30 2024-02-02T11:48:55.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd78ff9640 1 -- 172.21.15.161:0/3643527363 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcd74014a90 con 0x7fcd7c141b30 2024-02-02T11:48:55.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.628+0000 7fcd78ff9640 1 --2- 172.21.15.161:0/3643527363 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fcd5c065a60 0x7fcd5c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:55.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.632+0000 7fcd78ff9640 1 -- 172.21.15.161:0/3643527363 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd74083b50 con 0x7fcd7c141b30 2024-02-02T11:48:55.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.632+0000 7fcd7bfff640 1 --2- 172.21.15.161:0/3643527363 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fcd5c065a60 0x7fcd5c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:55.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.632+0000 7fcd7bfff640 1 --2- 172.21.15.161:0/3643527363 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fcd5c065a60 0x7fcd5c067f20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c0ad000 tx=0x7fcd6c004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:55.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.636+0000 7fcd78ff9640 1 -- 172.21.15.161:0/3643527363 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcd7c14a670 con 0x7fcd7c141b30 2024-02-02T11:48:55.786 INFO:tasks.ceph.mds.c.smithi161.stderr:2024-02-02T11:48:55.784+0000 7f2799425640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-02T11:48:55.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.788+0000 7fcd82826640 1 -- 172.21.15.161:0/3643527363 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd7c148580 con 0x7fcd5c065a60 2024-02-02T11:48:55.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.804+0000 7fcd78ff9640 1 -- 172.21.15.161:0/3643527363 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249730 (secure 0 0 0) 0x7fcd6c006e20 con 0x7fcd5c065a60 2024-02-02T11:48:55.811 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:48:55.813 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-02-02T11:48:55.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.808+0000 7fcd82826640 1 -- 172.21.15.161:0/3643527363 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fcd5c065a60 msgr2=0x7fcd5c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:55.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.808+0000 7fcd82826640 1 --2- 172.21.15.161:0/3643527363 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fcd5c065a60 0x7fcd5c067f20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c0ad000 tx=0x7fcd6c004740 comp rx=0 tx=0).stop 2024-02-02T11:48:55.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.808+0000 7fcd82826640 1 -- 172.21.15.161:0/3643527363 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd7c141b30 msgr2=0x7fcd7c14b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:55.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.808+0000 7fcd82826640 1 --2- 172.21.15.161:0/3643527363 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd7c141b30 0x7fcd7c14b010 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcd74009fd0 tx=0x7fcd7400e4b0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.808+0000 7fcd82826640 1 -- 172.21.15.161:0/3643527363 shutdown_connections 2024-02-02T11:48:55.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.808+0000 7fcd82826640 1 --2- 172.21.15.161:0/3643527363 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fcd5c065a60 0x7fcd5c067f20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.808+0000 7fcd82826640 1 --2- 172.21.15.161:0/3643527363 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd7c141b30 0x7fcd7c14b010 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.808+0000 7fcd82826640 1 --2- 172.21.15.161:0/3643527363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd7c0bc340 0x7fcd7c0baf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.808+0000 7fcd82826640 1 --2- 172.21.15.161:0/3643527363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd7c0b8020 0x7fcd7c143790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.808+0000 7fcd82826640 1 -- 172.21.15.161:0/3643527363 >> 172.21.15.161:0/3643527363 conn(0x7fcd7c069ef0 msgr2=0x7fcd7c06fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:55.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.808+0000 7fcd82826640 1 -- 172.21.15.161:0/3643527363 shutdown_connections 2024-02-02T11:48:55.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.808+0000 7fcd82826640 1 -- 172.21.15.161:0/3643527363 wait complete. 2024-02-02T11:48:55.829 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-02-02T11:48:54.253116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218556,"kb_used_data":2376,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754756164,"statfs":{"total":773094113280,"available":772870311936,"internally_reserved":0,"allocated":2433024,"data_stored":1546584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000888"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-02T11:48:43.179833+0000","last_change":"2024-02-02T11:48:41.563754+0000","last_active":"2024-02-02T11:48:43.179833+0000","last_peered":"2024-02-02T11:48:43.179833+0000","last_clean":"2024-02-02T11:48:43.179833+0000","last_became_active":"2024-02-02T11:48:41.562629+0000","last_became_peered":"2024-02-02T11:48:41.562629+0000","last_unstale":"2024-02-02T11:48:43.179833+0000","last_undegraded":"2024-02-02T11:48:43.179833+0000","last_fullsized":"2024-02-02T11:48:43.179833+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_clean_scrub_stamp":"2024-02-02T11:48:40.536978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:22:02.923582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-02T11:48:55.832 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-02T11:48:55.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.988+0000 7faebba84640 1 Processor -- start 2024-02-02T11:48:55.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faebba84640 1 -- start start 2024-02-02T11:48:55.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faebba84640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faeb40bc340 0x7faeb41415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:55.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faebba84640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb4071550 con 0x7faeb4141b30 2024-02-02T11:48:55.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faebba84640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb4071810 con 0x7faeb40b8020 2024-02-02T11:48:55.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faebba84640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb40bc720 con 0x7faeb40bc340 2024-02-02T11:48:55.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb901f640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7faeb4141b30 0x7faeb4147c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39960/0 (socket says 172.21.15.161:39960) 2024-02-02T11:48:55.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb901f640 1 -- 172.21.15.161:0/1875887265 learned_addr learned my addr 172.21.15.161:0/1875887265 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:48:55.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb9820640 1 --2- 172.21.15.161:0/1875887265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faeb40bc340 0x7faeb41415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:55.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb881e640 1 -- 172.21.15.161:0/1875887265 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099342403 0 0) 0x7faeb4071550 con 0x7faeb4141b30 2024-02-02T11:48:55.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb881e640 1 -- 172.21.15.161:0/1875887265 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faea0003530 con 0x7faeb4141b30 2024-02-02T11:48:55.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb881e640 1 -- 172.21.15.161:0/1875887265 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 331874058 0 0) 0x7faea0003530 con 0x7faeb4141b30 2024-02-02T11:48:55.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb881e640 1 -- 172.21.15.161:0/1875887265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faeb40bc340 msgr2=0x7faeb41415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:55.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb881e640 1 --2- 172.21.15.161:0/1875887265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faeb40bc340 0x7faeb41415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:55.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb881e640 1 -- 172.21.15.161:0/1875887265 >> v1:172.21.15.162:6789/0 conn(0x7faeb40b8020 legacy=0x7faeb4151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:55.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb881e640 1 -- 172.21.15.161:0/1875887265 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb40b2d90 con 0x7faeb4141b30 2024-02-02T11:48:55.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb881e640 1 -- 172.21.15.161:0/1875887265 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7faeb0001680 con 0x7faeb4141b30 2024-02-02T11:48:55.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb881e640 1 -- 172.21.15.161:0/1875887265 >> v1:172.21.15.161:6789/0 conn(0x7faeb4141b30 legacy=0x7faeb4147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:55.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb881e640 1 --2- 172.21.15.161:0/1875887265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faea00039b0 0x7faea0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:55.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb881e640 1 --2- 172.21.15.161:0/1875887265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faeb40bc340 0x7faea00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:55.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb881e640 1 --2- 172.21.15.161:0/1875887265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faea0004d10 0x7faea0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:55.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb881e640 1 -- 172.21.15.161:0/1875887265 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb40bc720 con 0x7faea0004d10 2024-02-02T11:48:55.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb881e640 1 -- 172.21.15.161:0/1875887265 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea000bac0 con 0x7faea00039b0 2024-02-02T11:48:55.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb881e640 1 -- 172.21.15.161:0/1875887265 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea000bc80 con 0x7faeb40bc340 2024-02-02T11:48:55.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeba021640 1 --2- 172.21.15.161:0/1875887265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faea0004d10 0x7faea0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:55.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb9820640 1 --2- 172.21.15.161:0/1875887265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faea00039b0 0x7faea0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb901f640 1 --2- 172.21.15.161:0/1875887265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faeb40bc340 0x7faea00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeba021640 1 -- 172.21.15.161:0/1875887265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faeb40bc340 msgr2=0x7faea00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:56.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeba021640 1 --2- 172.21.15.161:0/1875887265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faeb40bc340 0x7faea00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeba021640 1 -- 172.21.15.161:0/1875887265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faea00039b0 msgr2=0x7faea0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:56.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeba021640 1 --2- 172.21.15.161:0/1875887265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faea00039b0 0x7faea0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeba021640 1 -- 172.21.15.161:0/1875887265 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea0003530 con 0x7faea0004d10 2024-02-02T11:48:56.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb901f640 1 --2- 172.21.15.161:0/1875887265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faeb40bc340 0x7faea00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:48:56.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.992+0000 7faeb9820640 1 --2- 172.21.15.161:0/1875887265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faea00039b0 0x7faea0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:48:56.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeba021640 1 --2- 172.21.15.161:0/1875887265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faea0004d10 0x7faea0005190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faeb414bc90 tx=0x7faeac01c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1625d384c22c8bd1 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:56.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeb881e640 1 -- 172.21.15.161:0/1875887265 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac003b80 con 0x7faea0004d10 2024-02-02T11:48:56.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeb881e640 1 -- 172.21.15.161:0/1875887265 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac003ce0 con 0x7faea0004d10 2024-02-02T11:48:56.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeb881e640 1 -- 172.21.15.161:0/1875887265 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac005310 con 0x7faea0004d10 2024-02-02T11:48:56.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faebba84640 1 -- 172.21.15.161:0/1875887265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faea0004d10 msgr2=0x7faea0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:56.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faebba84640 1 --2- 172.21.15.161:0/1875887265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faea0004d10 0x7faea0005190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faeb414bc90 tx=0x7faeac01c700 comp rx=0 tx=0).stop 2024-02-02T11:48:56.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeba021640 1 -- 172.21.15.161:0/1875887265 reap_dead start 2024-02-02T11:48:56.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faebba84640 1 -- 172.21.15.161:0/1875887265 shutdown_connections 2024-02-02T11:48:56.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faebba84640 1 -- 172.21.15.161:0/1875887265 >> 172.21.15.161:0/1875887265 conn(0x7faeb4069ef0 msgr2=0x7faeb406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:56.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faebba84640 1 -- 172.21.15.161:0/1875887265 shutdown_connections 2024-02-02T11:48:56.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faebba84640 1 -- 172.21.15.161:0/1875887265 wait complete. 2024-02-02T11:48:56.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faebba84640 1 Processor -- start 2024-02-02T11:48:56.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faebba84640 1 -- start start 2024-02-02T11:48:56.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faebba84640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faea0004d10 0x7faeb4137a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:56.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faebba84640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faeb40b5be0 0x7faeb41e00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:56.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faebba84640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faeb40b6060 0x7faeb41e0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:56.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faebba84640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb4136f50 con 0x7faea0004d10 2024-02-02T11:48:56.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faebba84640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb40b47d0 con 0x7faeb40b5be0 2024-02-02T11:48:56.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faebba84640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb413df00 con 0x7faeb40b6060 2024-02-02T11:48:56.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeb9820640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faea0004d10 0x7faeb4137a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeb9820640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faea0004d10 0x7faeb4137a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36540/0 (socket says 172.21.15.161:36540) 2024-02-02T11:48:56.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeb9820640 1 -- 172.21.15.161:0/2158368627 learned_addr learned my addr 172.21.15.161:0/2158368627 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:56.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeba021640 1 --2- 172.21.15.161:0/2158368627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faeb40b6060 0x7faeb41e0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeb901f640 1 --2- 172.21.15.161:0/2158368627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faeb40b5be0 0x7faeb41e00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeb9820640 1 -- 172.21.15.161:0/2158368627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faeb40b6060 msgr2=0x7faeb41e0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:56.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeb9820640 1 --2- 172.21.15.161:0/2158368627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faeb40b6060 0x7faeb41e0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeb9820640 1 -- 172.21.15.161:0/2158368627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faeb40b5be0 msgr2=0x7faeb41e00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:56.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeb9820640 1 --2- 172.21.15.161:0/2158368627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faeb40b5be0 0x7faeb41e00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeb9820640 1 -- 172.21.15.161:0/2158368627 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb4137fd0 con 0x7faea0004d10 2024-02-02T11:48:56.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeb901f640 1 --2- 172.21.15.161:0/2158368627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faeb40b5be0 0x7faeb41e00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:48:56.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeb9820640 1 --2- 172.21.15.161:0/2158368627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faea0004d10 0x7faeb4137a90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faea40115f0 tx=0x7faea4011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:56.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeaa7fc640 1 -- 172.21.15.161:0/2158368627 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4004220 con 0x7faea0004d10 2024-02-02T11:48:56.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeaa7fc640 1 -- 172.21.15.161:0/2158368627 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea4004380 con 0x7faea0004d10 2024-02-02T11:48:56.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faeaa7fc640 1 -- 172.21.15.161:0/2158368627 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea400f8f0 con 0x7faea0004d10 2024-02-02T11:48:56.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:55.996+0000 7faebba84640 1 -- 172.21.15.161:0/2158368627 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb41382a0 con 0x7faea0004d10 2024-02-02T11:48:56.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.000+0000 7faebba84640 1 -- 172.21.15.161:0/2158368627 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb4137160 con 0x7faea0004d10 2024-02-02T11:48:56.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.000+0000 7faebba84640 1 -- 172.21.15.161:0/2158368627 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb404e000 con 0x7faea0004d10 2024-02-02T11:48:56.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.000+0000 7faeaa7fc640 1 -- 172.21.15.161:0/2158368627 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faea400fa50 con 0x7faea0004d10 2024-02-02T11:48:56.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.000+0000 7faeaa7fc640 1 --2- 172.21.15.161:0/2158368627 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fae98065a60 0x7fae98067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:56.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.000+0000 7faeb901f640 1 --2- 172.21.15.161:0/2158368627 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fae98065a60 0x7fae98067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.000+0000 7faeaa7fc640 1 -- 172.21.15.161:0/2158368627 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faea40833d0 con 0x7faea0004d10 2024-02-02T11:48:56.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.000+0000 7faeb901f640 1 --2- 172.21.15.161:0/2158368627 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fae98065a60 0x7fae98067f20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faeb40bb630 tx=0x7faeb0000f80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:56.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.004+0000 7faeaa7fc640 1 -- 172.21.15.161:0/2158368627 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7faea4050e20 con 0x7faea0004d10 2024-02-02T11:48:56.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.152+0000 7faebba84640 1 -- 172.21.15.161:0/2158368627 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faeb4070980 con 0x7fae98065a60 2024-02-02T11:48:56.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.160+0000 7faeaa7fc640 1 -- 172.21.15.161:0/2158368627 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249730 (secure 0 0 0) 0x7faeb0012960 con 0x7fae98065a60 2024-02-02T11:48:56.165 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:48:56.166 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-02-02T11:48:56.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.164+0000 7faebba84640 1 -- 172.21.15.161:0/2158368627 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fae98065a60 msgr2=0x7fae98067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:56.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.164+0000 7faebba84640 1 --2- 172.21.15.161:0/2158368627 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fae98065a60 0x7fae98067f20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faeb40bb630 tx=0x7faeb0000f80 comp rx=0 tx=0).stop 2024-02-02T11:48:56.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.164+0000 7faebba84640 1 -- 172.21.15.161:0/2158368627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faea0004d10 msgr2=0x7faeb4137a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:56.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.164+0000 7faebba84640 1 --2- 172.21.15.161:0/2158368627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faea0004d10 0x7faeb4137a90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faea40115f0 tx=0x7faea4011ab0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.164+0000 7faebba84640 1 -- 172.21.15.161:0/2158368627 shutdown_connections 2024-02-02T11:48:56.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.164+0000 7faebba84640 1 --2- 172.21.15.161:0/2158368627 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fae98065a60 0x7fae98067f20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.164+0000 7faebba84640 1 --2- 172.21.15.161:0/2158368627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faeb40b6060 0x7faeb41e0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.164+0000 7faebba84640 1 --2- 172.21.15.161:0/2158368627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faeb40b5be0 0x7faeb41e00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.164+0000 7faebba84640 1 --2- 172.21.15.161:0/2158368627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faea0004d10 0x7faeb4137a90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.164+0000 7faebba84640 1 -- 172.21.15.161:0/2158368627 >> 172.21.15.161:0/2158368627 conn(0x7faeb4069ef0 msgr2=0x7faeb4147b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:56.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.164+0000 7faebba84640 1 -- 172.21.15.161:0/2158368627 shutdown_connections 2024-02-02T11:48:56.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.164+0000 7faebba84640 1 -- 172.21.15.161:0/2158368627 wait complete. 2024-02-02T11:48:56.183 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-02-02T11:48:54.253116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218556,"kb_used_data":2376,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754756164,"statfs":{"total":773094113280,"available":772870311936,"internally_reserved":0,"allocated":2433024,"data_stored":1546584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000888"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-02-02T11:48:43.179833+0000","last_change":"2024-02-02T11:48:41.563754+0000","last_active":"2024-02-02T11:48:43.179833+0000","last_peered":"2024-02-02T11:48:43.179833+0000","last_clean":"2024-02-02T11:48:43.179833+0000","last_became_active":"2024-02-02T11:48:41.562629+0000","last_became_peered":"2024-02-02T11:48:41.562629+0000","last_unstale":"2024-02-02T11:48:43.179833+0000","last_undegraded":"2024-02-02T11:48:43.179833+0000","last_fullsized":"2024-02-02T11:48:43.179833+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_clean_scrub_stamp":"2024-02-02T11:48:40.536978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:22:02.923582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:51.433234+0000","last_change":"2024-02-02T11:48:51.433234+0000","last_active":"2024-02-02T11:48:51.433234+0000","last_peered":"2024-02-02T11:48:51.433234+0000","last_clean":"2024-02-02T11:48:51.433234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:51.433234+0000","last_undegraded":"2024-02-02T11:48:51.433234+0000","last_fullsized":"2024-02-02T11:48:51.433234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:48:50.422893+0000","last_change":"2024-02-02T11:48:50.422893+0000","last_active":"2024-02-02T11:48:50.422893+0000","last_peered":"2024-02-02T11:48:50.422893+0000","last_clean":"2024-02-02T11:48:50.422893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:48:50.422893+0000","last_undegraded":"2024-02-02T11:48:50.422893+0000","last_fullsized":"2024-02-02T11:48:50.422893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-02T11:48:56.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2024-02-02T11:48:56.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2024-02-02T11:48:56.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2024-02-02T11:48:56.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2024-02-02T11:48:56.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2024-02-02T11:48:56.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2024-02-02T11:48:56.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2024-02-02T11:48:56.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2024-02-02T11:48:56.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2024-02-02T11:48:56.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2024-02-02T11:48:56.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2024-02-02T11:48:56.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2024-02-02T11:48:56.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2024-02-02T11:48:56.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2024-02-02T11:48:56.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2024-02-02T11:48:56.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2024-02-02T11:48:56.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2024-02-02T11:48:56.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2024-02-02T11:48:56.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2024-02-02T11:48:56.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2024-02-02T11:48:56.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2024-02-02T11:48:56.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2024-02-02T11:48:56.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2024-02-02T11:48:56.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2024-02-02T11:48:56.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2024-02-02T11:48:56.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2024-02-02T11:48:56.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2024-02-02T11:48:56.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2024-02-02T11:48:56.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2024-02-02T11:48:56.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2024-02-02T11:48:56.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2024-02-02T11:48:56.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2024-02-02T11:48:56.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-02-02T11:48:56.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2024-02-02T11:48:56.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-02-02T11:48:56.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2024-02-02T11:48:56.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2024-02-02T11:48:56.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-02-02T11:48:56.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2024-02-02T11:48:56.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-02-02T11:48:56.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2024-02-02T11:48:56.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-02-02T11:48:56.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2024-02-02T11:48:56.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-02-02T11:48:56.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2024-02-02T11:48:56.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-02-02T11:48:56.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2024-02-02T11:48:56.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-02-02T11:48:56.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2024-02-02T11:48:56.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-02-02T11:48:56.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2024-02-02T11:48:56.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-02-02T11:48:56.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2024-02-02T11:48:56.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-02-02T11:48:56.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2024-02-02T11:48:56.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-02-02T11:48:56.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2024-02-02T11:48:56.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-02-02T11:48:56.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2024-02-02T11:48:56.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-02-02T11:48:56.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2024-02-02T11:48:56.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-02-02T11:48:56.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2024-02-02T11:48:56.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-02-02T11:48:56.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2024-02-02T11:48:56.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-02-02T11:48:56.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2024-02-02T11:48:56.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-02-02T11:48:56.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2024-02-02T11:48:56.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-02-02T11:48:56.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2024-02-02T11:48:56.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-02-02T11:48:56.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2024-02-02T11:48:56.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-02-02T11:48:56.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2024-02-02T11:48:56.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-02-02T11:48:56.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2024-02-02T11:48:56.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-02-02T11:48:56.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2024-02-02T11:48:56.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-02-02T11:48:56.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2024-02-02T11:48:56.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-02-02T11:48:56.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2024-02-02T11:48:56.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-02-02T11:48:56.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2024-02-02T11:48:56.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-02-02T11:48:56.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2024-02-02T11:48:56.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-02-02T11:48:56.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-02-02T11:48:56.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2024-02-02T11:48:56.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-02-02T11:48:56.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2024-02-02T11:48:56.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-02-02T11:48:56.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2024-02-02T11:48:56.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-02-02T11:48:56.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:51.433234+0000', 'last_change': '2024-02-02T11:48:51.433234+0000', 'last_active': '2024-02-02T11:48:51.433234+0000', 'last_peered': '2024-02-02T11:48:51.433234+0000', 'last_clean': '2024-02-02T11:48:51.433234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:51.433234+0000', 'last_undegraded': '2024-02-02T11:48:51.433234+0000', 'last_fullsized': '2024-02-02T11:48:51.433234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:51.433234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2024-02-02T11:48:56.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:48:50.422893+0000', 'last_change': '2024-02-02T11:48:50.422893+0000', 'last_active': '2024-02-02T11:48:50.422893+0000', 'last_peered': '2024-02-02T11:48:50.422893+0000', 'last_clean': '2024-02-02T11:48:50.422893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:48:50.422893+0000', 'last_undegraded': '2024-02-02T11:48:50.422893+0000', 'last_fullsized': '2024-02-02T11:48:50.422893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'last_clean_scrub_stamp': '2024-02-02T11:48:50.422893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:48:56.205 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-02-02T11:48:56.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.340+0000 7fc85fe17640 1 Processor -- start 2024-02-02T11:48:56.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.340+0000 7fc85fe17640 1 -- start start 2024-02-02T11:48:56.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85fe17640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc8580708d0 0x7fc858070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:56.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85fe17640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc858147920 0x7fc8581440d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:56.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85fe17640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8580b2c80 con 0x7fc858071a20 2024-02-02T11:48:56.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85fe17640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85806fdb0 con 0x7fc8580708d0 2024-02-02T11:48:56.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85fe17640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc858070370 con 0x7fc858147920 2024-02-02T11:48:56.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85dbb3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc8580708d0 0x7fc858070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85dbb3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc8580708d0 0x7fc858070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36552/0 (socket says 172.21.15.161:36552) 2024-02-02T11:48:56.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85dbb3640 1 -- 172.21.15.161:0/433823755 learned_addr learned my addr 172.21.15.161:0/433823755 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:56.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85d3b2640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc858071a20 0x7fc858147210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39966/0 (socket says 172.21.15.161:39966) 2024-02-02T11:48:56.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85e3b4640 1 --2- 172.21.15.161:0/433823755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc858147920 0x7fc8581440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85dbb3640 1 -- 172.21.15.161:0/433823755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc858147920 msgr2=0x7fc8581440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:56.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85dbb3640 1 --2- 172.21.15.161:0/433823755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc858147920 0x7fc8581440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85dbb3640 1 -- 172.21.15.161:0/433823755 >> v1:172.21.15.161:6789/0 conn(0x7fc858071a20 legacy=0x7fc858147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:56.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85cbb1640 1 -- 172.21.15.161:0/433823755 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285485112 0 0) 0x7fc8580b2c80 con 0x7fc858071a20 2024-02-02T11:48:56.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85dbb3640 1 -- 172.21.15.161:0/433823755 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8580b2ed0 con 0x7fc8580708d0 2024-02-02T11:48:56.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85e3b4640 1 --2- 172.21.15.161:0/433823755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc858147920 0x7fc8581440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:48:56.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85dbb3640 1 --2- 172.21.15.161:0/433823755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8580708d0 0x7fc858070cb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc85400af60 tx=0x7fc85401dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a2acdfeb7efbbb server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:56.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85cbb1640 1 -- 172.21.15.161:0/433823755 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85400a2d0 con 0x7fc8580708d0 2024-02-02T11:48:56.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85cbb1640 1 -- 172.21.15.161:0/433823755 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8540a69e0 con 0x7fc8580708d0 2024-02-02T11:48:56.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85cbb1640 1 -- 172.21.15.161:0/433823755 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8540a6d70 con 0x7fc8580708d0 2024-02-02T11:48:56.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85fe17640 1 -- 172.21.15.161:0/433823755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8580708d0 msgr2=0x7fc858070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:56.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85fe17640 1 --2- 172.21.15.161:0/433823755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8580708d0 0x7fc858070cb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc85400af60 tx=0x7fc85401dae0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85fe17640 1 -- 172.21.15.161:0/433823755 shutdown_connections 2024-02-02T11:48:56.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85fe17640 1 --2- 172.21.15.161:0/433823755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc858147920 0x7fc8581440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85fe17640 1 --2- 172.21.15.161:0/433823755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8580708d0 0x7fc858070cb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85fe17640 1 -- 172.21.15.161:0/433823755 >> 172.21.15.161:0/433823755 conn(0x7fc858069ef0 msgr2=0x7fc85806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:56.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85fe17640 1 -- 172.21.15.161:0/433823755 shutdown_connections 2024-02-02T11:48:56.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.344+0000 7fc85fe17640 1 -- 172.21.15.161:0/433823755 wait complete. 2024-02-02T11:48:56.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85fe17640 1 Processor -- start 2024-02-02T11:48:56.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85fe17640 1 -- start start 2024-02-02T11:48:56.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85fe17640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8580708d0 0x7fc8580baf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:56.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85fe17640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc858071a20 0x7fc858136910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:56.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85fe17640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc858147920 0x7fc858131460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:56.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85fe17640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580bb4a0 con 0x7fc858147920 2024-02-02T11:48:56.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85fe17640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85813d940 con 0x7fc8580708d0 2024-02-02T11:48:56.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85fe17640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85813dc20 con 0x7fc858071a20 2024-02-02T11:48:56.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85e3b4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc858147920 0x7fc858131460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85e3b4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc858147920 0x7fc858131460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36560/0 (socket says 172.21.15.161:36560) 2024-02-02T11:48:56.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85e3b4640 1 -- 172.21.15.161:0/2898598200 learned_addr learned my addr 172.21.15.161:0/2898598200 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:56.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85d3b2640 1 --2- 172.21.15.161:0/2898598200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc858071a20 0x7fc858136910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85dbb3640 1 --2- 172.21.15.161:0/2898598200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8580708d0 0x7fc8580baf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85e3b4640 1 -- 172.21.15.161:0/2898598200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc858071a20 msgr2=0x7fc858136910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:56.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85e3b4640 1 --2- 172.21.15.161:0/2898598200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc858071a20 0x7fc858136910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85e3b4640 1 -- 172.21.15.161:0/2898598200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8580708d0 msgr2=0x7fc8580baf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:56.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85e3b4640 1 --2- 172.21.15.161:0/2898598200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8580708d0 0x7fc8580baf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85e3b4640 1 -- 172.21.15.161:0/2898598200 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85400ac40 con 0x7fc858147920 2024-02-02T11:48:56.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85d3b2640 1 --2- 172.21.15.161:0/2898598200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc858071a20 0x7fc858136910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:48:56.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85dbb3640 1 --2- 172.21.15.161:0/2898598200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8580708d0 0x7fc8580baf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:48:56.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85e3b4640 1 --2- 172.21.15.161:0/2898598200 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc858147920 0x7fc858131460 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc85000c7f0 tx=0x7fc85000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:56.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc84e7fc640 1 -- 172.21.15.161:0/2898598200 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc850004230 con 0x7fc858147920 2024-02-02T11:48:56.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc84e7fc640 1 -- 172.21.15.161:0/2898598200 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8500043b0 con 0x7fc858147920 2024-02-02T11:48:56.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85fe17640 1 -- 172.21.15.161:0/2898598200 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc85813c030 con 0x7fc858147920 2024-02-02T11:48:56.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc84e7fc640 1 -- 172.21.15.161:0/2898598200 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc850003860 con 0x7fc858147920 2024-02-02T11:48:56.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85fe17640 1 -- 172.21.15.161:0/2898598200 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85813c830 con 0x7fc858147920 2024-02-02T11:48:56.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc85fe17640 1 -- 172.21.15.161:0/2898598200 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc858067050 con 0x7fc858147920 2024-02-02T11:48:56.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.348+0000 7fc84e7fc640 1 -- 172.21.15.161:0/2898598200 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc850003bd0 con 0x7fc858147920 2024-02-02T11:48:56.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.352+0000 7fc84e7fc640 1 --2- 172.21.15.161:0/2898598200 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc83c065a60 0x7fc83c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:56.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.352+0000 7fc84e7fc640 1 -- 172.21.15.161:0/2898598200 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc850083740 con 0x7fc858147920 2024-02-02T11:48:56.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.352+0000 7fc85dbb3640 1 --2- 172.21.15.161:0/2898598200 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc83c065a60 0x7fc83c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.352+0000 7fc85dbb3640 1 --2- 172.21.15.161:0/2898598200 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc83c065a60 0x7fc83c067f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc8540af000 tx=0x7fc8540a8070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:56.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.356+0000 7fc84e7fc640 1 -- 172.21.15.161:0/2898598200 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc850051070 con 0x7fc858147920 2024-02-02T11:48:56.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.568+0000 7fc85fe17640 1 -- 172.21.15.161:0/2898598200 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc85813da80 con 0x7fc858147920 2024-02-02T11:48:56.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.568+0000 7fc84e7fc640 1 -- 172.21.15.161:0/2898598200 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1010 (secure 0 0 0) 0x7fc850015410 con 0x7fc858147920 2024-02-02T11:48:56.577 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:48:56.577 INFO:teuthology.orchestra.run.smithi161.stdout:{"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":28,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1706874519,"num_in_osds":8,"osd_in_since":1706874509,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":228433920,"bytes_avail":772865679360,"bytes_total":773094113280,"write_bytes_sec":2463,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4263}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-02-02T11:48:27.689424+0000","services":{}},"progress_events":{}} 2024-02-02T11:48:56.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.572+0000 7fc85fe17640 1 -- 172.21.15.161:0/2898598200 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc83c065a60 msgr2=0x7fc83c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:56.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.572+0000 7fc85fe17640 1 --2- 172.21.15.161:0/2898598200 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc83c065a60 0x7fc83c067f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc8540af000 tx=0x7fc8540a8070 comp rx=0 tx=0).stop 2024-02-02T11:48:56.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.572+0000 7fc85fe17640 1 -- 172.21.15.161:0/2898598200 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc858147920 msgr2=0x7fc858131460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:56.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.572+0000 7fc85fe17640 1 --2- 172.21.15.161:0/2898598200 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc858147920 0x7fc858131460 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc85000c7f0 tx=0x7fc85000ccb0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.572+0000 7fc85fe17640 1 -- 172.21.15.161:0/2898598200 shutdown_connections 2024-02-02T11:48:56.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.572+0000 7fc85fe17640 1 --2- 172.21.15.161:0/2898598200 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc83c065a60 0x7fc83c067f20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.572+0000 7fc85fe17640 1 --2- 172.21.15.161:0/2898598200 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc858147920 0x7fc858131460 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.572+0000 7fc85fe17640 1 --2- 172.21.15.161:0/2898598200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc858071a20 0x7fc858136910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.572+0000 7fc85fe17640 1 --2- 172.21.15.161:0/2898598200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8580708d0 0x7fc8580baf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.572+0000 7fc85fe17640 1 -- 172.21.15.161:0/2898598200 >> 172.21.15.161:0/2898598200 conn(0x7fc858069ef0 msgr2=0x7fc85813e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:56.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.572+0000 7fc85fe17640 1 -- 172.21.15.161:0/2898598200 shutdown_connections 2024-02-02T11:48:56.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.572+0000 7fc85fe17640 1 -- 172.21.15.161:0/2898598200 wait complete. 2024-02-02T11:48:56.591 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-02-02T11:48:56.592 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-02T11:48:56.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac07cc4640 1 Processor -- start 2024-02-02T11:48:56.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac07cc4640 1 -- start start 2024-02-02T11:48:56.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac07cc4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fac000bc340 0x7fac001415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:56.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac07cc4640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac00071550 con 0x7fac00141b30 2024-02-02T11:48:56.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac07cc4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac00071810 con 0x7fac000b8020 2024-02-02T11:48:56.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac07cc4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac000bc720 con 0x7fac000bc340 2024-02-02T11:48:56.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac0525f640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fac00141b30 0x7fac00147c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39974/0 (socket says 172.21.15.161:39974) 2024-02-02T11:48:56.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac0525f640 1 -- 172.21.15.161:0/2050178375 learned_addr learned my addr 172.21.15.161:0/2050178375 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:48:56.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac05a60640 1 --2- 172.21.15.161:0/2050178375 >> v2:172.21.15.162:3300/0 conn(0x7fac000bc340 0x7fac001415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac04a5e640 1 -- 172.21.15.161:0/2050178375 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601103952 0 0) 0x7fac00071550 con 0x7fac00141b30 2024-02-02T11:48:56.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac04a5e640 1 -- 172.21.15.161:0/2050178375 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabec005740 con 0x7fac00141b30 2024-02-02T11:48:56.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac04a5e640 1 -- 172.21.15.161:0/2050178375 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2675896160 0 0) 0x7fabec005740 con 0x7fac00141b30 2024-02-02T11:48:56.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac04a5e640 1 -- 172.21.15.161:0/2050178375 >> v2:172.21.15.162:3300/0 conn(0x7fac000bc340 msgr2=0x7fac001415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:56.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac04a5e640 1 --2- 172.21.15.161:0/2050178375 >> v2:172.21.15.162:3300/0 conn(0x7fac000bc340 0x7fac001415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac04a5e640 1 -- 172.21.15.161:0/2050178375 >> v1:172.21.15.162:6789/0 conn(0x7fac000b8020 legacy=0x7fac00151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:56.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac04a5e640 1 -- 172.21.15.161:0/2050178375 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac000b2d90 con 0x7fac00141b30 2024-02-02T11:48:56.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac04a5e640 1 -- 172.21.15.161:0/2050178375 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7fabf0001680 con 0x7fac00141b30 2024-02-02T11:48:56.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac04a5e640 1 -- 172.21.15.161:0/2050178375 >> v1:172.21.15.161:6789/0 conn(0x7fac00141b30 legacy=0x7fac00147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:56.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac04a5e640 1 --2- 172.21.15.161:0/2050178375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabec005b90 0x7fabec005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:56.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac04a5e640 1 --2- 172.21.15.161:0/2050178375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabec0069e0 0x7fabec006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:56.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac04a5e640 1 --2- 172.21.15.161:0/2050178375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabec0073a0 0x7fabec00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:56.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac04a5e640 1 -- 172.21.15.161:0/2050178375 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac000bc720 con 0x7fabec005b90 2024-02-02T11:48:56.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac04a5e640 1 -- 172.21.15.161:0/2050178375 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec00e340 con 0x7fabec0073a0 2024-02-02T11:48:56.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac04a5e640 1 -- 172.21.15.161:0/2050178375 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec00e500 con 0x7fabec0069e0 2024-02-02T11:48:56.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac05a60640 1 --2- 172.21.15.161:0/2050178375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabec005b90 0x7fabec005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac0525f640 1 --2- 172.21.15.161:0/2050178375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabec0069e0 0x7fabec006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac05a60640 1 -- 172.21.15.161:0/2050178375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabec0069e0 msgr2=0x7fabec006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:56.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac05a60640 1 --2- 172.21.15.161:0/2050178375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabec0069e0 0x7fabec006e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac06261640 1 --2- 172.21.15.161:0/2050178375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabec0073a0 0x7fabec00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac05a60640 1 -- 172.21.15.161:0/2050178375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabec0073a0 msgr2=0x7fabec00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:48:56.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac05a60640 1 --2- 172.21.15.161:0/2050178375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabec0073a0 0x7fabec00dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac06261640 1 -- 172.21.15.161:0/2050178375 reap_dead start 2024-02-02T11:48:56.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.712+0000 7fac05a60640 1 -- 172.21.15.161:0/2050178375 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec005740 con 0x7fabec005b90 2024-02-02T11:48:56.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac05a60640 1 --2- 172.21.15.161:0/2050178375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabec005b90 0x7fabec005fb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009ae0 tx=0x7fabfc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1458513793173710 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:56.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac04a5e640 1 -- 172.21.15.161:0/2050178375 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc0a6430 con 0x7fabec005b90 2024-02-02T11:48:56.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac04a5e640 1 -- 172.21.15.161:0/2050178375 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabfc0a6590 con 0x7fabec005b90 2024-02-02T11:48:56.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac04a5e640 1 -- 172.21.15.161:0/2050178375 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc0a6940 con 0x7fabec005b90 2024-02-02T11:48:56.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac07cc4640 1 -- 172.21.15.161:0/2050178375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabec005b90 msgr2=0x7fabec005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:56.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac07cc4640 1 --2- 172.21.15.161:0/2050178375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabec005b90 0x7fabec005fb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009ae0 tx=0x7fabfc01ca50 comp rx=0 tx=0).stop 2024-02-02T11:48:56.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac07cc4640 1 -- 172.21.15.161:0/2050178375 shutdown_connections 2024-02-02T11:48:56.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac07cc4640 1 --2- 172.21.15.161:0/2050178375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabec005b90 0x7fabec005fb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac07cc4640 1 -- 172.21.15.161:0/2050178375 >> 172.21.15.161:0/2050178375 conn(0x7fac00069ef0 msgr2=0x7fac0006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:56.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac07cc4640 1 -- 172.21.15.161:0/2050178375 shutdown_connections 2024-02-02T11:48:56.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac07cc4640 1 -- 172.21.15.161:0/2050178375 wait complete. 2024-02-02T11:48:56.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac07cc4640 1 Processor -- start 2024-02-02T11:48:56.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac07cc4640 1 -- start start 2024-02-02T11:48:56.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac07cc4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabec005b90 0x7fac00149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:56.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac07cc4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac001e23b0 0x7fac000ba650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:56.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac07cc4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac000b4f60 0x7fac000b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:56.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac07cc4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac000ba230 con 0x7fac000b4f60 2024-02-02T11:48:56.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac07cc4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac00145710 con 0x7fac001e23b0 2024-02-02T11:48:56.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac07cc4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0014a1a0 con 0x7fabec005b90 2024-02-02T11:48:56.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac06261640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac000b4f60 0x7fac000b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac06261640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac000b4f60 0x7fac000b53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36572/0 (socket says 172.21.15.161:36572) 2024-02-02T11:48:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac06261640 1 -- 172.21.15.161:0/3982115178 learned_addr learned my addr 172.21.15.161:0/3982115178 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:48:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac05a60640 1 --2- 172.21.15.161:0/3982115178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabec005b90 0x7fac00149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.716+0000 7fac0525f640 1 --2- 172.21.15.161:0/3982115178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac001e23b0 0x7fac000ba650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.720+0000 7fac06261640 1 -- 172.21.15.161:0/3982115178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabec005b90 msgr2=0x7fac00149c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.720+0000 7fac06261640 1 --2- 172.21.15.161:0/3982115178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabec005b90 0x7fac00149c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.720+0000 7fac06261640 1 -- 172.21.15.161:0/3982115178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac001e23b0 msgr2=0x7fac000ba650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.720+0000 7fac06261640 1 --2- 172.21.15.161:0/3982115178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac001e23b0 0x7fac000ba650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.720+0000 7fac06261640 1 -- 172.21.15.161:0/3982115178 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac000bab90 con 0x7fac000b4f60 2024-02-02T11:48:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.720+0000 7fac0525f640 1 --2- 172.21.15.161:0/3982115178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac001e23b0 0x7fac000ba650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:48:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.720+0000 7fac06261640 1 --2- 172.21.15.161:0/3982115178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac000b4f60 0x7fac000b53e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fac0006ea80 tx=0x7fabf800d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.720+0000 7fabf67fc640 1 -- 172.21.15.161:0/3982115178 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8003d90 con 0x7fac000b4f60 2024-02-02T11:48:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.720+0000 7fabf67fc640 1 -- 172.21.15.161:0/3982115178 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf8005070 con 0x7fac000b4f60 2024-02-02T11:48:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.720+0000 7fac07cc4640 1 -- 172.21.15.161:0/3982115178 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0014a750 con 0x7fac000b4f60 2024-02-02T11:48:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.720+0000 7fabf67fc640 1 -- 172.21.15.161:0/3982115178 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf80053e0 con 0x7fac000b4f60 2024-02-02T11:48:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.720+0000 7fac07cc4640 1 -- 172.21.15.161:0/3982115178 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac000b9e50 con 0x7fac000b4f60 2024-02-02T11:48:56.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.720+0000 7fac07cc4640 1 -- 172.21.15.161:0/3982115178 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac000ba370 con 0x7fac000b4f60 2024-02-02T11:48:56.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.720+0000 7fabf67fc640 1 -- 172.21.15.161:0/3982115178 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fabf8005540 con 0x7fac000b4f60 2024-02-02T11:48:56.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.720+0000 7fabf67fc640 1 --2- 172.21.15.161:0/3982115178 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fabe4065a60 0x7fabe4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:48:56.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.720+0000 7fabf67fc640 1 -- 172.21.15.161:0/3982115178 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabf80826e0 con 0x7fac000b4f60 2024-02-02T11:48:56.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.720+0000 7fac05a60640 1 --2- 172.21.15.161:0/3982115178 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fabe4065a60 0x7fabe4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:48:56.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.720+0000 7fac05a60640 1 --2- 172.21.15.161:0/3982115178 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fabe4065a60 0x7fabe4067f20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0ad000 tx=0x7fabfc0b2040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:48:56.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.724+0000 7fabf67fc640 1 -- 172.21.15.161:0/3982115178 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fac000ba370 con 0x7fac000b4f60 2024-02-02T11:48:56.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.876+0000 7fac07cc4640 1 -- 172.21.15.161:0/3982115178 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac00148470 con 0x7fabe4065a60 2024-02-02T11:48:56.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.896+0000 7fabf67fc640 1 -- 172.21.15.161:0/3982115178 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264540 (secure 0 0 0) 0x7fabfc0a6700 con 0x7fabe4065a60 2024-02-02T11:48:56.901 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:48:56.903 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-02-02T11:48:56.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.900+0000 7fac07cc4640 1 -- 172.21.15.161:0/3982115178 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fabe4065a60 msgr2=0x7fabe4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:56.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.900+0000 7fac07cc4640 1 --2- 172.21.15.161:0/3982115178 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fabe4065a60 0x7fabe4067f20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0ad000 tx=0x7fabfc0b2040 comp rx=0 tx=0).stop 2024-02-02T11:48:56.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.900+0000 7fac07cc4640 1 -- 172.21.15.161:0/3982115178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac000b4f60 msgr2=0x7fac000b53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:48:56.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.900+0000 7fac07cc4640 1 --2- 172.21.15.161:0/3982115178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac000b4f60 0x7fac000b53e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fac0006ea80 tx=0x7fabf800d9d0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.900+0000 7fac07cc4640 1 -- 172.21.15.161:0/3982115178 shutdown_connections 2024-02-02T11:48:56.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.900+0000 7fac07cc4640 1 --2- 172.21.15.161:0/3982115178 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fabe4065a60 0x7fabe4067f20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.900+0000 7fac07cc4640 1 --2- 172.21.15.161:0/3982115178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac000b4f60 0x7fac000b53e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.900+0000 7fac07cc4640 1 --2- 172.21.15.161:0/3982115178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac001e23b0 0x7fac000ba650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.900+0000 7fac07cc4640 1 --2- 172.21.15.161:0/3982115178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabec005b90 0x7fac00149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:48:56.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.900+0000 7fac07cc4640 1 -- 172.21.15.161:0/3982115178 >> 172.21.15.161:0/3982115178 conn(0x7fac00069ef0 msgr2=0x7fac0013f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:48:56.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.900+0000 7fac07cc4640 1 -- 172.21.15.161:0/3982115178 shutdown_connections 2024-02-02T11:48:56.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:48:56.900+0000 7fac07cc4640 1 -- 172.21.15.161:0/3982115178 wait complete. 2024-02-02T11:48:56.920 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-02-02T11:48:56.253647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223080,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":220146,"kb_avail":754751640,"statfs":{"total":773094113280,"available":772865679360,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225429592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.818918"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014159+0000","last_change":"2024-02-02T11:48:51.897055+0000","last_active":"2024-02-02T11:48:53.014159+0000","last_peered":"2024-02-02T11:48:53.014159+0000","last_clean":"2024-02-02T11:48:53.014159+0000","last_became_active":"2024-02-02T11:48:51.896591+0000","last_became_peered":"2024-02-02T11:48:51.896591+0000","last_unstale":"2024-02-02T11:48:53.014159+0000","last_undegraded":"2024-02-02T11:48:53.014159+0000","last_fullsized":"2024-02-02T11:48:53.014159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825415+0000","last_change":"2024-02-02T11:48:51.849203+0000","last_active":"2024-02-02T11:48:52.825415+0000","last_peered":"2024-02-02T11:48:52.825415+0000","last_clean":"2024-02-02T11:48:52.825415+0000","last_became_active":"2024-02-02T11:48:51.848773+0000","last_became_peered":"2024-02-02T11:48:51.848773+0000","last_unstale":"2024-02-02T11:48:52.825415+0000","last_undegraded":"2024-02-02T11:48:52.825415+0000","last_fullsized":"2024-02-02T11:48:52.825415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:26:18.517358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014636+0000","last_change":"2024-02-02T11:48:51.848120+0000","last_active":"2024-02-02T11:48:53.014636+0000","last_peered":"2024-02-02T11:48:53.014636+0000","last_clean":"2024-02-02T11:48:53.014636+0000","last_became_active":"2024-02-02T11:48:51.847834+0000","last_became_peered":"2024-02-02T11:48:51.847834+0000","last_unstale":"2024-02-02T11:48:53.014636+0000","last_undegraded":"2024-02-02T11:48:53.014636+0000","last_fullsized":"2024-02-02T11:48:53.014636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:14.049200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828595+0000","last_change":"2024-02-02T11:48:51.873374+0000","last_active":"2024-02-02T11:48:52.828595+0000","last_peered":"2024-02-02T11:48:52.828595+0000","last_clean":"2024-02-02T11:48:52.828595+0000","last_became_active":"2024-02-02T11:48:51.872600+0000","last_became_peered":"2024-02-02T11:48:51.872600+0000","last_unstale":"2024-02-02T11:48:52.828595+0000","last_undegraded":"2024-02-02T11:48:52.828595+0000","last_fullsized":"2024-02-02T11:48:52.828595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:31:27.082147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013509+0000","last_change":"2024-02-02T11:48:51.886196+0000","last_active":"2024-02-02T11:48:53.013509+0000","last_peered":"2024-02-02T11:48:53.013509+0000","last_clean":"2024-02-02T11:48:53.013509+0000","last_became_active":"2024-02-02T11:48:51.885504+0000","last_became_peered":"2024-02-02T11:48:51.885504+0000","last_unstale":"2024-02-02T11:48:53.013509+0000","last_undegraded":"2024-02-02T11:48:53.013509+0000","last_fullsized":"2024-02-02T11:48:53.013509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:55:40.677428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828565+0000","last_change":"2024-02-02T11:48:51.890332+0000","last_active":"2024-02-02T11:48:52.828565+0000","last_peered":"2024-02-02T11:48:52.828565+0000","last_clean":"2024-02-02T11:48:52.828565+0000","last_became_active":"2024-02-02T11:48:51.889165+0000","last_became_peered":"2024-02-02T11:48:51.889165+0000","last_unstale":"2024-02-02T11:48:52.828565+0000","last_undegraded":"2024-02-02T11:48:52.828565+0000","last_fullsized":"2024-02-02T11:48:52.828565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:01:26.016064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013297+0000","last_change":"2024-02-02T11:48:51.884543+0000","last_active":"2024-02-02T11:48:53.013297+0000","last_peered":"2024-02-02T11:48:53.013297+0000","last_clean":"2024-02-02T11:48:53.013297+0000","last_became_active":"2024-02-02T11:48:51.884113+0000","last_became_peered":"2024-02-02T11:48:51.884113+0000","last_unstale":"2024-02-02T11:48:53.013297+0000","last_undegraded":"2024-02-02T11:48:53.013297+0000","last_fullsized":"2024-02-02T11:48:53.013297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:31:27.082147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013204+0000","last_change":"2024-02-02T11:48:51.873291+0000","last_active":"2024-02-02T11:48:53.013204+0000","last_peered":"2024-02-02T11:48:53.013204+0000","last_clean":"2024-02-02T11:48:53.013204+0000","last_became_active":"2024-02-02T11:48:51.872981+0000","last_became_peered":"2024-02-02T11:48:51.872981+0000","last_unstale":"2024-02-02T11:48:53.013204+0000","last_undegraded":"2024-02-02T11:48:53.013204+0000","last_fullsized":"2024-02-02T11:48:53.013204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:14.049200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014205+0000","last_change":"2024-02-02T11:48:51.898237+0000","last_active":"2024-02-02T11:48:53.014205+0000","last_peered":"2024-02-02T11:48:53.014205+0000","last_clean":"2024-02-02T11:48:53.014205+0000","last_became_active":"2024-02-02T11:48:51.897065+0000","last_became_peered":"2024-02-02T11:48:51.897065+0000","last_unstale":"2024-02-02T11:48:53.014205+0000","last_undegraded":"2024-02-02T11:48:53.014205+0000","last_fullsized":"2024-02-02T11:48:53.014205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:56:59.771841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993307+0000","last_change":"2024-02-02T11:48:51.864449+0000","last_active":"2024-02-02T11:48:52.993307+0000","last_peered":"2024-02-02T11:48:52.993307+0000","last_clean":"2024-02-02T11:48:52.993307+0000","last_became_active":"2024-02-02T11:48:51.863664+0000","last_became_peered":"2024-02-02T11:48:51.863664+0000","last_unstale":"2024-02-02T11:48:52.993307+0000","last_undegraded":"2024-02-02T11:48:52.993307+0000","last_fullsized":"2024-02-02T11:48:52.993307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993018+0000","last_change":"2024-02-02T11:48:51.890353+0000","last_active":"2024-02-02T11:48:52.993018+0000","last_peered":"2024-02-02T11:48:52.993018+0000","last_clean":"2024-02-02T11:48:52.993018+0000","last_became_active":"2024-02-02T11:48:51.889927+0000","last_became_peered":"2024-02-02T11:48:51.889927+0000","last_unstale":"2024-02-02T11:48:52.993018+0000","last_undegraded":"2024-02-02T11:48:52.993018+0000","last_fullsized":"2024-02-02T11:48:52.993018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:44:05.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.827212+0000","last_change":"2024-02-02T11:48:51.865778+0000","last_active":"2024-02-02T11:48:52.827212+0000","last_peered":"2024-02-02T11:48:52.827212+0000","last_clean":"2024-02-02T11:48:52.827212+0000","last_became_active":"2024-02-02T11:48:51.864513+0000","last_became_peered":"2024-02-02T11:48:51.864513+0000","last_unstale":"2024-02-02T11:48:52.827212+0000","last_undegraded":"2024-02-02T11:48:52.827212+0000","last_fullsized":"2024-02-02T11:48:52.827212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:33.128561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014047+0000","last_change":"2024-02-02T11:48:51.871880+0000","last_active":"2024-02-02T11:48:53.014047+0000","last_peered":"2024-02-02T11:48:53.014047+0000","last_clean":"2024-02-02T11:48:53.014047+0000","last_became_active":"2024-02-02T11:48:51.871683+0000","last_became_peered":"2024-02-02T11:48:51.871683+0000","last_unstale":"2024-02-02T11:48:53.014047+0000","last_undegraded":"2024-02-02T11:48:53.014047+0000","last_fullsized":"2024-02-02T11:48:53.014047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:32:50.539652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016221+0000","last_change":"2024-02-02T11:48:51.843150+0000","last_active":"2024-02-02T11:48:53.016221+0000","last_peered":"2024-02-02T11:48:53.016221+0000","last_clean":"2024-02-02T11:48:53.016221+0000","last_became_active":"2024-02-02T11:48:51.842884+0000","last_became_peered":"2024-02-02T11:48:51.842884+0000","last_unstale":"2024-02-02T11:48:53.016221+0000","last_undegraded":"2024-02-02T11:48:53.016221+0000","last_fullsized":"2024-02-02T11:48:53.016221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:33:43.440229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.824851+0000","last_change":"2024-02-02T11:48:51.835634+0000","last_active":"2024-02-02T11:48:52.824851+0000","last_peered":"2024-02-02T11:48:52.824851+0000","last_clean":"2024-02-02T11:48:52.824851+0000","last_became_active":"2024-02-02T11:48:51.835378+0000","last_became_peered":"2024-02-02T11:48:51.835378+0000","last_unstale":"2024-02-02T11:48:52.824851+0000","last_undegraded":"2024-02-02T11:48:52.824851+0000","last_fullsized":"2024-02-02T11:48:52.824851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828051+0000","last_change":"2024-02-02T11:48:51.873754+0000","last_active":"2024-02-02T11:48:52.828051+0000","last_peered":"2024-02-02T11:48:52.828051+0000","last_clean":"2024-02-02T11:48:52.828051+0000","last_became_active":"2024-02-02T11:48:51.864819+0000","last_became_peered":"2024-02-02T11:48:51.864819+0000","last_unstale":"2024-02-02T11:48:52.828051+0000","last_undegraded":"2024-02-02T11:48:52.828051+0000","last_fullsized":"2024-02-02T11:48:52.828051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:02:09.899239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829342+0000","last_change":"2024-02-02T11:48:51.884635+0000","last_active":"2024-02-02T11:48:52.829342+0000","last_peered":"2024-02-02T11:48:52.829342+0000","last_clean":"2024-02-02T11:48:52.829342+0000","last_became_active":"2024-02-02T11:48:51.884182+0000","last_became_peered":"2024-02-02T11:48:51.884182+0000","last_unstale":"2024-02-02T11:48:52.829342+0000","last_undegraded":"2024-02-02T11:48:52.829342+0000","last_fullsized":"2024-02-02T11:48:52.829342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:15:46.872789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015398+0000","last_change":"2024-02-02T11:48:51.870210+0000","last_active":"2024-02-02T11:48:53.015398+0000","last_peered":"2024-02-02T11:48:53.015398+0000","last_clean":"2024-02-02T11:48:53.015398+0000","last_became_active":"2024-02-02T11:48:51.869889+0000","last_became_peered":"2024-02-02T11:48:51.869889+0000","last_unstale":"2024-02-02T11:48:53.015398+0000","last_undegraded":"2024-02-02T11:48:53.015398+0000","last_fullsized":"2024-02-02T11:48:53.015398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:33.128561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014093+0000","last_change":"2024-02-02T11:48:51.888159+0000","last_active":"2024-02-02T11:48:53.014093+0000","last_peered":"2024-02-02T11:48:53.014093+0000","last_clean":"2024-02-02T11:48:53.014093+0000","last_became_active":"2024-02-02T11:48:51.887546+0000","last_became_peered":"2024-02-02T11:48:51.887546+0000","last_unstale":"2024-02-02T11:48:53.014093+0000","last_undegraded":"2024-02-02T11:48:53.014093+0000","last_fullsized":"2024-02-02T11:48:53.014093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:36:48.786870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992872+0000","last_change":"2024-02-02T11:48:51.862691+0000","last_active":"2024-02-02T11:48:52.992872+0000","last_peered":"2024-02-02T11:48:52.992872+0000","last_clean":"2024-02-02T11:48:52.992872+0000","last_became_active":"2024-02-02T11:48:51.862032+0000","last_became_peered":"2024-02-02T11:48:51.862032+0000","last_unstale":"2024-02-02T11:48:52.992872+0000","last_undegraded":"2024-02-02T11:48:52.992872+0000","last_fullsized":"2024-02-02T11:48:52.992872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:17:07.932896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015727+0000","last_change":"2024-02-02T11:48:51.884441+0000","last_active":"2024-02-02T11:48:53.015727+0000","last_peered":"2024-02-02T11:48:53.015727+0000","last_clean":"2024-02-02T11:48:53.015727+0000","last_became_active":"2024-02-02T11:48:51.884033+0000","last_became_peered":"2024-02-02T11:48:51.884033+0000","last_unstale":"2024-02-02T11:48:53.015727+0000","last_undegraded":"2024-02-02T11:48:53.015727+0000","last_fullsized":"2024-02-02T11:48:53.015727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828714+0000","last_change":"2024-02-02T11:48:51.884667+0000","last_active":"2024-02-02T11:48:52.828714+0000","last_peered":"2024-02-02T11:48:52.828714+0000","last_clean":"2024-02-02T11:48:52.828714+0000","last_became_active":"2024-02-02T11:48:51.884211+0000","last_became_peered":"2024-02-02T11:48:51.884211+0000","last_unstale":"2024-02-02T11:48:52.828714+0000","last_undegraded":"2024-02-02T11:48:52.828714+0000","last_fullsized":"2024-02-02T11:48:52.828714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:34:16.623804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.017166+0000","last_change":"2024-02-02T11:48:51.844344+0000","last_active":"2024-02-02T11:48:53.017166+0000","last_peered":"2024-02-02T11:48:53.017166+0000","last_clean":"2024-02-02T11:48:53.017166+0000","last_became_active":"2024-02-02T11:48:51.844068+0000","last_became_peered":"2024-02-02T11:48:51.844068+0000","last_unstale":"2024-02-02T11:48:53.017166+0000","last_undegraded":"2024-02-02T11:48:53.017166+0000","last_fullsized":"2024-02-02T11:48:53.017166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:31:27.082147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829389+0000","last_change":"2024-02-02T11:48:51.863370+0000","last_active":"2024-02-02T11:48:52.829389+0000","last_peered":"2024-02-02T11:48:52.829389+0000","last_clean":"2024-02-02T11:48:52.829389+0000","last_became_active":"2024-02-02T11:48:51.862502+0000","last_became_peered":"2024-02-02T11:48:51.862502+0000","last_unstale":"2024-02-02T11:48:52.829389+0000","last_undegraded":"2024-02-02T11:48:52.829389+0000","last_fullsized":"2024-02-02T11:48:52.829389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:55:40.677428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015018+0000","last_change":"2024-02-02T11:48:51.844587+0000","last_active":"2024-02-02T11:48:53.015018+0000","last_peered":"2024-02-02T11:48:53.015018+0000","last_clean":"2024-02-02T11:48:53.015018+0000","last_became_active":"2024-02-02T11:48:51.844279+0000","last_became_peered":"2024-02-02T11:48:51.844279+0000","last_unstale":"2024-02-02T11:48:53.015018+0000","last_undegraded":"2024-02-02T11:48:53.015018+0000","last_fullsized":"2024-02-02T11:48:53.015018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:56:59.771841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993316+0000","last_change":"2024-02-02T11:48:51.886760+0000","last_active":"2024-02-02T11:48:52.993316+0000","last_peered":"2024-02-02T11:48:52.993316+0000","last_clean":"2024-02-02T11:48:52.993316+0000","last_became_active":"2024-02-02T11:48:51.886352+0000","last_became_peered":"2024-02-02T11:48:51.886352+0000","last_unstale":"2024-02-02T11:48:52.993316+0000","last_undegraded":"2024-02-02T11:48:52.993316+0000","last_fullsized":"2024-02-02T11:48:52.993316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825142+0000","last_change":"2024-02-02T11:48:51.836508+0000","last_active":"2024-02-02T11:48:52.825142+0000","last_peered":"2024-02-02T11:48:52.825142+0000","last_clean":"2024-02-02T11:48:52.825142+0000","last_became_active":"2024-02-02T11:48:51.836243+0000","last_became_peered":"2024-02-02T11:48:51.836243+0000","last_unstale":"2024-02-02T11:48:52.825142+0000","last_undegraded":"2024-02-02T11:48:52.825142+0000","last_fullsized":"2024-02-02T11:48:52.825142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:17:07.932896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015447+0000","last_change":"2024-02-02T11:48:51.857222+0000","last_active":"2024-02-02T11:48:53.015447+0000","last_peered":"2024-02-02T11:48:53.015447+0000","last_clean":"2024-02-02T11:48:53.015447+0000","last_became_active":"2024-02-02T11:48:51.857008+0000","last_became_peered":"2024-02-02T11:48:51.857008+0000","last_unstale":"2024-02-02T11:48:53.015447+0000","last_undegraded":"2024-02-02T11:48:53.015447+0000","last_fullsized":"2024-02-02T11:48:53.015447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:55:40.677428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015969+0000","last_change":"2024-02-02T11:48:51.848918+0000","last_active":"2024-02-02T11:48:53.015969+0000","last_peered":"2024-02-02T11:48:53.015969+0000","last_clean":"2024-02-02T11:48:53.015969+0000","last_became_active":"2024-02-02T11:48:51.847820+0000","last_became_peered":"2024-02-02T11:48:51.847820+0000","last_unstale":"2024-02-02T11:48:53.015969+0000","last_undegraded":"2024-02-02T11:48:53.015969+0000","last_fullsized":"2024-02-02T11:48:53.015969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:44:05.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828816+0000","last_change":"2024-02-02T11:48:51.863180+0000","last_active":"2024-02-02T11:48:52.828816+0000","last_peered":"2024-02-02T11:48:52.828816+0000","last_clean":"2024-02-02T11:48:52.828816+0000","last_became_active":"2024-02-02T11:48:51.862533+0000","last_became_peered":"2024-02-02T11:48:51.862533+0000","last_unstale":"2024-02-02T11:48:52.828816+0000","last_undegraded":"2024-02-02T11:48:52.828816+0000","last_fullsized":"2024-02-02T11:48:52.828816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:32:50.539652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013102+0000","last_change":"2024-02-02T11:48:51.862936+0000","last_active":"2024-02-02T11:48:53.013102+0000","last_peered":"2024-02-02T11:48:53.013102+0000","last_clean":"2024-02-02T11:48:53.013102+0000","last_became_active":"2024-02-02T11:48:51.862663+0000","last_became_peered":"2024-02-02T11:48:51.862663+0000","last_unstale":"2024-02-02T11:48:53.013102+0000","last_undegraded":"2024-02-02T11:48:53.013102+0000","last_fullsized":"2024-02-02T11:48:53.013102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:27.396890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992606+0000","last_change":"2024-02-02T11:48:51.865648+0000","last_active":"2024-02-02T11:48:52.992606+0000","last_peered":"2024-02-02T11:48:52.992606+0000","last_clean":"2024-02-02T11:48:52.992606+0000","last_became_active":"2024-02-02T11:48:51.864078+0000","last_became_peered":"2024-02-02T11:48:51.864078+0000","last_unstale":"2024-02-02T11:48:52.992606+0000","last_undegraded":"2024-02-02T11:48:52.992606+0000","last_fullsized":"2024-02-02T11:48:52.992606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:14.049200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.826642+0000","last_change":"2024-02-02T11:48:51.837010+0000","last_active":"2024-02-02T11:48:52.826642+0000","last_peered":"2024-02-02T11:48:52.826642+0000","last_clean":"2024-02-02T11:48:52.826642+0000","last_became_active":"2024-02-02T11:48:51.836245+0000","last_became_peered":"2024-02-02T11:48:51.836245+0000","last_unstale":"2024-02-02T11:48:52.826642+0000","last_undegraded":"2024-02-02T11:48:52.826642+0000","last_fullsized":"2024-02-02T11:48:52.826642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:05:40.202784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014518+0000","last_change":"2024-02-02T11:48:51.490158+0000","last_active":"2024-02-02T11:48:53.014518+0000","last_peered":"2024-02-02T11:48:53.014518+0000","last_clean":"2024-02-02T11:48:53.014518+0000","last_became_active":"2024-02-02T11:48:51.489826+0000","last_became_peered":"2024-02-02T11:48:51.489826+0000","last_unstale":"2024-02-02T11:48:53.014518+0000","last_undegraded":"2024-02-02T11:48:53.014518+0000","last_fullsized":"2024-02-02T11:48:53.014518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:06:13.971694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016208+0000","last_change":"2024-02-02T11:48:51.848592+0000","last_active":"2024-02-02T11:48:53.016208+0000","last_peered":"2024-02-02T11:48:53.016208+0000","last_clean":"2024-02-02T11:48:53.016208+0000","last_became_active":"2024-02-02T11:48:51.848379+0000","last_became_peered":"2024-02-02T11:48:51.848379+0000","last_unstale":"2024-02-02T11:48:53.016208+0000","last_undegraded":"2024-02-02T11:48:53.016208+0000","last_fullsized":"2024-02-02T11:48:53.016208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:17:07.932896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992668+0000","last_change":"2024-02-02T11:48:51.481701+0000","last_active":"2024-02-02T11:48:52.992668+0000","last_peered":"2024-02-02T11:48:52.992668+0000","last_clean":"2024-02-02T11:48:52.992668+0000","last_became_active":"2024-02-02T11:48:51.480901+0000","last_became_peered":"2024-02-02T11:48:51.480901+0000","last_unstale":"2024-02-02T11:48:52.992668+0000","last_undegraded":"2024-02-02T11:48:52.992668+0000","last_fullsized":"2024-02-02T11:48:52.992668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.017353+0000","last_change":"2024-02-02T11:48:51.482357+0000","last_active":"2024-02-02T11:48:53.017353+0000","last_peered":"2024-02-02T11:48:53.017353+0000","last_clean":"2024-02-02T11:48:53.017353+0000","last_became_active":"2024-02-02T11:48:51.482055+0000","last_became_peered":"2024-02-02T11:48:51.482055+0000","last_unstale":"2024-02-02T11:48:53.017353+0000","last_undegraded":"2024-02-02T11:48:53.017353+0000","last_fullsized":"2024-02-02T11:48:53.017353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:12:40.411121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013783+0000","last_change":"2024-02-02T11:48:51.843584+0000","last_active":"2024-02-02T11:48:53.013783+0000","last_peered":"2024-02-02T11:48:53.013783+0000","last_clean":"2024-02-02T11:48:53.013783+0000","last_became_active":"2024-02-02T11:48:51.843299+0000","last_became_peered":"2024-02-02T11:48:51.843299+0000","last_unstale":"2024-02-02T11:48:53.013783+0000","last_undegraded":"2024-02-02T11:48:53.013783+0000","last_fullsized":"2024-02-02T11:48:53.013783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:26:18.517358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828293+0000","last_change":"2024-02-02T11:48:51.475843+0000","last_active":"2024-02-02T11:48:52.828293+0000","last_peered":"2024-02-02T11:48:52.828293+0000","last_clean":"2024-02-02T11:48:52.828293+0000","last_became_active":"2024-02-02T11:48:51.474780+0000","last_became_peered":"2024-02-02T11:48:51.474780+0000","last_unstale":"2024-02-02T11:48:52.828293+0000","last_undegraded":"2024-02-02T11:48:52.828293+0000","last_fullsized":"2024-02-02T11:48:52.828293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:06:13.971694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825017+0000","last_change":"2024-02-02T11:48:51.836833+0000","last_active":"2024-02-02T11:48:52.825017+0000","last_peered":"2024-02-02T11:48:52.825017+0000","last_clean":"2024-02-02T11:48:52.825017+0000","last_became_active":"2024-02-02T11:48:51.836528+0000","last_became_peered":"2024-02-02T11:48:51.836528+0000","last_unstale":"2024-02-02T11:48:52.825017+0000","last_undegraded":"2024-02-02T11:48:52.825017+0000","last_fullsized":"2024-02-02T11:48:52.825017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:44:05.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993305+0000","last_change":"2024-02-02T11:48:51.487441+0000","last_active":"2024-02-02T11:48:52.993305+0000","last_peered":"2024-02-02T11:48:52.993305+0000","last_clean":"2024-02-02T11:48:52.993305+0000","last_became_active":"2024-02-02T11:48:51.486655+0000","last_became_peered":"2024-02-02T11:48:51.486655+0000","last_unstale":"2024-02-02T11:48:52.993305+0000","last_undegraded":"2024-02-02T11:48:52.993305+0000","last_fullsized":"2024-02-02T11:48:52.993305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:22:40.437082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829603+0000","last_change":"2024-02-02T11:48:51.886180+0000","last_active":"2024-02-02T11:48:52.829603+0000","last_peered":"2024-02-02T11:48:52.829603+0000","last_clean":"2024-02-02T11:48:52.829603+0000","last_became_active":"2024-02-02T11:48:51.885591+0000","last_became_peered":"2024-02-02T11:48:51.885591+0000","last_unstale":"2024-02-02T11:48:52.829603+0000","last_undegraded":"2024-02-02T11:48:52.829603+0000","last_fullsized":"2024-02-02T11:48:52.829603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:31:31.979723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829725+0000","last_change":"2024-02-02T11:48:51.485465+0000","last_active":"2024-02-02T11:48:52.829725+0000","last_peered":"2024-02-02T11:48:52.829725+0000","last_clean":"2024-02-02T11:48:52.829725+0000","last_became_active":"2024-02-02T11:48:51.484749+0000","last_became_peered":"2024-02-02T11:48:51.484749+0000","last_unstale":"2024-02-02T11:48:52.829725+0000","last_undegraded":"2024-02-02T11:48:52.829725+0000","last_fullsized":"2024-02-02T11:48:52.829725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:12:40.411121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015866+0000","last_change":"2024-02-02T11:48:51.890561+0000","last_active":"2024-02-02T11:48:53.015866+0000","last_peered":"2024-02-02T11:48:53.015866+0000","last_clean":"2024-02-02T11:48:53.015866+0000","last_became_active":"2024-02-02T11:48:51.890385+0000","last_became_peered":"2024-02-02T11:48:51.890385+0000","last_unstale":"2024-02-02T11:48:53.015866+0000","last_undegraded":"2024-02-02T11:48:53.015866+0000","last_fullsized":"2024-02-02T11:48:53.015866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:26:18.517358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825200+0000","last_change":"2024-02-02T11:48:51.467792+0000","last_active":"2024-02-02T11:48:52.825200+0000","last_peered":"2024-02-02T11:48:52.825200+0000","last_clean":"2024-02-02T11:48:52.825200+0000","last_became_active":"2024-02-02T11:48:51.467447+0000","last_became_peered":"2024-02-02T11:48:51.467447+0000","last_unstale":"2024-02-02T11:48:52.825200+0000","last_undegraded":"2024-02-02T11:48:52.825200+0000","last_fullsized":"2024-02-02T11:48:52.825200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:32.118220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.827459+0000","last_change":"2024-02-02T11:48:51.886539+0000","last_active":"2024-02-02T11:48:52.827459+0000","last_peered":"2024-02-02T11:48:52.827459+0000","last_clean":"2024-02-02T11:48:52.827459+0000","last_became_active":"2024-02-02T11:48:51.886091+0000","last_became_peered":"2024-02-02T11:48:51.886091+0000","last_unstale":"2024-02-02T11:48:52.827459+0000","last_undegraded":"2024-02-02T11:48:52.827459+0000","last_fullsized":"2024-02-02T11:48:52.827459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:41:08.293554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992948+0000","last_change":"2024-02-02T11:48:51.478707+0000","last_active":"2024-02-02T11:48:52.992948+0000","last_peered":"2024-02-02T11:48:52.992948+0000","last_clean":"2024-02-02T11:48:52.992948+0000","last_became_active":"2024-02-02T11:48:51.477592+0000","last_became_peered":"2024-02-02T11:48:51.477592+0000","last_unstale":"2024-02-02T11:48:52.992948+0000","last_undegraded":"2024-02-02T11:48:52.992948+0000","last_fullsized":"2024-02-02T11:48:52.992948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:02:58.430952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013767+0000","last_change":"2024-02-02T11:48:51.885728+0000","last_active":"2024-02-02T11:48:53.013767+0000","last_peered":"2024-02-02T11:48:53.013767+0000","last_clean":"2024-02-02T11:48:53.013767+0000","last_became_active":"2024-02-02T11:48:51.885343+0000","last_became_peered":"2024-02-02T11:48:51.885343+0000","last_unstale":"2024-02-02T11:48:53.013767+0000","last_undegraded":"2024-02-02T11:48:53.013767+0000","last_fullsized":"2024-02-02T11:48:53.013767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:02:09.899239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016432+0000","last_change":"2024-02-02T11:48:51.489735+0000","last_active":"2024-02-02T11:48:53.016432+0000","last_peered":"2024-02-02T11:48:53.016432+0000","last_clean":"2024-02-02T11:48:53.016432+0000","last_became_active":"2024-02-02T11:48:51.489394+0000","last_became_peered":"2024-02-02T11:48:51.489394+0000","last_unstale":"2024-02-02T11:48:53.016432+0000","last_undegraded":"2024-02-02T11:48:53.016432+0000","last_fullsized":"2024-02-02T11:48:53.016432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:18:12.503377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016349+0000","last_change":"2024-02-02T11:48:51.884370+0000","last_active":"2024-02-02T11:48:53.016349+0000","last_peered":"2024-02-02T11:48:53.016349+0000","last_clean":"2024-02-02T11:48:53.016349+0000","last_became_active":"2024-02-02T11:48:51.884044+0000","last_became_peered":"2024-02-02T11:48:51.884044+0000","last_unstale":"2024-02-02T11:48:53.016349+0000","last_undegraded":"2024-02-02T11:48:53.016349+0000","last_fullsized":"2024-02-02T11:48:53.016349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:33.128561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828935+0000","last_change":"2024-02-02T11:48:51.466861+0000","last_active":"2024-02-02T11:48:52.828935+0000","last_peered":"2024-02-02T11:48:52.828935+0000","last_clean":"2024-02-02T11:48:52.828935+0000","last_became_active":"2024-02-02T11:48:51.466097+0000","last_became_peered":"2024-02-02T11:48:51.466097+0000","last_unstale":"2024-02-02T11:48:52.828935+0000","last_undegraded":"2024-02-02T11:48:52.828935+0000","last_fullsized":"2024-02-02T11:48:52.828935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:02:58.430952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013799+0000","last_change":"2024-02-02T11:48:51.885012+0000","last_active":"2024-02-02T11:48:53.013799+0000","last_peered":"2024-02-02T11:48:53.013799+0000","last_clean":"2024-02-02T11:48:53.013799+0000","last_became_active":"2024-02-02T11:48:51.884374+0000","last_became_peered":"2024-02-02T11:48:51.884374+0000","last_unstale":"2024-02-02T11:48:53.013799+0000","last_undegraded":"2024-02-02T11:48:53.013799+0000","last_fullsized":"2024-02-02T11:48:53.013799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T17:33:10.421610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992599+0000","last_change":"2024-02-02T11:48:51.478572+0000","last_active":"2024-02-02T11:48:52.992599+0000","last_peered":"2024-02-02T11:48:52.992599+0000","last_clean":"2024-02-02T11:48:52.992599+0000","last_became_active":"2024-02-02T11:48:51.477722+0000","last_became_peered":"2024-02-02T11:48:51.477722+0000","last_unstale":"2024-02-02T11:48:52.992599+0000","last_undegraded":"2024-02-02T11:48:52.992599+0000","last_fullsized":"2024-02-02T11:48:52.992599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:06:13.971694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992588+0000","last_change":"2024-02-02T11:48:51.869232+0000","last_active":"2024-02-02T11:48:52.992588+0000","last_peered":"2024-02-02T11:48:52.992588+0000","last_clean":"2024-02-02T11:48:52.992588+0000","last_became_active":"2024-02-02T11:48:51.864926+0000","last_became_peered":"2024-02-02T11:48:51.864926+0000","last_unstale":"2024-02-02T11:48:52.992588+0000","last_undegraded":"2024-02-02T11:48:52.992588+0000","last_fullsized":"2024-02-02T11:48:52.992588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:42:12.424582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013003+0000","last_change":"2024-02-02T11:48:51.470192+0000","last_active":"2024-02-02T11:48:53.013003+0000","last_peered":"2024-02-02T11:48:53.013003+0000","last_clean":"2024-02-02T11:48:53.013003+0000","last_became_active":"2024-02-02T11:48:51.469834+0000","last_became_peered":"2024-02-02T11:48:51.469834+0000","last_unstale":"2024-02-02T11:48:53.013003+0000","last_undegraded":"2024-02-02T11:48:53.013003+0000","last_fullsized":"2024-02-02T11:48:53.013003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:12:40.411121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013456+0000","last_change":"2024-02-02T11:48:51.884838+0000","last_active":"2024-02-02T11:48:53.013456+0000","last_peered":"2024-02-02T11:48:53.013456+0000","last_clean":"2024-02-02T11:48:53.013456+0000","last_became_active":"2024-02-02T11:48:51.884185+0000","last_became_peered":"2024-02-02T11:48:51.884185+0000","last_unstale":"2024-02-02T11:48:53.013456+0000","last_undegraded":"2024-02-02T11:48:53.013456+0000","last_fullsized":"2024-02-02T11:48:53.013456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:15:46.872789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.827152+0000","last_change":"2024-02-02T11:48:51.474818+0000","last_active":"2024-02-02T11:48:52.827152+0000","last_peered":"2024-02-02T11:48:52.827152+0000","last_clean":"2024-02-02T11:48:52.827152+0000","last_became_active":"2024-02-02T11:48:51.474087+0000","last_became_peered":"2024-02-02T11:48:51.474087+0000","last_unstale":"2024-02-02T11:48:52.827152+0000","last_undegraded":"2024-02-02T11:48:52.827152+0000","last_fullsized":"2024-02-02T11:48:52.827152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:18:12.503377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014027+0000","last_change":"2024-02-02T11:48:51.897044+0000","last_active":"2024-02-02T11:48:53.014027+0000","last_peered":"2024-02-02T11:48:53.014027+0000","last_clean":"2024-02-02T11:48:53.014027+0000","last_became_active":"2024-02-02T11:48:51.896554+0000","last_became_peered":"2024-02-02T11:48:51.896554+0000","last_unstale":"2024-02-02T11:48:53.014027+0000","last_undegraded":"2024-02-02T11:48:53.014027+0000","last_fullsized":"2024-02-02T11:48:53.014027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:34:16.623804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015526+0000","last_change":"2024-02-02T11:48:51.464028+0000","last_active":"2024-02-02T11:48:53.015526+0000","last_peered":"2024-02-02T11:48:53.015526+0000","last_clean":"2024-02-02T11:48:53.015526+0000","last_became_active":"2024-02-02T11:48:51.463717+0000","last_became_peered":"2024-02-02T11:48:51.463717+0000","last_unstale":"2024-02-02T11:48:53.015526+0000","last_undegraded":"2024-02-02T11:48:53.015526+0000","last_fullsized":"2024-02-02T11:48:53.015526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:18:12.503377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014400+0000","last_change":"2024-02-02T11:48:51.897969+0000","last_active":"2024-02-02T11:48:53.014400+0000","last_peered":"2024-02-02T11:48:53.014400+0000","last_clean":"2024-02-02T11:48:53.014400+0000","last_became_active":"2024-02-02T11:48:51.897552+0000","last_became_peered":"2024-02-02T11:48:51.897552+0000","last_unstale":"2024-02-02T11:48:53.014400+0000","last_undegraded":"2024-02-02T11:48:53.014400+0000","last_fullsized":"2024-02-02T11:48:53.014400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:31:31.979723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825340+0000","last_change":"2024-02-02T11:48:51.489925+0000","last_active":"2024-02-02T11:48:52.825340+0000","last_peered":"2024-02-02T11:48:52.825340+0000","last_clean":"2024-02-02T11:48:52.825340+0000","last_became_active":"2024-02-02T11:48:51.489586+0000","last_became_peered":"2024-02-02T11:48:51.489586+0000","last_unstale":"2024-02-02T11:48:52.825340+0000","last_undegraded":"2024-02-02T11:48:52.825340+0000","last_fullsized":"2024-02-02T11:48:52.825340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:26.386549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829151+0000","last_change":"2024-02-02T11:48:51.863155+0000","last_active":"2024-02-02T11:48:52.829151+0000","last_peered":"2024-02-02T11:48:52.829151+0000","last_clean":"2024-02-02T11:48:52.829151+0000","last_became_active":"2024-02-02T11:48:51.862353+0000","last_became_peered":"2024-02-02T11:48:51.862353+0000","last_unstale":"2024-02-02T11:48:52.829151+0000","last_undegraded":"2024-02-02T11:48:52.829151+0000","last_fullsized":"2024-02-02T11:48:52.829151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:56:59.771841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014144+0000","last_change":"2024-02-02T11:48:51.476119+0000","last_active":"2024-02-02T11:48:53.014144+0000","last_peered":"2024-02-02T11:48:53.014144+0000","last_clean":"2024-02-02T11:48:53.014144+0000","last_became_active":"2024-02-02T11:48:51.475833+0000","last_became_peered":"2024-02-02T11:48:51.475833+0000","last_unstale":"2024-02-02T11:48:53.014144+0000","last_undegraded":"2024-02-02T11:48:53.014144+0000","last_fullsized":"2024-02-02T11:48:53.014144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013759+0000","last_change":"2024-02-02T11:48:51.891228+0000","last_active":"2024-02-02T11:48:53.013759+0000","last_peered":"2024-02-02T11:48:53.013759+0000","last_clean":"2024-02-02T11:48:53.013759+0000","last_became_active":"2024-02-02T11:48:51.890322+0000","last_became_peered":"2024-02-02T11:48:51.890322+0000","last_unstale":"2024-02-02T11:48:53.013759+0000","last_undegraded":"2024-02-02T11:48:53.013759+0000","last_fullsized":"2024-02-02T11:48:53.013759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:01:26.016064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-02T11:48:51.857399+0000","last_change":"2024-02-02T11:48:41.563754+0000","last_active":"2024-02-02T11:48:51.857399+0000","last_peered":"2024-02-02T11:48:51.857399+0000","last_clean":"2024-02-02T11:48:51.857399+0000","last_became_active":"2024-02-02T11:48:41.562629+0000","last_became_peered":"2024-02-02T11:48:41.562629+0000","last_unstale":"2024-02-02T11:48:51.857399+0000","last_undegraded":"2024-02-02T11:48:51.857399+0000","last_fullsized":"2024-02-02T11:48:51.857399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_clean_scrub_stamp":"2024-02-02T11:48:40.536978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:22:02.923582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828445+0000","last_change":"2024-02-02T11:48:51.467641+0000","last_active":"2024-02-02T11:48:52.828445+0000","last_peered":"2024-02-02T11:48:52.828445+0000","last_clean":"2024-02-02T11:48:52.828445+0000","last_became_active":"2024-02-02T11:48:51.466793+0000","last_became_peered":"2024-02-02T11:48:51.466793+0000","last_unstale":"2024-02-02T11:48:52.828445+0000","last_undegraded":"2024-02-02T11:48:52.828445+0000","last_fullsized":"2024-02-02T11:48:52.828445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:22:40.437082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014197+0000","last_change":"2024-02-02T11:48:51.889165+0000","last_active":"2024-02-02T11:48:53.014197+0000","last_peered":"2024-02-02T11:48:53.014197+0000","last_clean":"2024-02-02T11:48:53.014197+0000","last_became_active":"2024-02-02T11:48:51.888946+0000","last_became_peered":"2024-02-02T11:48:51.888946+0000","last_unstale":"2024-02-02T11:48:53.014197+0000","last_undegraded":"2024-02-02T11:48:53.014197+0000","last_fullsized":"2024-02-02T11:48:53.014197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:44:05.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013178+0000","last_change":"2024-02-02T11:48:51.490450+0000","last_active":"2024-02-02T11:48:53.013178+0000","last_peered":"2024-02-02T11:48:53.013178+0000","last_clean":"2024-02-02T11:48:53.013178+0000","last_became_active":"2024-02-02T11:48:51.489819+0000","last_became_peered":"2024-02-02T11:48:51.489819+0000","last_unstale":"2024-02-02T11:48:53.013178+0000","last_undegraded":"2024-02-02T11:48:53.013178+0000","last_fullsized":"2024-02-02T11:48:53.013178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:11:06.903511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015117+0000","last_change":"2024-02-02T11:48:51.844140+0000","last_active":"2024-02-02T11:48:53.015117+0000","last_peered":"2024-02-02T11:48:53.015117+0000","last_clean":"2024-02-02T11:48:53.015117+0000","last_became_active":"2024-02-02T11:48:51.843865+0000","last_became_peered":"2024-02-02T11:48:51.843865+0000","last_unstale":"2024-02-02T11:48:53.015117+0000","last_undegraded":"2024-02-02T11:48:53.015117+0000","last_fullsized":"2024-02-02T11:48:53.015117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:10:43.379183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013460+0000","last_change":"2024-02-02T11:48:51.468449+0000","last_active":"2024-02-02T11:48:53.013460+0000","last_peered":"2024-02-02T11:48:53.013460+0000","last_clean":"2024-02-02T11:48:53.013460+0000","last_became_active":"2024-02-02T11:48:51.468136+0000","last_became_peered":"2024-02-02T11:48:51.468136+0000","last_unstale":"2024-02-02T11:48:53.013460+0000","last_undegraded":"2024-02-02T11:48:53.013460+0000","last_fullsized":"2024-02-02T11:48:53.013460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:06:13.971694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825256+0000","last_change":"2024-02-02T11:48:51.836358+0000","last_active":"2024-02-02T11:48:52.825256+0000","last_peered":"2024-02-02T11:48:52.825256+0000","last_clean":"2024-02-02T11:48:52.825256+0000","last_became_active":"2024-02-02T11:48:51.836089+0000","last_became_peered":"2024-02-02T11:48:51.836089+0000","last_unstale":"2024-02-02T11:48:52.825256+0000","last_undegraded":"2024-02-02T11:48:52.825256+0000","last_fullsized":"2024-02-02T11:48:52.825256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829035+0000","last_change":"2024-02-02T11:48:51.472708+0000","last_active":"2024-02-02T11:48:52.829035+0000","last_peered":"2024-02-02T11:48:52.829035+0000","last_clean":"2024-02-02T11:48:52.829035+0000","last_became_active":"2024-02-02T11:48:51.471927+0000","last_became_peered":"2024-02-02T11:48:51.471927+0000","last_unstale":"2024-02-02T11:48:52.829035+0000","last_undegraded":"2024-02-02T11:48:52.829035+0000","last_fullsized":"2024-02-02T11:48:52.829035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:11:06.903511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.827116+0000","last_change":"2024-02-02T11:48:51.854118+0000","last_active":"2024-02-02T11:48:52.827116+0000","last_peered":"2024-02-02T11:48:52.827116+0000","last_clean":"2024-02-02T11:48:52.827116+0000","last_became_active":"2024-02-02T11:48:51.852712+0000","last_became_peered":"2024-02-02T11:48:51.852712+0000","last_unstale":"2024-02-02T11:48:52.827116+0000","last_undegraded":"2024-02-02T11:48:52.827116+0000","last_fullsized":"2024-02-02T11:48:52.827116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:55:18.720031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825177+0000","last_change":"2024-02-02T11:48:51.470060+0000","last_active":"2024-02-02T11:48:52.825177+0000","last_peered":"2024-02-02T11:48:52.825177+0000","last_clean":"2024-02-02T11:48:52.825177+0000","last_became_active":"2024-02-02T11:48:51.469761+0000","last_became_peered":"2024-02-02T11:48:51.469761+0000","last_unstale":"2024-02-02T11:48:52.825177+0000","last_undegraded":"2024-02-02T11:48:52.825177+0000","last_fullsized":"2024-02-02T11:48:52.825177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829453+0000","last_change":"2024-02-02T11:48:51.873107+0000","last_active":"2024-02-02T11:48:52.829453+0000","last_peered":"2024-02-02T11:48:52.829453+0000","last_clean":"2024-02-02T11:48:52.829453+0000","last_became_active":"2024-02-02T11:48:51.863234+0000","last_became_peered":"2024-02-02T11:48:51.863234+0000","last_unstale":"2024-02-02T11:48:52.829453+0000","last_undegraded":"2024-02-02T11:48:52.829453+0000","last_fullsized":"2024-02-02T11:48:52.829453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:36:48.786870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014135+0000","last_change":"2024-02-02T11:48:51.495141+0000","last_active":"2024-02-02T11:48:53.014135+0000","last_peered":"2024-02-02T11:48:53.014135+0000","last_clean":"2024-02-02T11:48:53.014135+0000","last_became_active":"2024-02-02T11:48:51.494357+0000","last_became_peered":"2024-02-02T11:48:51.494357+0000","last_unstale":"2024-02-02T11:48:53.014135+0000","last_undegraded":"2024-02-02T11:48:53.014135+0000","last_fullsized":"2024-02-02T11:48:53.014135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:26.386549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825161+0000","last_change":"2024-02-02T11:48:51.834937+0000","last_active":"2024-02-02T11:48:52.825161+0000","last_peered":"2024-02-02T11:48:52.825161+0000","last_clean":"2024-02-02T11:48:52.825161+0000","last_became_active":"2024-02-02T11:48:51.834659+0000","last_became_peered":"2024-02-02T11:48:51.834659+0000","last_unstale":"2024-02-02T11:48:52.825161+0000","last_undegraded":"2024-02-02T11:48:52.825161+0000","last_fullsized":"2024-02-02T11:48:52.825161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:14.049200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825320+0000","last_change":"2024-02-02T11:48:51.487838+0000","last_active":"2024-02-02T11:48:52.825320+0000","last_peered":"2024-02-02T11:48:52.825320+0000","last_clean":"2024-02-02T11:48:52.825320+0000","last_became_active":"2024-02-02T11:48:51.487608+0000","last_became_peered":"2024-02-02T11:48:51.487608+0000","last_unstale":"2024-02-02T11:48:52.825320+0000","last_undegraded":"2024-02-02T11:48:52.825320+0000","last_fullsized":"2024-02-02T11:48:52.825320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:22:40.437082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015208+0000","last_change":"2024-02-02T11:48:51.884253+0000","last_active":"2024-02-02T11:48:53.015208+0000","last_peered":"2024-02-02T11:48:53.015208+0000","last_clean":"2024-02-02T11:48:53.015208+0000","last_became_active":"2024-02-02T11:48:51.883954+0000","last_became_peered":"2024-02-02T11:48:51.883954+0000","last_unstale":"2024-02-02T11:48:53.015208+0000","last_undegraded":"2024-02-02T11:48:53.015208+0000","last_fullsized":"2024-02-02T11:48:53.015208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993422+0000","last_change":"2024-02-02T11:48:51.492938+0000","last_active":"2024-02-02T11:48:52.993422+0000","last_peered":"2024-02-02T11:48:52.993422+0000","last_clean":"2024-02-02T11:48:52.993422+0000","last_became_active":"2024-02-02T11:48:51.492303+0000","last_became_peered":"2024-02-02T11:48:51.492303+0000","last_unstale":"2024-02-02T11:48:52.993422+0000","last_undegraded":"2024-02-02T11:48:52.993422+0000","last_fullsized":"2024-02-02T11:48:52.993422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:11:06.903511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016684+0000","last_change":"2024-02-02T11:48:51.848144+0000","last_active":"2024-02-02T11:48:53.016684+0000","last_peered":"2024-02-02T11:48:53.016684+0000","last_clean":"2024-02-02T11:48:53.016684+0000","last_became_active":"2024-02-02T11:48:51.847887+0000","last_became_peered":"2024-02-02T11:48:51.847887+0000","last_unstale":"2024-02-02T11:48:53.016684+0000","last_undegraded":"2024-02-02T11:48:53.016684+0000","last_fullsized":"2024-02-02T11:48:53.016684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:11:37.650346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013207+0000","last_change":"2024-02-02T11:48:51.482652+0000","last_active":"2024-02-02T11:48:53.013207+0000","last_peered":"2024-02-02T11:48:53.013207+0000","last_clean":"2024-02-02T11:48:53.013207+0000","last_became_active":"2024-02-02T11:48:51.481995+0000","last_became_peered":"2024-02-02T11:48:51.481995+0000","last_unstale":"2024-02-02T11:48:53.013207+0000","last_undegraded":"2024-02-02T11:48:53.013207+0000","last_fullsized":"2024-02-02T11:48:53.013207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:22:40.437082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.826883+0000","last_change":"2024-02-02T11:48:51.833510+0000","last_active":"2024-02-02T11:48:52.826883+0000","last_peered":"2024-02-02T11:48:52.826883+0000","last_clean":"2024-02-02T11:48:52.826883+0000","last_became_active":"2024-02-02T11:48:51.830625+0000","last_became_peered":"2024-02-02T11:48:51.830625+0000","last_unstale":"2024-02-02T11:48:52.826883+0000","last_undegraded":"2024-02-02T11:48:52.826883+0000","last_fullsized":"2024-02-02T11:48:52.826883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:27.396890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.824977+0000","last_change":"2024-02-02T11:48:51.480505+0000","last_active":"2024-02-02T11:48:52.824977+0000","last_peered":"2024-02-02T11:48:52.824977+0000","last_clean":"2024-02-02T11:48:52.824977+0000","last_became_active":"2024-02-02T11:48:51.480230+0000","last_became_peered":"2024-02-02T11:48:51.480230+0000","last_unstale":"2024-02-02T11:48:52.824977+0000","last_undegraded":"2024-02-02T11:48:52.824977+0000","last_fullsized":"2024-02-02T11:48:52.824977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:11:06.903511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014049+0000","last_change":"2024-02-02T11:48:51.837394+0000","last_active":"2024-02-02T11:48:53.014049+0000","last_peered":"2024-02-02T11:48:53.014049+0000","last_clean":"2024-02-02T11:48:53.014049+0000","last_became_active":"2024-02-02T11:48:51.837092+0000","last_became_peered":"2024-02-02T11:48:51.837092+0000","last_unstale":"2024-02-02T11:48:53.014049+0000","last_undegraded":"2024-02-02T11:48:53.014049+0000","last_fullsized":"2024-02-02T11:48:53.014049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:17:07.932896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825011+0000","last_change":"2024-02-02T11:48:51.469411+0000","last_active":"2024-02-02T11:48:52.825011+0000","last_peered":"2024-02-02T11:48:52.825011+0000","last_clean":"2024-02-02T11:48:52.825011+0000","last_became_active":"2024-02-02T11:48:51.469142+0000","last_became_peered":"2024-02-02T11:48:51.469142+0000","last_unstale":"2024-02-02T11:48:52.825011+0000","last_undegraded":"2024-02-02T11:48:52.825011+0000","last_fullsized":"2024-02-02T11:48:52.825011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:02:58.430952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014321+0000","last_change":"2024-02-02T11:48:51.849339+0000","last_active":"2024-02-02T11:48:53.014321+0000","last_peered":"2024-02-02T11:48:53.014321+0000","last_clean":"2024-02-02T11:48:53.014321+0000","last_became_active":"2024-02-02T11:48:51.849074+0000","last_became_peered":"2024-02-02T11:48:51.849074+0000","last_unstale":"2024-02-02T11:48:53.014321+0000","last_undegraded":"2024-02-02T11:48:53.014321+0000","last_fullsized":"2024-02-02T11:48:53.014321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014003+0000","last_change":"2024-02-02T11:48:51.491708+0000","last_active":"2024-02-02T11:48:53.014003+0000","last_peered":"2024-02-02T11:48:53.014003+0000","last_clean":"2024-02-02T11:48:53.014003+0000","last_became_active":"2024-02-02T11:48:51.490530+0000","last_became_peered":"2024-02-02T11:48:51.490530+0000","last_unstale":"2024-02-02T11:48:53.014003+0000","last_undegraded":"2024-02-02T11:48:53.014003+0000","last_fullsized":"2024-02-02T11:48:53.014003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992605+0000","last_change":"2024-02-02T11:48:51.866340+0000","last_active":"2024-02-02T11:48:52.992605+0000","last_peered":"2024-02-02T11:48:52.992605+0000","last_clean":"2024-02-02T11:48:52.992605+0000","last_became_active":"2024-02-02T11:48:51.865769+0000","last_became_peered":"2024-02-02T11:48:51.865769+0000","last_unstale":"2024-02-02T11:48:52.992605+0000","last_undegraded":"2024-02-02T11:48:52.992605+0000","last_fullsized":"2024-02-02T11:48:52.992605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:26:18.517358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829215+0000","last_change":"2024-02-02T11:48:51.873724+0000","last_active":"2024-02-02T11:48:52.829215+0000","last_peered":"2024-02-02T11:48:52.829215+0000","last_clean":"2024-02-02T11:48:52.829215+0000","last_became_active":"2024-02-02T11:48:51.872899+0000","last_became_peered":"2024-02-02T11:48:51.872899+0000","last_unstale":"2024-02-02T11:48:52.829215+0000","last_undegraded":"2024-02-02T11:48:52.829215+0000","last_fullsized":"2024-02-02T11:48:52.829215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013728+0000","last_change":"2024-02-02T11:48:51.498148+0000","last_active":"2024-02-02T11:48:53.013728+0000","last_peered":"2024-02-02T11:48:53.013728+0000","last_clean":"2024-02-02T11:48:53.013728+0000","last_became_active":"2024-02-02T11:48:51.497318+0000","last_became_peered":"2024-02-02T11:48:51.497318+0000","last_unstale":"2024-02-02T11:48:53.013728+0000","last_undegraded":"2024-02-02T11:48:53.013728+0000","last_fullsized":"2024-02-02T11:48:53.013728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:55:17.709690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828889+0000","last_change":"2024-02-02T11:48:51.874421+0000","last_active":"2024-02-02T11:48:52.828889+0000","last_peered":"2024-02-02T11:48:52.828889+0000","last_clean":"2024-02-02T11:48:52.828889+0000","last_became_active":"2024-02-02T11:48:51.873913+0000","last_became_peered":"2024-02-02T11:48:51.873913+0000","last_unstale":"2024-02-02T11:48:52.828889+0000","last_undegraded":"2024-02-02T11:48:52.828889+0000","last_fullsized":"2024-02-02T11:48:52.828889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013994+0000","last_change":"2024-02-02T11:48:51.495990+0000","last_active":"2024-02-02T11:48:53.013994+0000","last_peered":"2024-02-02T11:48:53.013994+0000","last_clean":"2024-02-02T11:48:53.013994+0000","last_became_active":"2024-02-02T11:48:51.495310+0000","last_became_peered":"2024-02-02T11:48:51.495310+0000","last_unstale":"2024-02-02T11:48:53.013994+0000","last_undegraded":"2024-02-02T11:48:53.013994+0000","last_fullsized":"2024-02-02T11:48:53.013994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:32.118220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015727+0000","last_change":"2024-02-02T11:48:51.890655+0000","last_active":"2024-02-02T11:48:53.015727+0000","last_peered":"2024-02-02T11:48:53.015727+0000","last_clean":"2024-02-02T11:48:53.015727+0000","last_became_active":"2024-02-02T11:48:51.890435+0000","last_became_peered":"2024-02-02T11:48:51.890435+0000","last_unstale":"2024-02-02T11:48:53.015727+0000","last_undegraded":"2024-02-02T11:48:53.015727+0000","last_fullsized":"2024-02-02T11:48:53.015727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015002+0000","last_change":"2024-02-02T11:48:51.469696+0000","last_active":"2024-02-02T11:48:53.015002+0000","last_peered":"2024-02-02T11:48:53.015002+0000","last_clean":"2024-02-02T11:48:53.015002+0000","last_became_active":"2024-02-02T11:48:51.469392+0000","last_became_peered":"2024-02-02T11:48:51.469392+0000","last_unstale":"2024-02-02T11:48:53.015002+0000","last_undegraded":"2024-02-02T11:48:53.015002+0000","last_fullsized":"2024-02-02T11:48:53.015002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015320+0000","last_change":"2024-02-02T11:48:51.870169+0000","last_active":"2024-02-02T11:48:53.015320+0000","last_peered":"2024-02-02T11:48:53.015320+0000","last_clean":"2024-02-02T11:48:53.015320+0000","last_became_active":"2024-02-02T11:48:51.869883+0000","last_became_peered":"2024-02-02T11:48:51.869883+0000","last_unstale":"2024-02-02T11:48:53.015320+0000","last_undegraded":"2024-02-02T11:48:53.015320+0000","last_fullsized":"2024-02-02T11:48:53.015320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:36:48.786870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016079+0000","last_change":"2024-02-02T11:48:51.483548+0000","last_active":"2024-02-02T11:48:53.016079+0000","last_peered":"2024-02-02T11:48:53.016079+0000","last_clean":"2024-02-02T11:48:53.016079+0000","last_became_active":"2024-02-02T11:48:51.483219+0000","last_became_peered":"2024-02-02T11:48:51.483219+0000","last_unstale":"2024-02-02T11:48:53.016079+0000","last_undegraded":"2024-02-02T11:48:53.016079+0000","last_fullsized":"2024-02-02T11:48:53.016079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T17:21:41.030654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.542}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.516}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-02T11:48:59.925 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-02T11:49:00.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.051+0000 7f243d0de640 1 Processor -- start 2024-02-02T11:49:00.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.051+0000 7f243d0de640 1 -- start start 2024-02-02T11:49:00.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f243d0de640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2438071160 0x7f24380b9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:00.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f243d0de640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f24381429f0 0x7f2438153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:00.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f243d0de640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24380b3c40 con 0x7f24380b42d0 2024-02-02T11:49:00.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f243d0de640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24380b5140 con 0x7f24381429f0 2024-02-02T11:49:00.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f243d0de640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24380b4720 con 0x7f2438071160 2024-02-02T11:49:00.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f243759e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f24381429f0 0x7f2438153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:00.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f243759e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f24381429f0 0x7f2438153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36584/0 (socket says 172.21.15.161:36584) 2024-02-02T11:49:00.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f243659c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f24380b42d0 0x7f24380b8ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39986/0 (socket says 172.21.15.161:39986) 2024-02-02T11:49:00.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f243759e640 1 -- 172.21.15.161:0/171169548 learned_addr learned my addr 172.21.15.161:0/171169548 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:00.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f2436d9d640 1 --2- 172.21.15.161:0/171169548 >> v2:172.21.15.162:3300/0 conn(0x7f2438071160 0x7f24380b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:00.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f243759e640 1 -- 172.21.15.161:0/171169548 >> v2:172.21.15.162:3300/0 conn(0x7f2438071160 msgr2=0x7f24380b9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:00.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f243759e640 1 --2- 172.21.15.161:0/171169548 >> v2:172.21.15.162:3300/0 conn(0x7f2438071160 0x7f24380b9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f243759e640 1 -- 172.21.15.161:0/171169548 >> v1:172.21.15.161:6789/0 conn(0x7f24380b42d0 legacy=0x7f24380b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:00.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f243759e640 1 -- 172.21.15.161:0/171169548 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24380b9f60 con 0x7f24381429f0 2024-02-02T11:49:00.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f243759e640 1 --2- 172.21.15.161:0/171169548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24381429f0 0x7f2438153260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2438070b20 tx=0x7f243001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdba2288377cf6d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:00.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f2435d9b640 1 -- 172.21.15.161:0/171169548 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24300a57d0 con 0x7f24381429f0 2024-02-02T11:49:00.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f2435d9b640 1 -- 172.21.15.161:0/171169548 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24300a5930 con 0x7f24381429f0 2024-02-02T11:49:00.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f2435d9b640 1 -- 172.21.15.161:0/171169548 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24300a5cc0 con 0x7f24381429f0 2024-02-02T11:49:00.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f243d0de640 1 -- 172.21.15.161:0/171169548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24381429f0 msgr2=0x7f2438153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.055+0000 7f243d0de640 1 --2- 172.21.15.161:0/171169548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24381429f0 0x7f2438153260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2438070b20 tx=0x7f243001c910 comp rx=0 tx=0).stop 2024-02-02T11:49:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243d0de640 1 -- 172.21.15.161:0/171169548 shutdown_connections 2024-02-02T11:49:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243d0de640 1 --2- 172.21.15.161:0/171169548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24381429f0 0x7f2438153260 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243d0de640 1 --2- 172.21.15.161:0/171169548 >> v2:172.21.15.162:3300/0 conn(0x7f2438071160 0x7f24380b9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243d0de640 1 -- 172.21.15.161:0/171169548 >> 172.21.15.161:0/171169548 conn(0x7f24380be150 msgr2=0x7f24380be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243d0de640 1 -- 172.21.15.161:0/171169548 shutdown_connections 2024-02-02T11:49:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243d0de640 1 -- 172.21.15.161:0/171169548 wait complete. 2024-02-02T11:49:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243d0de640 1 Processor -- start 2024-02-02T11:49:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243d0de640 1 -- start start 2024-02-02T11:49:00.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243d0de640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2438071160 0x7f24380b7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:00.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243d0de640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24380b42d0 0x7f2438147740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:00.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243d0de640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24381429f0 0x7f2438139ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:00.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243d0de640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24380b8190 con 0x7f24381429f0 2024-02-02T11:49:00.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243d0de640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243813ef90 con 0x7f24380b42d0 2024-02-02T11:49:00.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243d0de640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243806cb00 con 0x7f2438071160 2024-02-02T11:49:00.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24381429f0 0x7f2438139ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:00.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24381429f0 0x7f2438139ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36592/0 (socket says 172.21.15.161:36592) 2024-02-02T11:49:00.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243759e640 1 -- 172.21.15.161:0/1430375092 learned_addr learned my addr 172.21.15.161:0/1430375092 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:00.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243659c640 1 --2- 172.21.15.161:0/1430375092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24380b42d0 0x7f2438147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:00.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f2436d9d640 1 --2- 172.21.15.161:0/1430375092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2438071160 0x7f24380b7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:00.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243759e640 1 -- 172.21.15.161:0/1430375092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2438071160 msgr2=0x7f24380b7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:00.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243759e640 1 --2- 172.21.15.161:0/1430375092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2438071160 0x7f24380b7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243759e640 1 -- 172.21.15.161:0/1430375092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24380b42d0 msgr2=0x7f2438147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:00.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243759e640 1 --2- 172.21.15.161:0/1430375092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24380b42d0 0x7f2438147740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243759e640 1 -- 172.21.15.161:0/1430375092 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2430009b30 con 0x7f24381429f0 2024-02-02T11:49:00.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f2436d9d640 1 --2- 172.21.15.161:0/1430375092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2438071160 0x7f24380b7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:49:00.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243759e640 1 --2- 172.21.15.161:0/1430375092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24381429f0 0x7f2438139ed0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f24300af040 tx=0x7f24300196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:00.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f242f7fe640 1 -- 172.21.15.161:0/1430375092 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24300b8670 con 0x7f24381429f0 2024-02-02T11:49:00.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f242f7fe640 1 -- 172.21.15.161:0/1430375092 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24300b87f0 con 0x7f24381429f0 2024-02-02T11:49:00.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243d0de640 1 -- 172.21.15.161:0/1430375092 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243806c820 con 0x7f24381429f0 2024-02-02T11:49:00.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f242f7fe640 1 -- 172.21.15.161:0/1430375092 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24300b8ba0 con 0x7f24381429f0 2024-02-02T11:49:00.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.059+0000 7f243d0de640 1 -- 172.21.15.161:0/1430375092 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243806b240 con 0x7f24381429f0 2024-02-02T11:49:00.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.063+0000 7f243d0de640 1 -- 172.21.15.161:0/1430375092 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f243806b430 con 0x7f24381429f0 2024-02-02T11:49:00.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.063+0000 7f242f7fe640 1 -- 172.21.15.161:0/1430375092 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f24300b8d00 con 0x7f24381429f0 2024-02-02T11:49:00.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.063+0000 7f242f7fe640 1 --2- 172.21.15.161:0/1430375092 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2418065a30 0x7f2418067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:00.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.063+0000 7f242f7fe640 1 -- 172.21.15.161:0/1430375092 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f243011e5f0 con 0x7f24381429f0 2024-02-02T11:49:00.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.063+0000 7f2436d9d640 1 --2- 172.21.15.161:0/1430375092 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2418065a30 0x7f2418067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:00.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.063+0000 7f2436d9d640 1 --2- 172.21.15.161:0/1430375092 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2418065a30 0x7f2418067ef0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2428007a70 tx=0x7f2428008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:00.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.067+0000 7f242f7fe640 1 -- 172.21.15.161:0/1430375092 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f24300ec160 con 0x7f24381429f0 2024-02-02T11:49:00.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.219+0000 7f243d0de640 1 -- 172.21.15.161:0/1430375092 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24380b93e0 con 0x7f2418065a30 2024-02-02T11:49:00.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.227+0000 7f242f7fe640 1 -- 172.21.15.161:0/1430375092 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264540 (secure 0 0 0) 0x7f2428007710 con 0x7f2418065a30 2024-02-02T11:49:00.233 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:00.234 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-02-02T11:49:00.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.231+0000 7f243d0de640 1 -- 172.21.15.161:0/1430375092 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2418065a30 msgr2=0x7f2418067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:00.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.231+0000 7f243d0de640 1 --2- 172.21.15.161:0/1430375092 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2418065a30 0x7f2418067ef0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2428007a70 tx=0x7f2428008040 comp rx=0 tx=0).stop 2024-02-02T11:49:00.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.231+0000 7f243d0de640 1 -- 172.21.15.161:0/1430375092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24381429f0 msgr2=0x7f2438139ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:00.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.231+0000 7f243d0de640 1 --2- 172.21.15.161:0/1430375092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24381429f0 0x7f2438139ed0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f24300af040 tx=0x7f24300196b0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.231+0000 7f243d0de640 1 -- 172.21.15.161:0/1430375092 shutdown_connections 2024-02-02T11:49:00.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.231+0000 7f243d0de640 1 --2- 172.21.15.161:0/1430375092 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2418065a30 0x7f2418067ef0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.231+0000 7f243d0de640 1 --2- 172.21.15.161:0/1430375092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24381429f0 0x7f2438139ed0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.231+0000 7f243d0de640 1 --2- 172.21.15.161:0/1430375092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24380b42d0 0x7f2438147740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.231+0000 7f243d0de640 1 --2- 172.21.15.161:0/1430375092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2438071160 0x7f24380b7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.231+0000 7f243d0de640 1 -- 172.21.15.161:0/1430375092 >> 172.21.15.161:0/1430375092 conn(0x7f24380be150 msgr2=0x7f2438072f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:00.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.231+0000 7f243d0de640 1 -- 172.21.15.161:0/1430375092 shutdown_connections 2024-02-02T11:49:00.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.231+0000 7f243d0de640 1 -- 172.21.15.161:0/1430375092 wait complete. 2024-02-02T11:49:00.250 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-02-02T11:48:58.254230+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223080,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":220146,"kb_avail":754751640,"statfs":{"total":773094113280,"available":772865679360,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225429592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.813993"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014159+0000","last_change":"2024-02-02T11:48:51.897055+0000","last_active":"2024-02-02T11:48:53.014159+0000","last_peered":"2024-02-02T11:48:53.014159+0000","last_clean":"2024-02-02T11:48:53.014159+0000","last_became_active":"2024-02-02T11:48:51.896591+0000","last_became_peered":"2024-02-02T11:48:51.896591+0000","last_unstale":"2024-02-02T11:48:53.014159+0000","last_undegraded":"2024-02-02T11:48:53.014159+0000","last_fullsized":"2024-02-02T11:48:53.014159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825415+0000","last_change":"2024-02-02T11:48:51.849203+0000","last_active":"2024-02-02T11:48:52.825415+0000","last_peered":"2024-02-02T11:48:52.825415+0000","last_clean":"2024-02-02T11:48:52.825415+0000","last_became_active":"2024-02-02T11:48:51.848773+0000","last_became_peered":"2024-02-02T11:48:51.848773+0000","last_unstale":"2024-02-02T11:48:52.825415+0000","last_undegraded":"2024-02-02T11:48:52.825415+0000","last_fullsized":"2024-02-02T11:48:52.825415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:26:18.517358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014636+0000","last_change":"2024-02-02T11:48:51.848120+0000","last_active":"2024-02-02T11:48:53.014636+0000","last_peered":"2024-02-02T11:48:53.014636+0000","last_clean":"2024-02-02T11:48:53.014636+0000","last_became_active":"2024-02-02T11:48:51.847834+0000","last_became_peered":"2024-02-02T11:48:51.847834+0000","last_unstale":"2024-02-02T11:48:53.014636+0000","last_undegraded":"2024-02-02T11:48:53.014636+0000","last_fullsized":"2024-02-02T11:48:53.014636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:14.049200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828595+0000","last_change":"2024-02-02T11:48:51.873374+0000","last_active":"2024-02-02T11:48:52.828595+0000","last_peered":"2024-02-02T11:48:52.828595+0000","last_clean":"2024-02-02T11:48:52.828595+0000","last_became_active":"2024-02-02T11:48:51.872600+0000","last_became_peered":"2024-02-02T11:48:51.872600+0000","last_unstale":"2024-02-02T11:48:52.828595+0000","last_undegraded":"2024-02-02T11:48:52.828595+0000","last_fullsized":"2024-02-02T11:48:52.828595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:31:27.082147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013509+0000","last_change":"2024-02-02T11:48:51.886196+0000","last_active":"2024-02-02T11:48:53.013509+0000","last_peered":"2024-02-02T11:48:53.013509+0000","last_clean":"2024-02-02T11:48:53.013509+0000","last_became_active":"2024-02-02T11:48:51.885504+0000","last_became_peered":"2024-02-02T11:48:51.885504+0000","last_unstale":"2024-02-02T11:48:53.013509+0000","last_undegraded":"2024-02-02T11:48:53.013509+0000","last_fullsized":"2024-02-02T11:48:53.013509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:55:40.677428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828565+0000","last_change":"2024-02-02T11:48:51.890332+0000","last_active":"2024-02-02T11:48:52.828565+0000","last_peered":"2024-02-02T11:48:52.828565+0000","last_clean":"2024-02-02T11:48:52.828565+0000","last_became_active":"2024-02-02T11:48:51.889165+0000","last_became_peered":"2024-02-02T11:48:51.889165+0000","last_unstale":"2024-02-02T11:48:52.828565+0000","last_undegraded":"2024-02-02T11:48:52.828565+0000","last_fullsized":"2024-02-02T11:48:52.828565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:01:26.016064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013297+0000","last_change":"2024-02-02T11:48:51.884543+0000","last_active":"2024-02-02T11:48:53.013297+0000","last_peered":"2024-02-02T11:48:53.013297+0000","last_clean":"2024-02-02T11:48:53.013297+0000","last_became_active":"2024-02-02T11:48:51.884113+0000","last_became_peered":"2024-02-02T11:48:51.884113+0000","last_unstale":"2024-02-02T11:48:53.013297+0000","last_undegraded":"2024-02-02T11:48:53.013297+0000","last_fullsized":"2024-02-02T11:48:53.013297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:31:27.082147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013204+0000","last_change":"2024-02-02T11:48:51.873291+0000","last_active":"2024-02-02T11:48:53.013204+0000","last_peered":"2024-02-02T11:48:53.013204+0000","last_clean":"2024-02-02T11:48:53.013204+0000","last_became_active":"2024-02-02T11:48:51.872981+0000","last_became_peered":"2024-02-02T11:48:51.872981+0000","last_unstale":"2024-02-02T11:48:53.013204+0000","last_undegraded":"2024-02-02T11:48:53.013204+0000","last_fullsized":"2024-02-02T11:48:53.013204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:14.049200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014205+0000","last_change":"2024-02-02T11:48:51.898237+0000","last_active":"2024-02-02T11:48:53.014205+0000","last_peered":"2024-02-02T11:48:53.014205+0000","last_clean":"2024-02-02T11:48:53.014205+0000","last_became_active":"2024-02-02T11:48:51.897065+0000","last_became_peered":"2024-02-02T11:48:51.897065+0000","last_unstale":"2024-02-02T11:48:53.014205+0000","last_undegraded":"2024-02-02T11:48:53.014205+0000","last_fullsized":"2024-02-02T11:48:53.014205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:56:59.771841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993307+0000","last_change":"2024-02-02T11:48:51.864449+0000","last_active":"2024-02-02T11:48:52.993307+0000","last_peered":"2024-02-02T11:48:52.993307+0000","last_clean":"2024-02-02T11:48:52.993307+0000","last_became_active":"2024-02-02T11:48:51.863664+0000","last_became_peered":"2024-02-02T11:48:51.863664+0000","last_unstale":"2024-02-02T11:48:52.993307+0000","last_undegraded":"2024-02-02T11:48:52.993307+0000","last_fullsized":"2024-02-02T11:48:52.993307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993018+0000","last_change":"2024-02-02T11:48:51.890353+0000","last_active":"2024-02-02T11:48:52.993018+0000","last_peered":"2024-02-02T11:48:52.993018+0000","last_clean":"2024-02-02T11:48:52.993018+0000","last_became_active":"2024-02-02T11:48:51.889927+0000","last_became_peered":"2024-02-02T11:48:51.889927+0000","last_unstale":"2024-02-02T11:48:52.993018+0000","last_undegraded":"2024-02-02T11:48:52.993018+0000","last_fullsized":"2024-02-02T11:48:52.993018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:44:05.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.827212+0000","last_change":"2024-02-02T11:48:51.865778+0000","last_active":"2024-02-02T11:48:52.827212+0000","last_peered":"2024-02-02T11:48:52.827212+0000","last_clean":"2024-02-02T11:48:52.827212+0000","last_became_active":"2024-02-02T11:48:51.864513+0000","last_became_peered":"2024-02-02T11:48:51.864513+0000","last_unstale":"2024-02-02T11:48:52.827212+0000","last_undegraded":"2024-02-02T11:48:52.827212+0000","last_fullsized":"2024-02-02T11:48:52.827212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:33.128561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014047+0000","last_change":"2024-02-02T11:48:51.871880+0000","last_active":"2024-02-02T11:48:53.014047+0000","last_peered":"2024-02-02T11:48:53.014047+0000","last_clean":"2024-02-02T11:48:53.014047+0000","last_became_active":"2024-02-02T11:48:51.871683+0000","last_became_peered":"2024-02-02T11:48:51.871683+0000","last_unstale":"2024-02-02T11:48:53.014047+0000","last_undegraded":"2024-02-02T11:48:53.014047+0000","last_fullsized":"2024-02-02T11:48:53.014047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:32:50.539652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016221+0000","last_change":"2024-02-02T11:48:51.843150+0000","last_active":"2024-02-02T11:48:53.016221+0000","last_peered":"2024-02-02T11:48:53.016221+0000","last_clean":"2024-02-02T11:48:53.016221+0000","last_became_active":"2024-02-02T11:48:51.842884+0000","last_became_peered":"2024-02-02T11:48:51.842884+0000","last_unstale":"2024-02-02T11:48:53.016221+0000","last_undegraded":"2024-02-02T11:48:53.016221+0000","last_fullsized":"2024-02-02T11:48:53.016221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:33:43.440229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.824851+0000","last_change":"2024-02-02T11:48:51.835634+0000","last_active":"2024-02-02T11:48:52.824851+0000","last_peered":"2024-02-02T11:48:52.824851+0000","last_clean":"2024-02-02T11:48:52.824851+0000","last_became_active":"2024-02-02T11:48:51.835378+0000","last_became_peered":"2024-02-02T11:48:51.835378+0000","last_unstale":"2024-02-02T11:48:52.824851+0000","last_undegraded":"2024-02-02T11:48:52.824851+0000","last_fullsized":"2024-02-02T11:48:52.824851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828051+0000","last_change":"2024-02-02T11:48:51.873754+0000","last_active":"2024-02-02T11:48:52.828051+0000","last_peered":"2024-02-02T11:48:52.828051+0000","last_clean":"2024-02-02T11:48:52.828051+0000","last_became_active":"2024-02-02T11:48:51.864819+0000","last_became_peered":"2024-02-02T11:48:51.864819+0000","last_unstale":"2024-02-02T11:48:52.828051+0000","last_undegraded":"2024-02-02T11:48:52.828051+0000","last_fullsized":"2024-02-02T11:48:52.828051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:02:09.899239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829342+0000","last_change":"2024-02-02T11:48:51.884635+0000","last_active":"2024-02-02T11:48:52.829342+0000","last_peered":"2024-02-02T11:48:52.829342+0000","last_clean":"2024-02-02T11:48:52.829342+0000","last_became_active":"2024-02-02T11:48:51.884182+0000","last_became_peered":"2024-02-02T11:48:51.884182+0000","last_unstale":"2024-02-02T11:48:52.829342+0000","last_undegraded":"2024-02-02T11:48:52.829342+0000","last_fullsized":"2024-02-02T11:48:52.829342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:15:46.872789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015398+0000","last_change":"2024-02-02T11:48:51.870210+0000","last_active":"2024-02-02T11:48:53.015398+0000","last_peered":"2024-02-02T11:48:53.015398+0000","last_clean":"2024-02-02T11:48:53.015398+0000","last_became_active":"2024-02-02T11:48:51.869889+0000","last_became_peered":"2024-02-02T11:48:51.869889+0000","last_unstale":"2024-02-02T11:48:53.015398+0000","last_undegraded":"2024-02-02T11:48:53.015398+0000","last_fullsized":"2024-02-02T11:48:53.015398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:33.128561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014093+0000","last_change":"2024-02-02T11:48:51.888159+0000","last_active":"2024-02-02T11:48:53.014093+0000","last_peered":"2024-02-02T11:48:53.014093+0000","last_clean":"2024-02-02T11:48:53.014093+0000","last_became_active":"2024-02-02T11:48:51.887546+0000","last_became_peered":"2024-02-02T11:48:51.887546+0000","last_unstale":"2024-02-02T11:48:53.014093+0000","last_undegraded":"2024-02-02T11:48:53.014093+0000","last_fullsized":"2024-02-02T11:48:53.014093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:36:48.786870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992872+0000","last_change":"2024-02-02T11:48:51.862691+0000","last_active":"2024-02-02T11:48:52.992872+0000","last_peered":"2024-02-02T11:48:52.992872+0000","last_clean":"2024-02-02T11:48:52.992872+0000","last_became_active":"2024-02-02T11:48:51.862032+0000","last_became_peered":"2024-02-02T11:48:51.862032+0000","last_unstale":"2024-02-02T11:48:52.992872+0000","last_undegraded":"2024-02-02T11:48:52.992872+0000","last_fullsized":"2024-02-02T11:48:52.992872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:17:07.932896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015727+0000","last_change":"2024-02-02T11:48:51.884441+0000","last_active":"2024-02-02T11:48:53.015727+0000","last_peered":"2024-02-02T11:48:53.015727+0000","last_clean":"2024-02-02T11:48:53.015727+0000","last_became_active":"2024-02-02T11:48:51.884033+0000","last_became_peered":"2024-02-02T11:48:51.884033+0000","last_unstale":"2024-02-02T11:48:53.015727+0000","last_undegraded":"2024-02-02T11:48:53.015727+0000","last_fullsized":"2024-02-02T11:48:53.015727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828714+0000","last_change":"2024-02-02T11:48:51.884667+0000","last_active":"2024-02-02T11:48:52.828714+0000","last_peered":"2024-02-02T11:48:52.828714+0000","last_clean":"2024-02-02T11:48:52.828714+0000","last_became_active":"2024-02-02T11:48:51.884211+0000","last_became_peered":"2024-02-02T11:48:51.884211+0000","last_unstale":"2024-02-02T11:48:52.828714+0000","last_undegraded":"2024-02-02T11:48:52.828714+0000","last_fullsized":"2024-02-02T11:48:52.828714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:34:16.623804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.017166+0000","last_change":"2024-02-02T11:48:51.844344+0000","last_active":"2024-02-02T11:48:53.017166+0000","last_peered":"2024-02-02T11:48:53.017166+0000","last_clean":"2024-02-02T11:48:53.017166+0000","last_became_active":"2024-02-02T11:48:51.844068+0000","last_became_peered":"2024-02-02T11:48:51.844068+0000","last_unstale":"2024-02-02T11:48:53.017166+0000","last_undegraded":"2024-02-02T11:48:53.017166+0000","last_fullsized":"2024-02-02T11:48:53.017166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:31:27.082147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829389+0000","last_change":"2024-02-02T11:48:51.863370+0000","last_active":"2024-02-02T11:48:52.829389+0000","last_peered":"2024-02-02T11:48:52.829389+0000","last_clean":"2024-02-02T11:48:52.829389+0000","last_became_active":"2024-02-02T11:48:51.862502+0000","last_became_peered":"2024-02-02T11:48:51.862502+0000","last_unstale":"2024-02-02T11:48:52.829389+0000","last_undegraded":"2024-02-02T11:48:52.829389+0000","last_fullsized":"2024-02-02T11:48:52.829389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:55:40.677428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015018+0000","last_change":"2024-02-02T11:48:51.844587+0000","last_active":"2024-02-02T11:48:53.015018+0000","last_peered":"2024-02-02T11:48:53.015018+0000","last_clean":"2024-02-02T11:48:53.015018+0000","last_became_active":"2024-02-02T11:48:51.844279+0000","last_became_peered":"2024-02-02T11:48:51.844279+0000","last_unstale":"2024-02-02T11:48:53.015018+0000","last_undegraded":"2024-02-02T11:48:53.015018+0000","last_fullsized":"2024-02-02T11:48:53.015018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:56:59.771841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993316+0000","last_change":"2024-02-02T11:48:51.886760+0000","last_active":"2024-02-02T11:48:52.993316+0000","last_peered":"2024-02-02T11:48:52.993316+0000","last_clean":"2024-02-02T11:48:52.993316+0000","last_became_active":"2024-02-02T11:48:51.886352+0000","last_became_peered":"2024-02-02T11:48:51.886352+0000","last_unstale":"2024-02-02T11:48:52.993316+0000","last_undegraded":"2024-02-02T11:48:52.993316+0000","last_fullsized":"2024-02-02T11:48:52.993316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825142+0000","last_change":"2024-02-02T11:48:51.836508+0000","last_active":"2024-02-02T11:48:52.825142+0000","last_peered":"2024-02-02T11:48:52.825142+0000","last_clean":"2024-02-02T11:48:52.825142+0000","last_became_active":"2024-02-02T11:48:51.836243+0000","last_became_peered":"2024-02-02T11:48:51.836243+0000","last_unstale":"2024-02-02T11:48:52.825142+0000","last_undegraded":"2024-02-02T11:48:52.825142+0000","last_fullsized":"2024-02-02T11:48:52.825142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:17:07.932896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015447+0000","last_change":"2024-02-02T11:48:51.857222+0000","last_active":"2024-02-02T11:48:53.015447+0000","last_peered":"2024-02-02T11:48:53.015447+0000","last_clean":"2024-02-02T11:48:53.015447+0000","last_became_active":"2024-02-02T11:48:51.857008+0000","last_became_peered":"2024-02-02T11:48:51.857008+0000","last_unstale":"2024-02-02T11:48:53.015447+0000","last_undegraded":"2024-02-02T11:48:53.015447+0000","last_fullsized":"2024-02-02T11:48:53.015447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:55:40.677428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015969+0000","last_change":"2024-02-02T11:48:51.848918+0000","last_active":"2024-02-02T11:48:53.015969+0000","last_peered":"2024-02-02T11:48:53.015969+0000","last_clean":"2024-02-02T11:48:53.015969+0000","last_became_active":"2024-02-02T11:48:51.847820+0000","last_became_peered":"2024-02-02T11:48:51.847820+0000","last_unstale":"2024-02-02T11:48:53.015969+0000","last_undegraded":"2024-02-02T11:48:53.015969+0000","last_fullsized":"2024-02-02T11:48:53.015969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:44:05.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828816+0000","last_change":"2024-02-02T11:48:51.863180+0000","last_active":"2024-02-02T11:48:52.828816+0000","last_peered":"2024-02-02T11:48:52.828816+0000","last_clean":"2024-02-02T11:48:52.828816+0000","last_became_active":"2024-02-02T11:48:51.862533+0000","last_became_peered":"2024-02-02T11:48:51.862533+0000","last_unstale":"2024-02-02T11:48:52.828816+0000","last_undegraded":"2024-02-02T11:48:52.828816+0000","last_fullsized":"2024-02-02T11:48:52.828816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:32:50.539652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013102+0000","last_change":"2024-02-02T11:48:51.862936+0000","last_active":"2024-02-02T11:48:53.013102+0000","last_peered":"2024-02-02T11:48:53.013102+0000","last_clean":"2024-02-02T11:48:53.013102+0000","last_became_active":"2024-02-02T11:48:51.862663+0000","last_became_peered":"2024-02-02T11:48:51.862663+0000","last_unstale":"2024-02-02T11:48:53.013102+0000","last_undegraded":"2024-02-02T11:48:53.013102+0000","last_fullsized":"2024-02-02T11:48:53.013102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:27.396890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992606+0000","last_change":"2024-02-02T11:48:51.865648+0000","last_active":"2024-02-02T11:48:52.992606+0000","last_peered":"2024-02-02T11:48:52.992606+0000","last_clean":"2024-02-02T11:48:52.992606+0000","last_became_active":"2024-02-02T11:48:51.864078+0000","last_became_peered":"2024-02-02T11:48:51.864078+0000","last_unstale":"2024-02-02T11:48:52.992606+0000","last_undegraded":"2024-02-02T11:48:52.992606+0000","last_fullsized":"2024-02-02T11:48:52.992606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:14.049200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.826642+0000","last_change":"2024-02-02T11:48:51.837010+0000","last_active":"2024-02-02T11:48:52.826642+0000","last_peered":"2024-02-02T11:48:52.826642+0000","last_clean":"2024-02-02T11:48:52.826642+0000","last_became_active":"2024-02-02T11:48:51.836245+0000","last_became_peered":"2024-02-02T11:48:51.836245+0000","last_unstale":"2024-02-02T11:48:52.826642+0000","last_undegraded":"2024-02-02T11:48:52.826642+0000","last_fullsized":"2024-02-02T11:48:52.826642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:05:40.202784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014518+0000","last_change":"2024-02-02T11:48:51.490158+0000","last_active":"2024-02-02T11:48:53.014518+0000","last_peered":"2024-02-02T11:48:53.014518+0000","last_clean":"2024-02-02T11:48:53.014518+0000","last_became_active":"2024-02-02T11:48:51.489826+0000","last_became_peered":"2024-02-02T11:48:51.489826+0000","last_unstale":"2024-02-02T11:48:53.014518+0000","last_undegraded":"2024-02-02T11:48:53.014518+0000","last_fullsized":"2024-02-02T11:48:53.014518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:06:13.971694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016208+0000","last_change":"2024-02-02T11:48:51.848592+0000","last_active":"2024-02-02T11:48:53.016208+0000","last_peered":"2024-02-02T11:48:53.016208+0000","last_clean":"2024-02-02T11:48:53.016208+0000","last_became_active":"2024-02-02T11:48:51.848379+0000","last_became_peered":"2024-02-02T11:48:51.848379+0000","last_unstale":"2024-02-02T11:48:53.016208+0000","last_undegraded":"2024-02-02T11:48:53.016208+0000","last_fullsized":"2024-02-02T11:48:53.016208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:17:07.932896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992668+0000","last_change":"2024-02-02T11:48:51.481701+0000","last_active":"2024-02-02T11:48:52.992668+0000","last_peered":"2024-02-02T11:48:52.992668+0000","last_clean":"2024-02-02T11:48:52.992668+0000","last_became_active":"2024-02-02T11:48:51.480901+0000","last_became_peered":"2024-02-02T11:48:51.480901+0000","last_unstale":"2024-02-02T11:48:52.992668+0000","last_undegraded":"2024-02-02T11:48:52.992668+0000","last_fullsized":"2024-02-02T11:48:52.992668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.017353+0000","last_change":"2024-02-02T11:48:51.482357+0000","last_active":"2024-02-02T11:48:53.017353+0000","last_peered":"2024-02-02T11:48:53.017353+0000","last_clean":"2024-02-02T11:48:53.017353+0000","last_became_active":"2024-02-02T11:48:51.482055+0000","last_became_peered":"2024-02-02T11:48:51.482055+0000","last_unstale":"2024-02-02T11:48:53.017353+0000","last_undegraded":"2024-02-02T11:48:53.017353+0000","last_fullsized":"2024-02-02T11:48:53.017353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:12:40.411121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013783+0000","last_change":"2024-02-02T11:48:51.843584+0000","last_active":"2024-02-02T11:48:53.013783+0000","last_peered":"2024-02-02T11:48:53.013783+0000","last_clean":"2024-02-02T11:48:53.013783+0000","last_became_active":"2024-02-02T11:48:51.843299+0000","last_became_peered":"2024-02-02T11:48:51.843299+0000","last_unstale":"2024-02-02T11:48:53.013783+0000","last_undegraded":"2024-02-02T11:48:53.013783+0000","last_fullsized":"2024-02-02T11:48:53.013783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:26:18.517358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828293+0000","last_change":"2024-02-02T11:48:51.475843+0000","last_active":"2024-02-02T11:48:52.828293+0000","last_peered":"2024-02-02T11:48:52.828293+0000","last_clean":"2024-02-02T11:48:52.828293+0000","last_became_active":"2024-02-02T11:48:51.474780+0000","last_became_peered":"2024-02-02T11:48:51.474780+0000","last_unstale":"2024-02-02T11:48:52.828293+0000","last_undegraded":"2024-02-02T11:48:52.828293+0000","last_fullsized":"2024-02-02T11:48:52.828293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:06:13.971694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825017+0000","last_change":"2024-02-02T11:48:51.836833+0000","last_active":"2024-02-02T11:48:52.825017+0000","last_peered":"2024-02-02T11:48:52.825017+0000","last_clean":"2024-02-02T11:48:52.825017+0000","last_became_active":"2024-02-02T11:48:51.836528+0000","last_became_peered":"2024-02-02T11:48:51.836528+0000","last_unstale":"2024-02-02T11:48:52.825017+0000","last_undegraded":"2024-02-02T11:48:52.825017+0000","last_fullsized":"2024-02-02T11:48:52.825017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:44:05.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993305+0000","last_change":"2024-02-02T11:48:51.487441+0000","last_active":"2024-02-02T11:48:52.993305+0000","last_peered":"2024-02-02T11:48:52.993305+0000","last_clean":"2024-02-02T11:48:52.993305+0000","last_became_active":"2024-02-02T11:48:51.486655+0000","last_became_peered":"2024-02-02T11:48:51.486655+0000","last_unstale":"2024-02-02T11:48:52.993305+0000","last_undegraded":"2024-02-02T11:48:52.993305+0000","last_fullsized":"2024-02-02T11:48:52.993305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:22:40.437082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829603+0000","last_change":"2024-02-02T11:48:51.886180+0000","last_active":"2024-02-02T11:48:52.829603+0000","last_peered":"2024-02-02T11:48:52.829603+0000","last_clean":"2024-02-02T11:48:52.829603+0000","last_became_active":"2024-02-02T11:48:51.885591+0000","last_became_peered":"2024-02-02T11:48:51.885591+0000","last_unstale":"2024-02-02T11:48:52.829603+0000","last_undegraded":"2024-02-02T11:48:52.829603+0000","last_fullsized":"2024-02-02T11:48:52.829603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:31:31.979723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829725+0000","last_change":"2024-02-02T11:48:51.485465+0000","last_active":"2024-02-02T11:48:52.829725+0000","last_peered":"2024-02-02T11:48:52.829725+0000","last_clean":"2024-02-02T11:48:52.829725+0000","last_became_active":"2024-02-02T11:48:51.484749+0000","last_became_peered":"2024-02-02T11:48:51.484749+0000","last_unstale":"2024-02-02T11:48:52.829725+0000","last_undegraded":"2024-02-02T11:48:52.829725+0000","last_fullsized":"2024-02-02T11:48:52.829725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:12:40.411121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015866+0000","last_change":"2024-02-02T11:48:51.890561+0000","last_active":"2024-02-02T11:48:53.015866+0000","last_peered":"2024-02-02T11:48:53.015866+0000","last_clean":"2024-02-02T11:48:53.015866+0000","last_became_active":"2024-02-02T11:48:51.890385+0000","last_became_peered":"2024-02-02T11:48:51.890385+0000","last_unstale":"2024-02-02T11:48:53.015866+0000","last_undegraded":"2024-02-02T11:48:53.015866+0000","last_fullsized":"2024-02-02T11:48:53.015866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:26:18.517358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825200+0000","last_change":"2024-02-02T11:48:51.467792+0000","last_active":"2024-02-02T11:48:52.825200+0000","last_peered":"2024-02-02T11:48:52.825200+0000","last_clean":"2024-02-02T11:48:52.825200+0000","last_became_active":"2024-02-02T11:48:51.467447+0000","last_became_peered":"2024-02-02T11:48:51.467447+0000","last_unstale":"2024-02-02T11:48:52.825200+0000","last_undegraded":"2024-02-02T11:48:52.825200+0000","last_fullsized":"2024-02-02T11:48:52.825200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:32.118220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.827459+0000","last_change":"2024-02-02T11:48:51.886539+0000","last_active":"2024-02-02T11:48:52.827459+0000","last_peered":"2024-02-02T11:48:52.827459+0000","last_clean":"2024-02-02T11:48:52.827459+0000","last_became_active":"2024-02-02T11:48:51.886091+0000","last_became_peered":"2024-02-02T11:48:51.886091+0000","last_unstale":"2024-02-02T11:48:52.827459+0000","last_undegraded":"2024-02-02T11:48:52.827459+0000","last_fullsized":"2024-02-02T11:48:52.827459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:41:08.293554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992948+0000","last_change":"2024-02-02T11:48:51.478707+0000","last_active":"2024-02-02T11:48:52.992948+0000","last_peered":"2024-02-02T11:48:52.992948+0000","last_clean":"2024-02-02T11:48:52.992948+0000","last_became_active":"2024-02-02T11:48:51.477592+0000","last_became_peered":"2024-02-02T11:48:51.477592+0000","last_unstale":"2024-02-02T11:48:52.992948+0000","last_undegraded":"2024-02-02T11:48:52.992948+0000","last_fullsized":"2024-02-02T11:48:52.992948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:02:58.430952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013767+0000","last_change":"2024-02-02T11:48:51.885728+0000","last_active":"2024-02-02T11:48:53.013767+0000","last_peered":"2024-02-02T11:48:53.013767+0000","last_clean":"2024-02-02T11:48:53.013767+0000","last_became_active":"2024-02-02T11:48:51.885343+0000","last_became_peered":"2024-02-02T11:48:51.885343+0000","last_unstale":"2024-02-02T11:48:53.013767+0000","last_undegraded":"2024-02-02T11:48:53.013767+0000","last_fullsized":"2024-02-02T11:48:53.013767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:02:09.899239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016432+0000","last_change":"2024-02-02T11:48:51.489735+0000","last_active":"2024-02-02T11:48:53.016432+0000","last_peered":"2024-02-02T11:48:53.016432+0000","last_clean":"2024-02-02T11:48:53.016432+0000","last_became_active":"2024-02-02T11:48:51.489394+0000","last_became_peered":"2024-02-02T11:48:51.489394+0000","last_unstale":"2024-02-02T11:48:53.016432+0000","last_undegraded":"2024-02-02T11:48:53.016432+0000","last_fullsized":"2024-02-02T11:48:53.016432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:18:12.503377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016349+0000","last_change":"2024-02-02T11:48:51.884370+0000","last_active":"2024-02-02T11:48:53.016349+0000","last_peered":"2024-02-02T11:48:53.016349+0000","last_clean":"2024-02-02T11:48:53.016349+0000","last_became_active":"2024-02-02T11:48:51.884044+0000","last_became_peered":"2024-02-02T11:48:51.884044+0000","last_unstale":"2024-02-02T11:48:53.016349+0000","last_undegraded":"2024-02-02T11:48:53.016349+0000","last_fullsized":"2024-02-02T11:48:53.016349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:33.128561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828935+0000","last_change":"2024-02-02T11:48:51.466861+0000","last_active":"2024-02-02T11:48:52.828935+0000","last_peered":"2024-02-02T11:48:52.828935+0000","last_clean":"2024-02-02T11:48:52.828935+0000","last_became_active":"2024-02-02T11:48:51.466097+0000","last_became_peered":"2024-02-02T11:48:51.466097+0000","last_unstale":"2024-02-02T11:48:52.828935+0000","last_undegraded":"2024-02-02T11:48:52.828935+0000","last_fullsized":"2024-02-02T11:48:52.828935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:02:58.430952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013799+0000","last_change":"2024-02-02T11:48:51.885012+0000","last_active":"2024-02-02T11:48:53.013799+0000","last_peered":"2024-02-02T11:48:53.013799+0000","last_clean":"2024-02-02T11:48:53.013799+0000","last_became_active":"2024-02-02T11:48:51.884374+0000","last_became_peered":"2024-02-02T11:48:51.884374+0000","last_unstale":"2024-02-02T11:48:53.013799+0000","last_undegraded":"2024-02-02T11:48:53.013799+0000","last_fullsized":"2024-02-02T11:48:53.013799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T17:33:10.421610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992599+0000","last_change":"2024-02-02T11:48:51.478572+0000","last_active":"2024-02-02T11:48:52.992599+0000","last_peered":"2024-02-02T11:48:52.992599+0000","last_clean":"2024-02-02T11:48:52.992599+0000","last_became_active":"2024-02-02T11:48:51.477722+0000","last_became_peered":"2024-02-02T11:48:51.477722+0000","last_unstale":"2024-02-02T11:48:52.992599+0000","last_undegraded":"2024-02-02T11:48:52.992599+0000","last_fullsized":"2024-02-02T11:48:52.992599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:06:13.971694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992588+0000","last_change":"2024-02-02T11:48:51.869232+0000","last_active":"2024-02-02T11:48:52.992588+0000","last_peered":"2024-02-02T11:48:52.992588+0000","last_clean":"2024-02-02T11:48:52.992588+0000","last_became_active":"2024-02-02T11:48:51.864926+0000","last_became_peered":"2024-02-02T11:48:51.864926+0000","last_unstale":"2024-02-02T11:48:52.992588+0000","last_undegraded":"2024-02-02T11:48:52.992588+0000","last_fullsized":"2024-02-02T11:48:52.992588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:42:12.424582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013003+0000","last_change":"2024-02-02T11:48:51.470192+0000","last_active":"2024-02-02T11:48:53.013003+0000","last_peered":"2024-02-02T11:48:53.013003+0000","last_clean":"2024-02-02T11:48:53.013003+0000","last_became_active":"2024-02-02T11:48:51.469834+0000","last_became_peered":"2024-02-02T11:48:51.469834+0000","last_unstale":"2024-02-02T11:48:53.013003+0000","last_undegraded":"2024-02-02T11:48:53.013003+0000","last_fullsized":"2024-02-02T11:48:53.013003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:12:40.411121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013456+0000","last_change":"2024-02-02T11:48:51.884838+0000","last_active":"2024-02-02T11:48:53.013456+0000","last_peered":"2024-02-02T11:48:53.013456+0000","last_clean":"2024-02-02T11:48:53.013456+0000","last_became_active":"2024-02-02T11:48:51.884185+0000","last_became_peered":"2024-02-02T11:48:51.884185+0000","last_unstale":"2024-02-02T11:48:53.013456+0000","last_undegraded":"2024-02-02T11:48:53.013456+0000","last_fullsized":"2024-02-02T11:48:53.013456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:15:46.872789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.827152+0000","last_change":"2024-02-02T11:48:51.474818+0000","last_active":"2024-02-02T11:48:52.827152+0000","last_peered":"2024-02-02T11:48:52.827152+0000","last_clean":"2024-02-02T11:48:52.827152+0000","last_became_active":"2024-02-02T11:48:51.474087+0000","last_became_peered":"2024-02-02T11:48:51.474087+0000","last_unstale":"2024-02-02T11:48:52.827152+0000","last_undegraded":"2024-02-02T11:48:52.827152+0000","last_fullsized":"2024-02-02T11:48:52.827152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:18:12.503377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014027+0000","last_change":"2024-02-02T11:48:51.897044+0000","last_active":"2024-02-02T11:48:53.014027+0000","last_peered":"2024-02-02T11:48:53.014027+0000","last_clean":"2024-02-02T11:48:53.014027+0000","last_became_active":"2024-02-02T11:48:51.896554+0000","last_became_peered":"2024-02-02T11:48:51.896554+0000","last_unstale":"2024-02-02T11:48:53.014027+0000","last_undegraded":"2024-02-02T11:48:53.014027+0000","last_fullsized":"2024-02-02T11:48:53.014027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:34:16.623804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015526+0000","last_change":"2024-02-02T11:48:51.464028+0000","last_active":"2024-02-02T11:48:53.015526+0000","last_peered":"2024-02-02T11:48:53.015526+0000","last_clean":"2024-02-02T11:48:53.015526+0000","last_became_active":"2024-02-02T11:48:51.463717+0000","last_became_peered":"2024-02-02T11:48:51.463717+0000","last_unstale":"2024-02-02T11:48:53.015526+0000","last_undegraded":"2024-02-02T11:48:53.015526+0000","last_fullsized":"2024-02-02T11:48:53.015526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:18:12.503377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014400+0000","last_change":"2024-02-02T11:48:51.897969+0000","last_active":"2024-02-02T11:48:53.014400+0000","last_peered":"2024-02-02T11:48:53.014400+0000","last_clean":"2024-02-02T11:48:53.014400+0000","last_became_active":"2024-02-02T11:48:51.897552+0000","last_became_peered":"2024-02-02T11:48:51.897552+0000","last_unstale":"2024-02-02T11:48:53.014400+0000","last_undegraded":"2024-02-02T11:48:53.014400+0000","last_fullsized":"2024-02-02T11:48:53.014400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:31:31.979723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825340+0000","last_change":"2024-02-02T11:48:51.489925+0000","last_active":"2024-02-02T11:48:52.825340+0000","last_peered":"2024-02-02T11:48:52.825340+0000","last_clean":"2024-02-02T11:48:52.825340+0000","last_became_active":"2024-02-02T11:48:51.489586+0000","last_became_peered":"2024-02-02T11:48:51.489586+0000","last_unstale":"2024-02-02T11:48:52.825340+0000","last_undegraded":"2024-02-02T11:48:52.825340+0000","last_fullsized":"2024-02-02T11:48:52.825340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:26.386549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829151+0000","last_change":"2024-02-02T11:48:51.863155+0000","last_active":"2024-02-02T11:48:52.829151+0000","last_peered":"2024-02-02T11:48:52.829151+0000","last_clean":"2024-02-02T11:48:52.829151+0000","last_became_active":"2024-02-02T11:48:51.862353+0000","last_became_peered":"2024-02-02T11:48:51.862353+0000","last_unstale":"2024-02-02T11:48:52.829151+0000","last_undegraded":"2024-02-02T11:48:52.829151+0000","last_fullsized":"2024-02-02T11:48:52.829151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:56:59.771841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014144+0000","last_change":"2024-02-02T11:48:51.476119+0000","last_active":"2024-02-02T11:48:53.014144+0000","last_peered":"2024-02-02T11:48:53.014144+0000","last_clean":"2024-02-02T11:48:53.014144+0000","last_became_active":"2024-02-02T11:48:51.475833+0000","last_became_peered":"2024-02-02T11:48:51.475833+0000","last_unstale":"2024-02-02T11:48:53.014144+0000","last_undegraded":"2024-02-02T11:48:53.014144+0000","last_fullsized":"2024-02-02T11:48:53.014144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013759+0000","last_change":"2024-02-02T11:48:51.891228+0000","last_active":"2024-02-02T11:48:53.013759+0000","last_peered":"2024-02-02T11:48:53.013759+0000","last_clean":"2024-02-02T11:48:53.013759+0000","last_became_active":"2024-02-02T11:48:51.890322+0000","last_became_peered":"2024-02-02T11:48:51.890322+0000","last_unstale":"2024-02-02T11:48:53.013759+0000","last_undegraded":"2024-02-02T11:48:53.013759+0000","last_fullsized":"2024-02-02T11:48:53.013759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:01:26.016064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-02T11:48:51.857399+0000","last_change":"2024-02-02T11:48:41.563754+0000","last_active":"2024-02-02T11:48:51.857399+0000","last_peered":"2024-02-02T11:48:51.857399+0000","last_clean":"2024-02-02T11:48:51.857399+0000","last_became_active":"2024-02-02T11:48:41.562629+0000","last_became_peered":"2024-02-02T11:48:41.562629+0000","last_unstale":"2024-02-02T11:48:51.857399+0000","last_undegraded":"2024-02-02T11:48:51.857399+0000","last_fullsized":"2024-02-02T11:48:51.857399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_clean_scrub_stamp":"2024-02-02T11:48:40.536978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:22:02.923582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828445+0000","last_change":"2024-02-02T11:48:51.467641+0000","last_active":"2024-02-02T11:48:52.828445+0000","last_peered":"2024-02-02T11:48:52.828445+0000","last_clean":"2024-02-02T11:48:52.828445+0000","last_became_active":"2024-02-02T11:48:51.466793+0000","last_became_peered":"2024-02-02T11:48:51.466793+0000","last_unstale":"2024-02-02T11:48:52.828445+0000","last_undegraded":"2024-02-02T11:48:52.828445+0000","last_fullsized":"2024-02-02T11:48:52.828445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:22:40.437082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014197+0000","last_change":"2024-02-02T11:48:51.889165+0000","last_active":"2024-02-02T11:48:53.014197+0000","last_peered":"2024-02-02T11:48:53.014197+0000","last_clean":"2024-02-02T11:48:53.014197+0000","last_became_active":"2024-02-02T11:48:51.888946+0000","last_became_peered":"2024-02-02T11:48:51.888946+0000","last_unstale":"2024-02-02T11:48:53.014197+0000","last_undegraded":"2024-02-02T11:48:53.014197+0000","last_fullsized":"2024-02-02T11:48:53.014197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:44:05.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013178+0000","last_change":"2024-02-02T11:48:51.490450+0000","last_active":"2024-02-02T11:48:53.013178+0000","last_peered":"2024-02-02T11:48:53.013178+0000","last_clean":"2024-02-02T11:48:53.013178+0000","last_became_active":"2024-02-02T11:48:51.489819+0000","last_became_peered":"2024-02-02T11:48:51.489819+0000","last_unstale":"2024-02-02T11:48:53.013178+0000","last_undegraded":"2024-02-02T11:48:53.013178+0000","last_fullsized":"2024-02-02T11:48:53.013178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:11:06.903511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015117+0000","last_change":"2024-02-02T11:48:51.844140+0000","last_active":"2024-02-02T11:48:53.015117+0000","last_peered":"2024-02-02T11:48:53.015117+0000","last_clean":"2024-02-02T11:48:53.015117+0000","last_became_active":"2024-02-02T11:48:51.843865+0000","last_became_peered":"2024-02-02T11:48:51.843865+0000","last_unstale":"2024-02-02T11:48:53.015117+0000","last_undegraded":"2024-02-02T11:48:53.015117+0000","last_fullsized":"2024-02-02T11:48:53.015117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:10:43.379183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013460+0000","last_change":"2024-02-02T11:48:51.468449+0000","last_active":"2024-02-02T11:48:53.013460+0000","last_peered":"2024-02-02T11:48:53.013460+0000","last_clean":"2024-02-02T11:48:53.013460+0000","last_became_active":"2024-02-02T11:48:51.468136+0000","last_became_peered":"2024-02-02T11:48:51.468136+0000","last_unstale":"2024-02-02T11:48:53.013460+0000","last_undegraded":"2024-02-02T11:48:53.013460+0000","last_fullsized":"2024-02-02T11:48:53.013460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:06:13.971694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825256+0000","last_change":"2024-02-02T11:48:51.836358+0000","last_active":"2024-02-02T11:48:52.825256+0000","last_peered":"2024-02-02T11:48:52.825256+0000","last_clean":"2024-02-02T11:48:52.825256+0000","last_became_active":"2024-02-02T11:48:51.836089+0000","last_became_peered":"2024-02-02T11:48:51.836089+0000","last_unstale":"2024-02-02T11:48:52.825256+0000","last_undegraded":"2024-02-02T11:48:52.825256+0000","last_fullsized":"2024-02-02T11:48:52.825256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829035+0000","last_change":"2024-02-02T11:48:51.472708+0000","last_active":"2024-02-02T11:48:52.829035+0000","last_peered":"2024-02-02T11:48:52.829035+0000","last_clean":"2024-02-02T11:48:52.829035+0000","last_became_active":"2024-02-02T11:48:51.471927+0000","last_became_peered":"2024-02-02T11:48:51.471927+0000","last_unstale":"2024-02-02T11:48:52.829035+0000","last_undegraded":"2024-02-02T11:48:52.829035+0000","last_fullsized":"2024-02-02T11:48:52.829035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:11:06.903511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.827116+0000","last_change":"2024-02-02T11:48:51.854118+0000","last_active":"2024-02-02T11:48:52.827116+0000","last_peered":"2024-02-02T11:48:52.827116+0000","last_clean":"2024-02-02T11:48:52.827116+0000","last_became_active":"2024-02-02T11:48:51.852712+0000","last_became_peered":"2024-02-02T11:48:51.852712+0000","last_unstale":"2024-02-02T11:48:52.827116+0000","last_undegraded":"2024-02-02T11:48:52.827116+0000","last_fullsized":"2024-02-02T11:48:52.827116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:55:18.720031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825177+0000","last_change":"2024-02-02T11:48:51.470060+0000","last_active":"2024-02-02T11:48:52.825177+0000","last_peered":"2024-02-02T11:48:52.825177+0000","last_clean":"2024-02-02T11:48:52.825177+0000","last_became_active":"2024-02-02T11:48:51.469761+0000","last_became_peered":"2024-02-02T11:48:51.469761+0000","last_unstale":"2024-02-02T11:48:52.825177+0000","last_undegraded":"2024-02-02T11:48:52.825177+0000","last_fullsized":"2024-02-02T11:48:52.825177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829453+0000","last_change":"2024-02-02T11:48:51.873107+0000","last_active":"2024-02-02T11:48:52.829453+0000","last_peered":"2024-02-02T11:48:52.829453+0000","last_clean":"2024-02-02T11:48:52.829453+0000","last_became_active":"2024-02-02T11:48:51.863234+0000","last_became_peered":"2024-02-02T11:48:51.863234+0000","last_unstale":"2024-02-02T11:48:52.829453+0000","last_undegraded":"2024-02-02T11:48:52.829453+0000","last_fullsized":"2024-02-02T11:48:52.829453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:36:48.786870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014135+0000","last_change":"2024-02-02T11:48:51.495141+0000","last_active":"2024-02-02T11:48:53.014135+0000","last_peered":"2024-02-02T11:48:53.014135+0000","last_clean":"2024-02-02T11:48:53.014135+0000","last_became_active":"2024-02-02T11:48:51.494357+0000","last_became_peered":"2024-02-02T11:48:51.494357+0000","last_unstale":"2024-02-02T11:48:53.014135+0000","last_undegraded":"2024-02-02T11:48:53.014135+0000","last_fullsized":"2024-02-02T11:48:53.014135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:26.386549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825161+0000","last_change":"2024-02-02T11:48:51.834937+0000","last_active":"2024-02-02T11:48:52.825161+0000","last_peered":"2024-02-02T11:48:52.825161+0000","last_clean":"2024-02-02T11:48:52.825161+0000","last_became_active":"2024-02-02T11:48:51.834659+0000","last_became_peered":"2024-02-02T11:48:51.834659+0000","last_unstale":"2024-02-02T11:48:52.825161+0000","last_undegraded":"2024-02-02T11:48:52.825161+0000","last_fullsized":"2024-02-02T11:48:52.825161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:14.049200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825320+0000","last_change":"2024-02-02T11:48:51.487838+0000","last_active":"2024-02-02T11:48:52.825320+0000","last_peered":"2024-02-02T11:48:52.825320+0000","last_clean":"2024-02-02T11:48:52.825320+0000","last_became_active":"2024-02-02T11:48:51.487608+0000","last_became_peered":"2024-02-02T11:48:51.487608+0000","last_unstale":"2024-02-02T11:48:52.825320+0000","last_undegraded":"2024-02-02T11:48:52.825320+0000","last_fullsized":"2024-02-02T11:48:52.825320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:22:40.437082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015208+0000","last_change":"2024-02-02T11:48:51.884253+0000","last_active":"2024-02-02T11:48:53.015208+0000","last_peered":"2024-02-02T11:48:53.015208+0000","last_clean":"2024-02-02T11:48:53.015208+0000","last_became_active":"2024-02-02T11:48:51.883954+0000","last_became_peered":"2024-02-02T11:48:51.883954+0000","last_unstale":"2024-02-02T11:48:53.015208+0000","last_undegraded":"2024-02-02T11:48:53.015208+0000","last_fullsized":"2024-02-02T11:48:53.015208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993422+0000","last_change":"2024-02-02T11:48:51.492938+0000","last_active":"2024-02-02T11:48:52.993422+0000","last_peered":"2024-02-02T11:48:52.993422+0000","last_clean":"2024-02-02T11:48:52.993422+0000","last_became_active":"2024-02-02T11:48:51.492303+0000","last_became_peered":"2024-02-02T11:48:51.492303+0000","last_unstale":"2024-02-02T11:48:52.993422+0000","last_undegraded":"2024-02-02T11:48:52.993422+0000","last_fullsized":"2024-02-02T11:48:52.993422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:11:06.903511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016684+0000","last_change":"2024-02-02T11:48:51.848144+0000","last_active":"2024-02-02T11:48:53.016684+0000","last_peered":"2024-02-02T11:48:53.016684+0000","last_clean":"2024-02-02T11:48:53.016684+0000","last_became_active":"2024-02-02T11:48:51.847887+0000","last_became_peered":"2024-02-02T11:48:51.847887+0000","last_unstale":"2024-02-02T11:48:53.016684+0000","last_undegraded":"2024-02-02T11:48:53.016684+0000","last_fullsized":"2024-02-02T11:48:53.016684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:11:37.650346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013207+0000","last_change":"2024-02-02T11:48:51.482652+0000","last_active":"2024-02-02T11:48:53.013207+0000","last_peered":"2024-02-02T11:48:53.013207+0000","last_clean":"2024-02-02T11:48:53.013207+0000","last_became_active":"2024-02-02T11:48:51.481995+0000","last_became_peered":"2024-02-02T11:48:51.481995+0000","last_unstale":"2024-02-02T11:48:53.013207+0000","last_undegraded":"2024-02-02T11:48:53.013207+0000","last_fullsized":"2024-02-02T11:48:53.013207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:22:40.437082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.826883+0000","last_change":"2024-02-02T11:48:51.833510+0000","last_active":"2024-02-02T11:48:52.826883+0000","last_peered":"2024-02-02T11:48:52.826883+0000","last_clean":"2024-02-02T11:48:52.826883+0000","last_became_active":"2024-02-02T11:48:51.830625+0000","last_became_peered":"2024-02-02T11:48:51.830625+0000","last_unstale":"2024-02-02T11:48:52.826883+0000","last_undegraded":"2024-02-02T11:48:52.826883+0000","last_fullsized":"2024-02-02T11:48:52.826883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:27.396890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.824977+0000","last_change":"2024-02-02T11:48:51.480505+0000","last_active":"2024-02-02T11:48:52.824977+0000","last_peered":"2024-02-02T11:48:52.824977+0000","last_clean":"2024-02-02T11:48:52.824977+0000","last_became_active":"2024-02-02T11:48:51.480230+0000","last_became_peered":"2024-02-02T11:48:51.480230+0000","last_unstale":"2024-02-02T11:48:52.824977+0000","last_undegraded":"2024-02-02T11:48:52.824977+0000","last_fullsized":"2024-02-02T11:48:52.824977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:11:06.903511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014049+0000","last_change":"2024-02-02T11:48:51.837394+0000","last_active":"2024-02-02T11:48:53.014049+0000","last_peered":"2024-02-02T11:48:53.014049+0000","last_clean":"2024-02-02T11:48:53.014049+0000","last_became_active":"2024-02-02T11:48:51.837092+0000","last_became_peered":"2024-02-02T11:48:51.837092+0000","last_unstale":"2024-02-02T11:48:53.014049+0000","last_undegraded":"2024-02-02T11:48:53.014049+0000","last_fullsized":"2024-02-02T11:48:53.014049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:17:07.932896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825011+0000","last_change":"2024-02-02T11:48:51.469411+0000","last_active":"2024-02-02T11:48:52.825011+0000","last_peered":"2024-02-02T11:48:52.825011+0000","last_clean":"2024-02-02T11:48:52.825011+0000","last_became_active":"2024-02-02T11:48:51.469142+0000","last_became_peered":"2024-02-02T11:48:51.469142+0000","last_unstale":"2024-02-02T11:48:52.825011+0000","last_undegraded":"2024-02-02T11:48:52.825011+0000","last_fullsized":"2024-02-02T11:48:52.825011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:02:58.430952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014321+0000","last_change":"2024-02-02T11:48:51.849339+0000","last_active":"2024-02-02T11:48:53.014321+0000","last_peered":"2024-02-02T11:48:53.014321+0000","last_clean":"2024-02-02T11:48:53.014321+0000","last_became_active":"2024-02-02T11:48:51.849074+0000","last_became_peered":"2024-02-02T11:48:51.849074+0000","last_unstale":"2024-02-02T11:48:53.014321+0000","last_undegraded":"2024-02-02T11:48:53.014321+0000","last_fullsized":"2024-02-02T11:48:53.014321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014003+0000","last_change":"2024-02-02T11:48:51.491708+0000","last_active":"2024-02-02T11:48:53.014003+0000","last_peered":"2024-02-02T11:48:53.014003+0000","last_clean":"2024-02-02T11:48:53.014003+0000","last_became_active":"2024-02-02T11:48:51.490530+0000","last_became_peered":"2024-02-02T11:48:51.490530+0000","last_unstale":"2024-02-02T11:48:53.014003+0000","last_undegraded":"2024-02-02T11:48:53.014003+0000","last_fullsized":"2024-02-02T11:48:53.014003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992605+0000","last_change":"2024-02-02T11:48:51.866340+0000","last_active":"2024-02-02T11:48:52.992605+0000","last_peered":"2024-02-02T11:48:52.992605+0000","last_clean":"2024-02-02T11:48:52.992605+0000","last_became_active":"2024-02-02T11:48:51.865769+0000","last_became_peered":"2024-02-02T11:48:51.865769+0000","last_unstale":"2024-02-02T11:48:52.992605+0000","last_undegraded":"2024-02-02T11:48:52.992605+0000","last_fullsized":"2024-02-02T11:48:52.992605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:26:18.517358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829215+0000","last_change":"2024-02-02T11:48:51.873724+0000","last_active":"2024-02-02T11:48:52.829215+0000","last_peered":"2024-02-02T11:48:52.829215+0000","last_clean":"2024-02-02T11:48:52.829215+0000","last_became_active":"2024-02-02T11:48:51.872899+0000","last_became_peered":"2024-02-02T11:48:51.872899+0000","last_unstale":"2024-02-02T11:48:52.829215+0000","last_undegraded":"2024-02-02T11:48:52.829215+0000","last_fullsized":"2024-02-02T11:48:52.829215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013728+0000","last_change":"2024-02-02T11:48:51.498148+0000","last_active":"2024-02-02T11:48:53.013728+0000","last_peered":"2024-02-02T11:48:53.013728+0000","last_clean":"2024-02-02T11:48:53.013728+0000","last_became_active":"2024-02-02T11:48:51.497318+0000","last_became_peered":"2024-02-02T11:48:51.497318+0000","last_unstale":"2024-02-02T11:48:53.013728+0000","last_undegraded":"2024-02-02T11:48:53.013728+0000","last_fullsized":"2024-02-02T11:48:53.013728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:55:17.709690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828889+0000","last_change":"2024-02-02T11:48:51.874421+0000","last_active":"2024-02-02T11:48:52.828889+0000","last_peered":"2024-02-02T11:48:52.828889+0000","last_clean":"2024-02-02T11:48:52.828889+0000","last_became_active":"2024-02-02T11:48:51.873913+0000","last_became_peered":"2024-02-02T11:48:51.873913+0000","last_unstale":"2024-02-02T11:48:52.828889+0000","last_undegraded":"2024-02-02T11:48:52.828889+0000","last_fullsized":"2024-02-02T11:48:52.828889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013994+0000","last_change":"2024-02-02T11:48:51.495990+0000","last_active":"2024-02-02T11:48:53.013994+0000","last_peered":"2024-02-02T11:48:53.013994+0000","last_clean":"2024-02-02T11:48:53.013994+0000","last_became_active":"2024-02-02T11:48:51.495310+0000","last_became_peered":"2024-02-02T11:48:51.495310+0000","last_unstale":"2024-02-02T11:48:53.013994+0000","last_undegraded":"2024-02-02T11:48:53.013994+0000","last_fullsized":"2024-02-02T11:48:53.013994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:32.118220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015727+0000","last_change":"2024-02-02T11:48:51.890655+0000","last_active":"2024-02-02T11:48:53.015727+0000","last_peered":"2024-02-02T11:48:53.015727+0000","last_clean":"2024-02-02T11:48:53.015727+0000","last_became_active":"2024-02-02T11:48:51.890435+0000","last_became_peered":"2024-02-02T11:48:51.890435+0000","last_unstale":"2024-02-02T11:48:53.015727+0000","last_undegraded":"2024-02-02T11:48:53.015727+0000","last_fullsized":"2024-02-02T11:48:53.015727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015002+0000","last_change":"2024-02-02T11:48:51.469696+0000","last_active":"2024-02-02T11:48:53.015002+0000","last_peered":"2024-02-02T11:48:53.015002+0000","last_clean":"2024-02-02T11:48:53.015002+0000","last_became_active":"2024-02-02T11:48:51.469392+0000","last_became_peered":"2024-02-02T11:48:51.469392+0000","last_unstale":"2024-02-02T11:48:53.015002+0000","last_undegraded":"2024-02-02T11:48:53.015002+0000","last_fullsized":"2024-02-02T11:48:53.015002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015320+0000","last_change":"2024-02-02T11:48:51.870169+0000","last_active":"2024-02-02T11:48:53.015320+0000","last_peered":"2024-02-02T11:48:53.015320+0000","last_clean":"2024-02-02T11:48:53.015320+0000","last_became_active":"2024-02-02T11:48:51.869883+0000","last_became_peered":"2024-02-02T11:48:51.869883+0000","last_unstale":"2024-02-02T11:48:53.015320+0000","last_undegraded":"2024-02-02T11:48:53.015320+0000","last_fullsized":"2024-02-02T11:48:53.015320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:36:48.786870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016079+0000","last_change":"2024-02-02T11:48:51.483548+0000","last_active":"2024-02-02T11:48:53.016079+0000","last_peered":"2024-02-02T11:48:53.016079+0000","last_clean":"2024-02-02T11:48:53.016079+0000","last_became_active":"2024-02-02T11:48:51.483219+0000","last_became_peered":"2024-02-02T11:48:51.483219+0000","last_unstale":"2024-02-02T11:48:53.016079+0000","last_undegraded":"2024-02-02T11:48:53.016079+0000","last_fullsized":"2024-02-02T11:48:53.016079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T17:21:41.030654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.542}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.516}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-02T11:49:00.255 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-02T11:49:00.255 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-02T11:49:00.255 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-02T11:49:00.256 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-02T11:49:00.256 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-02T11:49:00.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.403+0000 7f69fa565640 1 Processor -- start 2024-02-02T11:49:00.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.403+0000 7f69fa565640 1 -- start start 2024-02-02T11:49:00.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.403+0000 7f69fa565640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f69f4071160 0x7f69f40b9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:00.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.403+0000 7f69fa565640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69f41429f0 0x7f69f4153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:00.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.403+0000 7f69fa565640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f40b3c40 con 0x7f69f40b42d0 2024-02-02T11:49:00.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.403+0000 7f69fa565640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f40b5140 con 0x7f69f4071160 2024-02-02T11:49:00.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.403+0000 7f69fa565640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f40b4720 con 0x7f69f41429f0 2024-02-02T11:49:00.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.403+0000 7f69ebfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f69f40b42d0 0x7f69f40b8ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39992/0 (socket says 172.21.15.161:39992) 2024-02-02T11:49:00.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.403+0000 7f69ebfff640 1 -- 172.21.15.161:0/4022205372 learned_addr learned my addr 172.21.15.161:0/4022205372 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:00.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.403+0000 7f69f3fff640 1 --2- 172.21.15.161:0/4022205372 >> v2:172.21.15.161:3300/0 conn(0x7f69f4071160 0x7f69f40b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:00.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.403+0000 7f69f8b02640 1 --2- 172.21.15.161:0/4022205372 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69f41429f0 0x7f69f4153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:00.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.403+0000 7f69f3fff640 1 -- 172.21.15.161:0/4022205372 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69f41429f0 msgr2=0x7f69f4153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:00.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.403+0000 7f69f3fff640 1 --2- 172.21.15.161:0/4022205372 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69f41429f0 0x7f69f4153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.403+0000 7f69f3fff640 1 -- 172.21.15.161:0/4022205372 >> v1:172.21.15.161:6789/0 conn(0x7f69f40b42d0 legacy=0x7f69f40b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:00.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.403+0000 7f69f3fff640 1 -- 172.21.15.161:0/4022205372 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f40b9f60 con 0x7f69f4071160 2024-02-02T11:49:00.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.403+0000 7f69f37fe640 1 -- 172.21.15.161:0/4022205372 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799391544 0 0) 0x7f69f40b3c40 con 0x7f69f40b42d0 2024-02-02T11:49:00.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.403+0000 7f69f3fff640 1 --2- 172.21.15.161:0/4022205372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69f4071160 0x7f69f40b9900 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f69e40097c0 tx=0x7f69e401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52eb6dc171391a16 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:00.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69f37fe640 1 -- 172.21.15.161:0/4022205372 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e40ab670 con 0x7f69f4071160 2024-02-02T11:49:00.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69f37fe640 1 -- 172.21.15.161:0/4022205372 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e40ab7d0 con 0x7f69f4071160 2024-02-02T11:49:00.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69f37fe640 1 -- 172.21.15.161:0/4022205372 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e40abb60 con 0x7f69f4071160 2024-02-02T11:49:00.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69fa565640 1 -- 172.21.15.161:0/4022205372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69f4071160 msgr2=0x7f69f40b9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:00.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69fa565640 1 --2- 172.21.15.161:0/4022205372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69f4071160 0x7f69f40b9900 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f69e40097c0 tx=0x7f69e401c450 comp rx=0 tx=0).stop 2024-02-02T11:49:00.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69fa565640 1 -- 172.21.15.161:0/4022205372 shutdown_connections 2024-02-02T11:49:00.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69fa565640 1 --2- 172.21.15.161:0/4022205372 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69f41429f0 0x7f69f4153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69fa565640 1 --2- 172.21.15.161:0/4022205372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69f4071160 0x7f69f40b9900 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69fa565640 1 -- 172.21.15.161:0/4022205372 >> 172.21.15.161:0/4022205372 conn(0x7f69f40be150 msgr2=0x7f69f40be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:00.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69fa565640 1 -- 172.21.15.161:0/4022205372 shutdown_connections 2024-02-02T11:49:00.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69fa565640 1 -- 172.21.15.161:0/4022205372 wait complete. 2024-02-02T11:49:00.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69fa565640 1 Processor -- start 2024-02-02T11:49:00.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69fa565640 1 -- start start 2024-02-02T11:49:00.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69fa565640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69f4071160 0x7f69f4148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:00.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69fa565640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69f40b42d0 0x7f69f4144380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:00.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69fa565640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69f41429f0 0x7f69f406c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:00.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69fa565640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f413fdd0 con 0x7f69f41429f0 2024-02-02T11:49:00.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69fa565640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f4149410 con 0x7f69f4071160 2024-02-02T11:49:00.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69fa565640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f413ffb0 con 0x7f69f40b42d0 2024-02-02T11:49:00.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69f8b02640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69f41429f0 0x7f69f406c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:00.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69f8b02640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69f41429f0 0x7f69f406c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36606/0 (socket says 172.21.15.161:36606) 2024-02-02T11:49:00.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69f8b02640 1 -- 172.21.15.161:0/1574094640 learned_addr learned my addr 172.21.15.161:0/1574094640 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:00.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69f3fff640 1 --2- 172.21.15.161:0/1574094640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69f4071160 0x7f69f4148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:00.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69ebfff640 1 --2- 172.21.15.161:0/1574094640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69f40b42d0 0x7f69f4144380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:00.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69f8b02640 1 -- 172.21.15.161:0/1574094640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69f40b42d0 msgr2=0x7f69f4144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:00.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69f8b02640 1 --2- 172.21.15.161:0/1574094640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69f40b42d0 0x7f69f4144380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69f8b02640 1 -- 172.21.15.161:0/1574094640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69f4071160 msgr2=0x7f69f4148ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:00.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69f8b02640 1 --2- 172.21.15.161:0/1574094640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69f4071160 0x7f69f4148ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69f8b02640 1 -- 172.21.15.161:0/1574094640 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e4009420 con 0x7f69f41429f0 2024-02-02T11:49:00.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69ebfff640 1 --2- 172.21.15.161:0/1574094640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69f40b42d0 0x7f69f4144380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:00.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69f8b02640 1 --2- 172.21.15.161:0/1574094640 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69f41429f0 0x7f69f406c2b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f69ec007e90 tx=0x7f69ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:00.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69f17fa640 1 -- 172.21.15.161:0/1574094640 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec014420 con 0x7f69f41429f0 2024-02-02T11:49:00.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69f17fa640 1 -- 172.21.15.161:0/1574094640 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec014580 con 0x7f69f41429f0 2024-02-02T11:49:00.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69fa565640 1 -- 172.21.15.161:0/1574094640 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f406b620 con 0x7f69f41429f0 2024-02-02T11:49:00.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69f17fa640 1 -- 172.21.15.161:0/1574094640 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec014930 con 0x7f69f41429f0 2024-02-02T11:49:00.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.407+0000 7f69fa565640 1 -- 172.21.15.161:0/1574094640 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f406b2b0 con 0x7f69f41429f0 2024-02-02T11:49:00.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.411+0000 7f69fa565640 1 -- 172.21.15.161:0/1574094640 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f406b7b0 con 0x7f69f41429f0 2024-02-02T11:49:00.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.411+0000 7f69f17fa640 1 -- 172.21.15.161:0/1574094640 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f69ec014a90 con 0x7f69f41429f0 2024-02-02T11:49:00.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.411+0000 7f69f17fa640 1 --2- 172.21.15.161:0/1574094640 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f69d4065a60 0x7f69d4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:00.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.411+0000 7f69f17fa640 1 -- 172.21.15.161:0/1574094640 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69ec083a10 con 0x7f69f41429f0 2024-02-02T11:49:00.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.411+0000 7f69f3fff640 1 --2- 172.21.15.161:0/1574094640 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f69d4065a60 0x7f69d4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:00.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.411+0000 7f69f3fff640 1 --2- 172.21.15.161:0/1574094640 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f69d4065a60 0x7f69d4067f20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f69e40af000 tx=0x7f69e40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:00.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.415+0000 7f69f17fa640 1 -- 172.21.15.161:0/1574094640 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f69ec051460 con 0x7f69f41429f0 2024-02-02T11:49:00.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.595+0000 7f69fa565640 1 -- 172.21.15.161:0/1574094640 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f69f406b440 con 0x7f69f41429f0 2024-02-02T11:49:00.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.599+0000 7f69f17fa640 1 -- 172.21.15.161:0/1574094640 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163370 (secure 0 0 0) 0x7f69ec054a80 con 0x7f69f41429f0 2024-02-02T11:49:00.605 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:00.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.603+0000 7f69fa565640 1 -- 172.21.15.161:0/1574094640 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f69d4065a60 msgr2=0x7f69d4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:00.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.603+0000 7f69fa565640 1 --2- 172.21.15.161:0/1574094640 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f69d4065a60 0x7f69d4067f20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f69e40af000 tx=0x7f69e40a7000 comp rx=0 tx=0).stop 2024-02-02T11:49:00.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.603+0000 7f69fa565640 1 -- 172.21.15.161:0/1574094640 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69f41429f0 msgr2=0x7f69f406c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:00.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.603+0000 7f69fa565640 1 --2- 172.21.15.161:0/1574094640 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69f41429f0 0x7f69f406c2b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f69ec007e90 tx=0x7f69ec00e4b0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.603+0000 7f69fa565640 1 -- 172.21.15.161:0/1574094640 shutdown_connections 2024-02-02T11:49:00.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.603+0000 7f69fa565640 1 --2- 172.21.15.161:0/1574094640 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f69d4065a60 0x7f69d4067f20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.603+0000 7f69fa565640 1 --2- 172.21.15.161:0/1574094640 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69f41429f0 0x7f69f406c2b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.603+0000 7f69fa565640 1 --2- 172.21.15.161:0/1574094640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69f40b42d0 0x7f69f4144380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.603+0000 7f69fa565640 1 --2- 172.21.15.161:0/1574094640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69f4071160 0x7f69f4148ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.603+0000 7f69fa565640 1 -- 172.21.15.161:0/1574094640 >> 172.21.15.161:0/1574094640 conn(0x7f69f40be150 msgr2=0x7f69f40bc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:00.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.603+0000 7f69fa565640 1 -- 172.21.15.161:0/1574094640 shutdown_connections 2024-02-02T11:49:00.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.603+0000 7f69fa565640 1 -- 172.21.15.161:0/1574094640 wait complete. 2024-02-02T11:49:00.621 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":27599},{"type":"v1","addr":"172.21.15.161:6833","nonce":27599}]},"active_addr":"172.21.15.161:6833/27599","active_change":"2024-02-02T11:48:32.239125+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":1320986911}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":1917978773}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":2629763174}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":1608868276}]}]} 2024-02-02T11:49:00.625 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-02T11:49:00.625 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-02T11:49:00.625 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:49:00.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.735+0000 7fc239a8c640 1 Processor -- start 2024-02-02T11:49:00.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.739+0000 7fc239a8c640 1 -- start start 2024-02-02T11:49:00.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.739+0000 7fc239a8c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc234148d60 0x7fc2341491b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:00.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.739+0000 7fc239a8c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc234151100 0x7fc2341534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:00.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.739+0000 7fc239a8c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc234071770 con 0x7fc2340bc340 2024-02-02T11:49:00.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.739+0000 7fc239a8c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2341496f0 con 0x7fc234148d60 2024-02-02T11:49:00.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.739+0000 7fc239a8c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc234142f20 con 0x7fc234151100 2024-02-02T11:49:00.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.739+0000 7fc2337fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc2340bc340 0x7fc234142810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40004/0 (socket says 172.21.15.161:40004) 2024-02-02T11:49:00.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.739+0000 7fc2337fe640 1 -- 172.21.15.161:0/2674659398 learned_addr learned my addr 172.21.15.161:0/2674659398 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:00.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.739+0000 7fc22affd640 1 --2- 172.21.15.161:0/2674659398 >> v2:172.21.15.161:3300/0 conn(0x7fc234148d60 0x7fc2341491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:00.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.739+0000 7fc233fff640 1 --2- 172.21.15.161:0/2674659398 >> v2:172.21.15.162:3300/0 conn(0x7fc234151100 0x7fc2341534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:00.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.739+0000 7fc22affd640 1 -- 172.21.15.161:0/2674659398 >> v2:172.21.15.162:3300/0 conn(0x7fc234151100 msgr2=0x7fc2341534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:00.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.739+0000 7fc22affd640 1 --2- 172.21.15.161:0/2674659398 >> v2:172.21.15.162:3300/0 conn(0x7fc234151100 0x7fc2341534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.739+0000 7fc232ffd640 1 -- 172.21.15.161:0/2674659398 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504711727 0 0) 0x7fc234071770 con 0x7fc2340bc340 2024-02-02T11:49:00.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.739+0000 7fc22affd640 1 -- 172.21.15.161:0/2674659398 >> v1:172.21.15.161:6789/0 conn(0x7fc2340bc340 legacy=0x7fc234142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:00.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.739+0000 7fc22affd640 1 -- 172.21.15.161:0/2674659398 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2340b37e0 con 0x7fc234148d60 2024-02-02T11:49:00.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.739+0000 7fc22affd640 1 --2- 172.21.15.161:0/2674659398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc234148d60 0x7fc2341491b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc2341463e0 tx=0x7fc21c01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a9a2d0b95b65fc server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:00.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.739+0000 7fc232ffd640 1 -- 172.21.15.161:0/2674659398 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c0a8950 con 0x7fc234148d60 2024-02-02T11:49:00.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.739+0000 7fc232ffd640 1 -- 172.21.15.161:0/2674659398 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21c0a8ab0 con 0x7fc234148d60 2024-02-02T11:49:00.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.739+0000 7fc232ffd640 1 -- 172.21.15.161:0/2674659398 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c0a8e40 con 0x7fc234148d60 2024-02-02T11:49:00.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc239a8c640 1 -- 172.21.15.161:0/2674659398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc234148d60 msgr2=0x7fc2341491b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:00.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc239a8c640 1 --2- 172.21.15.161:0/2674659398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc234148d60 0x7fc2341491b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc2341463e0 tx=0x7fc21c01ec50 comp rx=0 tx=0).stop 2024-02-02T11:49:00.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc239a8c640 1 -- 172.21.15.161:0/2674659398 shutdown_connections 2024-02-02T11:49:00.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc239a8c640 1 --2- 172.21.15.161:0/2674659398 >> v2:172.21.15.162:3300/0 conn(0x7fc234151100 0x7fc2341534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc239a8c640 1 --2- 172.21.15.161:0/2674659398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc234148d60 0x7fc2341491b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc239a8c640 1 -- 172.21.15.161:0/2674659398 >> 172.21.15.161:0/2674659398 conn(0x7fc234069ef0 msgr2=0x7fc23406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:00.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc239a8c640 1 -- 172.21.15.161:0/2674659398 shutdown_connections 2024-02-02T11:49:00.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc239a8c640 1 -- 172.21.15.161:0/2674659398 wait complete. 2024-02-02T11:49:00.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc239a8c640 1 Processor -- start 2024-02-02T11:49:00.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc239a8c640 1 -- start start 2024-02-02T11:49:00.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc239a8c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2340bc340 0x7fc2340702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:00.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc239a8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc234148d60 0x7fc23412eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:00.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc239a8c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc234151100 0x7fc234132080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:00.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc239a8c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2341325c0 con 0x7fc234151100 2024-02-02T11:49:00.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc239a8c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23413eda0 con 0x7fc2340bc340 2024-02-02T11:49:00.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc239a8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc234147350 con 0x7fc234148d60 2024-02-02T11:49:00.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc233fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc234151100 0x7fc234132080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:00.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc233fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc234151100 0x7fc234132080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36620/0 (socket says 172.21.15.161:36620) 2024-02-02T11:49:00.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc233fff640 1 -- 172.21.15.161:0/4077054303 learned_addr learned my addr 172.21.15.161:0/4077054303 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:00.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc233fff640 1 -- 172.21.15.161:0/4077054303 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc234148d60 msgr2=0x7fc23412eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:00.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc233fff640 1 --2- 172.21.15.161:0/4077054303 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc234148d60 0x7fc23412eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc233fff640 1 -- 172.21.15.161:0/4077054303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2340bc340 msgr2=0x7fc2340702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:00.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc233fff640 1 --2- 172.21.15.161:0/4077054303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2340bc340 0x7fc2340702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc233fff640 1 -- 172.21.15.161:0/4077054303 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c009420 con 0x7fc234151100 2024-02-02T11:49:00.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc233fff640 1 --2- 172.21.15.161:0/4077054303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc234151100 0x7fc234132080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc22c007e90 tx=0x7fc22c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:00.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc230ff9640 1 -- 172.21.15.161:0/4077054303 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c014420 con 0x7fc234151100 2024-02-02T11:49:00.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc230ff9640 1 -- 172.21.15.161:0/4077054303 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22c014580 con 0x7fc234151100 2024-02-02T11:49:00.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc239a8c640 1 -- 172.21.15.161:0/4077054303 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2341484a0 con 0x7fc234151100 2024-02-02T11:49:00.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc230ff9640 1 -- 172.21.15.161:0/4077054303 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c014930 con 0x7fc234151100 2024-02-02T11:49:00.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc239a8c640 1 -- 172.21.15.161:0/4077054303 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc234147070 con 0x7fc234151100 2024-02-02T11:49:00.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.743+0000 7fc239a8c640 1 -- 172.21.15.161:0/4077054303 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23404e000 con 0x7fc234151100 2024-02-02T11:49:00.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.747+0000 7fc230ff9640 1 -- 172.21.15.161:0/4077054303 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc22c014a90 con 0x7fc234151100 2024-02-02T11:49:00.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.747+0000 7fc230ff9640 1 --2- 172.21.15.161:0/4077054303 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc214065a90 0x7fc214067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:00.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.747+0000 7fc230ff9640 1 -- 172.21.15.161:0/4077054303 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc22c0839b0 con 0x7fc234151100 2024-02-02T11:49:00.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.747+0000 7fc2337fe640 1 --2- 172.21.15.161:0/4077054303 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc214065a90 0x7fc214067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:00.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.747+0000 7fc2337fe640 1 --2- 172.21.15.161:0/4077054303 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc214065a90 0x7fc214067f50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc2240011f0 tx=0x7fc224007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:00.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.751+0000 7fc230ff9640 1 -- 172.21.15.161:0/4077054303 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc22c051400 con 0x7fc234151100 2024-02-02T11:49:00.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.895+0000 7fc239a8c640 1 -- 172.21.15.161:0/4077054303 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2340b4cb0 con 0x7fc234151100 2024-02-02T11:49:00.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.899+0000 7fc230ff9640 1 -- 172.21.15.161:0/4077054303 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fc22c054a20 con 0x7fc234151100 2024-02-02T11:49:00.902 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:00.902 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":20,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:52.816101+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:48:50.155565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-02T11:48:50.795158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:49:00.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.899+0000 7fc239a8c640 1 -- 172.21.15.161:0/4077054303 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc214065a90 msgr2=0x7fc214067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:00.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.899+0000 7fc239a8c640 1 --2- 172.21.15.161:0/4077054303 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc214065a90 0x7fc214067f50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc2240011f0 tx=0x7fc224007930 comp rx=0 tx=0).stop 2024-02-02T11:49:00.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.899+0000 7fc239a8c640 1 -- 172.21.15.161:0/4077054303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc234151100 msgr2=0x7fc234132080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:00.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.899+0000 7fc239a8c640 1 --2- 172.21.15.161:0/4077054303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc234151100 0x7fc234132080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc22c007e90 tx=0x7fc22c00e4b0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.899+0000 7fc239a8c640 1 -- 172.21.15.161:0/4077054303 shutdown_connections 2024-02-02T11:49:00.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.899+0000 7fc239a8c640 1 --2- 172.21.15.161:0/4077054303 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc214065a90 0x7fc214067f50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.899+0000 7fc239a8c640 1 --2- 172.21.15.161:0/4077054303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc234151100 0x7fc234132080 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.899+0000 7fc239a8c640 1 --2- 172.21.15.161:0/4077054303 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc234148d60 0x7fc23412eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.899+0000 7fc239a8c640 1 --2- 172.21.15.161:0/4077054303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2340bc340 0x7fc2340702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:00.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.899+0000 7fc239a8c640 1 -- 172.21.15.161:0/4077054303 >> 172.21.15.161:0/4077054303 conn(0x7fc234069ef0 msgr2=0x7fc2340b6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:00.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.899+0000 7fc239a8c640 1 -- 172.21.15.161:0/4077054303 shutdown_connections 2024-02-02T11:49:00.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:00.899+0000 7fc239a8c640 1 -- 172.21.15.161:0/4077054303 wait complete. 2024-02-02T11:49:00.919 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-02T11:49:00.919 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:49:01.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.027+0000 7f7482321640 1 Processor -- start 2024-02-02T11:49:01.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.027+0000 7f7482321640 1 -- start start 2024-02-02T11:49:01.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.031+0000 7f7482321640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f747c0b9900 0x7f747c0b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.031+0000 7f7482321640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f747c1429f0 0x7f747c153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.031+0000 7f7482321640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747c0b3c40 con 0x7f747c071160 2024-02-02T11:49:01.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.031+0000 7f7482321640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747c0b5140 con 0x7f747c0b9900 2024-02-02T11:49:01.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.031+0000 7f7482321640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c0b9d50 con 0x7f747c1429f0 2024-02-02T11:49:01.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.031+0000 7f747b7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f747c0b9900 0x7f747c0b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.031+0000 7f747b7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f747c0b9900 0x7f747c0b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36632/0 (socket says 172.21.15.161:36632) 2024-02-02T11:49:01.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.031+0000 7f747b7fe640 1 -- 172.21.15.161:0/4211365043 learned_addr learned my addr 172.21.15.161:0/4211365043 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.031+0000 7f74808be640 1 --2- 172.21.15.161:0/4211365043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f747c1429f0 0x7f747c153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.031+0000 7f747b7fe640 1 -- 172.21.15.161:0/4211365043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f747c1429f0 msgr2=0x7f747c153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:01.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.031+0000 7f747b7fe640 1 --2- 172.21.15.161:0/4211365043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f747c1429f0 0x7f747c153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.031+0000 7f747b7fe640 1 -- 172.21.15.161:0/4211365043 >> v1:172.21.15.161:6789/0 conn(0x7f747c071160 legacy=0x7f747c0b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.031+0000 7f747b7fe640 1 -- 172.21.15.161:0/4211365043 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c0b9f60 con 0x7f747c0b9900 2024-02-02T11:49:01.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.031+0000 7f74808be640 1 --2- 172.21.15.161:0/4211365043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f747c1429f0 0x7f747c153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:01.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.031+0000 7f747b7fe640 1 --2- 172.21.15.161:0/4211365043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f747c0b9900 0x7f747c0b42d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7464009870 tx=0x7f746401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4315331340efdd server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.031+0000 7f747affd640 1 -- 172.21.15.161:0/4211365043 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74640a9620 con 0x7f747c0b9900 2024-02-02T11:49:01.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.031+0000 7f747affd640 1 -- 172.21.15.161:0/4211365043 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74640a9780 con 0x7f747c0b9900 2024-02-02T11:49:01.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.031+0000 7f747affd640 1 -- 172.21.15.161:0/4211365043 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74640a9b10 con 0x7f747c0b9900 2024-02-02T11:49:01.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7482321640 1 -- 172.21.15.161:0/4211365043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f747c0b9900 msgr2=0x7f747c0b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7482321640 1 --2- 172.21.15.161:0/4211365043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f747c0b9900 0x7f747c0b42d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7464009870 tx=0x7f746401c540 comp rx=0 tx=0).stop 2024-02-02T11:49:01.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7482321640 1 -- 172.21.15.161:0/4211365043 shutdown_connections 2024-02-02T11:49:01.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7482321640 1 --2- 172.21.15.161:0/4211365043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f747c1429f0 0x7f747c153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7482321640 1 --2- 172.21.15.161:0/4211365043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f747c0b9900 0x7f747c0b42d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7482321640 1 -- 172.21.15.161:0/4211365043 >> 172.21.15.161:0/4211365043 conn(0x7f747c0be150 msgr2=0x7f747c0be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7482321640 1 -- 172.21.15.161:0/4211365043 shutdown_connections 2024-02-02T11:49:01.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7482321640 1 -- 172.21.15.161:0/4211365043 wait complete. 2024-02-02T11:49:01.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7482321640 1 Processor -- start 2024-02-02T11:49:01.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7482321640 1 -- start start 2024-02-02T11:49:01.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7482321640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f747c071160 0x7f747c06cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7482321640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f747c0b9900 0x7f747c06b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7482321640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f747c1429f0 0x7f747c1e3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7482321640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c099b50 con 0x7f747c0b9900 2024-02-02T11:49:01.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7482321640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c06bac0 con 0x7f747c1429f0 2024-02-02T11:49:01.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7482321640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c06bd60 con 0x7f747c071160 2024-02-02T11:49:01.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f747b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f747c0b9900 0x7f747c06b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f747b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f747c0b9900 0x7f747c06b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36642/0 (socket says 172.21.15.161:36642) 2024-02-02T11:49:01.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f747b7fe640 1 -- 172.21.15.161:0/2522205965 learned_addr learned my addr 172.21.15.161:0/2522205965 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f747b7fe640 1 -- 172.21.15.161:0/2522205965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f747c071160 msgr2=0x7f747c06cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f747bfff640 1 --2- 172.21.15.161:0/2522205965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f747c071160 0x7f747c06cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f74808be640 1 --2- 172.21.15.161:0/2522205965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f747c1429f0 0x7f747c1e3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f747b7fe640 1 --2- 172.21.15.161:0/2522205965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f747c071160 0x7f747c06cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f747b7fe640 1 -- 172.21.15.161:0/2522205965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f747c1429f0 msgr2=0x7f747c1e3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f747b7fe640 1 --2- 172.21.15.161:0/2522205965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f747c1429f0 0x7f747c1e3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f747b7fe640 1 -- 172.21.15.161:0/2522205965 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74640094d0 con 0x7f747c0b9900 2024-02-02T11:49:01.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f747b7fe640 1 --2- 172.21.15.161:0/2522205965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f747c0b9900 0x7f747c06b200 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f746401cde0 tx=0x7f746401ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7478ff9640 1 -- 172.21.15.161:0/2522205965 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74640bb5f0 con 0x7f747c0b9900 2024-02-02T11:49:01.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7478ff9640 1 -- 172.21.15.161:0/2522205965 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74640bb750 con 0x7f747c0b9900 2024-02-02T11:49:01.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7482321640 1 -- 172.21.15.161:0/2522205965 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747c1e34a0 con 0x7f747c0b9900 2024-02-02T11:49:01.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7478ff9640 1 -- 172.21.15.161:0/2522205965 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74640bbb00 con 0x7f747c0b9900 2024-02-02T11:49:01.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7482321640 1 -- 172.21.15.161:0/2522205965 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747c147740 con 0x7f747c0b9900 2024-02-02T11:49:01.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.035+0000 7f7482321640 1 -- 172.21.15.161:0/2522205965 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747c04e000 con 0x7f747c0b9900 2024-02-02T11:49:01.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.039+0000 7f7478ff9640 1 -- 172.21.15.161:0/2522205965 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f74640ba3a0 con 0x7f747c0b9900 2024-02-02T11:49:01.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.039+0000 7f7478ff9640 1 --2- 172.21.15.161:0/2522205965 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f745c065a60 0x7f745c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.039+0000 7f7478ff9640 1 -- 172.21.15.161:0/2522205965 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f746411d8b0 con 0x7f747c0b9900 2024-02-02T11:49:01.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.039+0000 7f747bfff640 1 --2- 172.21.15.161:0/2522205965 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f745c065a60 0x7f745c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.039+0000 7f747bfff640 1 --2- 172.21.15.161:0/2522205965 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f745c065a60 0x7f745c067f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f746c007fd0 tx=0x7f746c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.043+0000 7f7478ff9640 1 -- 172.21.15.161:0/2522205965 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f74640eb420 con 0x7f747c0b9900 2024-02-02T11:49:01.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.187+0000 7f7482321640 1 -- 172.21.15.161:0/2522205965 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f747c140010 con 0x7f747c0b9900 2024-02-02T11:49:01.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.187+0000 7f7478ff9640 1 -- 172.21.15.161:0/2522205965 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f74640c0090 con 0x7f747c0b9900 2024-02-02T11:49:01.191 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:01.191 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":20,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:52.816101+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:48:50.155565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-02T11:48:50.795158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:49:01.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.191+0000 7f7482321640 1 -- 172.21.15.161:0/2522205965 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f745c065a60 msgr2=0x7f745c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.191+0000 7f7482321640 1 --2- 172.21.15.161:0/2522205965 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f745c065a60 0x7f745c067f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f746c007fd0 tx=0x7f746c009040 comp rx=0 tx=0).stop 2024-02-02T11:49:01.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.191+0000 7f7482321640 1 -- 172.21.15.161:0/2522205965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f747c0b9900 msgr2=0x7f747c06b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.191+0000 7f7482321640 1 --2- 172.21.15.161:0/2522205965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f747c0b9900 0x7f747c06b200 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f746401cde0 tx=0x7f746401ad80 comp rx=0 tx=0).stop 2024-02-02T11:49:01.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.191+0000 7f7482321640 1 -- 172.21.15.161:0/2522205965 shutdown_connections 2024-02-02T11:49:01.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.191+0000 7f7482321640 1 --2- 172.21.15.161:0/2522205965 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f745c065a60 0x7f745c067f20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.191+0000 7f7482321640 1 --2- 172.21.15.161:0/2522205965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f747c1429f0 0x7f747c1e3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.191+0000 7f7482321640 1 --2- 172.21.15.161:0/2522205965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f747c0b9900 0x7f747c06b200 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.191+0000 7f7482321640 1 --2- 172.21.15.161:0/2522205965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f747c071160 0x7f747c06cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.191+0000 7f7482321640 1 -- 172.21.15.161:0/2522205965 >> 172.21.15.161:0/2522205965 conn(0x7f747c0be150 msgr2=0x7f747c13f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.191+0000 7f7482321640 1 -- 172.21.15.161:0/2522205965 shutdown_connections 2024-02-02T11:49:01.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.191+0000 7f7482321640 1 -- 172.21.15.161:0/2522205965 wait complete. 2024-02-02T11:49:01.209 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-02T11:49:01.209 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-02T11:49:01.210 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-02T11:49:01.210 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-02T11:49:01.210 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-02-02T11:49:01.211 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-02-02T11:49:01.211 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-02-02T11:49:01.211 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-02-02T11:49:01.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.383+0000 7fb031243640 1 Processor -- start 2024-02-02T11:49:01.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.383+0000 7f1451cd1640 1 Processor -- start 2024-02-02T11:49:01.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.383+0000 7fb031243640 1 -- start start 2024-02-02T11:49:01.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.383+0000 7fc440364640 1 Processor -- start 2024-02-02T11:49:01.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.383+0000 7fc440364640 1 -- start start 2024-02-02T11:49:01.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.383+0000 7f5bc6629640 1 Processor -- start 2024-02-02T11:49:01.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.383+0000 7f5bc6629640 1 -- start start 2024-02-02T11:49:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.383+0000 7f1451cd1640 1 -- start start 2024-02-02T11:49:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.383+0000 7f1451cd1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f144c0b7950 0x7f144c0b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.383+0000 7fb031243640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb02c0b9290 0x7fb02c06be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.383+0000 7fb031243640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c06ed20 con 0x7fb02c147150 2024-02-02T11:49:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.383+0000 7fb031243640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c06c540 con 0x7fb02c0b28d0 2024-02-02T11:49:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.383+0000 7fb031243640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02c14a620 con 0x7fb02c0b9290 2024-02-02T11:49:01.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.383+0000 7f1451cd1640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f144c146fe0 0x7f144c147430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.383+0000 7f1451cd1640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f144c06c340 con 0x7f144c0b7d30 2024-02-02T11:49:01.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.383+0000 7f1451cd1640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f144c0b81a0 con 0x7f144c146fe0 2024-02-02T11:49:01.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.383+0000 7f1451cd1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f144c06c7d0 con 0x7f144c0b7950 2024-02-02T11:49:01.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb02c0b9290 0x7fb02c06be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb02c0b9290 0x7fb02c06be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36650/0 (socket says 172.21.15.161:36650) 2024-02-02T11:49:01.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02bfff640 1 -- 172.21.15.161:0/3989973631 learned_addr learned my addr 172.21.15.161:0/3989973631 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fc440364640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4380b2d20 0x7fc43806f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fc440364640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc438070190 con 0x7fc438146aa0 2024-02-02T11:49:01.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fc440364640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4380bc900 con 0x7fc4380b5e70 2024-02-02T11:49:01.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fc440364640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43806f920 con 0x7fc4380b2d20 2024-02-02T11:49:01.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f144affd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f144c0b7d30 0x7f144c149f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40016/0 (socket says 172.21.15.161:40016) 2024-02-02T11:49:01.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f144affd640 1 -- 172.21.15.161:0/233215561 learned_addr learned my addr 172.21.15.161:0/233215561 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:01.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f9870fc7640 1 Processor -- start 2024-02-02T11:49:01.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f144bfff640 1 --2- 172.21.15.161:0/233215561 >> v2:172.21.15.161:3300/0 conn(0x7f144c146fe0 0x7f144c147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fc43e901640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4380b2d20 0x7fc43806f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fc43e100640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fc4380b5e70 0x7fc438070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.161:57466/0 (socket says 172.21.15.161:57466) 2024-02-02T11:49:01.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fc43e100640 1 -- 172.21.15.161:0/3573734774 learned_addr learned my addr 172.21.15.161:0/3573734774 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:01.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02affd640 1 -- 172.21.15.161:0/3989973631 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340231631 0 0) 0x7fb02c06ed20 con 0x7fb02c147150 2024-02-02T11:49:01.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02affd640 1 -- 172.21.15.161:0/3989973631 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb014003530 con 0x7fb02c147150 2024-02-02T11:49:01.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f5bc6629640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5bb803a3f0 0x7f5bb803c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f5bc6629640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5bb80384c0 0x7f5bb8038930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f5bc6629640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb803c020 con 0x7f5bb8007260 2024-02-02T11:49:01.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f5bc6629640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb803c980 con 0x7f5bb80384c0 2024-02-02T11:49:01.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f5bc6629640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb803a880 con 0x7f5bb803a3f0 2024-02-02T11:49:01.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7faece0db640 1 Processor -- start 2024-02-02T11:49:01.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f9870fc7640 1 -- start start 2024-02-02T11:49:01.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f0d34931640 1 Processor -- start 2024-02-02T11:49:01.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02affd640 1 -- 172.21.15.161:0/3989973631 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119553197 0 0) 0x7fb02c06c540 con 0x7fb02c0b28d0 2024-02-02T11:49:01.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02affd640 1 -- 172.21.15.161:0/3989973631 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb02c06ed20 con 0x7fb02c0b28d0 2024-02-02T11:49:01.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f5bc4e26640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5bb803a3f0 0x7f5bb803c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f5bc4e26640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5bb803a3f0 0x7f5bb803c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.161:35744/0 (socket says 172.21.15.161:35744) 2024-02-02T11:49:01.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f5bc4e26640 1 -- 172.21.15.161:0/3761812365 learned_addr learned my addr 172.21.15.161:0/3761812365 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f5bc5627640 1 --1- 172.21.15.161:0/3761812365 >> v1:172.21.15.162:6789/0 conn(0x7f5bb8007260 0x7f5bb803e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.161:57476/0 (socket says 172.21.15.161:57476) 2024-02-02T11:49:01.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7faece0db640 1 -- start start 2024-02-02T11:49:01.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fc43d0fe640 1 -- 172.21.15.161:0/3573734774 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942417647 0 0) 0x7fc4380bc900 con 0x7fc4380b5e70 2024-02-02T11:49:01.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fc43d0fe640 1 -- 172.21.15.161:0/3573734774 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc424003530 con 0x7fc4380b5e70 2024-02-02T11:49:01.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fc43d0fe640 1 -- 172.21.15.161:0/3573734774 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2804632439 0 0) 0x7fc438070190 con 0x7fc438146aa0 2024-02-02T11:49:01.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fc43d0fe640 1 -- 172.21.15.161:0/3573734774 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4380bc900 con 0x7fc438146aa0 2024-02-02T11:49:01.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02affd640 1 -- 172.21.15.161:0/3989973631 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3053330811 0 0) 0x7fb014003530 con 0x7fb02c147150 2024-02-02T11:49:01.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02affd640 1 -- 172.21.15.161:0/3989973631 >> v2:172.21.15.161:3300/0 conn(0x7fb02c0b9290 msgr2=0x7fb02c06be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:01.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02affd640 1 --2- 172.21.15.161:0/3989973631 >> v2:172.21.15.161:3300/0 conn(0x7fb02c0b9290 0x7fb02c06be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02affd640 1 -- 172.21.15.161:0/3989973631 >> v1:172.21.15.162:6789/0 conn(0x7fb02c0b28d0 legacy=0x7fb02c149f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fc43e901640 1 -- 172.21.15.161:0/3573734774 >> v1:172.21.15.162:6789/0 conn(0x7fc4380b5e70 legacy=0x7fc438070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fc43e901640 1 -- 172.21.15.161:0/3573734774 >> v1:172.21.15.161:6789/0 conn(0x7fc438146aa0 legacy=0x7fc4380bc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fc43e901640 1 -- 172.21.15.161:0/3573734774 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43806f100 con 0x7fc4380b2d20 2024-02-02T11:49:01.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02affd640 1 -- 172.21.15.161:0/3989973631 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c0b77b0 con 0x7fb02c147150 2024-02-02T11:49:01.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02affd640 1 -- 172.21.15.161:0/3989973631 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7fb020001680 con 0x7fb02c147150 2024-02-02T11:49:01.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02affd640 1 -- 172.21.15.161:0/3989973631 >> v1:172.21.15.161:6789/0 conn(0x7fb02c147150 legacy=0x7fb02c14b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02affd640 1 --2- 172.21.15.161:0/3989973631 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb014003b40 0x7fb014003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02affd640 1 --2- 172.21.15.161:0/3989973631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0140047d0 0x7fb014004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02affd640 1 --2- 172.21.15.161:0/3989973631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb014005190 0x7fb01400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02affd640 1 -- 172.21.15.161:0/3989973631 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240015c0 con 0x7fb0140047d0 2024-02-02T11:49:01.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02affd640 1 -- 172.21.15.161:0/3989973631 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c14a620 con 0x7fb014005190 2024-02-02T11:49:01.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02affd640 1 -- 172.21.15.161:0/3989973631 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01400c060 con 0x7fb014003b40 2024-02-02T11:49:01.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f9870fc7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c0bbdd0 0x7f986c0bc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f9870fc7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f986c0b9d00 0x7f986c0b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f9870fc7640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986c14fa70 con 0x7f986c0b6260 2024-02-02T11:49:01.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f9870fc7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986c14f140 con 0x7f986c0b9d00 2024-02-02T11:49:01.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f9870fc7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c14f420 con 0x7f986c0bbdd0 2024-02-02T11:49:01.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f144a7fc640 1 -- 172.21.15.161:0/233215561 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938355288 0 0) 0x7f144c06c340 con 0x7f144c0b7d30 2024-02-02T11:49:01.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02b7fe640 1 --2- 172.21.15.161:0/3989973631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0140047d0 0x7fb014004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f5bc4e26640 1 -- 172.21.15.161:0/3761812365 >> v2:172.21.15.161:3300/0 conn(0x7f5bb80384c0 msgr2=0x7f5bb8038930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:01.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f5bc4e26640 1 --2- 172.21.15.161:0/3761812365 >> v2:172.21.15.161:3300/0 conn(0x7f5bb80384c0 0x7f5bb8038930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f5bc4e26640 1 -- 172.21.15.161:0/3761812365 >> v1:172.21.15.162:6789/0 conn(0x7f5bb8007260 legacy=0x7f5bb803e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f5bc4e26640 1 -- 172.21.15.161:0/3761812365 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb803ab60 con 0x7f5bb803a3f0 2024-02-02T11:49:01.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f144a7fc640 1 -- 172.21.15.161:0/233215561 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1434005740 con 0x7f144c0b7d30 2024-02-02T11:49:01.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb030a42640 1 --2- 172.21.15.161:0/3989973631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb014005190 0x7fb01400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02bfff640 1 --2- 172.21.15.161:0/3989973631 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb014003b40 0x7fb014003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f0d34931640 1 -- start start 2024-02-02T11:49:01.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f0d34931640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d2803a3f0 0x7f0d2803c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f0d34931640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0d280384c0 0x7f0d28038970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f0d34931640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2803c020 con 0x7f0d28007260 2024-02-02T11:49:01.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f0d34931640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2803c980 con 0x7f0d280384c0 2024-02-02T11:49:01.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f0d34931640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2803a880 con 0x7f0d2803a3f0 2024-02-02T11:49:01.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f986affd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f986c0b6260 0x7f986c0b95f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40034/0 (socket says 172.21.15.161:40034) 2024-02-02T11:49:01.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f986affd640 1 -- 172.21.15.161:0/2853849261 learned_addr learned my addr 172.21.15.161:0/2853849261 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:01.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f0d2f7fe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f0d28007260 0x7f0d2803e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.161:57478/0 (socket says 172.21.15.161:57478) 2024-02-02T11:49:01.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f0d2f7fe640 1 -- 172.21.15.161:0/3069273867 learned_addr learned my addr 172.21.15.161:0/3069273867 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:01.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f0d2effd640 1 --2- 172.21.15.161:0/3069273867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d2803a3f0 0x7f0d2803c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7ff925651640 1 Processor -- start 2024-02-02T11:49:01.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7ff925651640 1 -- start start 2024-02-02T11:49:01.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f144bfff640 1 -- 172.21.15.161:0/233215561 >> v2:172.21.15.162:3300/0 conn(0x7f144c0b7950 msgr2=0x7f144c0b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:01.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f144b7fe640 1 --2- 172.21.15.161:0/233215561 >> v2:172.21.15.162:3300/0 conn(0x7f144c0b7950 0x7f144c0b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02b7fe640 1 -- 172.21.15.161:0/3989973631 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb014003b40 msgr2=0x7fb014003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:01.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02b7fe640 1 --2- 172.21.15.161:0/3989973631 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb014003b40 0x7fb014003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02b7fe640 1 -- 172.21.15.161:0/3989973631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb014005190 msgr2=0x7fb01400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:01.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02b7fe640 1 --2- 172.21.15.161:0/3989973631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb014005190 0x7fb01400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb02b7fe640 1 -- 172.21.15.161:0/3989973631 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c0b77b0 con 0x7fb0140047d0 2024-02-02T11:49:01.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7ff925651640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff918042700 0x7ff918042ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7fb030a42640 1 -- 172.21.15.161:0/3989973631 reap_dead start 2024-02-02T11:49:01.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f0d2ffff640 1 --2- 172.21.15.161:0/3069273867 >> v2:172.21.15.162:3300/0 conn(0x7f0d280384c0 0x7f0d28038970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f144a7fc640 1 -- 172.21.15.161:0/233215561 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1830379104 0 0) 0x7f1434005740 con 0x7f144c0b7d30 2024-02-02T11:49:01.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f986b7fe640 1 --2- 172.21.15.161:0/2853849261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c0bbdd0 0x7f986c0bc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f986bfff640 1 --2- 172.21.15.161:0/2853849261 >> v2:172.21.15.162:3300/0 conn(0x7f986c0b9d00 0x7f986c0b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7ff925651640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9180d1920 con 0x7ff91803b9d0 2024-02-02T11:49:01.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7ff925651640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9180d1030 con 0x7ff9180d1db0 2024-02-02T11:49:01.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7ff925651640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91803e220 con 0x7ff918042700 2024-02-02T11:49:01.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7ff91effd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff918042700 0x7ff918042ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7ff91effd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff918042700 0x7ff918042ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.161:35792/0 (socket says 172.21.15.161:35792) 2024-02-02T11:49:01.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7ff91effd640 1 -- 172.21.15.161:0/554875174 learned_addr learned my addr 172.21.15.161:0/554875174 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f986a7fc640 1 -- 172.21.15.161:0/2853849261 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674556983 0 0) 0x7f986c14fa70 con 0x7f986c0b6260 2024-02-02T11:49:01.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f986a7fc640 1 -- 172.21.15.161:0/2853849261 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9854003530 con 0x7f986c0b6260 2024-02-02T11:49:01.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f986b7fe640 1 -- 172.21.15.161:0/2853849261 >> v2:172.21.15.162:3300/0 conn(0x7f986c0b9d00 msgr2=0x7f986c0b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:01.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f986b7fe640 1 --2- 172.21.15.161:0/2853849261 >> v2:172.21.15.162:3300/0 conn(0x7f986c0b9d00 0x7f986c0b66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f986b7fe640 1 -- 172.21.15.161:0/2853849261 >> v1:172.21.15.161:6789/0 conn(0x7f986c0b6260 legacy=0x7f986c0b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f986b7fe640 1 -- 172.21.15.161:0/2853849261 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c14f700 con 0x7f986c0bbdd0 2024-02-02T11:49:01.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7faece0db640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faec003b460 0x7faec003a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7faece0db640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faec00ce1c0 0x7faec00ce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7faecd0d9640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7faec0007260 0x7faec003ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40054/0 (socket says 172.21.15.161:40054) 2024-02-02T11:49:01.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fc43e901640 1 --2- 172.21.15.161:0/3573734774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4380b2d20 0x7fc43806f3e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc430009cb0 tx=0x7fc43001d9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=421dbc3bd3ec261d server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7faece0db640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec00ceb70 con 0x7faec0007260 2024-02-02T11:49:01.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7faece0db640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec003c870 con 0x7faec00ce1c0 2024-02-02T11:49:01.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7faece0db640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec0039900 con 0x7faec003b460 2024-02-02T11:49:01.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7faecd0d9640 1 -- 172.21.15.161:0/260502681 learned_addr learned my addr 172.21.15.161:0/260502681 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:01.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fb02b7fe640 1 --2- 172.21.15.161:0/3989973631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0140047d0 0x7fb014004c50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb02400c3c0 tx=0x7fb02401f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a3fe55349062e4 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fb02affd640 1 -- 172.21.15.161:0/3989973631 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024003b80 con 0x7fb0140047d0 2024-02-02T11:49:01.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fb02affd640 1 -- 172.21.15.161:0/3989973631 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0240ab070 con 0x7fb0140047d0 2024-02-02T11:49:01.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fb02affd640 1 -- 172.21.15.161:0/3989973631 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024005070 con 0x7fb0140047d0 2024-02-02T11:49:01.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f144bfff640 1 --2- 172.21.15.161:0/233215561 >> v2:172.21.15.162:3300/0 conn(0x7f144c0b7950 0x7f144c0b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f144bfff640 1 -- 172.21.15.161:0/233215561 >> v1:172.21.15.161:6789/0 conn(0x7f144c0b7d30 legacy=0x7f144c149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f144bfff640 1 -- 172.21.15.161:0/233215561 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144c14a650 con 0x7f144c146fe0 2024-02-02T11:49:01.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7f144bfff640 1 --2- 172.21.15.161:0/233215561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f144c146fe0 0x7f144c147430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f144c06df90 tx=0x7f144401f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e621337a02f40d75 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7f5bc4e26640 1 --2- 172.21.15.161:0/3761812365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bb803a3f0 0x7f5bb803c440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8007980 tx=0x7f5bbc01ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a01d11652850679f server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7f5bb7fff640 1 -- 172.21.15.161:0/3761812365 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc0a8a10 con 0x7f5bb803a3f0 2024-02-02T11:49:01.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7f5bb7fff640 1 -- 172.21.15.161:0/3761812365 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc0a8b70 con 0x7f5bb803a3f0 2024-02-02T11:49:01.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7f5bb7fff640 1 -- 172.21.15.161:0/3761812365 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc0b0440 con 0x7f5bb803a3f0 2024-02-02T11:49:01.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7f144b7fe640 1 --2- 172.21.15.161:0/233215561 >> v2:172.21.15.162:3300/0 conn(0x7f144c0b7950 0x7f144c0b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:01.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7faecd8da640 1 --2- 172.21.15.161:0/260502681 >> v2:172.21.15.162:3300/0 conn(0x7faec00ce1c0 0x7faec00ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7faecc8d8640 1 --2- 172.21.15.161:0/260502681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faec003b460 0x7faec003a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fc43d0fe640 1 -- 172.21.15.161:0/3573734774 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4300a6af0 con 0x7fc4380b2d20 2024-02-02T11:49:01.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fc43d0fe640 1 -- 172.21.15.161:0/3573734774 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4300a6c50 con 0x7fc4380b2d20 2024-02-02T11:49:01.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fc440364640 1 -- 172.21.15.161:0/3573734774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4380b2d20 msgr2=0x7fc43806f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fc440364640 1 --2- 172.21.15.161:0/3573734774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4380b2d20 0x7fc43806f3e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc430009cb0 tx=0x7fc43001d9f0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fc440364640 1 -- 172.21.15.161:0/3573734774 shutdown_connections 2024-02-02T11:49:01.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fc440364640 1 --2- 172.21.15.161:0/3573734774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4380b2d20 0x7fc43806f3e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fc440364640 1 -- 172.21.15.161:0/3573734774 >> 172.21.15.161:0/3573734774 conn(0x7fc438069ef0 msgr2=0x7fc43806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f0d2effd640 1 -- 172.21.15.161:0/3069273867 >> v2:172.21.15.162:3300/0 conn(0x7f0d280384c0 msgr2=0x7f0d28038970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:01.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f0d2effd640 1 --2- 172.21.15.161:0/3069273867 >> v2:172.21.15.162:3300/0 conn(0x7f0d280384c0 0x7f0d28038970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f0d2effd640 1 -- 172.21.15.161:0/3069273867 >> v1:172.21.15.162:6789/0 conn(0x7f0d28007260 legacy=0x7f0d2803e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7f0d2effd640 1 -- 172.21.15.161:0/3069273867 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2803ab60 con 0x7f0d2803a3f0 2024-02-02T11:49:01.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7faebbfff640 1 -- 172.21.15.161:0/260502681 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734498176 0 0) 0x7faec4001120 con 0x7faec0007260 2024-02-02T11:49:01.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7faebbfff640 1 -- 172.21.15.161:0/260502681 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeb4003530 con 0x7faec0007260 2024-02-02T11:49:01.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7ff91effd640 1 -- 172.21.15.161:0/554875174 >> v1:172.21.15.162:6789/0 conn(0x7ff9180d1db0 legacy=0x7ff918041a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.387+0000 7ff91effd640 1 -- 172.21.15.161:0/554875174 >> v1:172.21.15.161:6789/0 conn(0x7ff91803b9d0 legacy=0x7ff9180db990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:01.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7ff91effd640 1 -- 172.21.15.161:0/554875174 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9180d12d0 con 0x7ff918042700 2024-02-02T11:49:01.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7f144a7fc640 1 -- 172.21.15.161:0/233215561 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c004ce0 con 0x7f144c146fe0 2024-02-02T11:49:01.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7f144a7fc640 1 -- 172.21.15.161:0/233215561 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14440ab050 con 0x7f144c146fe0 2024-02-02T11:49:01.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7f144a7fc640 1 -- 172.21.15.161:0/233215561 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144400a2f0 con 0x7f144c146fe0 2024-02-02T11:49:01.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7faebbfff640 1 -- 172.21.15.161:0/260502681 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2597415449 0 0) 0x7faeb4003530 con 0x7faec0007260 2024-02-02T11:49:01.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7faecc8d8640 1 -- 172.21.15.161:0/260502681 >> v2:172.21.15.162:3300/0 conn(0x7faec00ce1c0 msgr2=0x7faec00ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:01.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7faecc8d8640 1 --2- 172.21.15.161:0/260502681 >> v2:172.21.15.162:3300/0 conn(0x7faec00ce1c0 0x7faec00ce630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7faecc8d8640 1 -- 172.21.15.161:0/260502681 >> v1:172.21.15.161:6789/0 conn(0x7faec0007260 legacy=0x7faec003ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7faecc8d8640 1 -- 172.21.15.161:0/260502681 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec0039e80 con 0x7faec003b460 2024-02-02T11:49:01.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fb031243640 1 -- 172.21.15.161:0/3989973631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0140047d0 msgr2=0x7fb014004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fb031243640 1 --2- 172.21.15.161:0/3989973631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0140047d0 0x7fb014004c50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb02400c3c0 tx=0x7fb02401f540 comp rx=0 tx=0).stop 2024-02-02T11:49:01.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fb031243640 1 -- 172.21.15.161:0/3989973631 shutdown_connections 2024-02-02T11:49:01.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fb031243640 1 --2- 172.21.15.161:0/3989973631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0140047d0 0x7fb014004c50 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb02400c3c0 tx=0x7fb02401f540 comp rx=0 tx=0).stop 2024-02-02T11:49:01.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fb031243640 1 -- 172.21.15.161:0/3989973631 >> 172.21.15.161:0/3989973631 conn(0x7fb02c0b8770 msgr2=0x7fb02c0b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7f0d2effd640 1 --2- 172.21.15.161:0/3069273867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d2803a3f0 0x7f0d2803c440 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0d240097c0 tx=0x7f0d2401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7e108ffeeaaf784 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7ff91effd640 1 --2- 172.21.15.161:0/554875174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff918042700 0x7ff918042ae0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff910009870 tx=0x7ff91001ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27b5a6f0eef040b2 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7f5bc6629640 1 -- 172.21.15.161:0/3761812365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bb803a3f0 msgr2=0x7f5bb803c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7f5bc6629640 1 --2- 172.21.15.161:0/3761812365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bb803a3f0 0x7f5bb803c440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8007980 tx=0x7f5bbc01ed10 comp rx=0 tx=0).stop 2024-02-02T11:49:01.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fb031243640 1 -- 172.21.15.161:0/3989973631 shutdown_connections 2024-02-02T11:49:01.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7f5bc6629640 1 -- 172.21.15.161:0/3761812365 shutdown_connections 2024-02-02T11:49:01.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7f5bc6629640 1 --2- 172.21.15.161:0/3761812365 >> v2:172.21.15.161:3300/0 conn(0x7f5bb80384c0 0x7f5bb8038930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7f5bc6629640 1 --2- 172.21.15.161:0/3761812365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bb803a3f0 0x7f5bb803c440 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7f5bc6629640 1 -- 172.21.15.161:0/3761812365 >> 172.21.15.161:0/3761812365 conn(0x7f5bb803ef80 msgr2=0x7f5bb803f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7ff91dffb640 1 -- 172.21.15.161:0/554875174 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9100a8a10 con 0x7ff918042700 2024-02-02T11:49:01.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7f5bc6629640 1 -- 172.21.15.161:0/3761812365 shutdown_connections 2024-02-02T11:49:01.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7f5bc6629640 1 -- 172.21.15.161:0/3761812365 wait complete. 2024-02-02T11:49:01.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7ff91dffb640 1 -- 172.21.15.161:0/554875174 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9100a8b70 con 0x7ff918042700 2024-02-02T11:49:01.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7ff91dffb640 1 -- 172.21.15.161:0/554875174 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9100b0440 con 0x7ff918042700 2024-02-02T11:49:01.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fb031243640 1 -- 172.21.15.161:0/3989973631 wait complete. 2024-02-02T11:49:01.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f1451cd1640 1 -- 172.21.15.161:0/233215561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f144c146fe0 msgr2=0x7f144c147430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f1451cd1640 1 --2- 172.21.15.161:0/233215561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f144c146fe0 0x7f144c147430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f144c06df90 tx=0x7f144401f310 comp rx=0 tx=0).stop 2024-02-02T11:49:01.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f1451cd1640 1 -- 172.21.15.161:0/233215561 shutdown_connections 2024-02-02T11:49:01.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f1451cd1640 1 --2- 172.21.15.161:0/233215561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f144c146fe0 0x7f144c147430 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f1451cd1640 1 --2- 172.21.15.161:0/233215561 >> v2:172.21.15.162:3300/0 conn(0x7f144c0b7950 0x7f144c0b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f1451cd1640 1 -- 172.21.15.161:0/233215561 >> 172.21.15.161:0/233215561 conn(0x7f144c0bbd20 msgr2=0x7f144c0bc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7ff925651640 1 -- 172.21.15.161:0/554875174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff918042700 msgr2=0x7ff918042ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7ff925651640 1 --2- 172.21.15.161:0/554875174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff918042700 0x7ff918042ae0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff910009870 tx=0x7ff91001ed10 comp rx=0 tx=0).stop 2024-02-02T11:49:01.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7ff925651640 1 -- 172.21.15.161:0/554875174 shutdown_connections 2024-02-02T11:49:01.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7ff925651640 1 --2- 172.21.15.161:0/554875174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff918042700 0x7ff918042ae0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7ff925651640 1 -- 172.21.15.161:0/554875174 >> 172.21.15.161:0/554875174 conn(0x7ff91800f640 msgr2=0x7ff918006170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fb031243640 1 Processor -- start 2024-02-02T11:49:01.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fb031243640 1 -- start start 2024-02-02T11:49:01.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7f986b7fe640 1 --2- 172.21.15.161:0/2853849261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c0bbdd0 0x7f986c0bc620 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9864009d90 tx=0x7f986401f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c90f97ed19949a server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f986a7fc640 1 -- 172.21.15.161:0/2853849261 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640af600 con 0x7f986c0bbdd0 2024-02-02T11:49:01.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f986a7fc640 1 -- 172.21.15.161:0/2853849261 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98640ab050 con 0x7f986c0bbdd0 2024-02-02T11:49:01.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f986a7fc640 1 -- 172.21.15.161:0/2853849261 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640af9c0 con 0x7f986c0bbdd0 2024-02-02T11:49:01.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc6629640 1 Processor -- start 2024-02-02T11:49:01.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7ff925651640 1 -- 172.21.15.161:0/554875174 shutdown_connections 2024-02-02T11:49:01.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc6629640 1 -- start start 2024-02-02T11:49:01.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fb031243640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb02c0b5240 0x7fb02c13a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fb031243640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb02c13a600 0x7fb02c138f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fb031243640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb02c0b5620 0x7fb02c1394d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fb031243640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c137a90 con 0x7fb02c0b5240 2024-02-02T11:49:01.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fb031243640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c1356f0 con 0x7fb02c13a600 2024-02-02T11:49:01.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fb031243640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c133850 con 0x7fb02c0b5620 2024-02-02T11:49:01.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc6629640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bb8007260 0x7f5bb8040b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc6629640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5bb80384c0 0x7f5bb801e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc6629640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bb816abe0 0x7f5bb8034c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc6629640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb80410b0 con 0x7f5bb816abe0 2024-02-02T11:49:01.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc6629640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb8165320 con 0x7f5bb8007260 2024-02-02T11:49:01.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc6629640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb816e2e0 con 0x7f5bb80384c0 2024-02-02T11:49:01.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f0d2e7fc640 1 -- 172.21.15.161:0/3069273867 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d240a8870 con 0x7f0d2803a3f0 2024-02-02T11:49:01.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f0d2e7fc640 1 -- 172.21.15.161:0/3069273867 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d240a89d0 con 0x7f0d2803a3f0 2024-02-02T11:49:01.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f0d2e7fc640 1 -- 172.21.15.161:0/3069273867 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d240a8d60 con 0x7f0d2803a3f0 2024-02-02T11:49:01.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7ff925651640 1 -- 172.21.15.161:0/554875174 wait complete. 2024-02-02T11:49:01.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7ff925651640 1 Processor -- start 2024-02-02T11:49:01.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc5e28640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bb816abe0 0x7f5bb8034c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc5e28640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bb816abe0 0x7f5bb8034c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36702/0 (socket says 172.21.15.161:36702) 2024-02-02T11:49:01.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc5627640 1 --2- 172.21.15.161:0/2299232675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bb8007260 0x7f5bb8040b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc5e28640 1 -- 172.21.15.161:0/2299232675 learned_addr learned my addr 172.21.15.161:0/2299232675 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fb02bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb02c0b5240 0x7fb02c13a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fb02bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb02c0b5240 0x7fb02c13a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36686/0 (socket says 172.21.15.161:36686) 2024-02-02T11:49:01.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fb02bfff640 1 -- 172.21.15.161:0/2102430153 learned_addr learned my addr 172.21.15.161:0/2102430153 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fb030a42640 1 --2- 172.21.15.161:0/2102430153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb02c0b5620 0x7fb02c1394d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc4e26640 1 --2- 172.21.15.161:0/2299232675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5bb80384c0 0x7f5bb801e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f9870fc7640 1 -- 172.21.15.161:0/2853849261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c0bbdd0 msgr2=0x7f986c0bc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f9870fc7640 1 --2- 172.21.15.161:0/2853849261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c0bbdd0 0x7f986c0bc620 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9864009d90 tx=0x7f986401f150 comp rx=0 tx=0).stop 2024-02-02T11:49:01.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f9870fc7640 1 -- 172.21.15.161:0/2853849261 shutdown_connections 2024-02-02T11:49:01.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f9870fc7640 1 --2- 172.21.15.161:0/2853849261 >> v2:172.21.15.162:3300/0 conn(0x7f986c0b9d00 0x7f986c0b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f9870fc7640 1 --2- 172.21.15.161:0/2853849261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c0bbdd0 0x7f986c0bc620 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f9870fc7640 1 -- 172.21.15.161:0/2853849261 >> 172.21.15.161:0/2853849261 conn(0x7f986c0bcc60 msgr2=0x7f986c0bd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc5e28640 1 -- 172.21.15.161:0/2299232675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5bb80384c0 msgr2=0x7f5bb801e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc5e28640 1 --2- 172.21.15.161:0/2299232675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5bb80384c0 0x7f5bb801e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc5e28640 1 -- 172.21.15.161:0/2299232675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bb8007260 msgr2=0x7f5bb8040b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc5e28640 1 --2- 172.21.15.161:0/2299232675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bb8007260 0x7f5bb8040b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc5e28640 1 -- 172.21.15.161:0/2299232675 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc0094d0 con 0x7f5bb816abe0 2024-02-02T11:49:01.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f9870fc7640 1 -- 172.21.15.161:0/2853849261 shutdown_connections 2024-02-02T11:49:01.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f9870fc7640 1 -- 172.21.15.161:0/2853849261 wait complete. 2024-02-02T11:49:01.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc5e28640 1 --2- 172.21.15.161:0/2299232675 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bb816abe0 0x7f5bb8034c20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0074340 tx=0x7f5bc0073320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fb02bfff640 1 -- 172.21.15.161:0/2102430153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb02c0b5620 msgr2=0x7fb02c1394d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fb02bfff640 1 --2- 172.21.15.161:0/2102430153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb02c0b5620 0x7fb02c1394d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fb02bfff640 1 -- 172.21.15.161:0/2102430153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb02c13a600 msgr2=0x7fb02c138f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-02T11:49:01.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fb02bfff640 1 --2- 172.21.15.161:0/2102430153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb02c13a600 0x7fb02c138f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fb02bfff640 1 -- 172.21.15.161:0/2102430153 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c13aaf0 con 0x7fb02c0b5240 2024-02-02T11:49:01.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bb5ffb640 1 -- 172.21.15.161:0/2299232675 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0067230 con 0x7f5bb816abe0 2024-02-02T11:49:01.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc6629640 1 -- 172.21.15.161:0/2299232675 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb801ea40 con 0x7f5bb816abe0 2024-02-02T11:49:01.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7ff925651640 1 -- start start 2024-02-02T11:49:01.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc6629640 1 -- 172.21.15.161:0/2299232675 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb816e860 con 0x7f5bb816abe0 2024-02-02T11:49:01.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f0d34931640 1 -- 172.21.15.161:0/3069273867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d2803a3f0 msgr2=0x7f0d2803c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f0d34931640 1 --2- 172.21.15.161:0/3069273867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d2803a3f0 0x7f0d2803c440 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0d240097c0 tx=0x7f0d2401ecb0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7ff925651640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91803b9d0 0x7ff9180d0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7ff925651640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff918042700 0x7ff9180d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7ff925651640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9180d1db0 0x7ff91816e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7ff925651640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180d0a40 con 0x7ff918042700 2024-02-02T11:49:01.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7ff925651640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180d2b10 con 0x7ff9180d1db0 2024-02-02T11:49:01.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7ff925651640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180ca140 con 0x7ff91803b9d0 2024-02-02T11:49:01.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bb5ffb640 1 -- 172.21.15.161:0/2299232675 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc00739a0 con 0x7f5bb816abe0 2024-02-02T11:49:01.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bb5ffb640 1 -- 172.21.15.161:0/2299232675 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0091640 con 0x7f5bb816abe0 2024-02-02T11:49:01.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fc440364640 1 -- 172.21.15.161:0/3573734774 shutdown_connections 2024-02-02T11:49:01.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.391+0000 7fc440364640 1 -- 172.21.15.161:0/3573734774 wait complete. 2024-02-02T11:49:01.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fc440364640 1 Processor -- start 2024-02-02T11:49:01.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fc440364640 1 -- start start 2024-02-02T11:49:01.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fc440364640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4380b2d20 0x7fc4381de800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fc440364640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4380b5e70 0x7fc438144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fc440364640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc438146aa0 0x7fc43813b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fc440364640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4381de060 con 0x7fc4380b5e70 2024-02-02T11:49:01.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fc440364640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4380bb7b0 con 0x7fc438146aa0 2024-02-02T11:49:01.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fc440364640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4381ddb30 con 0x7fc4380b2d20 2024-02-02T11:49:01.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fc43e901640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc438146aa0 0x7fc43813b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fc43e901640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc438146aa0 0x7fc43813b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.161:35814/0 (socket says 172.21.15.161:35814) 2024-02-02T11:49:01.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fc43e901640 1 -- 172.21.15.161:0/2273384171 learned_addr learned my addr 172.21.15.161:0/2273384171 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fc43e901640 1 -- 172.21.15.161:0/2273384171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4380b2d20 msgr2=0x7fc4381de800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-02T11:49:01.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fc43e901640 1 --2- 172.21.15.161:0/2273384171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4380b2d20 0x7fc4381de800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fc43e901640 1 -- 172.21.15.161:0/2273384171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4380b5e70 msgr2=0x7fc438144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fc43e901640 1 --2- 172.21.15.161:0/2273384171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4380b5e70 0x7fc438144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fc43e901640 1 -- 172.21.15.161:0/2273384171 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43000d040 con 0x7fc438146aa0 2024-02-02T11:49:01.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7ff91effd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91803b9d0 0x7ff9180d0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f0d34931640 1 -- 172.21.15.161:0/3069273867 shutdown_connections 2024-02-02T11:49:01.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f0d34931640 1 --2- 172.21.15.161:0/3069273867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d2803a3f0 0x7f0d2803c440 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f0d34931640 1 --2- 172.21.15.161:0/3069273867 >> v2:172.21.15.162:3300/0 conn(0x7f0d280384c0 0x7f0d28038970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f0d34931640 1 -- 172.21.15.161:0/3069273867 >> 172.21.15.161:0/3069273867 conn(0x7f0d2803ef80 msgr2=0x7f0d2803f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f0d34931640 1 -- 172.21.15.161:0/3069273867 shutdown_connections 2024-02-02T11:49:01.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7ff91f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9180d1db0 0x7ff91816e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7ff91f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9180d1db0 0x7ff91816e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.161:35822/0 (socket says 172.21.15.161:35822) 2024-02-02T11:49:01.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7ff91f7fe640 1 -- 172.21.15.161:0/2254472609 learned_addr learned my addr 172.21.15.161:0/2254472609 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7ff91f7fe640 1 -- 172.21.15.161:0/2254472609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91803b9d0 msgr2=0x7ff9180d0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7ff91f7fe640 1 --2- 172.21.15.161:0/2254472609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91803b9d0 0x7ff9180d0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7ff91f7fe640 1 -- 172.21.15.161:0/2254472609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff918042700 msgr2=0x7ff9180d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7ff91f7fe640 1 --2- 172.21.15.161:0/2254472609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff918042700 0x7ff9180d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7ff91f7fe640 1 -- 172.21.15.161:0/2254472609 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9100094d0 con 0x7ff9180d1db0 2024-02-02T11:49:01.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7fb02bfff640 1 --2- 172.21.15.161:0/2102430153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb02c0b5240 0x7fb02c13a0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0119a0 tx=0x7fb01c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7ff91f7fe640 1 --2- 172.21.15.161:0/2254472609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9180d1db0 0x7ff91816e4a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff920000b70 tx=0x7ff920067320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7ff9077fe640 1 -- 172.21.15.161:0/2254472609 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9200723d0 con 0x7ff9180d1db0 2024-02-02T11:49:01.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7fb028ff9640 1 -- 172.21.15.161:0/2102430153 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c00faf0 con 0x7fb02c0b5240 2024-02-02T11:49:01.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7fb028ff9640 1 -- 172.21.15.161:0/2102430153 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c00fc50 con 0x7fb02c0b5240 2024-02-02T11:49:01.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7fb028ff9640 1 -- 172.21.15.161:0/2102430153 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c014440 con 0x7fb02c0b5240 2024-02-02T11:49:01.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f5bc6629640 1 -- 172.21.15.161:0/2299232675 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5bb803e110 con 0x7f5bb816abe0 2024-02-02T11:49:01.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f9870fc7640 1 Processor -- start 2024-02-02T11:49:01.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f9870fc7640 1 -- start start 2024-02-02T11:49:01.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7ff9077fe640 1 -- 172.21.15.161:0/2254472609 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff920073990 con 0x7ff9180d1db0 2024-02-02T11:49:01.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7ff9077fe640 1 -- 172.21.15.161:0/2254472609 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920073bc0 con 0x7ff9180d1db0 2024-02-02T11:49:01.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7f0d34931640 1 -- 172.21.15.161:0/3069273867 wait complete. 2024-02-02T11:49:01.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f0d34931640 1 Processor -- start 2024-02-02T11:49:01.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.395+0000 7fc43e901640 1 --2- 172.21.15.161:0/2273384171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc438146aa0 0x7fc43813b300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc430009cb0 tx=0x7fc43001a790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f9870fc7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f986c0b6260 0x7f986c0bf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7ff925651640 1 -- 172.21.15.161:0/2254472609 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff91816dd30 con 0x7ff9180d1db0 2024-02-02T11:49:01.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7ff925651640 1 -- 172.21.15.161:0/2254472609 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9180cac90 con 0x7ff9180d1db0 2024-02-02T11:49:01.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7ff925651640 1 -- 172.21.15.161:0/2254472609 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff900000fd0 con 0x7ff9180d1db0 2024-02-02T11:49:01.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f9870fc7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c0b9d00 0x7f986c1d7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f9870fc7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c0bbdd0 0x7f986c14b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f9870fc7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c14a350 con 0x7f986c0b6260 2024-02-02T11:49:01.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f9870fc7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0bfa00 con 0x7f986c0b9d00 2024-02-02T11:49:01.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f9870fc7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c149dd0 con 0x7f986c0bbdd0 2024-02-02T11:49:01.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7fb031243640 1 -- 172.21.15.161:0/2102430153 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c0b5fe0 con 0x7fb02c0b5240 2024-02-02T11:49:01.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7fb031243640 1 -- 172.21.15.161:0/2102430153 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c0a0c10 con 0x7fb02c0b5240 2024-02-02T11:49:01.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f986affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c0b9d00 0x7f986c1d7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f5bb5ffb640 1 -- 172.21.15.161:0/2299232675 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5bc009b3f0 con 0x7f5bb816abe0 2024-02-02T11:49:01.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f986affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c0b9d00 0x7f986c1d7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.161:35838/0 (socket says 172.21.15.161:35838) 2024-02-02T11:49:01.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f986affd640 1 -- 172.21.15.161:0/1761646426 learned_addr learned my addr 172.21.15.161:0/1761646426 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f986bfff640 1 --2- 172.21.15.161:0/1761646426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c0bbdd0 0x7f986c14b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7fb031243640 1 -- 172.21.15.161:0/2102430153 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb02c0b7a90 con 0x7fb02c0b5240 2024-02-02T11:49:01.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f986b7fe640 1 --2- 172.21.15.161:0/1761646426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f986c0b6260 0x7f986c0bf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f0d34931640 1 -- start start 2024-02-02T11:49:01.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f0d34931640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d28007260 0x7f0d280d37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7faecc8d8640 1 --2- 172.21.15.161:0/260502681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faec003b460 0x7faec003a710 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faec802c850 tx=0x7faec80961e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfd0ffc865505b67 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f0d34931640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d280384c0 0x7f0d280c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f0d34931640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d280c07f0 0x7f0d28032120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f0d34931640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d280c39b0 con 0x7f0d280c07f0 2024-02-02T11:49:01.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f0d34931640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d280d5530 con 0x7f0d280384c0 2024-02-02T11:49:01.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f0d2f7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d28007260 0x7f0d280d37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f5bb5ffb640 1 --2- 172.21.15.161:0/2299232675 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f5ba4065a60 0x7f5ba4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f5bb5ffb640 1 -- 172.21.15.161:0/2299232675 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bc00fccd0 con 0x7f5bb816abe0 2024-02-02T11:49:01.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f5bb5ffb640 1 --2- 172.21.15.161:0/2299232675 >> [v2:172.21.15.162:6816/27912,v1:172.21.15.162:6817/27912] conn(0x7f5ba406dc80 0x7f5ba40700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f5bb5ffb640 1 -- 172.21.15.161:0/2299232675 --> [v2:172.21.15.162:6816/27912,v1:172.21.15.162:6817/27912] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ba4070750 con 0x7f5ba406dc80 2024-02-02T11:49:01.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f0d2f7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d28007260 0x7f0d280d37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.161:47898/0 (socket says 172.21.15.161:47898) 2024-02-02T11:49:01.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f0d2f7fe640 1 -- 172.21.15.161:0/1338477897 learned_addr learned my addr 172.21.15.161:0/1338477897 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f5bb5ffb640 1 -- 172.21.15.161:0/2299232675 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5bc00fd080 con 0x7f5bb816abe0 2024-02-02T11:49:01.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f0d34931640 1 -- 172.21.15.161:0/1338477897 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d280d5d30 con 0x7f0d28007260 2024-02-02T11:49:01.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f5bc5627640 1 --2- 172.21.15.161:0/2299232675 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f5ba4065a60 0x7f5ba4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7fc42effd640 1 -- 172.21.15.161:0/2273384171 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4300aed80 con 0x7fc438146aa0 2024-02-02T11:49:01.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f1451cd1640 1 -- 172.21.15.161:0/233215561 shutdown_connections 2024-02-02T11:49:01.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f0d2ffff640 1 --2- 172.21.15.161:0/1338477897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d280c07f0 0x7f0d28032120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7fc42effd640 1 -- 172.21.15.161:0/2273384171 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4300b8400 con 0x7fc438146aa0 2024-02-02T11:49:01.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7fc440364640 1 -- 172.21.15.161:0/2273384171 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4381df030 con 0x7fc438146aa0 2024-02-02T11:49:01.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7fc440364640 1 -- 172.21.15.161:0/2273384171 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4380b9f30 con 0x7fc438146aa0 2024-02-02T11:49:01.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7fc42effd640 1 -- 172.21.15.161:0/2273384171 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4300b8790 con 0x7fc438146aa0 2024-02-02T11:49:01.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7faebbfff640 1 -- 172.21.15.161:0/260502681 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4001810 con 0x7faec003b460 2024-02-02T11:49:01.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7faebbfff640 1 -- 172.21.15.161:0/260502681 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec8121050 con 0x7faec003b460 2024-02-02T11:49:01.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7faebbfff640 1 -- 172.21.15.161:0/260502681 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8125620 con 0x7faec003b460 2024-02-02T11:49:01.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7faece0db640 1 -- 172.21.15.161:0/260502681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faec003b460 msgr2=0x7faec003a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7faece0db640 1 --2- 172.21.15.161:0/260502681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faec003b460 0x7faec003a710 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faec802c850 tx=0x7faec80961e0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7faece0db640 1 -- 172.21.15.161:0/260502681 shutdown_connections 2024-02-02T11:49:01.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7faece0db640 1 --2- 172.21.15.161:0/260502681 >> v2:172.21.15.162:3300/0 conn(0x7faec00ce1c0 0x7faec00ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7faece0db640 1 --2- 172.21.15.161:0/260502681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faec003b460 0x7faec003a710 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faec802c850 tx=0x7faec80961e0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7faece0db640 1 -- 172.21.15.161:0/260502681 >> 172.21.15.161:0/260502681 conn(0x7faec003ef80 msgr2=0x7faec003f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faece0db640 1 -- 172.21.15.161:0/260502681 shutdown_connections 2024-02-02T11:49:01.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7ff9077fe640 1 -- 172.21.15.161:0/2254472609 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff92009b3f0 con 0x7ff9180d1db0 2024-02-02T11:49:01.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f0d2effd640 1 --2- 172.21.15.161:0/1338477897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d280384c0 0x7f0d280c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7ff9077fe640 1 --2- 172.21.15.161:0/2254472609 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff90c065a60 0x7ff90c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7ff9077fe640 1 -- 172.21.15.161:0/2254472609 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9200fcde0 con 0x7ff9180d1db0 2024-02-02T11:49:01.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7ff91effd640 1 --2- 172.21.15.161:0/2254472609 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff90c065a60 0x7ff90c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7ff9077fe640 1 --2- 172.21.15.161:0/2254472609 >> [v2:172.21.15.161:6800/27682,v1:172.21.15.161:6801/27682] conn(0x7ff90c06dc00 0x7ff90c070020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7ff9077fe640 1 -- 172.21.15.161:0/2254472609 --> [v2:172.21.15.161:6800/27682,v1:172.21.15.161:6801/27682] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff90c0706d0 con 0x7ff90c06dc00 2024-02-02T11:49:01.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f0d2f7fe640 1 -- 172.21.15.161:0/1338477897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d280384c0 msgr2=0x7f0d280c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f0d2f7fe640 1 --2- 172.21.15.161:0/1338477897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d280384c0 0x7f0d280c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7ff9077fe640 1 -- 172.21.15.161:0/2254472609 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9200fd230 con 0x7ff9180d1db0 2024-02-02T11:49:01.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f0d2f7fe640 1 -- 172.21.15.161:0/1338477897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d280c07f0 msgr2=0x7f0d28032120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f0d2f7fe640 1 --2- 172.21.15.161:0/1338477897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d280c07f0 0x7f0d28032120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f0d2f7fe640 1 -- 172.21.15.161:0/1338477897 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24009420 con 0x7f0d28007260 2024-02-02T11:49:01.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f1451cd1640 1 -- 172.21.15.161:0/233215561 wait complete. 2024-02-02T11:49:01.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f1451cd1640 1 Processor -- start 2024-02-02T11:49:01.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f5bc4e26640 1 --2- 172.21.15.161:0/2299232675 >> [v2:172.21.15.162:6816/27912,v1:172.21.15.162:6817/27912] conn(0x7f5ba406dc80 0x7f5ba40700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faece0db640 1 -- 172.21.15.161:0/260502681 wait complete. 2024-02-02T11:49:01.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faece0db640 1 Processor -- start 2024-02-02T11:49:01.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f986affd640 1 -- 172.21.15.161:0/1761646426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c0bbdd0 msgr2=0x7f986c14b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f986affd640 1 --2- 172.21.15.161:0/1761646426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986c0bbdd0 0x7f986c14b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f986affd640 1 -- 172.21.15.161:0/1761646426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f986c0b6260 msgr2=0x7f986c0bf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f986affd640 1 --2- 172.21.15.161:0/1761646426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f986c0b6260 0x7f986c0bf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f986affd640 1 -- 172.21.15.161:0/1761646426 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9864009a70 con 0x7f986c0b9d00 2024-02-02T11:49:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f986affd640 1 --2- 172.21.15.161:0/1761646426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c0b9d00 0x7f986c1d7810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f986000c4d0 tx=0x7f986000c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f9853fff640 1 -- 172.21.15.161:0/1761646426 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860005cf0 con 0x7f986c0b9d00 2024-02-02T11:49:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f9853fff640 1 -- 172.21.15.161:0/1761646426 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9860005e50 con 0x7f986c0b9d00 2024-02-02T11:49:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.399+0000 7f9853fff640 1 -- 172.21.15.161:0/1761646426 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860007270 con 0x7f986c0b9d00 2024-02-02T11:49:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7ff91e7fc640 1 --2- 172.21.15.161:0/2254472609 >> [v2:172.21.15.161:6800/27682,v1:172.21.15.161:6801/27682] conn(0x7ff90c06dc00 0x7ff90c070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f0d2f7fe640 1 --2- 172.21.15.161:0/1338477897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d28007260 0x7f0d280d37f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00c500 tx=0x7f0d1c00c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7ff91effd640 1 --2- 172.21.15.161:0/2254472609 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff90c065a60 0x7ff90c067f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff9100b2000 tx=0x7ff910008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7fb028ff9640 1 -- 172.21.15.161:0/2102430153 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb01c0263f0 con 0x7fb02c0b5240 2024-02-02T11:49:01.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7fb028ff9640 1 --2- 172.21.15.161:0/2102430153 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb018065b60 0x7fb018068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7fb028ff9640 1 -- 172.21.15.161:0/2102430153 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb01c083ba0 con 0x7fb02c0b5240 2024-02-02T11:49:01.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7fb028ff9640 1 --2- 172.21.15.161:0/2102430153 >> [v2:172.21.15.161:6824/27684,v1:172.21.15.161:6825/27684] conn(0x7fb01806dd80 0x7fb0180701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7fb028ff9640 1 -- 172.21.15.161:0/2102430153 --> [v2:172.21.15.161:6824/27684,v1:172.21.15.161:6825/27684] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb018070850 con 0x7fb01806dd80 2024-02-02T11:49:01.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7fb028ff9640 1 -- 172.21.15.161:0/2102430153 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb01c083f50 con 0x7fb02c0b5240 2024-02-02T11:49:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faece0db640 1 -- start start 2024-02-02T11:49:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faece0db640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faec0007260 0x7faec00d1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faece0db640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faec00ce1c0 0x7faec00ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faece0db640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faec00cd460 0x7faec00c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faece0db640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec00cb1e0 con 0x7faec0007260 2024-02-02T11:49:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faece0db640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec00d1890 con 0x7faec00ce1c0 2024-02-02T11:49:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faece0db640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec00c7640 con 0x7faec00cd460 2024-02-02T11:49:01.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7ff91e7fc640 1 --2- 172.21.15.161:0/2254472609 >> [v2:172.21.15.161:6800/27682,v1:172.21.15.161:6801/27682] conn(0x7ff90c06dc00 0x7ff90c070020 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faecd8da640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faec00cd460 0x7faec00c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faecd8da640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faec00cd460 0x7faec00c7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.161:47914/0 (socket says 172.21.15.161:47914) 2024-02-02T11:49:01.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faecd8da640 1 -- 172.21.15.161:0/3122590778 learned_addr learned my addr 172.21.15.161:0/3122590778 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faecc8d8640 1 --2- 172.21.15.161:0/3122590778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faec00ce1c0 0x7faec00ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7fc42effd640 1 -- 172.21.15.161:0/2273384171 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc4300b88f0 con 0x7fc438146aa0 2024-02-02T11:49:01.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7fb02b7fe640 1 --2- 172.21.15.161:0/2102430153 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb018065b60 0x7fb018068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f0d1bfff640 1 -- 172.21.15.161:0/1338477897 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c005cf0 con 0x7f0d28007260 2024-02-02T11:49:01.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f0d1bfff640 1 -- 172.21.15.161:0/1338477897 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c005e50 con 0x7f0d28007260 2024-02-02T11:49:01.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f0d1bfff640 1 -- 172.21.15.161:0/1338477897 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c0072f0 con 0x7f0d28007260 2024-02-02T11:49:01.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f0d34931640 1 -- 172.21.15.161:0/1338477897 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d280d6010 con 0x7f0d28007260 2024-02-02T11:49:01.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f0d34931640 1 -- 172.21.15.161:0/1338477897 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d280d5250 con 0x7f0d28007260 2024-02-02T11:49:01.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f1451cd1640 1 -- start start 2024-02-02T11:49:01.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f1451cd1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f144c0b7950 0x7f144c1d5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f1451cd1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f144c0b7d30 0x7f144c0b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f1451cd1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f144c146fe0 0x7f144c0b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f1451cd1640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144c1d5c50 con 0x7f144c0b7950 2024-02-02T11:49:01.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f1451cd1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144c0b3e80 con 0x7f144c146fe0 2024-02-02T11:49:01.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f1451cd1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144c0b5af0 con 0x7f144c0b7d30 2024-02-02T11:49:01.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f5bc5627640 1 --2- 172.21.15.161:0/2299232675 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f5ba4065a60 0x7f5ba4067f20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0000f70 tx=0x7f5bb0007e10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f5bc4e26640 1 --2- 172.21.15.161:0/2299232675 >> [v2:172.21.15.162:6816/27912,v1:172.21.15.162:6817/27912] conn(0x7f5ba406dc80 0x7f5ba40700a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f0d34931640 1 -- 172.21.15.161:0/1338477897 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d2803e110 con 0x7f0d28007260 2024-02-02T11:49:01.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f144affd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f144c0b7d30 0x7f144c0b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f144affd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f144c0b7d30 0x7f144c0b55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.161:47922/0 (socket says 172.21.15.161:47922) 2024-02-02T11:49:01.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f144affd640 1 -- 172.21.15.161:0/1286535521 learned_addr learned my addr 172.21.15.161:0/1286535521 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7f144bfff640 1 --2- 172.21.15.161:0/1286535521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f144c146fe0 0x7f144c0b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7fc440364640 1 -- 172.21.15.161:0/2273384171 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc420000fd0 con 0x7fc438146aa0 2024-02-02T11:49:01.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faecd8da640 1 -- 172.21.15.161:0/3122590778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faec00ce1c0 msgr2=0x7faec00ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faecd8da640 1 --2- 172.21.15.161:0/3122590778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faec00ce1c0 0x7faec00ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7fb030a42640 1 --2- 172.21.15.161:0/2102430153 >> [v2:172.21.15.161:6824/27684,v1:172.21.15.161:6825/27684] conn(0x7fb01806dd80 0x7fb0180701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7fb02b7fe640 1 --2- 172.21.15.161:0/2102430153 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb018065b60 0x7fb018068020 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb0240af000 tx=0x7fb0240aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faecd8da640 1 -- 172.21.15.161:0/3122590778 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faec0007260 msgr2=0x7faec00d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faecd8da640 1 --2- 172.21.15.161:0/3122590778 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faec0007260 0x7faec00d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faecd8da640 1 -- 172.21.15.161:0/3122590778 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec804ef90 con 0x7faec00cd460 2024-02-02T11:49:01.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faecc8d8640 1 --2- 172.21.15.161:0/3122590778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faec00ce1c0 0x7faec00ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-02T11:49:01.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7ff9077fe640 1 -- 172.21.15.161:0/2254472609 <== osd.1 v2:172.21.15.161:6800/27682 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff90c0706d0 con 0x7ff90c06dc00 2024-02-02T11:49:01.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7fc42effd640 1 --2- 172.21.15.161:0/2273384171 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc41c065b30 0x7fc41c067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7fc43e100640 1 --2- 172.21.15.161:0/2273384171 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc41c065b30 0x7fc41c067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7fc42effd640 1 -- 172.21.15.161:0/2273384171 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc43011e1a0 con 0x7fc438146aa0 2024-02-02T11:49:01.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7fc42effd640 1 --2- 172.21.15.161:0/2273384171 >> [v2:172.21.15.162:6808/27911,v1:172.21.15.162:6809/27911] conn(0x7fc41c06dcd0 0x7fc41c0700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7fc42effd640 1 -- 172.21.15.161:0/2273384171 --> [v2:172.21.15.162:6808/27911,v1:172.21.15.162:6809/27911] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc41c0707a0 con 0x7fc41c06dcd0 2024-02-02T11:49:01.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.403+0000 7faecd8da640 1 --2- 172.21.15.161:0/3122590778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faec00cd460 0x7faec00c7ad0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faebc00e820 tx=0x7faebc00ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7f144bfff640 1 -- 172.21.15.161:0/1286535521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f144c0b7d30 msgr2=0x7f144c0b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7f144bfff640 1 --2- 172.21.15.161:0/1286535521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f144c0b7d30 0x7f144c0b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7f144bfff640 1 -- 172.21.15.161:0/1286535521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f144c0b7950 msgr2=0x7f144c1d5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7f144bfff640 1 --2- 172.21.15.161:0/1286535521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f144c0b7950 0x7f144c1d5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7f144bfff640 1 -- 172.21.15.161:0/1286535521 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14440078e0 con 0x7f144c146fe0 2024-02-02T11:49:01.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7fb030a42640 1 --2- 172.21.15.161:0/2102430153 >> [v2:172.21.15.161:6824/27684,v1:172.21.15.161:6825/27684] conn(0x7fb01806dd80 0x7fb0180701a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7fc43d8ff640 1 --2- 172.21.15.161:0/2273384171 >> [v2:172.21.15.162:6808/27911,v1:172.21.15.162:6809/27911] conn(0x7fc41c06dcd0 0x7fc41c0700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7fc43e100640 1 --2- 172.21.15.161:0/2273384171 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc41c065b30 0x7fc41c067ff0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc428006120 tx=0x7fc428004a60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7f144bfff640 1 --2- 172.21.15.161:0/1286535521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f144c146fe0 0x7f144c0b62e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f14440ae000 tx=0x7f144401c0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7faeb9ffb640 1 -- 172.21.15.161:0/3122590778 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc009530 con 0x7faec00cd460 2024-02-02T11:49:01.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7faece0db640 1 -- 172.21.15.161:0/3122590778 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec00cd8f0 con 0x7faec00cd460 2024-02-02T11:49:01.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7faece0db640 1 -- 172.21.15.161:0/3122590778 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec0171630 con 0x7faec00cd460 2024-02-02T11:49:01.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7faeb9ffb640 1 -- 172.21.15.161:0/3122590778 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc00eed0 con 0x7faec00cd460 2024-02-02T11:49:01.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7faece0db640 1 -- 172.21.15.161:0/3122590778 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faec0007640 con 0x7faec00cd460 2024-02-02T11:49:01.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7fc43d8ff640 1 --2- 172.21.15.161:0/2273384171 >> [v2:172.21.15.162:6808/27911,v1:172.21.15.162:6809/27911] conn(0x7fc41c06dcd0 0x7fc41c0700f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7f5bb5ffb640 1 -- 172.21.15.161:0/2299232675 <== osd.4 v2:172.21.15.162:6816/27912 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5ba4070750 con 0x7f5ba406dc80 2024-02-02T11:49:01.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7f9870fc7640 1 -- 172.21.15.161:0/1761646426 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986c14bfe0 con 0x7f986c0b9d00 2024-02-02T11:49:01.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7f9870fc7640 1 -- 172.21.15.161:0/1761646426 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986c14ada0 con 0x7f986c0b9d00 2024-02-02T11:49:01.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7fb028ff9640 1 -- 172.21.15.161:0/2102430153 <== osd.3 v2:172.21.15.161:6824/27684 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb018070850 con 0x7fb01806dd80 2024-02-02T11:49:01.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7fc42effd640 1 -- 172.21.15.161:0/2273384171 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4300ae440 con 0x7fc438146aa0 2024-02-02T11:49:01.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7f9853fff640 1 -- 172.21.15.161:0/1761646426 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f98600073d0 con 0x7f986c0b9d00 2024-02-02T11:49:01.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7fc42effd640 1 -- 172.21.15.161:0/2273384171 <== osd.7 v2:172.21.15.162:6808/27911 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc41c0707a0 con 0x7fc41c06dcd0 2024-02-02T11:49:01.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7f9853fff640 1 --2- 172.21.15.161:0/1761646426 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9858065a60 0x7f9858067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7f9853fff640 1 -- 172.21.15.161:0/1761646426 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9860082780 con 0x7f986c0b9d00 2024-02-02T11:49:01.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.407+0000 7f986b7fe640 1 --2- 172.21.15.161:0/1761646426 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9858065a60 0x7f9858067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f0d1bfff640 1 -- 172.21.15.161:0/1338477897 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0d1c007450 con 0x7f0d28007260 2024-02-02T11:49:01.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f9870fc7640 1 --2- 172.21.15.161:0/1761646426 >> [v2:172.21.15.162:6800/27910,v1:172.21.15.162:6801/27910] conn(0x7f986c0bfbe0 0x7f986c0a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f9870fc7640 1 -- 172.21.15.161:0/1761646426 --> [v2:172.21.15.162:6800/27910,v1:172.21.15.162:6801/27910] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f986c074100 con 0x7f986c0bfbe0 2024-02-02T11:49:01.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f986bfff640 1 --2- 172.21.15.161:0/1761646426 >> [v2:172.21.15.162:6800/27910,v1:172.21.15.162:6801/27910] conn(0x7f986c0bfbe0 0x7f986c0a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f0d1bfff640 1 --2- 172.21.15.161:0/1338477897 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0d14065a90 0x7f0d14067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f0d1bfff640 1 -- 172.21.15.161:0/1338477897 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d1c082e50 con 0x7f0d28007260 2024-02-02T11:49:01.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f0d1bfff640 1 --2- 172.21.15.161:0/1338477897 >> [v2:172.21.15.161:6808/27681,v1:172.21.15.161:6809/27681] conn(0x7f0d1406dcb0 0x7f0d140700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f0d1bfff640 1 -- 172.21.15.161:0/1338477897 --> [v2:172.21.15.161:6808/27681,v1:172.21.15.161:6809/27681] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d14070780 con 0x7f0d1406dcb0 2024-02-02T11:49:01.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f0d1bfff640 1 -- 172.21.15.161:0/1338477897 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d1c083200 con 0x7f0d28007260 2024-02-02T11:49:01.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f1433fff640 1 -- 172.21.15.161:0/1286535521 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444004240 con 0x7f144c146fe0 2024-02-02T11:49:01.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f0d2effd640 1 --2- 172.21.15.161:0/1338477897 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0d14065a90 0x7f0d14067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f1433fff640 1 -- 172.21.15.161:0/1286535521 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14440043a0 con 0x7f144c146fe0 2024-02-02T11:49:01.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f986bfff640 1 --2- 172.21.15.161:0/1761646426 >> [v2:172.21.15.162:6800/27910,v1:172.21.15.162:6801/27910] conn(0x7f986c0bfbe0 0x7f986c0a59f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f986b7fe640 1 --2- 172.21.15.161:0/1761646426 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9858065a60 0x7f9858067f20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f98640b1000 tx=0x7f98640aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f1451cd1640 1 -- 172.21.15.161:0/1286535521 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144c0b4410 con 0x7f144c146fe0 2024-02-02T11:49:01.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f1451cd1640 1 -- 172.21.15.161:0/1286535521 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f144c0b49d0 con 0x7f144c146fe0 2024-02-02T11:49:01.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f0d2effd640 1 --2- 172.21.15.161:0/1338477897 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0d14065a90 0x7f0d14067f50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0d240b2000 tx=0x7f0d240aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f1433fff640 1 -- 172.21.15.161:0/1286535521 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444004730 con 0x7f144c146fe0 2024-02-02T11:49:01.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f1451cd1640 1 -- 172.21.15.161:0/1286535521 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f144c06bcf0 con 0x7f144c146fe0 2024-02-02T11:49:01.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.411+0000 7f9853fff640 1 -- 172.21.15.161:0/1761646426 <== osd.6 v2:172.21.15.162:6800/27910 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f986c074100 con 0x7f986c0bfbe0 2024-02-02T11:49:01.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.415+0000 7f1433fff640 1 -- 172.21.15.161:0/1286535521 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f14440b6070 con 0x7f144c146fe0 2024-02-02T11:49:01.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.415+0000 7f1433fff640 1 --2- 172.21.15.161:0/1286535521 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1438065b30 0x7f1438067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.415+0000 7f1433fff640 1 -- 172.21.15.161:0/1286535521 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1444121cb0 con 0x7f144c146fe0 2024-02-02T11:49:01.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.415+0000 7f144b7fe640 1 --2- 172.21.15.161:0/1286535521 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1438065b30 0x7f1438067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.415+0000 7f1433fff640 1 --2- 172.21.15.161:0/1286535521 >> [v2:172.21.15.161:6816/27683,v1:172.21.15.161:6817/27683] conn(0x7f143806dd50 0x7f1438070170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.415+0000 7f1433fff640 1 -- 172.21.15.161:0/1286535521 --> [v2:172.21.15.161:6816/27683,v1:172.21.15.161:6817/27683] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1438070820 con 0x7f143806dd50 2024-02-02T11:49:01.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.415+0000 7f1433fff640 1 -- 172.21.15.161:0/1286535521 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1444122060 con 0x7f144c146fe0 2024-02-02T11:49:01.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.415+0000 7f0d2ffff640 1 --2- 172.21.15.161:0/1338477897 >> [v2:172.21.15.161:6808/27681,v1:172.21.15.161:6809/27681] conn(0x7f0d1406dcb0 0x7f0d140700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.415+0000 7f0d2ffff640 1 --2- 172.21.15.161:0/1338477897 >> [v2:172.21.15.161:6808/27681,v1:172.21.15.161:6809/27681] conn(0x7f0d1406dcb0 0x7f0d140700d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.415+0000 7f144b7fe640 1 --2- 172.21.15.161:0/1286535521 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1438065b30 0x7f1438067ff0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f144000a8d0 tx=0x7f1440008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.415+0000 7f0d1bfff640 1 -- 172.21.15.161:0/1338477897 <== osd.0 v2:172.21.15.161:6808/27681 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0d14070780 con 0x7f0d1406dcb0 2024-02-02T11:49:01.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.415+0000 7faeb9ffb640 1 -- 172.21.15.161:0/3122590778 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc00cb60 con 0x7faec00cd460 2024-02-02T11:49:01.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.419+0000 7faeb9ffb640 1 -- 172.21.15.161:0/3122590778 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faebc00cd60 con 0x7faec00cd460 2024-02-02T11:49:01.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.419+0000 7faeb9ffb640 1 --2- 172.21.15.161:0/3122590778 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7faeac065b60 0x7faeac068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.419+0000 7faeb9ffb640 1 -- 172.21.15.161:0/3122590778 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faebc083b30 con 0x7faec00cd460 2024-02-02T11:49:01.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.419+0000 7faeb9ffb640 1 --2- 172.21.15.161:0/3122590778 >> [v2:172.21.15.162:6824/27913,v1:172.21.15.162:6825/27913] conn(0x7faeac06dd80 0x7faeac0701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.419+0000 7faeb9ffb640 1 -- 172.21.15.161:0/3122590778 --> [v2:172.21.15.162:6824/27913,v1:172.21.15.162:6825/27913] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faeac070850 con 0x7faeac06dd80 2024-02-02T11:49:01.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.419+0000 7faeb9ffb640 1 -- 172.21.15.161:0/3122590778 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7faebc083e90 con 0x7faec00cd460 2024-02-02T11:49:01.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.419+0000 7faecc8d8640 1 --2- 172.21.15.161:0/3122590778 >> [v2:172.21.15.162:6824/27913,v1:172.21.15.162:6825/27913] conn(0x7faeac06dd80 0x7faeac0701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.419+0000 7faecc8d8640 1 --2- 172.21.15.161:0/3122590778 >> [v2:172.21.15.162:6824/27913,v1:172.21.15.162:6825/27913] conn(0x7faeac06dd80 0x7faeac0701a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.419+0000 7faeb9ffb640 1 -- 172.21.15.161:0/3122590778 <== osd.5 v2:172.21.15.162:6824/27913 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7faeac070850 con 0x7faeac06dd80 2024-02-02T11:49:01.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7faecd0d9640 1 --2- 172.21.15.161:0/3122590778 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7faeac065b60 0x7faeac068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7f144affd640 1 --2- 172.21.15.161:0/1286535521 >> [v2:172.21.15.161:6816/27683,v1:172.21.15.161:6817/27683] conn(0x7f143806dd50 0x7f1438070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7f5bc6629640 1 -- 172.21.15.161:0/2299232675 --> [v2:172.21.15.162:6816/27912,v1:172.21.15.162:6817/27912] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5bb803ae40 con 0x7f5ba406dc80 2024-02-02T11:49:01.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7faecd0d9640 1 --2- 172.21.15.161:0/3122590778 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7faeac065b60 0x7faeac068020 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faec40012f0 tx=0x7faec4001740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7ff925651640 1 -- 172.21.15.161:0/2254472609 --> [v2:172.21.15.161:6800/27682,v1:172.21.15.161:6801/27682] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff900002cc0 con 0x7ff90c06dc00 2024-02-02T11:49:01.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7f144affd640 1 --2- 172.21.15.161:0/1286535521 >> [v2:172.21.15.161:6816/27683,v1:172.21.15.161:6817/27683] conn(0x7f143806dd50 0x7f1438070170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7f5bb5ffb640 1 -- 172.21.15.161:0/2299232675 <== osd.4 v2:172.21.15.162:6816/27912 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5bbc0b05c0 con 0x7f5ba406dc80 2024-02-02T11:49:01.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7ff9077fe640 1 -- 172.21.15.161:0/2254472609 <== osd.1 v2:172.21.15.161:6800/27682 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff900002cc0 con 0x7ff90c06dc00 2024-02-02T11:49:01.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7f5bc6629640 1 -- 172.21.15.161:0/2299232675 >> [v2:172.21.15.162:6816/27912,v1:172.21.15.162:6817/27912] conn(0x7f5ba406dc80 msgr2=0x7f5ba40700a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7f5bc6629640 1 --2- 172.21.15.161:0/2299232675 >> [v2:172.21.15.162:6816/27912,v1:172.21.15.162:6817/27912] conn(0x7f5ba406dc80 0x7f5ba40700a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7f5bc6629640 1 -- 172.21.15.161:0/2299232675 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f5ba4065a60 msgr2=0x7f5ba4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7f5bc6629640 1 --2- 172.21.15.161:0/2299232675 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f5ba4065a60 0x7f5ba4067f20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0000f70 tx=0x7f5bb0007e10 comp rx=0 tx=0).stop 2024-02-02T11:49:01.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7f5bc6629640 1 -- 172.21.15.161:0/2299232675 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bb816abe0 msgr2=0x7f5bb8034c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7f5bc6629640 1 --2- 172.21.15.161:0/2299232675 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bb816abe0 0x7f5bb8034c20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0074340 tx=0x7f5bc0073320 comp rx=0 tx=0).stop 2024-02-02T11:49:01.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7f5bc5e28640 1 -- 172.21.15.161:0/2299232675 reap_dead start 2024-02-02T11:49:01.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7f5bc6629640 1 -- 172.21.15.161:0/2299232675 shutdown_connections 2024-02-02T11:49:01.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7f5bc6629640 1 -- 172.21.15.161:0/2299232675 >> 172.21.15.161:0/2299232675 conn(0x7f5bb803ef80 msgr2=0x7f5bb803f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7f5bc6629640 1 -- 172.21.15.161:0/2299232675 shutdown_connections 2024-02-02T11:49:01.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7f5bc6629640 1 -- 172.21.15.161:0/2299232675 wait complete. 2024-02-02T11:49:01.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7f1433fff640 1 -- 172.21.15.161:0/1286535521 <== osd.2 v2:172.21.15.161:6816/27683 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1438070820 con 0x7f143806dd50 2024-02-02T11:49:01.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7ff925651640 1 -- 172.21.15.161:0/2254472609 >> [v2:172.21.15.161:6800/27682,v1:172.21.15.161:6801/27682] conn(0x7ff90c06dc00 msgr2=0x7ff90c070020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7ff925651640 1 --2- 172.21.15.161:0/2254472609 >> [v2:172.21.15.161:6800/27682,v1:172.21.15.161:6801/27682] conn(0x7ff90c06dc00 0x7ff90c070020 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7ff925651640 1 -- 172.21.15.161:0/2254472609 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff90c065a60 msgr2=0x7ff90c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7ff925651640 1 --2- 172.21.15.161:0/2254472609 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff90c065a60 0x7ff90c067f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff9100b2000 tx=0x7ff910008040 comp rx=0 tx=0).stop 2024-02-02T11:49:01.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7ff925651640 1 -- 172.21.15.161:0/2254472609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9180d1db0 msgr2=0x7ff91816e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7ff925651640 1 --2- 172.21.15.161:0/2254472609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9180d1db0 0x7ff91816e4a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff920000b70 tx=0x7ff920067320 comp rx=0 tx=0).stop 2024-02-02T11:49:01.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.423+0000 7ff91f7fe640 1 -- 172.21.15.161:0/2254472609 reap_dead start 2024-02-02T11:49:01.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.431+0000 7ff925651640 1 -- 172.21.15.161:0/2254472609 shutdown_connections 2024-02-02T11:49:01.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.431+0000 7ff925651640 1 -- 172.21.15.161:0/2254472609 >> 172.21.15.161:0/2254472609 conn(0x7ff91800f640 msgr2=0x7ff918006350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.431+0000 7ff925651640 1 -- 172.21.15.161:0/2254472609 shutdown_connections 2024-02-02T11:49:01.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.431+0000 7ff925651640 1 -- 172.21.15.161:0/2254472609 wait complete. 2024-02-02T11:49:01.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.435+0000 7fb031243640 1 -- 172.21.15.161:0/2102430153 --> [v2:172.21.15.161:6824/27684,v1:172.21.15.161:6825/27684] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb02c06c820 con 0x7fb01806dd80 2024-02-02T11:49:01.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.435+0000 7fb028ff9640 1 -- 172.21.15.161:0/2102430153 <== osd.3 v2:172.21.15.161:6824/27684 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb020001660 con 0x7fb01806dd80 2024-02-02T11:49:01.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.435+0000 7fc440364640 1 -- 172.21.15.161:0/2273384171 --> [v2:172.21.15.162:6808/27911,v1:172.21.15.162:6809/27911] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc420002cc0 con 0x7fc41c06dcd0 2024-02-02T11:49:01.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.439+0000 7fc42effd640 1 -- 172.21.15.161:0/2273384171 <== osd.7 v2:172.21.15.162:6808/27911 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc420002cc0 con 0x7fc41c06dcd0 2024-02-02T11:49:01.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.439+0000 7fc440364640 1 -- 172.21.15.161:0/2273384171 >> [v2:172.21.15.162:6808/27911,v1:172.21.15.162:6809/27911] conn(0x7fc41c06dcd0 msgr2=0x7fc41c0700f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.439+0000 7fc440364640 1 --2- 172.21.15.161:0/2273384171 >> [v2:172.21.15.162:6808/27911,v1:172.21.15.162:6809/27911] conn(0x7fc41c06dcd0 0x7fc41c0700f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.439+0000 7fc440364640 1 -- 172.21.15.161:0/2273384171 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc41c065b30 msgr2=0x7fc41c067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.439+0000 7fc440364640 1 --2- 172.21.15.161:0/2273384171 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc41c065b30 0x7fc41c067ff0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc428006120 tx=0x7fc428004a60 comp rx=0 tx=0).stop 2024-02-02T11:49:01.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.439+0000 7fc440364640 1 -- 172.21.15.161:0/2273384171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc438146aa0 msgr2=0x7fc43813b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.439+0000 7fc440364640 1 --2- 172.21.15.161:0/2273384171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc438146aa0 0x7fc43813b300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc430009cb0 tx=0x7fc43001a790 comp rx=0 tx=0).stop 2024-02-02T11:49:01.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.439+0000 7fc43e901640 1 -- 172.21.15.161:0/2273384171 reap_dead start 2024-02-02T11:49:01.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.439+0000 7fc440364640 1 -- 172.21.15.161:0/2273384171 shutdown_connections 2024-02-02T11:49:01.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.439+0000 7fc440364640 1 -- 172.21.15.161:0/2273384171 >> 172.21.15.161:0/2273384171 conn(0x7fc438069ef0 msgr2=0x7fc4380b6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.439+0000 7fc440364640 1 -- 172.21.15.161:0/2273384171 shutdown_connections 2024-02-02T11:49:01.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.439+0000 7fc440364640 1 -- 172.21.15.161:0/2273384171 wait complete. 2024-02-02T11:49:01.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.439+0000 7f0d34931640 1 -- 172.21.15.161:0/1338477897 --> [v2:172.21.15.161:6808/27681,v1:172.21.15.161:6809/27681] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0d2803ae40 con 0x7f0d1406dcb0 2024-02-02T11:49:01.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f0d1bfff640 1 -- 172.21.15.161:0/1338477897 <== osd.0 v2:172.21.15.161:6808/27681 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0d3004e850 con 0x7f0d1406dcb0 2024-02-02T11:49:01.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f0d34931640 1 -- 172.21.15.161:0/1338477897 >> [v2:172.21.15.161:6808/27681,v1:172.21.15.161:6809/27681] conn(0x7f0d1406dcb0 msgr2=0x7f0d140700d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f0d34931640 1 --2- 172.21.15.161:0/1338477897 >> [v2:172.21.15.161:6808/27681,v1:172.21.15.161:6809/27681] conn(0x7f0d1406dcb0 0x7f0d140700d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7faece0db640 1 -- 172.21.15.161:0/3122590778 --> [v2:172.21.15.162:6824/27913,v1:172.21.15.162:6825/27913] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faec0035d30 con 0x7faeac06dd80 2024-02-02T11:49:01.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f0d34931640 1 -- 172.21.15.161:0/1338477897 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0d14065a90 msgr2=0x7f0d14067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7fb0127fc640 1 -- 172.21.15.161:0/2102430153 >> [v2:172.21.15.161:6824/27684,v1:172.21.15.161:6825/27684] conn(0x7fb01806dd80 msgr2=0x7fb0180701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7fb0127fc640 1 --2- 172.21.15.161:0/2102430153 >> [v2:172.21.15.161:6824/27684,v1:172.21.15.161:6825/27684] conn(0x7fb01806dd80 0x7fb0180701a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f9870fc7640 1 -- 172.21.15.161:0/1761646426 --> [v2:172.21.15.162:6800/27910,v1:172.21.15.162:6801/27910] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f986c14aa50 con 0x7f986c0bfbe0 2024-02-02T11:49:01.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f0d34931640 1 --2- 172.21.15.161:0/1338477897 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0d14065a90 0x7f0d14067f50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0d240b2000 tx=0x7f0d240aa070 comp rx=0 tx=0).stop 2024-02-02T11:49:01.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f0d34931640 1 -- 172.21.15.161:0/1338477897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d28007260 msgr2=0x7f0d280d37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f0d34931640 1 --2- 172.21.15.161:0/1338477897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d28007260 0x7f0d280d37f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00c500 tx=0x7f0d1c00c9c0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7fb0127fc640 1 -- 172.21.15.161:0/2102430153 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb018065b60 msgr2=0x7fb018068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7fb0127fc640 1 --2- 172.21.15.161:0/2102430153 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb018065b60 0x7fb018068020 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb0240af000 tx=0x7fb0240aa000 comp rx=0 tx=0).stop 2024-02-02T11:49:01.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7fb0127fc640 1 -- 172.21.15.161:0/2102430153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb02c0b5240 msgr2=0x7fb02c13a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f0d2ffff640 1 -- 172.21.15.161:0/1338477897 reap_dead start 2024-02-02T11:49:01.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7fb0127fc640 1 --2- 172.21.15.161:0/2102430153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb02c0b5240 0x7fb02c13a0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0119a0 tx=0x7fb01c011e60 comp rx=0 tx=0).stop 2024-02-02T11:49:01.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7fb030a42640 1 -- 172.21.15.161:0/2102430153 reap_dead start 2024-02-02T11:49:01.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f0d34931640 1 -- 172.21.15.161:0/1338477897 shutdown_connections 2024-02-02T11:49:01.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f0d34931640 1 -- 172.21.15.161:0/1338477897 >> 172.21.15.161:0/1338477897 conn(0x7f0d2803ef80 msgr2=0x7f0d280c1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f0d34931640 1 -- 172.21.15.161:0/1338477897 shutdown_connections 2024-02-02T11:49:01.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7fb0127fc640 1 -- 172.21.15.161:0/2102430153 shutdown_connections 2024-02-02T11:49:01.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f9853fff640 1 -- 172.21.15.161:0/1761646426 <== osd.6 v2:172.21.15.162:6800/27910 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f986c14aa50 con 0x7f986c0bfbe0 2024-02-02T11:49:01.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7faeb9ffb640 1 -- 172.21.15.161:0/3122590778 <== osd.5 v2:172.21.15.162:6824/27913 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faec8066040 con 0x7faeac06dd80 2024-02-02T11:49:01.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7fb0127fc640 1 -- 172.21.15.161:0/2102430153 >> 172.21.15.161:0/2102430153 conn(0x7fb02c0b8770 msgr2=0x7fb02c0bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f0d34931640 1 -- 172.21.15.161:0/1338477897 wait complete. 2024-02-02T11:49:01.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7fb0127fc640 1 -- 172.21.15.161:0/2102430153 shutdown_connections 2024-02-02T11:49:01.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7fb0127fc640 1 -- 172.21.15.161:0/2102430153 wait complete. 2024-02-02T11:49:01.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f9870fc7640 1 -- 172.21.15.161:0/1761646426 >> [v2:172.21.15.162:6800/27910,v1:172.21.15.162:6801/27910] conn(0x7f986c0bfbe0 msgr2=0x7f986c0a59f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f9870fc7640 1 --2- 172.21.15.161:0/1761646426 >> [v2:172.21.15.162:6800/27910,v1:172.21.15.162:6801/27910] conn(0x7f986c0bfbe0 0x7f986c0a59f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7faece0db640 1 -- 172.21.15.161:0/3122590778 >> [v2:172.21.15.162:6824/27913,v1:172.21.15.162:6825/27913] conn(0x7faeac06dd80 msgr2=0x7faeac0701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7faece0db640 1 --2- 172.21.15.161:0/3122590778 >> [v2:172.21.15.162:6824/27913,v1:172.21.15.162:6825/27913] conn(0x7faeac06dd80 0x7faeac0701a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f9870fc7640 1 -- 172.21.15.161:0/1761646426 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9858065a60 msgr2=0x7f9858067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f9870fc7640 1 --2- 172.21.15.161:0/1761646426 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9858065a60 0x7f9858067f20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f98640b1000 tx=0x7f98640aa000 comp rx=0 tx=0).stop 2024-02-02T11:49:01.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f9870fc7640 1 -- 172.21.15.161:0/1761646426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c0b9d00 msgr2=0x7f986c1d7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f9870fc7640 1 --2- 172.21.15.161:0/1761646426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c0b9d00 0x7f986c1d7810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f986000c4d0 tx=0x7f986000c990 comp rx=0 tx=0).stop 2024-02-02T11:49:01.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f986bfff640 1 -- 172.21.15.161:0/1761646426 reap_dead start 2024-02-02T11:49:01.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7faece0db640 1 -- 172.21.15.161:0/3122590778 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7faeac065b60 msgr2=0x7faeac068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7faece0db640 1 --2- 172.21.15.161:0/3122590778 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7faeac065b60 0x7faeac068020 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faec40012f0 tx=0x7faec4001740 comp rx=0 tx=0).stop 2024-02-02T11:49:01.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f9870fc7640 1 -- 172.21.15.161:0/1761646426 shutdown_connections 2024-02-02T11:49:01.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7f9870fc7640 1 -- 172.21.15.161:0/1761646426 >> 172.21.15.161:0/1761646426 conn(0x7f986c0bcc60 msgr2=0x7f986c0b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.443+0000 7faece0db640 1 -- 172.21.15.161:0/3122590778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faec00cd460 msgr2=0x7faec00c7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.447+0000 7faece0db640 1 --2- 172.21.15.161:0/3122590778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faec00cd460 0x7faec00c7ad0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faebc00e820 tx=0x7faebc00ece0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.447+0000 7f9870fc7640 1 -- 172.21.15.161:0/1761646426 shutdown_connections 2024-02-02T11:49:01.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.447+0000 7f9870fc7640 1 -- 172.21.15.161:0/1761646426 wait complete. 2024-02-02T11:49:01.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.447+0000 7faecd8da640 1 -- 172.21.15.161:0/3122590778 reap_dead start 2024-02-02T11:49:01.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.447+0000 7faece0db640 1 -- 172.21.15.161:0/3122590778 shutdown_connections 2024-02-02T11:49:01.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.447+0000 7faece0db640 1 -- 172.21.15.161:0/3122590778 >> 172.21.15.161:0/3122590778 conn(0x7faec003ef80 msgr2=0x7faec0037740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.447+0000 7faece0db640 1 -- 172.21.15.161:0/3122590778 shutdown_connections 2024-02-02T11:49:01.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.447+0000 7faece0db640 1 -- 172.21.15.161:0/3122590778 wait complete. 2024-02-02T11:49:01.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.447+0000 7f1451cd1640 1 -- 172.21.15.161:0/1286535521 --> [v2:172.21.15.161:6816/27683,v1:172.21.15.161:6817/27683] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f144c147970 con 0x7f143806dd50 2024-02-02T11:49:01.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.451+0000 7f1433fff640 1 -- 172.21.15.161:0/1286535521 <== osd.2 v2:172.21.15.161:6816/27683 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f143c00b840 con 0x7f143806dd50 2024-02-02T11:49:01.503 INFO:teuthology.orchestra.run.smithi161.stdout:55834574855 2024-02-02T11:49:01.503 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-02T11:49:01.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.451+0000 7f1451cd1640 1 -- 172.21.15.161:0/1286535521 >> [v2:172.21.15.161:6816/27683,v1:172.21.15.161:6817/27683] conn(0x7f143806dd50 msgr2=0x7f1438070170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.451+0000 7f1451cd1640 1 --2- 172.21.15.161:0/1286535521 >> [v2:172.21.15.161:6816/27683,v1:172.21.15.161:6817/27683] conn(0x7f143806dd50 0x7f1438070170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.451+0000 7f1451cd1640 1 -- 172.21.15.161:0/1286535521 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1438065b30 msgr2=0x7f1438067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.451+0000 7f1451cd1640 1 --2- 172.21.15.161:0/1286535521 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1438065b30 0x7f1438067ff0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f144000a8d0 tx=0x7f1440008040 comp rx=0 tx=0).stop 2024-02-02T11:49:01.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.451+0000 7f1451cd1640 1 -- 172.21.15.161:0/1286535521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f144c146fe0 msgr2=0x7f144c0b62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.451+0000 7f1451cd1640 1 --2- 172.21.15.161:0/1286535521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f144c146fe0 0x7f144c0b62e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f14440ae000 tx=0x7f144401c0b0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.451+0000 7f144bfff640 1 -- 172.21.15.161:0/1286535521 reap_dead start 2024-02-02T11:49:01.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.451+0000 7f1451cd1640 1 -- 172.21.15.161:0/1286535521 shutdown_connections 2024-02-02T11:49:01.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.451+0000 7f1451cd1640 1 -- 172.21.15.161:0/1286535521 >> 172.21.15.161:0/1286535521 conn(0x7f144c0bbd20 msgr2=0x7f144c0a0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.451+0000 7f1451cd1640 1 -- 172.21.15.161:0/1286535521 shutdown_connections 2024-02-02T11:49:01.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.451+0000 7f1451cd1640 1 -- 172.21.15.161:0/1286535521 wait complete. 2024-02-02T11:49:01.505 INFO:teuthology.orchestra.run.smithi161.stdout:55834574856 2024-02-02T11:49:01.506 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-02T11:49:01.506 INFO:teuthology.orchestra.run.smithi161.stdout:55834574857 2024-02-02T11:49:01.507 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-02T11:49:01.507 INFO:teuthology.orchestra.run.smithi161.stdout:55834574856 2024-02-02T11:49:01.507 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-02T11:49:01.508 INFO:teuthology.orchestra.run.smithi161.stdout:55834574856 2024-02-02T11:49:01.509 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-02T11:49:01.509 INFO:teuthology.orchestra.run.smithi161.stdout:55834574856 2024-02-02T11:49:01.510 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-02T11:49:01.510 INFO:teuthology.orchestra.run.smithi161.stdout:55834574855 2024-02-02T11:49:01.511 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-02T11:49:01.512 INFO:teuthology.orchestra.run.smithi161.stdout:55834574855 2024-02-02T11:49:01.513 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-02T11:49:01.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.715+0000 7f367a6a2640 1 Processor -- start 2024-02-02T11:49:01.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.715+0000 7f367a6a2640 1 -- start start 2024-02-02T11:49:01.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.715+0000 7f367a6a2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f36740b2960 0x7f367406be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.715+0000 7f367a6a2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f367414a350 0x7f3674151240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.715+0000 7f367a6a2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367406ed20 con 0x7f3674149f10 2024-02-02T11:49:01.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.715+0000 7f367a6a2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367406c540 con 0x7f367414a350 2024-02-02T11:49:01.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.715+0000 7f367a6a2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36740b77b0 con 0x7f36740b2960 2024-02-02T11:49:01.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.715+0000 7f3679ea1640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f367414a350 0x7f3674151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.715+0000 7f3679ea1640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f367414a350 0x7f3674151240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36766/0 (socket says 172.21.15.161:36766) 2024-02-02T11:49:01.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.715+0000 7f3679ea1640 1 -- 172.21.15.161:0/2101262498 learned_addr learned my addr 172.21.15.161:0/2101262498 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.715+0000 7f36796a0640 1 --2- 172.21.15.161:0/2101262498 >> v2:172.21.15.162:3300/0 conn(0x7f36740b2960 0x7f367406be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.715+0000 7f3679ea1640 1 -- 172.21.15.161:0/2101262498 >> v2:172.21.15.162:3300/0 conn(0x7f36740b2960 msgr2=0x7f367406be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:01.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.715+0000 7f3679ea1640 1 --2- 172.21.15.161:0/2101262498 >> v2:172.21.15.162:3300/0 conn(0x7f36740b2960 0x7f367406be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.715+0000 7f3679ea1640 1 -- 172.21.15.161:0/2101262498 >> v1:172.21.15.162:6789/0 conn(0x7f3674149f10 legacy=0x7f3674147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.715+0000 7f3679ea1640 1 -- 172.21.15.161:0/2101262498 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36740b7a90 con 0x7f367414a350 2024-02-02T11:49:01.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.715+0000 7f2876446640 1 Processor -- start 2024-02-02T11:49:01.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.715+0000 7f2876446640 1 -- start start 2024-02-02T11:49:01.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.715+0000 7f366bd66640 1 Processor -- start 2024-02-02T11:49:01.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f366bd66640 1 -- start start 2024-02-02T11:49:01.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f0870dc1640 1 Processor -- start 2024-02-02T11:49:01.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f0870dc1640 1 -- start start 2024-02-02T11:49:01.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7fb28b59e640 1 Processor -- start 2024-02-02T11:49:01.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7fb28b59e640 1 -- start start 2024-02-02T11:49:01.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f2876446640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f28700b7950 0x7f28700b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f2876446640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2870146fe0 0x7f2870147430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f2876446640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287006c340 con 0x7f28700b7d30 2024-02-02T11:49:01.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f366bd66640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f36640b7950 0x7f36640b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f366bd66640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366406c340 con 0x7f36640b7d30 2024-02-02T11:49:01.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f366bd66640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366414a650 con 0x7f3664146fe0 2024-02-02T11:49:01.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f2876446640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28700b81a0 con 0x7f28700b7950 2024-02-02T11:49:01.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f366bd66640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36640b81a0 con 0x7f36640b7950 2024-02-02T11:49:01.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f2876446640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287006c7d0 con 0x7f2870146fe0 2024-02-02T11:49:01.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f0870dc1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f086c14bd20 0x7f086c14b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f3669b02640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f36640b7950 0x7f36640b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f3669b02640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f36640b7950 0x7f36640b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.161:35886/0 (socket says 172.21.15.161:35886) 2024-02-02T11:49:01.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f3669b02640 1 -- 172.21.15.161:0/814351736 learned_addr learned my addr 172.21.15.161:0/814351736 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f286f7fe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f28700b7d30 0x7f2870149f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.161:57514/0 (socket says 172.21.15.161:57514) 2024-02-02T11:49:01.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f286f7fe640 1 -- 172.21.15.161:0/1439151154 learned_addr learned my addr 172.21.15.161:0/1439151154 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:01.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7fb28b59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb28c1447e0 0x7fb28c06b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7fb28b59e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb28c14a8a0 0x7fb28c14ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f28749e3640 1 --2- 172.21.15.161:0/1439151154 >> v2:172.21.15.162:3300/0 conn(0x7f2870146fe0 0x7f2870147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7fb28b59e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb28c14b290 con 0x7fb28c14dd40 2024-02-02T11:49:01.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7fb28b59e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb28c0be4e0 con 0x7fb28c1447e0 2024-02-02T11:49:01.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7fb28b59e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb28c14e1d0 con 0x7fb28c14a8a0 2024-02-02T11:49:01.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f086bfff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f086c06b3b0 0x7f086c0b7680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.161:57530/0 (socket says 172.21.15.161:57530) 2024-02-02T11:49:01.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f086bfff640 1 -- 172.21.15.161:0/1044400524 learned_addr learned my addr 172.21.15.161:0/1044400524 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:01.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f286ffff640 1 --2- 172.21.15.161:0/1439151154 >> v2:172.21.15.161:3300/0 conn(0x7f28700b7950 0x7f28700b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f086affd640 1 --2- 172.21.15.161:0/1044400524 >> v2:172.21.15.162:3300/0 conn(0x7f086c14bd20 0x7f086c14b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7fb28ad9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb28c14a8a0 0x7fb28c14ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7fb289d9b640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fb28c14dd40 0x7fb28c0bddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.161:57532/0 (socket says 172.21.15.161:57532) 2024-02-02T11:49:01.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7fb289d9b640 1 -- 172.21.15.161:0/2490581882 learned_addr learned my addr 172.21.15.161:0/2490581882 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:01.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7fb28ad9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb28c14a8a0 0x7fb28c14ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.161:35914/0 (socket says 172.21.15.161:35914) 2024-02-02T11:49:01.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f0870dc1640 1 -- 172.21.15.161:0/1044400524 --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c14a8d0 con 0x7f086c144b40 2024-02-02T11:49:01.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f7f6ad20640 1 Processor -- start 2024-02-02T11:49:01.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f3aab271640 1 Processor -- start 2024-02-02T11:49:01.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f0870dc1640 1 -- 172.21.15.161:0/1044400524 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c0b7d90 con 0x7f086c06b3b0 2024-02-02T11:49:01.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f0870dc1640 1 -- 172.21.15.161:0/1044400524 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c14af30 con 0x7f086c14bd20 2024-02-02T11:49:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f3aab271640 1 -- start start 2024-02-02T11:49:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f286effd640 1 -- 172.21.15.161:0/1439151154 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829797103 0 0) 0x7f287006c340 con 0x7f28700b7d30 2024-02-02T11:49:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f286effd640 1 -- 172.21.15.161:0/1439151154 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2858003530 con 0x7f28700b7d30 2024-02-02T11:49:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f086a7fc640 1 -- 172.21.15.161:0/1044400524 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846714286 0 0) 0x7f086c14a8d0 con 0x7f086c144b40 2024-02-02T11:49:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f086a7fc640 1 -- 172.21.15.161:0/1044400524 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0854003530 con 0x7f086c144b40 2024-02-02T11:49:01.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7fb28ad9d640 1 -- 172.21.15.161:0/2490581882 >> v2:172.21.15.161:3300/0 conn(0x7fb28c1447e0 msgr2=0x7fb28c06b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:01.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7fb28ad9d640 1 --2- 172.21.15.161:0/2490581882 >> v2:172.21.15.161:3300/0 conn(0x7fb28c1447e0 0x7fb28c06b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7fb28ad9d640 1 -- 172.21.15.161:0/2490581882 >> v1:172.21.15.162:6789/0 conn(0x7fb28c14dd40 legacy=0x7fb28c0bddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:01.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7fb28ad9d640 1 -- 172.21.15.161:0/2490581882 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c14e4b0 con 0x7fb28c14a8a0 2024-02-02T11:49:01.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f086a7fc640 1 -- 172.21.15.161:0/1044400524 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657587947 0 0) 0x7f086c0b7d90 con 0x7f086c06b3b0 2024-02-02T11:49:01.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f086a7fc640 1 -- 172.21.15.161:0/1044400524 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f086c14a8d0 con 0x7f086c06b3b0 2024-02-02T11:49:01.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f286effd640 1 -- 172.21.15.161:0/1439151154 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1777260989 0 0) 0x7f2858003530 con 0x7f28700b7d30 2024-02-02T11:49:01.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f286ffff640 1 -- 172.21.15.161:0/1439151154 >> v2:172.21.15.162:3300/0 conn(0x7f2870146fe0 msgr2=0x7f2870147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:01.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f286ffff640 1 --2- 172.21.15.161:0/1439151154 >> v2:172.21.15.162:3300/0 conn(0x7f2870146fe0 0x7f2870147430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f286ffff640 1 -- 172.21.15.161:0/1439151154 >> v1:172.21.15.162:6789/0 conn(0x7f28700b7d30 legacy=0x7f2870149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f286ffff640 1 -- 172.21.15.161:0/1439151154 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287014a650 con 0x7f28700b7950 2024-02-02T11:49:01.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f7f6ad20640 1 -- start start 2024-02-02T11:49:01.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f7f6ad20640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f5c007150 0x7f7f5c03a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f7f6ad20640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7f5c03e9e0 0x7f7f5c0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f7f6ad20640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5c03a940 con 0x7f7f5c0397f0 2024-02-02T11:49:01.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f7f6ad20640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5c03ae50 con 0x7f7f5c03e9e0 2024-02-02T11:49:01.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f7f6ad20640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c03bf80 con 0x7f7f5c007150 2024-02-02T11:49:01.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f3aab271640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3aa4069fd0 0x7f3aa414ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f3aab271640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3aa40b6c20 0x7f3aa4070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f3aab271640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa40704e0 con 0x7f3aa406bc20 2024-02-02T11:49:01.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f3aab271640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa40707c0 con 0x7f3aa4069fd0 2024-02-02T11:49:01.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f3aab271640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa406b590 con 0x7f3aa40b6c20 2024-02-02T11:49:01.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f3679ea1640 1 --2- 172.21.15.161:0/2101262498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f367414a350 0x7f3674151240 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f367406d6f0 tx=0x7f367001e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdaf12b16b301229 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f3aa980e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3aa40b6c20 0x7f3aa4070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f086a7fc640 1 -- 172.21.15.161:0/1044400524 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 105107211 0 0) 0x7f086c14a8d0 con 0x7f086c06b3b0 2024-02-02T11:49:01.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f086a7fc640 1 -- 172.21.15.161:0/1044400524 >> v2:172.21.15.162:3300/0 conn(0x7f086c14bd20 msgr2=0x7f086c14b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:01.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f086a7fc640 1 --2- 172.21.15.161:0/1044400524 >> v2:172.21.15.162:3300/0 conn(0x7f086c14bd20 0x7f086c14b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f086a7fc640 1 -- 172.21.15.161:0/1044400524 >> v1:172.21.15.161:6789/0 conn(0x7f086c144b40 legacy=0x7f086c06bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f3aa980e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3aa40b6c20 0x7f3aa4070c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.161:35922/0 (socket says 172.21.15.161:35922) 2024-02-02T11:49:01.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f3aa980e640 1 -- 172.21.15.161:0/4018993309 learned_addr learned my addr 172.21.15.161:0/4018993309 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f086a7fc640 1 -- 172.21.15.161:0/1044400524 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c06c260 con 0x7f086c06b3b0 2024-02-02T11:49:01.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f7f69d1e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f5c007150 0x7f7f5c03a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f086a7fc640 1 -- 172.21.15.161:0/1044400524 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f0864001a00 con 0x7f086c06b3b0 2024-02-02T11:49:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f086a7fc640 1 -- 172.21.15.161:0/1044400524 >> v1:172.21.15.162:6789/0 conn(0x7f086c06b3b0 legacy=0x7f086c0b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f086a7fc640 1 --2- 172.21.15.161:0/1044400524 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0854003b60 0x7f0854003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f7f69d1e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f5c007150 0x7f7f5c03a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.161:47932/0 (socket says 172.21.15.161:47932) 2024-02-02T11:49:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f086a7fc640 1 --2- 172.21.15.161:0/1044400524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08540047d0 0x7f0854004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f086a7fc640 1 --2- 172.21.15.161:0/1044400524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08540053e0 0x7f085400ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f7f69d1e640 1 -- 172.21.15.161:0/1833566440 learned_addr learned my addr 172.21.15.161:0/1833566440 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f086a7fc640 1 -- 172.21.15.161:0/1044400524 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c14af30 con 0x7f08540047d0 2024-02-02T11:49:01.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f086a7fc640 1 -- 172.21.15.161:0/1044400524 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085400c320 con 0x7f08540053e0 2024-02-02T11:49:01.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f086a7fc640 1 -- 172.21.15.161:0/1044400524 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085400c4e0 con 0x7f0854003b60 2024-02-02T11:49:01.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f3669b02640 1 -- 172.21.15.161:0/814351736 >> v1:172.21.15.162:6789/0 conn(0x7f3664146fe0 legacy=0x7f3664147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:01.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f3669b02640 1 -- 172.21.15.161:0/814351736 >> v1:172.21.15.161:6789/0 conn(0x7f36640b7d30 legacy=0x7f3664149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.719+0000 7f3669b02640 1 -- 172.21.15.161:0/814351736 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366406bcf0 con 0x7f36640b7950 2024-02-02T11:49:01.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f086affd640 1 --2- 172.21.15.161:0/1044400524 >> v2:172.21.15.162:3300/0 conn(0x7f086c14bd20 0x7f086c14b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:01.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f086affd640 1 --2- 172.21.15.161:0/1044400524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08540047d0 0x7f0854004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f086bfff640 1 --2- 172.21.15.161:0/1044400524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08540053e0 0x7f085400ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f7f69d1e640 1 -- 172.21.15.161:0/1833566440 >> v2:172.21.15.162:3300/0 conn(0x7f7f5c03e9e0 msgr2=0x7f7f5c0cf0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-02T11:49:01.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f7f69d1e640 1 --2- 172.21.15.161:0/1833566440 >> v2:172.21.15.162:3300/0 conn(0x7f7f5c03e9e0 0x7f7f5c0cf0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f7f69d1e640 1 -- 172.21.15.161:0/1833566440 >> v1:172.21.15.162:6789/0 conn(0x7f7f5c0397f0 legacy=0x7f7f5c0d8a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-02T11:49:01.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f7f69d1e640 1 -- 172.21.15.161:0/1833566440 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c03ab70 con 0x7f7f5c007150 2024-02-02T11:49:01.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f8a53d8e640 1 Processor -- start 2024-02-02T11:49:01.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f3669b02640 1 --2- 172.21.15.161:0/814351736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36640b7950 0x7f36640b2810 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3660008870 tx=0x7f3660021220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3106d40daa7ce9fd server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f8a53d8e640 1 -- start start 2024-02-02T11:49:01.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f286ffff640 1 --2- 172.21.15.161:0/1439151154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28700b7950 0x7f28700b2810 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f287006c2b0 tx=0x7f286801f020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c8171e77abf879 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f8a53d8e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8a4c142c30 0x7f8a4c0ba2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f8a53d8e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a4c0b5470 0x7f8a4c148b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f8a53d8e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4c071740 con 0x7f8a4c0b58d0 2024-02-02T11:49:01.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f8a53d8e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4c143010 con 0x7f8a4c142c30 2024-02-02T11:49:01.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f8a53d8e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c070e10 con 0x7f8a4c0b5470 2024-02-02T11:49:01.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f286effd640 1 -- 172.21.15.161:0/1439151154 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860001680 con 0x7f28700b7950 2024-02-02T11:49:01.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f286effd640 1 -- 172.21.15.161:0/1439151154 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28680a8bf0 con 0x7f28700b7950 2024-02-02T11:49:01.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f286effd640 1 -- 172.21.15.161:0/1439151154 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28680b0440 con 0x7f28700b7950 2024-02-02T11:49:01.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f3668b00640 1 -- 172.21.15.161:0/814351736 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36600b3410 con 0x7f36640b7950 2024-02-02T11:49:01.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f3668b00640 1 -- 172.21.15.161:0/814351736 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36600ad030 con 0x7f36640b7950 2024-02-02T11:49:01.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f3668b00640 1 -- 172.21.15.161:0/814351736 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36600b3790 con 0x7f36640b7950 2024-02-02T11:49:01.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f366bd66640 1 -- 172.21.15.161:0/814351736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36640b7950 msgr2=0x7f36640b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f366bd66640 1 --2- 172.21.15.161:0/814351736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36640b7950 0x7f36640b2810 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3660008870 tx=0x7f3660021220 comp rx=0 tx=0).stop 2024-02-02T11:49:01.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f086bfff640 1 -- 172.21.15.161:0/1044400524 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0854003b60 msgr2=0x7f0854003f60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-02T11:49:01.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f086bfff640 1 --2- 172.21.15.161:0/1044400524 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0854003b60 0x7f0854003f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f086bfff640 1 -- 172.21.15.161:0/1044400524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08540047d0 msgr2=0x7f0854004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:01.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f086bfff640 1 --2- 172.21.15.161:0/1044400524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08540047d0 0x7f0854004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f086bfff640 1 -- 172.21.15.161:0/1044400524 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c14a8d0 con 0x7f08540053e0 2024-02-02T11:49:01.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f086affd640 1 --2- 172.21.15.161:0/1044400524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08540047d0 0x7f0854004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:49:01.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7fb28ad9d640 1 --2- 172.21.15.161:0/2490581882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb28c14a8a0 0x7fb28c14ad50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb2800097c0 tx=0x7fb28001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3df3228d52f7ed4 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7fb28959a640 1 -- 172.21.15.161:0/2490581882 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2800ac630 con 0x7fb28c14a8a0 2024-02-02T11:49:01.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7fb28959a640 1 -- 172.21.15.161:0/2490581882 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2800ac790 con 0x7fb28c14a8a0 2024-02-02T11:49:01.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f8a51b2a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8a4c142c30 0x7f8a4c0ba2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f8a5232b640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f8a4c0b58d0 0x7f8a4c14be50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.161:57554/0 (socket says 172.21.15.161:57554) 2024-02-02T11:49:01.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f8a5232b640 1 -- 172.21.15.161:0/924221931 learned_addr learned my addr 172.21.15.161:0/924221931 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:01.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f366bd66640 1 -- 172.21.15.161:0/814351736 shutdown_connections 2024-02-02T11:49:01.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f366bd66640 1 --2- 172.21.15.161:0/814351736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36640b7950 0x7f36640b2810 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f366bd66640 1 -- 172.21.15.161:0/814351736 >> 172.21.15.161:0/814351736 conn(0x7f36640bbd20 msgr2=0x7f36640bc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7fb28b59e640 1 -- 172.21.15.161:0/2490581882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb28c14a8a0 msgr2=0x7fb28c14ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7fb28b59e640 1 --2- 172.21.15.161:0/2490581882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb28c14a8a0 0x7fb28c14ad50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb2800097c0 tx=0x7fb28001c3f0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f366bd66640 1 -- 172.21.15.161:0/814351736 shutdown_connections 2024-02-02T11:49:01.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7fb28b59e640 1 -- 172.21.15.161:0/2490581882 shutdown_connections 2024-02-02T11:49:01.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7fb28b59e640 1 --2- 172.21.15.161:0/2490581882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb28c14a8a0 0x7fb28c14ad50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7fb28b59e640 1 --2- 172.21.15.161:0/2490581882 >> v2:172.21.15.161:3300/0 conn(0x7fb28c1447e0 0x7fb28c06b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7fb28b59e640 1 -- 172.21.15.161:0/2490581882 >> 172.21.15.161:0/2490581882 conn(0x7fb28c06e860 msgr2=0x7fb28c06ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f2876446640 1 -- 172.21.15.161:0/1439151154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28700b7950 msgr2=0x7f28700b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f2876446640 1 --2- 172.21.15.161:0/1439151154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28700b7950 0x7f28700b2810 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f287006c2b0 tx=0x7f286801f020 comp rx=0 tx=0).stop 2024-02-02T11:49:01.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f8a50b28640 1 -- 172.21.15.161:0/924221931 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097425850 0 0) 0x7f8a4c071740 con 0x7f8a4c0b58d0 2024-02-02T11:49:01.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f8a50b28640 1 -- 172.21.15.161:0/924221931 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a38003530 con 0x7f8a4c0b58d0 2024-02-02T11:49:01.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f3aa980e640 1 -- 172.21.15.161:0/4018993309 >> v2:172.21.15.161:3300/0 conn(0x7f3aa4069fd0 msgr2=0x7f3aa414ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:01.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f3aa980e640 1 --2- 172.21.15.161:0/4018993309 >> v2:172.21.15.161:3300/0 conn(0x7f3aa4069fd0 0x7f3aa414ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f3aa980e640 1 -- 172.21.15.161:0/4018993309 >> v1:172.21.15.161:6789/0 conn(0x7f3aa406bc20 legacy=0x7f3aa40b6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f3aa980e640 1 -- 172.21.15.161:0/4018993309 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa414b300 con 0x7f3aa40b6c20 2024-02-02T11:49:01.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f366bd66640 1 -- 172.21.15.161:0/814351736 wait complete. 2024-02-02T11:49:01.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7fb28b59e640 1 -- 172.21.15.161:0/2490581882 shutdown_connections 2024-02-02T11:49:01.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f2876446640 1 -- 172.21.15.161:0/1439151154 shutdown_connections 2024-02-02T11:49:01.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f2876446640 1 --2- 172.21.15.161:0/1439151154 >> v2:172.21.15.162:3300/0 conn(0x7f2870146fe0 0x7f2870147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f2876446640 1 --2- 172.21.15.161:0/1439151154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28700b7950 0x7f28700b2810 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f2876446640 1 -- 172.21.15.161:0/1439151154 >> 172.21.15.161:0/1439151154 conn(0x7f28700bbd20 msgr2=0x7f28700bc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7fb28b59e640 1 -- 172.21.15.161:0/2490581882 wait complete. 2024-02-02T11:49:01.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f2876446640 1 -- 172.21.15.161:0/1439151154 shutdown_connections 2024-02-02T11:49:01.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f366bfff640 1 -- 172.21.15.161:0/2101262498 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36700a7a00 con 0x7f367414a350 2024-02-02T11:49:01.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f366bfff640 1 -- 172.21.15.161:0/2101262498 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36700ab070 con 0x7f367414a350 2024-02-02T11:49:01.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f366bfff640 1 -- 172.21.15.161:0/2101262498 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36700a7d80 con 0x7f367414a350 2024-02-02T11:49:01.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f086bfff640 1 -- 172.21.15.161:0/1044400524 reap_dead start 2024-02-02T11:49:01.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f3aa980e640 1 --2- 172.21.15.161:0/4018993309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3aa40b6c20 0x7f3aa4070c50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3aa406b490 tx=0x7f3a9c01ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a23be4c98b82eca server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f2876446640 1 -- 172.21.15.161:0/1439151154 wait complete. 2024-02-02T11:49:01.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f8a51b2a640 1 -- 172.21.15.161:0/924221931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a4c0b5470 msgr2=0x7f8a4c148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:01.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3a9bfff640 1 -- 172.21.15.161:0/4018993309 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c0a5790 con 0x7f3aa40b6c20 2024-02-02T11:49:01.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f086bfff640 1 --2- 172.21.15.161:0/1044400524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08540053e0 0x7f085400ba40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f086400a6f0 tx=0x7f086401d200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbbc6c1a2fcb9cec server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f086a7fc640 1 -- 172.21.15.161:0/1044400524 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640ad410 con 0x7f08540053e0 2024-02-02T11:49:01.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f086a7fc640 1 -- 172.21.15.161:0/1044400524 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08640ad5b0 con 0x7f08540053e0 2024-02-02T11:49:01.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f086a7fc640 1 -- 172.21.15.161:0/1044400524 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640ad960 con 0x7f08540053e0 2024-02-02T11:49:01.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f367a6a2640 1 -- 172.21.15.161:0/2101262498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f367414a350 msgr2=0x7f3674151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f367a6a2640 1 --2- 172.21.15.161:0/2101262498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f367414a350 0x7f3674151240 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f367406d6f0 tx=0x7f367001e950 comp rx=0 tx=0).stop 2024-02-02T11:49:01.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f367a6a2640 1 -- 172.21.15.161:0/2101262498 shutdown_connections 2024-02-02T11:49:01.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f367a6a2640 1 --2- 172.21.15.161:0/2101262498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f367414a350 0x7f3674151240 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f367a6a2640 1 --2- 172.21.15.161:0/2101262498 >> v2:172.21.15.162:3300/0 conn(0x7f36740b2960 0x7f367406be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f367a6a2640 1 -- 172.21.15.161:0/2101262498 >> 172.21.15.161:0/2101262498 conn(0x7f36740b8770 msgr2=0x7f36740b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3a9bfff640 1 -- 172.21.15.161:0/4018993309 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9c0a58f0 con 0x7f3aa40b6c20 2024-02-02T11:49:01.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3a9bfff640 1 -- 172.21.15.161:0/4018993309 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c0a5cc0 con 0x7f3aa40b6c20 2024-02-02T11:49:01.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f366bd66640 1 Processor -- start 2024-02-02T11:49:01.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3aab271640 1 -- 172.21.15.161:0/4018993309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3aa40b6c20 msgr2=0x7f3aa4070c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3aab271640 1 --2- 172.21.15.161:0/4018993309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3aa40b6c20 0x7f3aa4070c50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3aa406b490 tx=0x7f3a9c01ca10 comp rx=0 tx=0).stop 2024-02-02T11:49:01.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f2876446640 1 Processor -- start 2024-02-02T11:49:01.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3aab271640 1 -- 172.21.15.161:0/4018993309 shutdown_connections 2024-02-02T11:49:01.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3aab271640 1 --2- 172.21.15.161:0/4018993309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3aa40b6c20 0x7f3aa4070c50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3aab271640 1 --2- 172.21.15.161:0/4018993309 >> v2:172.21.15.161:3300/0 conn(0x7f3aa4069fd0 0x7f3aa414ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3aab271640 1 -- 172.21.15.161:0/4018993309 >> 172.21.15.161:0/4018993309 conn(0x7f3aa40bd0b0 msgr2=0x7f3aa40bd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f367a6a2640 1 -- 172.21.15.161:0/2101262498 shutdown_connections 2024-02-02T11:49:01.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7fb28b59e640 1 Processor -- start 2024-02-02T11:49:01.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3aab271640 1 -- 172.21.15.161:0/4018993309 shutdown_connections 2024-02-02T11:49:01.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7fb28b59e640 1 -- start start 2024-02-02T11:49:01.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f0870dc1640 1 -- 172.21.15.161:0/1044400524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08540053e0 msgr2=0x7f085400ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f0870dc1640 1 --2- 172.21.15.161:0/1044400524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08540053e0 0x7f085400ba40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f086400a6f0 tx=0x7f086401d200 comp rx=0 tx=0).stop 2024-02-02T11:49:01.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f0870dc1640 1 -- 172.21.15.161:0/1044400524 shutdown_connections 2024-02-02T11:49:01.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f0870dc1640 1 --2- 172.21.15.161:0/1044400524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08540053e0 0x7f085400ba40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f0870dc1640 1 -- 172.21.15.161:0/1044400524 >> 172.21.15.161:0/1044400524 conn(0x7f086c0b8770 msgr2=0x7f086c0b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7fb28b59e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb28c1447e0 0x7fb28c140300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7fb28b59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb28c14a8a0 0x7fb28c0b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f2876446640 1 -- start start 2024-02-02T11:49:01.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f2876446640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28700b7950 0x7f28701251a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f2876446640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28700b7d30 0x7f2870124220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f2876446640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2870146fe0 0x7f2870125850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f2876446640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2870124760 con 0x7f2870146fe0 2024-02-02T11:49:01.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f2876446640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28701efba0 con 0x7f28700b7950 2024-02-02T11:49:01.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7fb28b59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb28c0b59c0 0x7fb28c0b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f2876446640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28701efe80 con 0x7f28700b7d30 2024-02-02T11:49:01.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f286f7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28700b7d30 0x7f2870124220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f286f7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28700b7d30 0x7f2870124220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.161:47956/0 (socket says 172.21.15.161:47956) 2024-02-02T11:49:01.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f286f7fe640 1 -- 172.21.15.161:0/1776075006 learned_addr learned my addr 172.21.15.161:0/1776075006 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7fb28b59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c0b6dd0 con 0x7fb28c0b59c0 2024-02-02T11:49:01.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7fb28b59e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c140840 con 0x7fb28c14a8a0 2024-02-02T11:49:01.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7fb28b59e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c0b6390 con 0x7fb28c1447e0 2024-02-02T11:49:01.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3aab271640 1 -- 172.21.15.161:0/4018993309 wait complete. 2024-02-02T11:49:01.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3aab271640 1 Processor -- start 2024-02-02T11:49:01.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f366bd66640 1 -- start start 2024-02-02T11:49:01.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f366bd66640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36640b7950 0x7f36641453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f366bd66640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36640b7d30 0x7f36640b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f366bd66640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3664146fe0 0x7f36641442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f366bd66640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3664145930 con 0x7f3664146fe0 2024-02-02T11:49:01.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f366bd66640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3664142100 con 0x7f36640b7d30 2024-02-02T11:49:01.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f366bd66640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36640b4dc0 con 0x7f36640b7950 2024-02-02T11:49:01.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f367a6a2640 1 -- 172.21.15.161:0/2101262498 wait complete. 2024-02-02T11:49:01.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f367a6a2640 1 Processor -- start 2024-02-02T11:49:01.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f28749e3640 1 --2- 172.21.15.161:0/1776075006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2870146fe0 0x7f2870125850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f286ffff640 1 --2- 172.21.15.161:0/1776075006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28700b7950 0x7f28701251a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7fb289d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb28c14a8a0 0x7fb28c0b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7fb289d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb28c14a8a0 0x7fb28c0b7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.161:35956/0 (socket says 172.21.15.161:35956) 2024-02-02T11:49:01.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7fb289d9b640 1 -- 172.21.15.161:0/2292744591 learned_addr learned my addr 172.21.15.161:0/2292744591 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7fb28a59c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb28c1447e0 0x7fb28c140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f7f69d1e640 1 --2- 172.21.15.161:0/1833566440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f5c007150 0x7f7f5c03a400 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7f54009870 tx=0x7f7f5401c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dede4f262eeb323 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7fb28ad9d640 1 --2- 172.21.15.161:0/2292744591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb28c0b59c0 0x7fb28c0b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3669301640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36640b7d30 0x7f36640b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3669301640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36640b7d30 0x7f36640b30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.161:35954/0 (socket says 172.21.15.161:35954) 2024-02-02T11:49:01.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3669301640 1 -- 172.21.15.161:0/653503806 learned_addr learned my addr 172.21.15.161:0/653503806 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f366a303640 1 --2- 172.21.15.161:0/653503806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3664146fe0 0x7f36641442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3669b02640 1 --2- 172.21.15.161:0/653503806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36640b7950 0x7f36641453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f8a50b28640 1 -- 172.21.15.161:0/924221931 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3144383661 0 0) 0x7f8a38003530 con 0x7f8a4c0b58d0 2024-02-02T11:49:01.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f7f68d1c640 1 -- 172.21.15.161:0/1833566440 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f540aa5f0 con 0x7f7f5c007150 2024-02-02T11:49:01.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f366a303640 1 -- 172.21.15.161:0/653503806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36640b7950 msgr2=0x7f36641453f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f366a303640 1 --2- 172.21.15.161:0/653503806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36640b7950 0x7f36641453f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f366a303640 1 -- 172.21.15.161:0/653503806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36640b7d30 msgr2=0x7f36640b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f366a303640 1 --2- 172.21.15.161:0/653503806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36640b7d30 0x7f36640b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f366a303640 1 -- 172.21.15.161:0/653503806 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3660008550 con 0x7f3664146fe0 2024-02-02T11:49:01.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f0870dc1640 1 -- 172.21.15.161:0/1044400524 shutdown_connections 2024-02-02T11:49:01.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3aab271640 1 -- start start 2024-02-02T11:49:01.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3aab271640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3aa4069fd0 0x7f3aa41f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f367a6a2640 1 -- start start 2024-02-02T11:49:01.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f367a6a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36740b2960 0x7f36740b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f367a6a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3674149f10 0x7f36741e9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f367a6a2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f367414a350 0x7f36741f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f367a6a2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36740b4b80 con 0x7f367414a350 2024-02-02T11:49:01.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3aab271640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3aa406bc20 0x7f3aa4153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3aab271640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3aa40b6c20 0x7f3aa4154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3aab271640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa414e8d0 con 0x7f3aa4069fd0 2024-02-02T11:49:01.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3aab271640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa414e350 con 0x7f3aa40b6c20 2024-02-02T11:49:01.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3aab271640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa414e5f0 con 0x7f3aa406bc20 2024-02-02T11:49:01.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7fb28ad9d640 1 -- 172.21.15.161:0/2292744591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb28c1447e0 msgr2=0x7fb28c140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7fb28ad9d640 1 --2- 172.21.15.161:0/2292744591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb28c1447e0 0x7fb28c140300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7fb28ad9d640 1 -- 172.21.15.161:0/2292744591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb28c14a8a0 msgr2=0x7fb28c0b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7fb28ad9d640 1 --2- 172.21.15.161:0/2292744591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb28c14a8a0 0x7fb28c0b7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7fb28ad9d640 1 -- 172.21.15.161:0/2292744591 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb280009420 con 0x7fb28c0b59c0 2024-02-02T11:49:01.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f367a6a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36740b5a70 con 0x7f36740b2960 2024-02-02T11:49:01.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f367a6a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3674070c60 con 0x7f3674149f10 2024-02-02T11:49:01.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f286f7fe640 1 -- 172.21.15.161:0/1776075006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28700b7950 msgr2=0x7f28701251a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f286f7fe640 1 --2- 172.21.15.161:0/1776075006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28700b7950 0x7f28701251a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f286f7fe640 1 -- 172.21.15.161:0/1776075006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2870146fe0 msgr2=0x7f2870125850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f286f7fe640 1 --2- 172.21.15.161:0/1776075006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2870146fe0 0x7f2870125850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f286f7fe640 1 -- 172.21.15.161:0/1776075006 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2868009a70 con 0x7f28700b7d30 2024-02-02T11:49:01.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3aa900d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3aa4069fd0 0x7f3aa41f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3aa900d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3aa4069fd0 0x7f3aa41f2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36848/0 (socket says 172.21.15.161:36848) 2024-02-02T11:49:01.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f3aa900d640 1 -- 172.21.15.161:0/2269766905 learned_addr learned my addr 172.21.15.161:0/2269766905 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f366a303640 1 --2- 172.21.15.161:0/653503806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3664146fe0 0x7f36641442b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f365400b3e0 tx=0x7f365400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f286f7fe640 1 --2- 172.21.15.161:0/1776075006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28700b7d30 0x7f2870124220 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f286000c760 tx=0x7f286000cb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f365a7fc640 1 -- 172.21.15.161:0/653503806 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3654011830 con 0x7f3664146fe0 2024-02-02T11:49:01.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f0870dc1640 1 -- 172.21.15.161:0/1044400524 wait complete. 2024-02-02T11:49:01.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f3aa980e640 1 --2- 172.21.15.161:0/2269766905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3aa40b6c20 0x7f3aa4154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f7f68d1c640 1 -- 172.21.15.161:0/1833566440 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f540aa750 con 0x7f7f5c007150 2024-02-02T11:49:01.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.727+0000 7f7f68d1c640 1 -- 172.21.15.161:0/1833566440 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f540aaae0 con 0x7f7f5c007150 2024-02-02T11:49:01.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f3679ea1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f367414a350 0x7f36741f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f36796a0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36740b2960 0x7f36740b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f3679ea1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f367414a350 0x7f36741f2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36860/0 (socket says 172.21.15.161:36860) 2024-02-02T11:49:01.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f3679ea1640 1 -- 172.21.15.161:0/2757365640 learned_addr learned my addr 172.21.15.161:0/2757365640 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7fb28ad9d640 1 --2- 172.21.15.161:0/2292744591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb28c0b59c0 0x7fb28c0b5e50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb2800ac000 tx=0x7fb280019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f3678e9f640 1 --2- 172.21.15.161:0/2757365640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3674149f10 0x7f36741e9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f3aa880c640 1 --2- 172.21.15.161:0/2269766905 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3aa406bc20 0x7f3aa4153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f366bd66640 1 -- 172.21.15.161:0/653503806 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3664144c70 con 0x7f3664146fe0 2024-02-02T11:49:01.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f366bd66640 1 -- 172.21.15.161:0/653503806 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36640b5940 con 0x7f3664146fe0 2024-02-02T11:49:01.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f365a7fc640 1 -- 172.21.15.161:0/653503806 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3654011990 con 0x7f3664146fe0 2024-02-02T11:49:01.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f286cff9640 1 -- 172.21.15.161:0/1776075006 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286000cea0 con 0x7f28700b7d30 2024-02-02T11:49:01.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f286cff9640 1 -- 172.21.15.161:0/1776075006 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2860005ae0 con 0x7f28700b7d30 2024-02-02T11:49:01.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f286cff9640 1 -- 172.21.15.161:0/1776075006 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860005e90 con 0x7f28700b7d30 2024-02-02T11:49:01.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f3aa900d640 1 -- 172.21.15.161:0/2269766905 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3aa406bc20 msgr2=0x7f3aa4153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f3aa900d640 1 --2- 172.21.15.161:0/2269766905 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3aa406bc20 0x7f3aa4153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f3aa900d640 1 -- 172.21.15.161:0/2269766905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3aa40b6c20 msgr2=0x7f3aa4154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f3aa900d640 1 --2- 172.21.15.161:0/2269766905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3aa40b6c20 0x7f3aa4154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f3aa900d640 1 -- 172.21.15.161:0/2269766905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9c009b30 con 0x7f3aa4069fd0 2024-02-02T11:49:01.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f7f6ad20640 1 -- 172.21.15.161:0/1833566440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f5c007150 msgr2=0x7f7f5c03a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f7f6ad20640 1 --2- 172.21.15.161:0/1833566440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f5c007150 0x7f7f5c03a400 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7f54009870 tx=0x7f7f5401c4f0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f7f6ad20640 1 -- 172.21.15.161:0/1833566440 shutdown_connections 2024-02-02T11:49:01.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f7f6ad20640 1 --2- 172.21.15.161:0/1833566440 >> v2:172.21.15.162:3300/0 conn(0x7f7f5c03e9e0 0x7f7f5c0cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f7f6ad20640 1 --2- 172.21.15.161:0/1833566440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f5c007150 0x7f7f5c03a400 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f7f6ad20640 1 -- 172.21.15.161:0/1833566440 >> 172.21.15.161:0/1833566440 conn(0x7f7f5c03ee70 msgr2=0x7f7f5c03f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f7f6ad20640 1 -- 172.21.15.161:0/1833566440 shutdown_connections 2024-02-02T11:49:01.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f0870dc1640 1 Processor -- start 2024-02-02T11:49:01.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f3aa900d640 1 --2- 172.21.15.161:0/2269766905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3aa4069fd0 0x7f3aa41f2b40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400b550 tx=0x7f3a9400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7fb27affd640 1 -- 172.21.15.161:0/2292744591 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2800acd10 con 0x7fb28c0b59c0 2024-02-02T11:49:01.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7fb27affd640 1 -- 172.21.15.161:0/2292744591 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2800ace70 con 0x7fb28c0b59c0 2024-02-02T11:49:01.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7fb27affd640 1 -- 172.21.15.161:0/2292744591 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb280003820 con 0x7fb28c0b59c0 2024-02-02T11:49:01.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7fb28b59e640 1 -- 172.21.15.161:0/2292744591 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28c14d790 con 0x7fb28c0b59c0 2024-02-02T11:49:01.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7fb28b59e640 1 -- 172.21.15.161:0/2292744591 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28c0b80b0 con 0x7fb28c0b59c0 2024-02-02T11:49:01.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f365a7fc640 1 -- 172.21.15.161:0/653503806 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3654011d80 con 0x7f3664146fe0 2024-02-02T11:49:01.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f366bd66640 1 -- 172.21.15.161:0/653503806 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364c005260 con 0x7f3664146fe0 2024-02-02T11:49:01.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f36796a0640 1 -- 172.21.15.161:0/2757365640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3674149f10 msgr2=0x7f36741e9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f36796a0640 1 --2- 172.21.15.161:0/2757365640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3674149f10 0x7f36741e9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f36796a0640 1 -- 172.21.15.161:0/2757365640 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f367414a350 msgr2=0x7f36741f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f36796a0640 1 --2- 172.21.15.161:0/2757365640 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f367414a350 0x7f36741f2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f36796a0640 1 -- 172.21.15.161:0/2757365640 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3670008550 con 0x7f36740b2960 2024-02-02T11:49:01.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f36796a0640 1 --2- 172.21.15.161:0/2757365640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36740b2960 0x7f36740b4640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f366400c7f0 tx=0x7f366400ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f0870dc1640 1 -- start start 2024-02-02T11:49:01.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f0870dc1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08540053e0 0x7f086c13aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f0870dc1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f086c0b3910 0x7f086c13e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f0870dc1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f086c13b240 0x7f086c0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f0870dc1640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c13a360 con 0x7f08540053e0 2024-02-02T11:49:01.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f0870dc1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c13eea0 con 0x7f086c0b3910 2024-02-02T11:49:01.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f0870dc1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c139da0 con 0x7f086c13b240 2024-02-02T11:49:01.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f086bfff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f086c13b240 0x7f086c0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f086bfff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f086c13b240 0x7f086c0b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.161:48004/0 (socket says 172.21.15.161:48004) 2024-02-02T11:49:01.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f086bfff640 1 -- 172.21.15.161:0/275730037 learned_addr learned my addr 172.21.15.161:0/275730037 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f086bfff640 1 -- 172.21.15.161:0/275730037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f086c0b3910 msgr2=0x7f086c13e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f086bfff640 1 --2- 172.21.15.161:0/275730037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f086c0b3910 0x7f086c13e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f086bfff640 1 -- 172.21.15.161:0/275730037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08540053e0 msgr2=0x7f086c13aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f086bfff640 1 --2- 172.21.15.161:0/275730037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08540053e0 0x7f086c13aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f086bfff640 1 -- 172.21.15.161:0/275730037 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c1387a0 con 0x7f086c13b240 2024-02-02T11:49:01.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f086bfff640 1 --2- 172.21.15.161:0/275730037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f086c13b240 0x7f086c0b0d90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f086401cc70 tx=0x7f0854005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f2876446640 1 -- 172.21.15.161:0/1776075006 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28701f0160 con 0x7f28700b7d30 2024-02-02T11:49:01.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f2876446640 1 -- 172.21.15.161:0/1776075006 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28700b5bd0 con 0x7f28700b7d30 2024-02-02T11:49:01.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.723+0000 7f8a51329640 1 --2- 172.21.15.161:0/924221931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a4c0b5470 0x7f8a4c148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f7f6ad20640 1 -- 172.21.15.161:0/1833566440 wait complete. 2024-02-02T11:49:01.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f7f6ad20640 1 Processor -- start 2024-02-02T11:49:01.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f3a99ffb640 1 -- 172.21.15.161:0/2269766905 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a94010870 con 0x7f3aa4069fd0 2024-02-02T11:49:01.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f3a99ffb640 1 -- 172.21.15.161:0/2269766905 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a940109f0 con 0x7f3aa4069fd0 2024-02-02T11:49:01.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f3a99ffb640 1 -- 172.21.15.161:0/2269766905 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a94010da0 con 0x7f3aa4069fd0 2024-02-02T11:49:01.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f3aab271640 1 -- 172.21.15.161:0/2269766905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa41f3440 con 0x7f3aa4069fd0 2024-02-02T11:49:01.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f3aab271640 1 -- 172.21.15.161:0/2269766905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa41f3080 con 0x7f3aa4069fd0 2024-02-02T11:49:01.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f8a51b2a640 1 --2- 172.21.15.161:0/924221931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a4c0b5470 0x7f8a4c148b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f8a51b2a640 1 -- 172.21.15.161:0/924221931 >> v1:172.21.15.162:6789/0 conn(0x7f8a4c0b58d0 legacy=0x7f8a4c14be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f8a51b2a640 1 -- 172.21.15.161:0/924221931 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c0710f0 con 0x7f8a4c142c30 2024-02-02T11:49:01.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f2876446640 1 -- 172.21.15.161:0/1776075006 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28700b8650 con 0x7f28700b7d30 2024-02-02T11:49:01.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f286cff9640 1 -- 172.21.15.161:0/1776075006 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2860007070 con 0x7f28700b7d30 2024-02-02T11:49:01.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f286cff9640 1 --2- 172.21.15.161:0/1776075006 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f285c065b30 0x7f285c067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f8a51329640 1 --2- 172.21.15.161:0/924221931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a4c0b5470 0x7f8a4c148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:01.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f286cff9640 1 -- 172.21.15.161:0/1776075006 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28600838e0 con 0x7f28700b7d30 2024-02-02T11:49:01.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7fb28b59e640 1 -- 172.21.15.161:0/2292744591 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb270005260 con 0x7fb28c0b59c0 2024-02-02T11:49:01.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f7f6ad20640 1 -- start start 2024-02-02T11:49:01.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f7f6ad20640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f5c0397f0 0x7f7f5c0c1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f7f6ad20640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f5c03e9e0 0x7f7f5c177320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f7f6ad20640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f5c036750 0x7f7f5c036bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f7f6ad20640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0c17c0 con 0x7f7f5c0397f0 2024-02-02T11:49:01.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f7f6ad20640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c01ba40 con 0x7f7f5c03e9e0 2024-02-02T11:49:01.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f7f6ad20640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c176b20 con 0x7f7f5c036750 2024-02-02T11:49:01.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f8a51b2a640 1 --2- 172.21.15.161:0/924221931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a4c142c30 0x7f8a4c0ba2e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0097c0 tx=0x7f8a3c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d83b9d060298e406 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.731+0000 7f3669ffb640 1 -- 172.21.15.161:0/2757365640 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664004220 con 0x7f36740b2960 2024-02-02T11:49:01.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f3669ffb640 1 -- 172.21.15.161:0/2757365640 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3664004380 con 0x7f36740b2960 2024-02-02T11:49:01.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f3669ffb640 1 -- 172.21.15.161:0/2757365640 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664003820 con 0x7f36740b2960 2024-02-02T11:49:01.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f367a6a2640 1 -- 172.21.15.161:0/2757365640 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36740b3f90 con 0x7f36740b2960 2024-02-02T11:49:01.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f367a6a2640 1 -- 172.21.15.161:0/2757365640 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36740b36d0 con 0x7f36740b2960 2024-02-02T11:49:01.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f8a50b28640 1 -- 172.21.15.161:0/924221931 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a44001a00 con 0x7f8a4c142c30 2024-02-02T11:49:01.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f7f6a51f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f5c036750 0x7f7f5c036bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f7f6a51f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f5c036750 0x7f7f5c036bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.161:48016/0 (socket says 172.21.15.161:48016) 2024-02-02T11:49:01.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f7f6a51f640 1 -- 172.21.15.161:0/179799257 learned_addr learned my addr 172.21.15.161:0/179799257 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f8a50b28640 1 -- 172.21.15.161:0/924221931 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c0a7050 con 0x7f8a4c142c30 2024-02-02T11:49:01.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f8a50b28640 1 -- 172.21.15.161:0/924221931 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c0ab600 con 0x7f8a4c142c30 2024-02-02T11:49:01.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f365a7fc640 1 -- 172.21.15.161:0/653503806 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3654004020 con 0x7f3664146fe0 2024-02-02T11:49:01.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f3aab271640 1 -- 172.21.15.161:0/2269766905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa4067050 con 0x7f3aa4069fd0 2024-02-02T11:49:01.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f7f6a51f640 1 -- 172.21.15.161:0/179799257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f5c03e9e0 msgr2=0x7f7f5c177320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-02T11:49:01.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f7f6a51f640 1 --2- 172.21.15.161:0/179799257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f5c03e9e0 0x7f7f5c177320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f7f6a51f640 1 -- 172.21.15.161:0/179799257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f5c0397f0 msgr2=0x7f7f5c0c1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f7f6a51f640 1 --2- 172.21.15.161:0/179799257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f5c0397f0 0x7f7f5c0c1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f7f6a51f640 1 -- 172.21.15.161:0/179799257 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f540094d0 con 0x7f7f5c036750 2024-02-02T11:49:01.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f8a53d8e640 1 -- 172.21.15.161:0/924221931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a4c142c30 msgr2=0x7f8a4c0ba2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f8a53d8e640 1 --2- 172.21.15.161:0/924221931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a4c142c30 0x7f8a4c0ba2e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0097c0 tx=0x7f8a3c01c3c0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f8a53d8e640 1 -- 172.21.15.161:0/924221931 shutdown_connections 2024-02-02T11:49:01.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f8a53d8e640 1 --2- 172.21.15.161:0/924221931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a4c0b5470 0x7f8a4c148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f8a53d8e640 1 --2- 172.21.15.161:0/924221931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a4c142c30 0x7f8a4c0ba2e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f8a53d8e640 1 -- 172.21.15.161:0/924221931 >> 172.21.15.161:0/924221931 conn(0x7f8a4c0be070 msgr2=0x7f8a4c0be480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:01.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f8a53d8e640 1 -- 172.21.15.161:0/924221931 shutdown_connections 2024-02-02T11:49:01.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f367a6a2640 1 -- 172.21.15.161:0/2757365640 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3674142d10 con 0x7f36740b2960 2024-02-02T11:49:01.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f286ffff640 1 --2- 172.21.15.161:0/1776075006 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f285c065b30 0x7f285c067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f7f6a51f640 1 --2- 172.21.15.161:0/179799257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f5c036750 0x7f7f5c036bd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7f6404ee50 tx=0x7f7f64073320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f365a7fc640 1 --2- 172.21.15.161:0/653503806 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3648065a60 0x7f3648067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f3669b02640 1 --2- 172.21.15.161:0/653503806 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3648065a60 0x7f3648067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f286ffff640 1 --2- 172.21.15.161:0/1776075006 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f285c065b30 0x7f285c067ff0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f28680b2000 tx=0x7f28680aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f8a53d8e640 1 -- 172.21.15.161:0/924221931 wait complete. 2024-02-02T11:49:01.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f3669b02640 1 --2- 172.21.15.161:0/653503806 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3648065a60 0x7f3648067f20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f36600b5000 tx=0x7f366000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.735+0000 7f365a7fc640 1 -- 172.21.15.161:0/653503806 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3654083520 con 0x7f3664146fe0 2024-02-02T11:49:01.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f3669ffb640 1 -- 172.21.15.161:0/2757365640 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3664003b90 con 0x7f36740b2960 2024-02-02T11:49:01.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f3669ffb640 1 --2- 172.21.15.161:0/2757365640 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3658065a90 0x7f3658067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f3669ffb640 1 -- 172.21.15.161:0/2757365640 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36640833c0 con 0x7f36740b2960 2024-02-02T11:49:01.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f8a53d8e640 1 Processor -- start 2024-02-02T11:49:01.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f3678e9f640 1 --2- 172.21.15.161:0/2757365640 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3658065a90 0x7f3658067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f365a7fc640 1 -- 172.21.15.161:0/653503806 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3654051000 con 0x7f3664146fe0 2024-02-02T11:49:01.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f3678e9f640 1 --2- 172.21.15.161:0/2757365640 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3658065a90 0x7f3658067f50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f36741495b0 tx=0x7f366c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f8a53d8e640 1 -- start start 2024-02-02T11:49:01.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f8a53d8e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a4c0b5470 0x7f8a4c141d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f8a53d8e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a4c0b58d0 0x7f8a4c1eb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f8a53d8e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a4c142c30 0x7f8a4c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f8a53d8e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c145110 con 0x7f8a4c142c30 2024-02-02T11:49:01.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f8a53d8e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c142260 con 0x7f8a4c0b5470 2024-02-02T11:49:01.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f8a53d8e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c1434b0 con 0x7f8a4c0b58d0 2024-02-02T11:49:01.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f3a99ffb640 1 -- 172.21.15.161:0/2269766905 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3a94023480 con 0x7f3aa4069fd0 2024-02-02T11:49:01.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f3a99ffb640 1 --2- 172.21.15.161:0/2269766905 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3a88065ab0 0x7f3a88067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f3a99ffb640 1 -- 172.21.15.161:0/2269766905 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a940835a0 con 0x7f3aa4069fd0 2024-02-02T11:49:01.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f8a5232b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a4c142c30 0x7f8a4c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f8a51329640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a4c0b58d0 0x7f8a4c1eb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7fb27affd640 1 -- 172.21.15.161:0/2292744591 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb2800b3050 con 0x7fb28c0b59c0 2024-02-02T11:49:01.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7fb27affd640 1 --2- 172.21.15.161:0/2292744591 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb26c065b60 0x7fb26c068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7fb27affd640 1 -- 172.21.15.161:0/2292744591 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb28011d960 con 0x7fb28c0b59c0 2024-02-02T11:49:01.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f8a5232b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a4c142c30 0x7f8a4c13b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36876/0 (socket says 172.21.15.161:36876) 2024-02-02T11:49:01.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f8a5232b640 1 -- 172.21.15.161:0/327540379 learned_addr learned my addr 172.21.15.161:0/327540379 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:01.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f3aa880c640 1 --2- 172.21.15.161:0/2269766905 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3a88065ab0 0x7f3a88067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f8a51b2a640 1 --2- 172.21.15.161:0/327540379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a4c0b5470 0x7f8a4c141d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7fb28a59c640 1 --2- 172.21.15.161:0/2292744591 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb26c065b60 0x7fb26c068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f8a51329640 1 -- 172.21.15.161:0/327540379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a4c0b5470 msgr2=0x7f8a4c141d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f8a51329640 1 --2- 172.21.15.161:0/327540379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a4c0b5470 0x7f8a4c141d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f3aa880c640 1 --2- 172.21.15.161:0/2269766905 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3a88065ab0 0x7f3a88067f70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3aa41e9cb0 tx=0x7f3aa0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f8a51329640 1 -- 172.21.15.161:0/327540379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a4c142c30 msgr2=0x7f8a4c13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:01.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f8a51329640 1 --2- 172.21.15.161:0/327540379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a4c142c30 0x7f8a4c13b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:01.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.739+0000 7f8a51329640 1 -- 172.21.15.161:0/327540379 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c009420 con 0x7f8a4c0b58d0 2024-02-02T11:49:01.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.743+0000 7f8a51329640 1 --2- 172.21.15.161:0/327540379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a4c0b58d0 0x7f8a4c1eb800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8a4800c7f0 tx=0x7f8a4800ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.743+0000 7fb28a59c640 1 --2- 172.21.15.161:0/2292744591 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb26c065b60 0x7fb26c068020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb27c009990 tx=0x7fb27c009110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.743+0000 7f3a99ffb640 1 -- 172.21.15.161:0/2269766905 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3a94051080 con 0x7f3aa4069fd0 2024-02-02T11:49:01.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f0853fff640 1 -- 172.21.15.161:0/275730037 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640b3070 con 0x7f086c13b240 2024-02-02T11:49:01.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f7f5a7fc640 1 -- 172.21.15.161:0/179799257 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f640721c0 con 0x7f7f5c036750 2024-02-02T11:49:01.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f8a427fc640 1 -- 172.21.15.161:0/327540379 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a48004220 con 0x7f8a4c0b58d0 2024-02-02T11:49:01.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f286cff9640 1 -- 172.21.15.161:0/1776075006 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2860054da0 con 0x7f28700b7d30 2024-02-02T11:49:01.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f7f5a7fc640 1 -- 172.21.15.161:0/179799257 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f64072360 con 0x7f7f5c036750 2024-02-02T11:49:01.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f7f6ad20640 1 -- 172.21.15.161:0/179799257 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5c176e00 con 0x7f7f5c036750 2024-02-02T11:49:01.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f7f6ad20640 1 -- 172.21.15.161:0/179799257 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5c0d6120 con 0x7f7f5c036750 2024-02-02T11:49:01.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f0870dc1640 1 -- 172.21.15.161:0/275730037 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c0b2290 con 0x7f086c13b240 2024-02-02T11:49:01.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f0870dc1640 1 -- 172.21.15.161:0/275730037 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c0b3d10 con 0x7f086c13b240 2024-02-02T11:49:01.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f0853fff640 1 -- 172.21.15.161:0/275730037 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08640ad410 con 0x7f086c13b240 2024-02-02T11:49:01.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f0853fff640 1 -- 172.21.15.161:0/275730037 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0864004db0 con 0x7f086c13b240 2024-02-02T11:49:01.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f7f5a7fc640 1 -- 172.21.15.161:0/179799257 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64091400 con 0x7f7f5c036750 2024-02-02T11:49:01.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f0870dc1640 1 -- 172.21.15.161:0/275730037 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c074100 con 0x7f086c13b240 2024-02-02T11:49:01.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f7f6ad20640 1 -- 172.21.15.161:0/179799257 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5c005350 con 0x7f7f5c036750 2024-02-02T11:49:01.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f8a53d8e640 1 -- 172.21.15.161:0/327540379 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4c1ebd40 con 0x7f8a4c0b58d0 2024-02-02T11:49:01.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f8a53d8e640 1 -- 172.21.15.161:0/327540379 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4c1eb000 con 0x7f8a4c0b58d0 2024-02-02T11:49:01.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f8a427fc640 1 -- 172.21.15.161:0/327540379 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a48004380 con 0x7f8a4c0b58d0 2024-02-02T11:49:01.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f8a427fc640 1 -- 172.21.15.161:0/327540379 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a48003820 con 0x7f8a4c0b58d0 2024-02-02T11:49:01.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f8a53d8e640 1 -- 172.21.15.161:0/327540379 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a34005260 con 0x7f8a4c0b58d0 2024-02-02T11:49:01.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.747+0000 7f0853fff640 1 -- 172.21.15.161:0/275730037 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0864007070 con 0x7f086c13b240 2024-02-02T11:49:01.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.751+0000 7f0853fff640 1 --2- 172.21.15.161:0/275730037 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0858065a90 0x7f0858067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.751+0000 7f0853fff640 1 -- 172.21.15.161:0/275730037 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08640eee80 con 0x7f086c13b240 2024-02-02T11:49:01.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.751+0000 7f086b7fe640 1 --2- 172.21.15.161:0/275730037 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0858065a90 0x7f0858067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.751+0000 7f8a427fc640 1 -- 172.21.15.161:0/327540379 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8a48003bd0 con 0x7f8a4c0b58d0 2024-02-02T11:49:01.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.751+0000 7f8a427fc640 1 --2- 172.21.15.161:0/327540379 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8a30065a60 0x7f8a30067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.751+0000 7f8a427fc640 1 -- 172.21.15.161:0/327540379 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a480836e0 con 0x7f8a4c0b58d0 2024-02-02T11:49:01.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.751+0000 7f7f5a7fc640 1 -- 172.21.15.161:0/179799257 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7f6409b3f0 con 0x7f7f5c036750 2024-02-02T11:49:01.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.751+0000 7f7f5a7fc640 1 --2- 172.21.15.161:0/179799257 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7f48065a60 0x7f7f48067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:01.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.751+0000 7f7f5a7fc640 1 -- 172.21.15.161:0/179799257 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f640fcd20 con 0x7f7f5c036750 2024-02-02T11:49:01.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.751+0000 7f8a51b2a640 1 --2- 172.21.15.161:0/327540379 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8a30065a60 0x7f8a30067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.751+0000 7f3669ffb640 1 -- 172.21.15.161:0/2757365640 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3664050ea0 con 0x7f36740b2960 2024-02-02T11:49:01.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.751+0000 7f086b7fe640 1 --2- 172.21.15.161:0/275730037 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0858065a90 0x7f0858067f50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f085c007fd0 tx=0x7f085c007980 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.751+0000 7f7f69d1e640 1 --2- 172.21.15.161:0/179799257 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7f48065a60 0x7f7f48067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:01.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.751+0000 7f8a51b2a640 1 --2- 172.21.15.161:0/327540379 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8a30065a60 0x7f8a30067f20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0ad000 tx=0x7f8a3c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.751+0000 7f7f69d1e640 1 --2- 172.21.15.161:0/179799257 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7f48065a60 0x7f7f48067f20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f540ae000 tx=0x7f7f54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:01.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.755+0000 7fb27affd640 1 -- 172.21.15.161:0/2292744591 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb2800eb440 con 0x7fb28c0b59c0 2024-02-02T11:49:01.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.763+0000 7f8a427fc640 1 -- 172.21.15.161:0/327540379 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8a480510a0 con 0x7f8a4c0b58d0 2024-02-02T11:49:01.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.775+0000 7f7f5a7fc640 1 -- 172.21.15.161:0/179799257 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7f640ca770 con 0x7f7f5c036750 2024-02-02T11:49:01.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:01.787+0000 7f0853fff640 1 -- 172.21.15.161:0/275730037 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f08640eaac0 con 0x7f086c13b240 2024-02-02T11:49:02.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.015+0000 7f366bd66640 1 -- 172.21.15.161:0/653503806 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f364c0057e0 con 0x7f3664146fe0 2024-02-02T11:49:02.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.015+0000 7f365a7fc640 1 -- 172.21.15.161:0/653503806 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3654015020 con 0x7f3664146fe0 2024-02-02T11:49:02.018 INFO:teuthology.orchestra.run.smithi161.stdout:55834574853 2024-02-02T11:49:02.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.019+0000 7f3647fff640 1 -- 172.21.15.161:0/653503806 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3648065a60 msgr2=0x7f3648067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:02.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.019+0000 7f3647fff640 1 --2- 172.21.15.161:0/653503806 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3648065a60 0x7f3648067f20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f36600b5000 tx=0x7f366000b040 comp rx=0 tx=0).stop 2024-02-02T11:49:02.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.019+0000 7f3647fff640 1 -- 172.21.15.161:0/653503806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3664146fe0 msgr2=0x7f36641442b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:02.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.019+0000 7f3647fff640 1 --2- 172.21.15.161:0/653503806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3664146fe0 0x7f36641442b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f365400b3e0 tx=0x7f365400b8a0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.019+0000 7f3647fff640 1 -- 172.21.15.161:0/653503806 shutdown_connections 2024-02-02T11:49:02.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.019+0000 7f3647fff640 1 --2- 172.21.15.161:0/653503806 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3648065a60 0x7f3648067f20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.019+0000 7f3647fff640 1 --2- 172.21.15.161:0/653503806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3664146fe0 0x7f36641442b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.019+0000 7f3647fff640 1 --2- 172.21.15.161:0/653503806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36640b7d30 0x7f36640b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.019+0000 7f3647fff640 1 --2- 172.21.15.161:0/653503806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36640b7950 0x7f36641453f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.019+0000 7f3647fff640 1 -- 172.21.15.161:0/653503806 >> 172.21.15.161:0/653503806 conn(0x7f36640bbd20 msgr2=0x7f36640b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:02.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.019+0000 7f3647fff640 1 -- 172.21.15.161:0/653503806 shutdown_connections 2024-02-02T11:49:02.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.019+0000 7f3647fff640 1 -- 172.21.15.161:0/653503806 wait complete. 2024-02-02T11:49:02.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.4 2024-02-02T11:49:02.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.043+0000 7fb28b59e640 1 -- 172.21.15.161:0/2292744591 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb2700057e0 con 0x7fb28c0b59c0 2024-02-02T11:49:02.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.043+0000 7fb27affd640 1 -- 172.21.15.161:0/2292744591 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb2800eea60 con 0x7fb28c0b59c0 2024-02-02T11:49:02.047 INFO:teuthology.orchestra.run.smithi161.stdout:55834574854 2024-02-02T11:49:02.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.047+0000 7fb28b59e640 1 -- 172.21.15.161:0/2292744591 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb26c065b60 msgr2=0x7fb26c068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:02.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.047+0000 7fb28b59e640 1 --2- 172.21.15.161:0/2292744591 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb26c065b60 0x7fb26c068020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb27c009990 tx=0x7fb27c009110 comp rx=0 tx=0).stop 2024-02-02T11:49:02.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.047+0000 7fb28b59e640 1 -- 172.21.15.161:0/2292744591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb28c0b59c0 msgr2=0x7fb28c0b5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:02.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.047+0000 7fb28b59e640 1 --2- 172.21.15.161:0/2292744591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb28c0b59c0 0x7fb28c0b5e50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb2800ac000 tx=0x7fb280019190 comp rx=0 tx=0).stop 2024-02-02T11:49:02.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.047+0000 7fb28b59e640 1 -- 172.21.15.161:0/2292744591 shutdown_connections 2024-02-02T11:49:02.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.047+0000 7fb28b59e640 1 --2- 172.21.15.161:0/2292744591 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb26c065b60 0x7fb26c068020 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.047+0000 7fb28b59e640 1 --2- 172.21.15.161:0/2292744591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb28c0b59c0 0x7fb28c0b5e50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.047+0000 7fb28b59e640 1 --2- 172.21.15.161:0/2292744591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb28c14a8a0 0x7fb28c0b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.047+0000 7fb28b59e640 1 --2- 172.21.15.161:0/2292744591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb28c1447e0 0x7fb28c140300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.047+0000 7fb28b59e640 1 -- 172.21.15.161:0/2292744591 >> 172.21.15.161:0/2292744591 conn(0x7fb28c06e860 msgr2=0x7fb28c0b96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:02.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.047+0000 7fb28b59e640 1 -- 172.21.15.161:0/2292744591 shutdown_connections 2024-02-02T11:49:02.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.047+0000 7fb28b59e640 1 -- 172.21.15.161:0/2292744591 wait complete. 2024-02-02T11:49:02.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.051+0000 7f3aab271640 1 -- 172.21.15.161:0/2269766905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3aa4074100 con 0x7f3aa4069fd0 2024-02-02T11:49:02.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.055+0000 7f3a99ffb640 1 -- 172.21.15.161:0/2269766905 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a94014020 con 0x7f3aa4069fd0 2024-02-02T11:49:02.057 INFO:teuthology.orchestra.run.smithi161.stdout:55834574853 2024-02-02T11:49:02.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.055+0000 7f3aab271640 1 -- 172.21.15.161:0/2269766905 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3a88065ab0 msgr2=0x7f3a88067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:02.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.055+0000 7f3aab271640 1 --2- 172.21.15.161:0/2269766905 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3a88065ab0 0x7f3a88067f70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3aa41e9cb0 tx=0x7f3aa0009040 comp rx=0 tx=0).stop 2024-02-02T11:49:02.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.059+0000 7f3aab271640 1 -- 172.21.15.161:0/2269766905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3aa4069fd0 msgr2=0x7f3aa41f2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:02.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.059+0000 7f3aab271640 1 --2- 172.21.15.161:0/2269766905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3aa4069fd0 0x7f3aa41f2b40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400b550 tx=0x7f3a9400ba10 comp rx=0 tx=0).stop 2024-02-02T11:49:02.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.059+0000 7f3aab271640 1 -- 172.21.15.161:0/2269766905 shutdown_connections 2024-02-02T11:49:02.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.059+0000 7f3aab271640 1 --2- 172.21.15.161:0/2269766905 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3a88065ab0 0x7f3a88067f70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.059+0000 7f3aab271640 1 --2- 172.21.15.161:0/2269766905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3aa40b6c20 0x7f3aa4154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.059+0000 7f3aab271640 1 --2- 172.21.15.161:0/2269766905 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3aa406bc20 0x7f3aa4153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.059+0000 7f3aab271640 1 --2- 172.21.15.161:0/2269766905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3aa4069fd0 0x7f3aa41f2b40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.059+0000 7f3aab271640 1 -- 172.21.15.161:0/2269766905 >> 172.21.15.161:0/2269766905 conn(0x7f3aa40bd0b0 msgr2=0x7f3aa4149630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:02.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.059+0000 7f3aab271640 1 -- 172.21.15.161:0/2269766905 shutdown_connections 2024-02-02T11:49:02.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.059+0000 7f3aab271640 1 -- 172.21.15.161:0/2269766905 wait complete. 2024-02-02T11:49:02.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.059+0000 7f2876446640 1 -- 172.21.15.161:0/1776075006 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f28701f0350 con 0x7f28700b7d30 2024-02-02T11:49:02.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.063+0000 7f286cff9640 1 -- 172.21.15.161:0/1776075006 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2860054930 con 0x7f28700b7d30 2024-02-02T11:49:02.065 INFO:teuthology.orchestra.run.smithi161.stdout:55834574854 2024-02-02T11:49:02.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.063+0000 7f367a6a2640 1 -- 172.21.15.161:0/2757365640 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3674074100 con 0x7f36740b2960 2024-02-02T11:49:02.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.063+0000 7f3669ffb640 1 -- 172.21.15.161:0/2757365640 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f366401e090 con 0x7f36740b2960 2024-02-02T11:49:02.067 INFO:teuthology.orchestra.run.smithi161.stdout:55834574855 2024-02-02T11:49:02.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.063+0000 7f2876446640 1 -- 172.21.15.161:0/1776075006 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f285c065b30 msgr2=0x7f285c067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:02.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.063+0000 7f2876446640 1 --2- 172.21.15.161:0/1776075006 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f285c065b30 0x7f285c067ff0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f28680b2000 tx=0x7f28680aa070 comp rx=0 tx=0).stop 2024-02-02T11:49:02.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.063+0000 7f2876446640 1 -- 172.21.15.161:0/1776075006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28700b7d30 msgr2=0x7f2870124220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:02.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.063+0000 7f2876446640 1 --2- 172.21.15.161:0/1776075006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28700b7d30 0x7f2870124220 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f286000c760 tx=0x7f286000cb60 comp rx=0 tx=0).stop 2024-02-02T11:49:02.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.063+0000 7f2876446640 1 -- 172.21.15.161:0/1776075006 shutdown_connections 2024-02-02T11:49:02.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.063+0000 7f2876446640 1 --2- 172.21.15.161:0/1776075006 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f285c065b30 0x7f285c067ff0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.063+0000 7f2876446640 1 --2- 172.21.15.161:0/1776075006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2870146fe0 0x7f2870125850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.063+0000 7f2876446640 1 --2- 172.21.15.161:0/1776075006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28700b7d30 0x7f2870124220 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.063+0000 7f2876446640 1 --2- 172.21.15.161:0/1776075006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28700b7950 0x7f28701251a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.063+0000 7f2876446640 1 -- 172.21.15.161:0/1776075006 >> 172.21.15.161:0/1776075006 conn(0x7f28700bbd20 msgr2=0x7f28700bc100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:02.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.063+0000 7f2876446640 1 -- 172.21.15.161:0/1776075006 shutdown_connections 2024-02-02T11:49:02.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.063+0000 7f2876446640 1 -- 172.21.15.161:0/1776075006 wait complete. 2024-02-02T11:49:02.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.067+0000 7f367a6a2640 1 -- 172.21.15.161:0/2757365640 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3658065a90 msgr2=0x7f3658067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:02.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.067+0000 7f367a6a2640 1 --2- 172.21.15.161:0/2757365640 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3658065a90 0x7f3658067f50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f36741495b0 tx=0x7f366c009040 comp rx=0 tx=0).stop 2024-02-02T11:49:02.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.067+0000 7f367a6a2640 1 -- 172.21.15.161:0/2757365640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36740b2960 msgr2=0x7f36740b4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:02.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.067+0000 7f367a6a2640 1 --2- 172.21.15.161:0/2757365640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36740b2960 0x7f36740b4640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f366400c7f0 tx=0x7f366400ccb0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.067+0000 7f367a6a2640 1 -- 172.21.15.161:0/2757365640 shutdown_connections 2024-02-02T11:49:02.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.067+0000 7f367a6a2640 1 --2- 172.21.15.161:0/2757365640 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3658065a90 0x7f3658067f50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.067+0000 7f367a6a2640 1 --2- 172.21.15.161:0/2757365640 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f367414a350 0x7f36741f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.067+0000 7f367a6a2640 1 --2- 172.21.15.161:0/2757365640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3674149f10 0x7f36741e9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.067+0000 7f367a6a2640 1 --2- 172.21.15.161:0/2757365640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36740b2960 0x7f36740b4640 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.067+0000 7f8a53d8e640 1 -- 172.21.15.161:0/327540379 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8a340057e0 con 0x7f8a4c0b58d0 2024-02-02T11:49:02.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.067+0000 7f8a427fc640 1 -- 172.21.15.161:0/327540379 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a4801e020 con 0x7f8a4c0b58d0 2024-02-02T11:49:02.072 INFO:teuthology.orchestra.run.smithi161.stdout:55834574854 2024-02-02T11:49:02.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.071+0000 7f367a6a2640 1 -- 172.21.15.161:0/2757365640 >> 172.21.15.161:0/2757365640 conn(0x7f36740b8770 msgr2=0x7f3674142f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:02.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.071+0000 7f367a6a2640 1 -- 172.21.15.161:0/2757365640 shutdown_connections 2024-02-02T11:49:02.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.071+0000 7f367a6a2640 1 -- 172.21.15.161:0/2757365640 wait complete. 2024-02-02T11:49:02.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.071+0000 7f7f6ad20640 1 -- 172.21.15.161:0/179799257 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7f5c176c60 con 0x7f7f5c036750 2024-02-02T11:49:02.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.071+0000 7f7f5a7fc640 1 -- 172.21.15.161:0/179799257 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f5c176c60 con 0x7f7f5c036750 2024-02-02T11:49:02.074 INFO:teuthology.orchestra.run.smithi161.stdout:55834574853 2024-02-02T11:49:02.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.071+0000 7f8a53d8e640 1 -- 172.21.15.161:0/327540379 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8a30065a60 msgr2=0x7f8a30067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:02.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.071+0000 7f8a53d8e640 1 --2- 172.21.15.161:0/327540379 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8a30065a60 0x7f8a30067f20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0ad000 tx=0x7f8a3c0a6000 comp rx=0 tx=0).stop 2024-02-02T11:49:02.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.071+0000 7f8a53d8e640 1 -- 172.21.15.161:0/327540379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a4c0b58d0 msgr2=0x7f8a4c1eb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:02.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.071+0000 7f8a53d8e640 1 --2- 172.21.15.161:0/327540379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a4c0b58d0 0x7f8a4c1eb800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8a4800c7f0 tx=0x7f8a4800ccb0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f8a53d8e640 1 -- 172.21.15.161:0/327540379 shutdown_connections 2024-02-02T11:49:02.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f8a53d8e640 1 --2- 172.21.15.161:0/327540379 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8a30065a60 0x7f8a30067f20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f8a53d8e640 1 --2- 172.21.15.161:0/327540379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a4c142c30 0x7f8a4c13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f8a53d8e640 1 --2- 172.21.15.161:0/327540379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a4c0b58d0 0x7f8a4c1eb800 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f8a53d8e640 1 --2- 172.21.15.161:0/327540379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a4c0b5470 0x7f8a4c141d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f8a53d8e640 1 -- 172.21.15.161:0/327540379 >> 172.21.15.161:0/327540379 conn(0x7f8a4c0be070 msgr2=0x7f8a4c0b7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:02.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f8a53d8e640 1 -- 172.21.15.161:0/327540379 shutdown_connections 2024-02-02T11:49:02.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f8a53d8e640 1 -- 172.21.15.161:0/327540379 wait complete. 2024-02-02T11:49:02.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f7f6ad20640 1 -- 172.21.15.161:0/179799257 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7f48065a60 msgr2=0x7f7f48067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:02.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f7f6ad20640 1 --2- 172.21.15.161:0/179799257 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7f48065a60 0x7f7f48067f20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f540ae000 tx=0x7f7f54008040 comp rx=0 tx=0).stop 2024-02-02T11:49:02.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f7f6ad20640 1 -- 172.21.15.161:0/179799257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f5c036750 msgr2=0x7f7f5c036bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:02.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f7f6ad20640 1 --2- 172.21.15.161:0/179799257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f5c036750 0x7f7f5c036bd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7f6404ee50 tx=0x7f7f64073320 comp rx=0 tx=0).stop 2024-02-02T11:49:02.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f7f6ad20640 1 -- 172.21.15.161:0/179799257 shutdown_connections 2024-02-02T11:49:02.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f7f6ad20640 1 --2- 172.21.15.161:0/179799257 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7f48065a60 0x7f7f48067f20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f7f6ad20640 1 --2- 172.21.15.161:0/179799257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f5c036750 0x7f7f5c036bd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f7f6ad20640 1 --2- 172.21.15.161:0/179799257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f5c03e9e0 0x7f7f5c177320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f7f6ad20640 1 --2- 172.21.15.161:0/179799257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f5c0397f0 0x7f7f5c0c1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f7f6ad20640 1 -- 172.21.15.161:0/179799257 >> 172.21.15.161:0/179799257 conn(0x7f7f5c03ee70 msgr2=0x7f7f5c0402f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:02.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f7f6ad20640 1 -- 172.21.15.161:0/179799257 shutdown_connections 2024-02-02T11:49:02.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.075+0000 7f7f6ad20640 1 -- 172.21.15.161:0/179799257 wait complete. 2024-02-02T11:49:02.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.1 2024-02-02T11:49:02.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.087+0000 7f0870dc1640 1 -- 172.21.15.161:0/275730037 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f086c0b9290 con 0x7f086c13b240 2024-02-02T11:49:02.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.087+0000 7f0853fff640 1 -- 172.21.15.161:0/275730037 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f08640ee0e0 con 0x7f086c13b240 2024-02-02T11:49:02.090 INFO:teuthology.orchestra.run.smithi161.stdout:55834574854 2024-02-02T11:49:02.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.087+0000 7f0870dc1640 1 -- 172.21.15.161:0/275730037 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0858065a90 msgr2=0x7f0858067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:02.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.087+0000 7f0870dc1640 1 --2- 172.21.15.161:0/275730037 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0858065a90 0x7f0858067f50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f085c007fd0 tx=0x7f085c007980 comp rx=0 tx=0).stop 2024-02-02T11:49:02.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.087+0000 7f0870dc1640 1 -- 172.21.15.161:0/275730037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f086c13b240 msgr2=0x7f086c0b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:02.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.087+0000 7f0870dc1640 1 --2- 172.21.15.161:0/275730037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f086c13b240 0x7f086c0b0d90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f086401cc70 tx=0x7f0854005800 comp rx=0 tx=0).stop 2024-02-02T11:49:02.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.091+0000 7f0870dc1640 1 -- 172.21.15.161:0/275730037 shutdown_connections 2024-02-02T11:49:02.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.091+0000 7f0870dc1640 1 --2- 172.21.15.161:0/275730037 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0858065a90 0x7f0858067f50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.091+0000 7f0870dc1640 1 --2- 172.21.15.161:0/275730037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f086c13b240 0x7f086c0b0d90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.091+0000 7f0870dc1640 1 --2- 172.21.15.161:0/275730037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f086c0b3910 0x7f086c13e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.091+0000 7f0870dc1640 1 --2- 172.21.15.161:0/275730037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08540053e0 0x7f086c13aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:02.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.091+0000 7f0870dc1640 1 -- 172.21.15.161:0/275730037 >> 172.21.15.161:0/275730037 conn(0x7f086c0b8770 msgr2=0x7f086c0bb130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:02.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.091+0000 7f0870dc1640 1 -- 172.21.15.161:0/275730037 shutdown_connections 2024-02-02T11:49:02.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:02.091+0000 7f0870dc1640 1 -- 172.21.15.161:0/275730037 wait complete. 2024-02-02T11:49:02.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.0 2024-02-02T11:49:02.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.2 2024-02-02T11:49:02.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.3 2024-02-02T11:49:02.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.6 2024-02-02T11:49:02.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.7 2024-02-02T11:49:02.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.5 2024-02-02T11:49:03.045 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-02T11:49:03.080 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-02T11:49:03.096 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-02T11:49:03.103 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-02T11:49:03.105 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-02T11:49:03.108 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-02T11:49:03.108 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-02T11:49:03.115 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-02T11:49:03.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.187+0000 7f23486ad640 1 Processor -- start 2024-02-02T11:49:03.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.187+0000 7f23486ad640 1 -- start start 2024-02-02T11:49:03.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.187+0000 7f23486ad640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23400b7950 0x7f23400b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.187+0000 7f23486ad640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f23400b7d30 0x7f2340149f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.187+0000 7f23486ad640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23400b8170 con 0x7f2340146fe0 2024-02-02T11:49:03.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.187+0000 7f23486ad640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234006c7d0 con 0x7f23400b7d30 2024-02-02T11:49:03.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.187+0000 7f23486ad640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234006c340 con 0x7f23400b7950 2024-02-02T11:49:03.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.187+0000 7f2346c4a640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f2340146fe0 0x7f2340147430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:57494/0 (socket says 172.21.15.161:57494) 2024-02-02T11:49:03.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.187+0000 7f2346c4a640 1 -- 172.21.15.161:0/105553095 learned_addr learned my addr 172.21.15.161:0/105553095 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:03.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.187+0000 7f2345c48640 1 --2- 172.21.15.161:0/105553095 >> v2:172.21.15.162:3300/0 conn(0x7f23400b7d30 0x7f2340149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.187+0000 7f2346449640 1 --2- 172.21.15.161:0/105553095 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23400b7950 0x7f23400b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.191+0000 7f2345447640 1 -- 172.21.15.161:0/105553095 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154767972 0 0) 0x7f23400b8170 con 0x7f2340146fe0 2024-02-02T11:49:03.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.191+0000 7f2345447640 1 -- 172.21.15.161:0/105553095 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f232c003530 con 0x7f2340146fe0 2024-02-02T11:49:03.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.191+0000 7f2345c48640 1 -- 172.21.15.161:0/105553095 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23400b7950 msgr2=0x7f23400b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:03.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.191+0000 7f2345c48640 1 --2- 172.21.15.161:0/105553095 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23400b7950 0x7f23400b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.191+0000 7f2345c48640 1 -- 172.21.15.161:0/105553095 >> v1:172.21.15.161:6789/0 conn(0x7f2340146fe0 legacy=0x7f2340147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.191+0000 7f2345c48640 1 -- 172.21.15.161:0/105553095 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234006bcf0 con 0x7f23400b7d30 2024-02-02T11:49:03.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.191+0000 7f2345c48640 1 --2- 172.21.15.161:0/105553095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23400b7d30 0x7f2340149f40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f233800aea0 tx=0x7f2338020240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6881c1e31bbae80f server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.195+0000 7f2345447640 1 -- 172.21.15.161:0/105553095 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233800a2d0 con 0x7f23400b7d30 2024-02-02T11:49:03.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.195+0000 7f2345447640 1 -- 172.21.15.161:0/105553095 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23380ac050 con 0x7f23400b7d30 2024-02-02T11:49:03.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.195+0000 7f23486ad640 1 -- 172.21.15.161:0/105553095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23400b7d30 msgr2=0x7f2340149f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.195+0000 7f23486ad640 1 --2- 172.21.15.161:0/105553095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23400b7d30 0x7f2340149f40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f233800aea0 tx=0x7f2338020240 comp rx=0 tx=0).stop 2024-02-02T11:49:03.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.195+0000 7f23486ad640 1 -- 172.21.15.161:0/105553095 shutdown_connections 2024-02-02T11:49:03.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.195+0000 7f23486ad640 1 --2- 172.21.15.161:0/105553095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23400b7d30 0x7f2340149f40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.195+0000 7f23486ad640 1 --2- 172.21.15.161:0/105553095 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23400b7950 0x7f23400b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.195+0000 7f23486ad640 1 -- 172.21.15.161:0/105553095 >> 172.21.15.161:0/105553095 conn(0x7f23400bbd20 msgr2=0x7f23400bc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:03.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.195+0000 7f23486ad640 1 -- 172.21.15.161:0/105553095 shutdown_connections 2024-02-02T11:49:03.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.195+0000 7f23486ad640 1 -- 172.21.15.161:0/105553095 wait complete. 2024-02-02T11:49:03.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.195+0000 7f23486ad640 1 Processor -- start 2024-02-02T11:49:03.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.195+0000 7f23486ad640 1 -- start start 2024-02-02T11:49:03.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.199+0000 7f23486ad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23400b7950 0x7f2340098d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.199+0000 7f23486ad640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23400b7d30 0x7f23400b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.199+0000 7f23486ad640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2340146fe0 0x7f23401e4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.199+0000 7f23486ad640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23400b4f00 con 0x7f23400b7950 2024-02-02T11:49:03.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.199+0000 7f23486ad640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23400a0c80 con 0x7f23400b7d30 2024-02-02T11:49:03.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.199+0000 7f23486ad640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23400b42c0 con 0x7f2340146fe0 2024-02-02T11:49:03.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.199+0000 7f2346449640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23400b7950 0x7f2340098d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.199+0000 7f2346449640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23400b7950 0x7f2340098d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39646/0 (socket says 172.21.15.161:39646) 2024-02-02T11:49:03.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.199+0000 7f2346449640 1 -- 172.21.15.161:0/3389011247 learned_addr learned my addr 172.21.15.161:0/3389011247 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:03.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.199+0000 7f2345c48640 1 --2- 172.21.15.161:0/3389011247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23400b7d30 0x7f23400b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.199+0000 7f2346c4a640 1 --2- 172.21.15.161:0/3389011247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2340146fe0 0x7f23401e4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.199+0000 7f2346449640 1 -- 172.21.15.161:0/3389011247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2340146fe0 msgr2=0x7f23401e4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.199+0000 7f2346449640 1 --2- 172.21.15.161:0/3389011247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2340146fe0 0x7f23401e4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.199+0000 7f2346449640 1 -- 172.21.15.161:0/3389011247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23400b7d30 msgr2=0x7f23400b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.199+0000 7f2346449640 1 --2- 172.21.15.161:0/3389011247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23400b7d30 0x7f23400b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.199+0000 7f2346449640 1 -- 172.21.15.161:0/3389011247 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233800ab80 con 0x7f23400b7950 2024-02-02T11:49:03.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.199+0000 7f2346c4a640 1 --2- 172.21.15.161:0/3389011247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2340146fe0 0x7f23401e4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:49:03.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.199+0000 7f2346449640 1 --2- 172.21.15.161:0/3389011247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23400b7950 0x7f2340098d30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f233c00e960 tx=0x7f233c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.203+0000 7f2336ffd640 1 -- 172.21.15.161:0/3389011247 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c009690 con 0x7f23400b7950 2024-02-02T11:49:03.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.203+0000 7f23486ad640 1 -- 172.21.15.161:0/3389011247 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23400b4cb0 con 0x7f23400b7950 2024-02-02T11:49:03.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.203+0000 7f23486ad640 1 -- 172.21.15.161:0/3389011247 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23400b2f90 con 0x7f23400b7950 2024-02-02T11:49:03.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.203+0000 7f2336ffd640 1 -- 172.21.15.161:0/3389011247 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c00ca00 con 0x7f23400b7950 2024-02-02T11:49:03.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.203+0000 7f2336ffd640 1 -- 172.21.15.161:0/3389011247 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c00cd70 con 0x7f23400b7950 2024-02-02T11:49:03.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.203+0000 7f2336ffd640 1 -- 172.21.15.161:0/3389011247 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f233c013470 con 0x7f23400b7950 2024-02-02T11:49:03.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.203+0000 7f2336ffd640 1 --2- 172.21.15.161:0/3389011247 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2324065ab0 0x7f2324067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.203+0000 7f2336ffd640 1 -- 172.21.15.161:0/3389011247 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f233c0832f0 con 0x7f23400b7950 2024-02-02T11:49:03.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.203+0000 7f2345c48640 1 --2- 172.21.15.161:0/3389011247 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2324065ab0 0x7f2324067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.207+0000 7f2345c48640 1 --2- 172.21.15.161:0/3389011247 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2324065ab0 0x7f2324067f70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f23380b2000 tx=0x7f23380ab000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.217 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.215+0000 7f23486ad640 1 -- 172.21.15.161:0/3389011247 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2328005260 con 0x7f23400b7950 2024-02-02T11:49:03.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.223+0000 7f2336ffd640 1 -- 172.21.15.161:0/3389011247 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f233c050dd0 con 0x7f23400b7950 2024-02-02T11:49:03.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.267+0000 7fdc3e1dd640 1 Processor -- start 2024-02-02T11:49:03.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.267+0000 7fdc3e1dd640 1 -- start start 2024-02-02T11:49:03.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.267+0000 7fdc3e1dd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdc380b7950 0x7fdc380b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.267+0000 7fdc3e1dd640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc3806c340 con 0x7fdc38146fe0 2024-02-02T11:49:03.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.267+0000 7fdc3e1dd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc3814a650 con 0x7fdc380b7d30 2024-02-02T11:49:03.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.267+0000 7fdc3e1dd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc380b81a0 con 0x7fdc380b7950 2024-02-02T11:49:03.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.267+0000 7fdc37fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fdc38146fe0 0x7fdc38147430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:57498/0 (socket says 172.21.15.161:57498) 2024-02-02T11:49:03.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.267+0000 7fdc37fff640 1 -- 172.21.15.161:0/2151382578 learned_addr learned my addr 172.21.15.161:0/2151382578 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:03.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.267+0000 7fdc377fe640 1 --2- 172.21.15.161:0/2151382578 >> v2:172.21.15.162:3300/0 conn(0x7fdc380b7950 0x7fdc380b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.271+0000 7fdc377fe640 1 -- 172.21.15.161:0/2151382578 >> v1:172.21.15.162:6789/0 conn(0x7fdc380b7d30 legacy=0x7fdc38149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.271+0000 7fdc377fe640 1 -- 172.21.15.161:0/2151382578 >> v1:172.21.15.161:6789/0 conn(0x7fdc38146fe0 legacy=0x7fdc38147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.271+0000 7fdc377fe640 1 -- 172.21.15.161:0/2151382578 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3806bcf0 con 0x7fdc380b7950 2024-02-02T11:49:03.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.271+0000 7fdc377fe640 1 --2- 172.21.15.161:0/2151382578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc380b7950 0x7fdc380b2810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdc3000aea0 tx=0x7fdc3001d970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2418bc8e17a3d35f server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.275+0000 7fdc367fc640 1 -- 172.21.15.161:0/2151382578 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3000a2d0 con 0x7fdc380b7950 2024-02-02T11:49:03.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.275+0000 7fdc367fc640 1 -- 172.21.15.161:0/2151382578 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc300a67f0 con 0x7fdc380b7950 2024-02-02T11:49:03.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.275+0000 7fdc3e1dd640 1 -- 172.21.15.161:0/2151382578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc380b7950 msgr2=0x7fdc380b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.275+0000 7fdc3e1dd640 1 --2- 172.21.15.161:0/2151382578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc380b7950 0x7fdc380b2810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdc3000aea0 tx=0x7fdc3001d970 comp rx=0 tx=0).stop 2024-02-02T11:49:03.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.275+0000 7fdc3e1dd640 1 -- 172.21.15.161:0/2151382578 shutdown_connections 2024-02-02T11:49:03.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.275+0000 7fdc3e1dd640 1 --2- 172.21.15.161:0/2151382578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc380b7950 0x7fdc380b2810 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.275+0000 7fdc3e1dd640 1 -- 172.21.15.161:0/2151382578 >> 172.21.15.161:0/2151382578 conn(0x7fdc380bbd20 msgr2=0x7fdc380bc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:03.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.275+0000 7fdc3e1dd640 1 -- 172.21.15.161:0/2151382578 shutdown_connections 2024-02-02T11:49:03.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.275+0000 7fdc3e1dd640 1 -- 172.21.15.161:0/2151382578 wait complete. 2024-02-02T11:49:03.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.275+0000 7fdc3e1dd640 1 Processor -- start 2024-02-02T11:49:03.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.275+0000 7fdc3e1dd640 1 -- start start 2024-02-02T11:49:03.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc3e1dd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc380b7d30 0x7fdc380b9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc3e1dd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc38146fe0 0x7fdc380b4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc3e1dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc38149110 0x7fdc380b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc3e1dd640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc380ba2a0 con 0x7fdc380b7d30 2024-02-02T11:49:03.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc3e1dd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc38149c20 con 0x7fdc38146fe0 2024-02-02T11:49:03.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc3e1dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc380bb040 con 0x7fdc38149110 2024-02-02T11:49:03.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc377fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc380b7d30 0x7fdc380b9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc377fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc380b7d30 0x7fdc380b9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39656/0 (socket says 172.21.15.161:39656) 2024-02-02T11:49:03.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc377fe640 1 -- 172.21.15.161:0/1461129352 learned_addr learned my addr 172.21.15.161:0/1461129352 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:03.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc37fff640 1 --2- 172.21.15.161:0/1461129352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc38149110 0x7fdc380b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc36ffd640 1 --2- 172.21.15.161:0/1461129352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc38146fe0 0x7fdc380b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc377fe640 1 -- 172.21.15.161:0/1461129352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc38149110 msgr2=0x7fdc380b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc377fe640 1 --2- 172.21.15.161:0/1461129352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc38149110 0x7fdc380b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc377fe640 1 -- 172.21.15.161:0/1461129352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc38146fe0 msgr2=0x7fdc380b4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc377fe640 1 --2- 172.21.15.161:0/1461129352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc38146fe0 0x7fdc380b4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc377fe640 1 -- 172.21.15.161:0/1461129352 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3000ab80 con 0x7fdc380b7d30 2024-02-02T11:49:03.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc37fff640 1 --2- 172.21.15.161:0/1461129352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc38149110 0x7fdc380b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:49:03.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc377fe640 1 --2- 172.21.15.161:0/1461129352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc380b7d30 0x7fdc380b9d60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdc3001b5a0 tx=0x7fdc3001a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc1ffff640 1 -- 172.21.15.161:0/1461129352 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc300b7680 con 0x7fdc380b7d30 2024-02-02T11:49:03.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc3e1dd640 1 -- 172.21.15.161:0/1461129352 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc381495d0 con 0x7fdc380b7d30 2024-02-02T11:49:03.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.279+0000 7fdc3e1dd640 1 -- 172.21.15.161:0/1461129352 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc380b4160 con 0x7fdc380b7d30 2024-02-02T11:49:03.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.283+0000 7fdc1ffff640 1 -- 172.21.15.161:0/1461129352 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc300a67f0 con 0x7fdc380b7d30 2024-02-02T11:49:03.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.283+0000 7fdc1ffff640 1 -- 172.21.15.161:0/1461129352 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc300b7a20 con 0x7fdc380b7d30 2024-02-02T11:49:03.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.283+0000 7fdc1ffff640 1 -- 172.21.15.161:0/1461129352 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdc300b7c00 con 0x7fdc380b7d30 2024-02-02T11:49:03.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.283+0000 7fdc1ffff640 1 --2- 172.21.15.161:0/1461129352 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fdc24065bb0 0x7fdc24068070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.283+0000 7fdc36ffd640 1 --2- 172.21.15.161:0/1461129352 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fdc24065bb0 0x7fdc24068070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.283+0000 7fdc36ffd640 1 --2- 172.21.15.161:0/1461129352 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fdc24065bb0 0x7fdc24068070 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdc381dfa50 tx=0x7fdc2c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.283+0000 7fdc1ffff640 1 -- 172.21.15.161:0/1461129352 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc3011de70 con 0x7fdc380b7d30 2024-02-02T11:49:03.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.287+0000 7fdc3e1dd640 1 -- 172.21.15.161:0/1461129352 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc18005260 con 0x7fdc380b7d30 2024-02-02T11:49:03.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.295+0000 7fdc1ffff640 1 -- 172.21.15.161:0/1461129352 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdc300bd080 con 0x7fdc380b7d30 2024-02-02T11:49:03.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.299+0000 7f1e93b7d640 1 Processor -- start 2024-02-02T11:49:03.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e93b7d640 1 -- start start 2024-02-02T11:49:03.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e93b7d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1e84007150 0x7f1e840f2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e93b7d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1e84039f60 0x7f1e840e8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e93b7d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e840397f0 con 0x7f1e8403ac20 2024-02-02T11:49:03.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e93b7d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e84039ad0 con 0x7f1e84007150 2024-02-02T11:49:03.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e93b7d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e840f2670 con 0x7f1e84039f60 2024-02-02T11:49:03.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e91118640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f1e8403ac20 0x7f1e8403e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:57514/0 (socket says 172.21.15.161:57514) 2024-02-02T11:49:03.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e91118640 1 -- 172.21.15.161:0/947846370 learned_addr learned my addr 172.21.15.161:0/947846370 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:03.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e9211a640 1 --2- 172.21.15.161:0/947846370 >> v2:172.21.15.162:3300/0 conn(0x7f1e84039f60 0x7f1e840e8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e90917640 1 -- 172.21.15.161:0/947846370 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843303005 0 0) 0x7f1e840397f0 con 0x7f1e8403ac20 2024-02-02T11:49:03.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e90917640 1 -- 172.21.15.161:0/947846370 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e78005740 con 0x7f1e8403ac20 2024-02-02T11:49:03.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e90917640 1 -- 172.21.15.161:0/947846370 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3842135789 0 0) 0x7f1e78005740 con 0x7f1e8403ac20 2024-02-02T11:49:03.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e90917640 1 -- 172.21.15.161:0/947846370 >> v2:172.21.15.162:3300/0 conn(0x7f1e84039f60 msgr2=0x7f1e840e8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:03.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e90917640 1 --2- 172.21.15.161:0/947846370 >> v2:172.21.15.162:3300/0 conn(0x7f1e84039f60 0x7f1e840e8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e90917640 1 -- 172.21.15.161:0/947846370 >> v2:172.21.15.161:3300/0 conn(0x7f1e84007150 msgr2=0x7f1e840f2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:03.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e91919640 1 --2- 172.21.15.161:0/947846370 >> v2:172.21.15.161:3300/0 conn(0x7f1e84007150 0x7f1e840f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e90917640 1 --2- 172.21.15.161:0/947846370 >> v2:172.21.15.161:3300/0 conn(0x7f1e84007150 0x7f1e840f2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e90917640 1 -- 172.21.15.161:0/947846370 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e84038d30 con 0x7f1e8403ac20 2024-02-02T11:49:03.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e90917640 1 -- 172.21.15.161:0/947846370 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f1e88001680 con 0x7f1e8403ac20 2024-02-02T11:49:03.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e90917640 1 -- 172.21.15.161:0/947846370 >> v1:172.21.15.161:6789/0 conn(0x7f1e8403ac20 legacy=0x7f1e8403e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e90917640 1 --2- 172.21.15.161:0/947846370 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e78005b90 0x7f1e78005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e90917640 1 --2- 172.21.15.161:0/947846370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e78006540 0x7f1e780069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e90917640 1 --2- 172.21.15.161:0/947846370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e780071e0 0x7f1e7801cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e90917640 1 -- 172.21.15.161:0/947846370 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e84039ad0 con 0x7f1e78006540 2024-02-02T11:49:03.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e90917640 1 -- 172.21.15.161:0/947846370 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840f2670 con 0x7f1e780071e0 2024-02-02T11:49:03.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e90917640 1 -- 172.21.15.161:0/947846370 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7801d190 con 0x7f1e78005b90 2024-02-02T11:49:03.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e9211a640 1 --2- 172.21.15.161:0/947846370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e780071e0 0x7f1e7801cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.303+0000 7f1e91118640 1 --2- 172.21.15.161:0/947846370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e78006540 0x7f1e780069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.307+0000 7f1e91118640 1 -- 172.21.15.161:0/947846370 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e78005b90 msgr2=0x7f1e78005fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-02T11:49:03.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.307+0000 7f1e91118640 1 --2- 172.21.15.161:0/947846370 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e78005b90 0x7f1e78005fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.307+0000 7f1e91118640 1 -- 172.21.15.161:0/947846370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e780071e0 msgr2=0x7f1e7801cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:03.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.307+0000 7f1e91118640 1 --2- 172.21.15.161:0/947846370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e780071e0 0x7f1e7801cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.307+0000 7f1e91118640 1 -- 172.21.15.161:0/947846370 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e84038d30 con 0x7f1e78006540 2024-02-02T11:49:03.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.307+0000 7f1e9211a640 1 --2- 172.21.15.161:0/947846370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e780071e0 0x7f1e7801cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-02T11:49:03.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.307+0000 7f1e9211a640 1 -- 172.21.15.161:0/947846370 reap_dead start 2024-02-02T11:49:03.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.307+0000 7f1e91919640 1 --2- 172.21.15.161:0/947846370 >> v2:172.21.15.161:3300/0 conn(0x7f1e84007150 0x7f1e840f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:03.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.307+0000 7f1e91118640 1 --2- 172.21.15.161:0/947846370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e78006540 0x7f1e780069e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800c2e0 tx=0x7f1e8803ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd201eac1afdf28d server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.307+0000 7f1e90917640 1 -- 172.21.15.161:0/947846370 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e880c79f0 con 0x7f1e78006540 2024-02-02T11:49:03.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.307+0000 7f1e90917640 1 -- 172.21.15.161:0/947846370 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e880c7b50 con 0x7f1e78006540 2024-02-02T11:49:03.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.307+0000 7f1e90917640 1 -- 172.21.15.161:0/947846370 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e880058e0 con 0x7f1e78006540 2024-02-02T11:49:03.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f046df95640 1 Processor -- start 2024-02-02T11:49:03.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f046df95640 1 -- start start 2024-02-02T11:49:03.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f1e93b7d640 1 -- 172.21.15.161:0/947846370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e78006540 msgr2=0x7f1e780069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f1e93b7d640 1 --2- 172.21.15.161:0/947846370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e78006540 0x7f1e780069e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800c2e0 tx=0x7f1e8803ed30 comp rx=0 tx=0).stop 2024-02-02T11:49:03.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f1e93b7d640 1 -- 172.21.15.161:0/947846370 shutdown_connections 2024-02-02T11:49:03.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f1e93b7d640 1 --2- 172.21.15.161:0/947846370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e78006540 0x7f1e780069e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f1e93b7d640 1 -- 172.21.15.161:0/947846370 >> 172.21.15.161:0/947846370 conn(0x7f1e8403ee70 msgr2=0x7f1e8403f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:03.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f1e93b7d640 1 -- 172.21.15.161:0/947846370 shutdown_connections 2024-02-02T11:49:03.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f046df95640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f046814af00 0x7f0468156320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f046df95640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046814b320 con 0x7f046814aa90 2024-02-02T11:49:03.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f046df95640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046814e180 con 0x7f04680bc590 2024-02-02T11:49:03.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f046df95640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f046814e460 con 0x7f046814af00 2024-02-02T11:49:03.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f1e93b7d640 1 -- 172.21.15.161:0/947846370 wait complete. 2024-02-02T11:49:03.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f0466ffd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f046814aa90 0x7f0468144930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:57516/0 (socket says 172.21.15.161:57516) 2024-02-02T11:49:03.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f0466ffd640 1 -- 172.21.15.161:0/2641046963 learned_addr learned my addr 172.21.15.161:0/2641046963 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:03.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f0467fff640 1 --2- 172.21.15.161:0/2641046963 >> v2:172.21.15.162:3300/0 conn(0x7f046814af00 0x7f0468156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f0467fff640 1 -- 172.21.15.161:0/2641046963 >> v1:172.21.15.162:6789/0 conn(0x7f04680bc590 legacy=0x7f046806eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:03.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f0467fff640 1 -- 172.21.15.161:0/2641046963 >> v1:172.21.15.161:6789/0 conn(0x7f046814aa90 legacy=0x7f0468144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:03.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f0467fff640 1 -- 172.21.15.161:0/2641046963 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046814e740 con 0x7f046814af00 2024-02-02T11:49:03.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f1e93b7d640 1 Processor -- start 2024-02-02T11:49:03.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f1e93b7d640 1 -- start start 2024-02-02T11:49:03.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.311+0000 7f1e93b7d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e840e9690 0x7f1e840e9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e91919640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e840e9690 0x7f1e840e9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e91919640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e840e9690 0x7f1e840e9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39678/0 (socket says 172.21.15.161:39678) 2024-02-02T11:49:03.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e91919640 1 -- 172.21.15.161:0/513655452 learned_addr learned my addr 172.21.15.161:0/513655452 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:03.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e93b7d640 1 --2- 172.21.15.161:0/513655452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e8402fb80 0x7f1e84030000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e93b7d640 1 --2- 172.21.15.161:0/513655452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e8402ebe0 0x7f1e8402f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e93b7d640 1 -- 172.21.15.161:0/513655452 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840eb540 con 0x7f1e840e9690 2024-02-02T11:49:03.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e93b7d640 1 -- 172.21.15.161:0/513655452 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8402f5d0 con 0x7f1e8402fb80 2024-02-02T11:49:03.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e93b7d640 1 -- 172.21.15.161:0/513655452 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e84030540 con 0x7f1e8402ebe0 2024-02-02T11:49:03.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e91118640 1 --2- 172.21.15.161:0/513655452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e8402fb80 0x7f1e84030000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e9211a640 1 --2- 172.21.15.161:0/513655452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e8402ebe0 0x7f1e8402f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e91118640 1 -- 172.21.15.161:0/513655452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e8402ebe0 msgr2=0x7f1e8402f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e91118640 1 --2- 172.21.15.161:0/513655452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e8402ebe0 0x7f1e8402f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e91118640 1 -- 172.21.15.161:0/513655452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e840e9690 msgr2=0x7f1e840e9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e91118640 1 --2- 172.21.15.161:0/513655452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e840e9690 0x7f1e840e9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e91118640 1 -- 172.21.15.161:0/513655452 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e841874d0 con 0x7f1e8402fb80 2024-02-02T11:49:03.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e91919640 1 --2- 172.21.15.161:0/513655452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e840e9690 0x7f1e840e9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-02T11:49:03.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e91118640 1 --2- 172.21.15.161:0/513655452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e8402fb80 0x7f1e84030000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1e88009000 tx=0x7f1e78007a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f0467fff640 1 --2- 172.21.15.161:0/2641046963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f046814af00 0x7f0468156320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0460009d90 tx=0x7f046001c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=716a4d1a2e305418 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e827fc640 1 -- 172.21.15.161:0/513655452 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e880072d0 con 0x7f1e8402fb80 2024-02-02T11:49:03.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e93b7d640 1 -- 172.21.15.161:0/513655452 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e841877b0 con 0x7f1e8402fb80 2024-02-02T11:49:03.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e93b7d640 1 -- 172.21.15.161:0/513655452 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e84187d70 con 0x7f1e8402fb80 2024-02-02T11:49:03.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e827fc640 1 -- 172.21.15.161:0/513655452 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e88007470 con 0x7f1e8402fb80 2024-02-02T11:49:03.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f04667fc640 1 -- 172.21.15.161:0/2641046963 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04600a5730 con 0x7f046814af00 2024-02-02T11:49:03.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f04667fc640 1 -- 172.21.15.161:0/2641046963 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04600a5890 con 0x7f046814af00 2024-02-02T11:49:03.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f04667fc640 1 -- 172.21.15.161:0/2641046963 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04600a5c20 con 0x7f046814af00 2024-02-02T11:49:03.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7f1e827fc640 1 -- 172.21.15.161:0/513655452 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88001650 con 0x7f1e8402fb80 2024-02-02T11:49:03.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f046df95640 1 -- 172.21.15.161:0/2641046963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f046814af00 msgr2=0x7f0468156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f046df95640 1 --2- 172.21.15.161:0/2641046963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f046814af00 0x7f0468156320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0460009d90 tx=0x7f046001c8d0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f046df95640 1 -- 172.21.15.161:0/2641046963 shutdown_connections 2024-02-02T11:49:03.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f046df95640 1 --2- 172.21.15.161:0/2641046963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f046814af00 0x7f0468156320 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f046df95640 1 -- 172.21.15.161:0/2641046963 >> 172.21.15.161:0/2641046963 conn(0x7f0468069d20 msgr2=0x7f046806a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:03.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f1e93b7d640 1 -- 172.21.15.161:0/513655452 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e74005260 con 0x7f1e8402fb80 2024-02-02T11:49:03.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f4e65d39640 1 Processor -- start 2024-02-02T11:49:03.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f4e65d39640 1 -- start start 2024-02-02T11:49:03.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f046df95640 1 -- 172.21.15.161:0/2641046963 shutdown_connections 2024-02-02T11:49:03.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f046df95640 1 -- 172.21.15.161:0/2641046963 wait complete. 2024-02-02T11:49:03.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f1e827fc640 1 -- 172.21.15.161:0/513655452 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1e880da450 con 0x7f1e8402fb80 2024-02-02T11:49:03.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f1e827fc640 1 --2- 172.21.15.161:0/513655452 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1e78069b70 0x7f1e7806c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f1e827fc640 1 -- 172.21.15.161:0/513655452 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e8813ef50 con 0x7f1e8402fb80 2024-02-02T11:49:03.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f1e91919640 1 --2- 172.21.15.161:0/513655452 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1e78069b70 0x7f1e7806c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f4e65d39640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4e600b5e50 0x7f4e60149f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f4e65d39640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e6006f900 0x7f4e600bc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f4e65d39640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6014a470 con 0x7f4e600b84b0 2024-02-02T11:49:03.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f4e65d39640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e60070c40 con 0x7f4e600b5e50 2024-02-02T11:49:03.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f4e65d39640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e60070960 con 0x7f4e6006f900 2024-02-02T11:49:03.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f475ffff640 1 Processor -- start 2024-02-02T11:49:03.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f4e5ffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e6006f900 0x7f4e600bc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f4e5ffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e6006f900 0x7f4e600bc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.161:58492/0 (socket says 172.21.15.161:58492) 2024-02-02T11:49:03.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f4e5ffff640 1 -- 172.21.15.161:0/3970466073 learned_addr learned my addr 172.21.15.161:0/3970466073 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:03.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f1e91919640 1 --2- 172.21.15.161:0/513655452 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1e78069b70 0x7f1e7806c030 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c006fd0 tx=0x7f1e7c006d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f046df95640 1 Processor -- start 2024-02-02T11:49:03.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f046df95640 1 -- start start 2024-02-02T11:49:03.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f046df95640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04680bc590 0x7f04681e65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f046df95640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f046814aa90 0x7f04681e4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f046df95640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f046814af00 0x7f046813e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f046df95640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04681e6b30 con 0x7f04680bc590 2024-02-02T11:49:03.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f046df95640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04681e7160 con 0x7f046814aa90 2024-02-02T11:49:03.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f046df95640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04680bb910 con 0x7f046814af00 2024-02-02T11:49:03.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f475ffff640 1 -- start start 2024-02-02T11:49:03.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f0467fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f046814af00 0x7f046813e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f475ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4760070070 0x7f4760069d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f475ffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f476006a260 0x7f47601595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f475ffff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47600b8ee0 con 0x7f47600b68b0 2024-02-02T11:49:03.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f475ffff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4760071400 con 0x7f4760070070 2024-02-02T11:49:03.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f475ffff640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476006fbe0 con 0x7f476006a260 2024-02-02T11:49:03.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f0467fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f046814af00 0x7f046813e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.161:58496/0 (socket says 172.21.15.161:58496) 2024-02-02T11:49:03.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f0467fff640 1 -- 172.21.15.161:0/4029102528 learned_addr learned my addr 172.21.15.161:0/4029102528 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:03.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7f475f7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f476006a260 0x7f47601595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f475f7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f476006a260 0x7f47601595d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.161:58504/0 (socket says 172.21.15.161:58504) 2024-02-02T11:49:03.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f475f7fe640 1 -- 172.21.15.161:0/2031704531 learned_addr learned my addr 172.21.15.161:0/2031704531 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:03.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f475e7fc640 1 --2- 172.21.15.161:0/2031704531 >> v2:172.21.15.161:3300/0 conn(0x7f4760070070 0x7f4760069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f4e5f7fe640 1 --2- 172.21.15.161:0/3970466073 >> v2:172.21.15.161:3300/0 conn(0x7f4e600b5e50 0x7f4e60149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f04677fe640 1 --2- 172.21.15.161:0/4029102528 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04680bc590 0x7f04681e65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f0467fff640 1 -- 172.21.15.161:0/4029102528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f046814aa90 msgr2=0x7f04681e4300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-02T11:49:03.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f0467fff640 1 --2- 172.21.15.161:0/4029102528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f046814aa90 0x7f04681e4300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f0467fff640 1 -- 172.21.15.161:0/4029102528 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04680bc590 msgr2=0x7f04681e65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f0467fff640 1 --2- 172.21.15.161:0/4029102528 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04680bc590 0x7f04681e65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f0467fff640 1 -- 172.21.15.161:0/4029102528 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0460009a70 con 0x7f046814af00 2024-02-02T11:49:03.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f475e7fc640 1 -- 172.21.15.161:0/2031704531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f476006a260 msgr2=0x7f47601595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:03.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f475e7fc640 1 --2- 172.21.15.161:0/2031704531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f476006a260 0x7f47601595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f475e7fc640 1 -- 172.21.15.161:0/2031704531 >> v1:172.21.15.161:6789/0 conn(0x7f47600b68b0 legacy=0x7f4760152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f475e7fc640 1 -- 172.21.15.161:0/2031704531 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476006a710 con 0x7f4760070070 2024-02-02T11:49:03.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f0467fff640 1 --2- 172.21.15.161:0/4029102528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f046814af00 0x7f046813e3f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f046001af80 tx=0x7f0460019670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f044ffff640 1 -- 172.21.15.161:0/4029102528 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04600a5690 con 0x7f046814af00 2024-02-02T11:49:03.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f044ffff640 1 -- 172.21.15.161:0/4029102528 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04600ad650 con 0x7f046814af00 2024-02-02T11:49:03.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f044ffff640 1 -- 172.21.15.161:0/4029102528 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04600ad9e0 con 0x7f046814af00 2024-02-02T11:49:03.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f046df95640 1 -- 172.21.15.161:0/4029102528 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0468143240 con 0x7f046814af00 2024-02-02T11:49:03.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f046df95640 1 -- 172.21.15.161:0/4029102528 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04680b2b00 con 0x7f046814af00 2024-02-02T11:49:03.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f046df95640 1 -- 172.21.15.161:0/4029102528 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04681441c0 con 0x7f046814af00 2024-02-02T11:49:03.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f4e5ffff640 1 -- 172.21.15.161:0/3970466073 >> v2:172.21.15.161:3300/0 conn(0x7f4e600b5e50 msgr2=0x7f4e60149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:03.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f4e5ffff640 1 --2- 172.21.15.161:0/3970466073 >> v2:172.21.15.161:3300/0 conn(0x7f4e600b5e50 0x7f4e60149f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f4e5ffff640 1 -- 172.21.15.161:0/3970466073 >> v1:172.21.15.162:6789/0 conn(0x7f4e600b84b0 legacy=0x7f4e60070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f4e5ffff640 1 -- 172.21.15.161:0/3970466073 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6006f100 con 0x7f4e6006f900 2024-02-02T11:49:03.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7fbd17761640 1 Processor -- start 2024-02-02T11:49:03.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7fbd17761640 1 -- start start 2024-02-02T11:49:03.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7fbd17761640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbd1006ee70 0x7fbd1015b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7fbd17761640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbd1015b8c0 0x7fbd100b6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7fbd17761640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd100b7f40 0x7fbd100b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7fbd17761640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd100b3110 con 0x7fbd1015b8c0 2024-02-02T11:49:03.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7fbd17761640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd100715f0 con 0x7fbd1006ee70 2024-02-02T11:49:03.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7fbd17761640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1006f7e0 con 0x7fbd100b7f40 2024-02-02T11:49:03.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7fbd15cfe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd100b7f40 0x7fbd100b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7fbd154fd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbd1006ee70 0x7fbd1015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.315+0000 7fbd14cfc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbd1015b8c0 0x7fbd100b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7fbd14cfc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbd1015b8c0 0x7fbd100b6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39688/0 (socket says 172.21.15.161:39688) 2024-02-02T11:49:03.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7fbd14cfc640 1 -- 172.21.15.161:0/628840005 learned_addr learned my addr 172.21.15.161:0/628840005 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:03.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7fbd15cfe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd100b7f40 0x7fbd100b6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.161:58476/0 (socket says 172.21.15.161:58476) 2024-02-02T11:49:03.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7fbd14cfc640 1 -- 172.21.15.161:0/628840005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd100b7f40 msgr2=0x7fbd100b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:03.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7fbd14cfc640 1 --2- 172.21.15.161:0/628840005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd100b7f40 0x7fbd100b6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7fbd14cfc640 1 -- 172.21.15.161:0/628840005 >> v2:172.21.15.162:3300/0 conn(0x7fbd1006ee70 msgr2=0x7fbd1015b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:03.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7fbd154fd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbd1006ee70 0x7fbd1015b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.161:55106/0 (socket says 172.21.15.161:55106) 2024-02-02T11:49:03.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7fbd14cfc640 1 --2- 172.21.15.161:0/628840005 >> v2:172.21.15.162:3300/0 conn(0x7fbd1006ee70 0x7fbd1015b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.319+0000 7fbd14cfc640 1 -- 172.21.15.161:0/628840005 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd100bc300 con 0x7fbd1015b8c0 2024-02-02T11:49:03.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7fbd154fd640 1 --2- 172.21.15.161:0/628840005 >> v2:172.21.15.162:3300/0 conn(0x7fbd1006ee70 0x7fbd1015b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:03.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f475e7fc640 1 --2- 172.21.15.161:0/2031704531 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4760070070 0x7f4760069d20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f47500097c0 tx=0x7f475001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985e581f525fff71 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.323+0000 7f475dffb640 1 -- 172.21.15.161:0/2031704531 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47500ab600 con 0x7f4760070070 2024-02-02T11:49:03.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f044ffff640 1 -- 172.21.15.161:0/4029102528 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f04600adb40 con 0x7f046814af00 2024-02-02T11:49:03.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f475dffb640 1 -- 172.21.15.161:0/2031704531 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47500a7050 con 0x7f4760070070 2024-02-02T11:49:03.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f475dffb640 1 -- 172.21.15.161:0/2031704531 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47500ab980 con 0x7f4760070070 2024-02-02T11:49:03.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f044ffff640 1 --2- 172.21.15.161:0/4029102528 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0454065a60 0x7f0454067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f044ffff640 1 -- 172.21.15.161:0/4029102528 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f046011e770 con 0x7f046814af00 2024-02-02T11:49:03.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f04677fe640 1 --2- 172.21.15.161:0/4029102528 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0454065a60 0x7f0454067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f4e5ffff640 1 --2- 172.21.15.161:0/3970466073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e6006f900 0x7f4e600bc480 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009a50 tx=0x7f4e5801cc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43a66f49390fd217 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f475ffff640 1 -- 172.21.15.161:0/2031704531 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4760070070 msgr2=0x7f4760069d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f475ffff640 1 --2- 172.21.15.161:0/2031704531 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4760070070 0x7f4760069d20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f47500097c0 tx=0x7f475001c480 comp rx=0 tx=0).stop 2024-02-02T11:49:03.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f475ffff640 1 -- 172.21.15.161:0/2031704531 shutdown_connections 2024-02-02T11:49:03.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f475ffff640 1 --2- 172.21.15.161:0/2031704531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f476006a260 0x7f47601595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f475ffff640 1 --2- 172.21.15.161:0/2031704531 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4760070070 0x7f4760069d20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f475ffff640 1 -- 172.21.15.161:0/2031704531 >> 172.21.15.161:0/2031704531 conn(0x7f47600b98f0 msgr2=0x7f47600b9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:03.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f475ffff640 1 -- 172.21.15.161:0/2031704531 shutdown_connections 2024-02-02T11:49:03.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f475ffff640 1 -- 172.21.15.161:0/2031704531 wait complete. 2024-02-02T11:49:03.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7fbd14cfc640 1 --2- 172.21.15.161:0/628840005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd1015b8c0 0x7fbd100b6890 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbd1006b750 tx=0x7fbd0001f020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b31ccac182335fa server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7fbd07fff640 1 -- 172.21.15.161:0/628840005 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd000a8dd0 con 0x7fbd1015b8c0 2024-02-02T11:49:03.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7fbd07fff640 1 -- 172.21.15.161:0/628840005 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd000ac070 con 0x7fbd1015b8c0 2024-02-02T11:49:03.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f04677fe640 1 --2- 172.21.15.161:0/4029102528 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0454065a60 0x7f0454067f20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f04580016c0 tx=0x7f0458009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7fbd07fff640 1 -- 172.21.15.161:0/628840005 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd000b2640 con 0x7fbd1015b8c0 2024-02-02T11:49:03.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7fbd17761640 1 -- 172.21.15.161:0/628840005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd1015b8c0 msgr2=0x7fbd100b6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7fbd17761640 1 --2- 172.21.15.161:0/628840005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd1015b8c0 0x7fbd100b6890 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbd1006b750 tx=0x7fbd0001f020 comp rx=0 tx=0).stop 2024-02-02T11:49:03.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7fbd17761640 1 -- 172.21.15.161:0/628840005 shutdown_connections 2024-02-02T11:49:03.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7fbd17761640 1 --2- 172.21.15.161:0/628840005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd100b7f40 0x7fbd100b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7fbd17761640 1 --2- 172.21.15.161:0/628840005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd1015b8c0 0x7fbd100b6890 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7fbd17761640 1 --2- 172.21.15.161:0/628840005 >> v2:172.21.15.162:3300/0 conn(0x7fbd1006ee70 0x7fbd1015b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7fbd17761640 1 -- 172.21.15.161:0/628840005 >> 172.21.15.161:0/628840005 conn(0x7fbd10069d20 msgr2=0x7fbd1006a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:03.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7fbd17761640 1 -- 172.21.15.161:0/628840005 shutdown_connections 2024-02-02T11:49:03.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7fbd17761640 1 -- 172.21.15.161:0/628840005 wait complete. 2024-02-02T11:49:03.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f475ffff640 1 Processor -- start 2024-02-02T11:49:03.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f475ffff640 1 -- start start 2024-02-02T11:49:03.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f99460c8640 1 Processor -- start 2024-02-02T11:49:03.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f99460c8640 1 -- start start 2024-02-02T11:49:03.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f475ffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f476006a260 0x7f476013c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.327+0000 7f475ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4760070070 0x7f476014b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f475ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47600b68b0 0x7f476014a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f475ffff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4760150060 con 0x7f47600b68b0 2024-02-02T11:49:03.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f475ffff640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476014fe10 con 0x7f4760070070 2024-02-02T11:49:03.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f475ffff640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4760149f00 con 0x7f476006a260 2024-02-02T11:49:03.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f475f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47600b68b0 0x7f476014a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f475f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47600b68b0 0x7f476014a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39710/0 (socket says 172.21.15.161:39710) 2024-02-02T11:49:03.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f475f7fe640 1 -- 172.21.15.161:0/896110662 learned_addr learned my addr 172.21.15.161:0/896110662 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:03.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd17761640 1 Processor -- start 2024-02-02T11:49:03.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f99460c8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9938006f90 0x7f9938007370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f99460c8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f99380cede0 0x7f99380c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd17761640 1 -- start start 2024-02-02T11:49:03.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f475effd640 1 --2- 172.21.15.161:0/896110662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f476006a260 0x7f476013c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f475e7fc640 1 --2- 172.21.15.161:0/896110662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4760070070 0x7f476014b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f475f7fe640 1 -- 172.21.15.161:0/896110662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f476006a260 msgr2=0x7f476013c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f475f7fe640 1 --2- 172.21.15.161:0/896110662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f476006a260 0x7f476013c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f475f7fe640 1 -- 172.21.15.161:0/896110662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4760070070 msgr2=0x7f476014b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f475f7fe640 1 --2- 172.21.15.161:0/896110662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4760070070 0x7f476014b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f475f7fe640 1 -- 172.21.15.161:0/896110662 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4750009420 con 0x7f47600b68b0 2024-02-02T11:49:03.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f475e7fc640 1 --2- 172.21.15.161:0/896110662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4760070070 0x7f476014b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:49:03.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f99460c8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f99380cf220 0x7f993803c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f99460c8640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f993803d920 con 0x7f99380cf220 2024-02-02T11:49:03.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f99460c8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99380078b0 con 0x7f99380cede0 2024-02-02T11:49:03.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f99458c7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f99380cf220 0x7f993803c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f99450c6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9938006f90 0x7f9938007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f99458c7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f99380cf220 0x7f993803c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39718/0 (socket says 172.21.15.161:39718) 2024-02-02T11:49:03.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f99458c7640 1 -- 172.21.15.161:0/4180862513 learned_addr learned my addr 172.21.15.161:0/4180862513 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:03.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f99448c5640 1 --2- 172.21.15.161:0/4180862513 >> v2:172.21.15.162:3300/0 conn(0x7f99380cede0 0x7f99380c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f99460c8640 1 -- 172.21.15.161:0/4180862513 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993803b080 con 0x7f9938006f90 2024-02-02T11:49:03.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f475f7fe640 1 --2- 172.21.15.161:0/896110662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47600b68b0 0x7f476014a710 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4758009d90 tx=0x7f475800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f99458c7640 1 -- 172.21.15.161:0/4180862513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9938006f90 msgr2=0x7f9938007370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:03.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f99458c7640 1 --2- 172.21.15.161:0/4180862513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9938006f90 0x7f9938007370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f99458c7640 1 -- 172.21.15.161:0/4180862513 >> v2:172.21.15.162:3300/0 conn(0x7f99380cede0 msgr2=0x7f99380c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:03.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f99458c7640 1 --2- 172.21.15.161:0/4180862513 >> v2:172.21.15.162:3300/0 conn(0x7f99380cede0 0x7f99380c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f99458c7640 1 -- 172.21.15.161:0/4180862513 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993803ff90 con 0x7f99380cf220 2024-02-02T11:49:03.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f99448c5640 1 --2- 172.21.15.161:0/4180862513 >> v2:172.21.15.162:3300/0 conn(0x7f99380cede0 0x7f99380c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-02T11:49:03.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.335+0000 7f99458c7640 1 --2- 172.21.15.161:0/4180862513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99380cf220 0x7f993803c880 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9940065790 tx=0x7f9940096480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c11c5063521c16 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd17761640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd1006ee70 0x7fbd10158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd17761640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd100b7f40 0x7fbd101eca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd17761640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd1015b8c0 0x7fbd101ecf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd17761640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd10159760 con 0x7fbd1015b8c0 2024-02-02T11:49:03.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd17761640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd10157830 con 0x7fbd100b7f40 2024-02-02T11:49:03.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd17761640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd10157b10 con 0x7fbd1006ee70 2024-02-02T11:49:03.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd15cfe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd1015b8c0 0x7fbd101ecf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd15cfe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd1015b8c0 0x7fbd101ecf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39726/0 (socket says 172.21.15.161:39726) 2024-02-02T11:49:03.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd15cfe640 1 -- 172.21.15.161:0/1737582051 learned_addr learned my addr 172.21.15.161:0/1737582051 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:03.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd154fd640 1 --2- 172.21.15.161:0/1737582051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd1006ee70 0x7fbd10158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd15cfe640 1 -- 172.21.15.161:0/1737582051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd1006ee70 msgr2=0x7fbd10158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd15cfe640 1 --2- 172.21.15.161:0/1737582051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd1006ee70 0x7fbd10158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd15cfe640 1 -- 172.21.15.161:0/1737582051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd100b7f40 msgr2=0x7fbd101eca40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-02T11:49:03.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd15cfe640 1 --2- 172.21.15.161:0/1737582051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd100b7f40 0x7fbd101eca40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd15cfe640 1 -- 172.21.15.161:0/1737582051 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0000a6f0 con 0x7fbd1015b8c0 2024-02-02T11:49:03.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd15cfe640 1 --2- 172.21.15.161:0/1737582051 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd1015b8c0 0x7fbd101ecf80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbd080099b0 tx=0x7fbd08009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd05ffb640 1 -- 172.21.15.161:0/1737582051 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0800d320 con 0x7fbd1015b8c0 2024-02-02T11:49:03.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd05ffb640 1 -- 172.21.15.161:0/1737582051 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0800d480 con 0x7fbd1015b8c0 2024-02-02T11:49:03.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd17761640 1 -- 172.21.15.161:0/1737582051 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd10157df0 con 0x7fbd1015b8c0 2024-02-02T11:49:03.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd05ffb640 1 -- 172.21.15.161:0/1737582051 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd08003be0 con 0x7fbd1015b8c0 2024-02-02T11:49:03.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd17761640 1 -- 172.21.15.161:0/1737582051 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd10159470 con 0x7fbd1015b8c0 2024-02-02T11:49:03.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7fbd17761640 1 -- 172.21.15.161:0/1737582051 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd101ec7d0 con 0x7fbd1015b8c0 2024-02-02T11:49:03.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.335+0000 7f1e827fc640 1 -- 172.21.15.161:0/513655452 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1e8810c9c0 con 0x7f1e8402fb80 2024-02-02T11:49:03.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f4747fff640 1 -- 172.21.15.161:0/896110662 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475800ccc0 con 0x7f47600b68b0 2024-02-02T11:49:03.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f4747fff640 1 -- 172.21.15.161:0/896110662 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475800f040 con 0x7f47600b68b0 2024-02-02T11:49:03.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f4747fff640 1 -- 172.21.15.161:0/896110662 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47580039a0 con 0x7f47600b68b0 2024-02-02T11:49:03.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f475ffff640 1 -- 172.21.15.161:0/896110662 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4760149bd0 con 0x7f47600b68b0 2024-02-02T11:49:03.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f475ffff640 1 -- 172.21.15.161:0/896110662 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476014a390 con 0x7f47600b68b0 2024-02-02T11:49:03.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f475ffff640 1 -- 172.21.15.161:0/896110662 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4760074100 con 0x7f47600b68b0 2024-02-02T11:49:03.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.331+0000 7f4747fff640 1 -- 172.21.15.161:0/896110662 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4758003b00 con 0x7f47600b68b0 2024-02-02T11:49:03.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.335+0000 7f4747fff640 1 --2- 172.21.15.161:0/896110662 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f474c065ab0 0x7f474c067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.335+0000 7f4747fff640 1 -- 172.21.15.161:0/896110662 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4758083570 con 0x7f47600b68b0 2024-02-02T11:49:03.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.335+0000 7f475effd640 1 --2- 172.21.15.161:0/896110662 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f474c065ab0 0x7f474c067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.335+0000 7f475effd640 1 --2- 172.21.15.161:0/896110662 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f474c065ab0 0x7f474c067f70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4754001770 tx=0x7f4754009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.339+0000 7f4e5effd640 1 -- 172.21.15.161:0/3970466073 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e580a5b60 con 0x7f4e6006f900 2024-02-02T11:49:03.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.339+0000 7f4e5effd640 1 -- 172.21.15.161:0/3970466073 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e580a5cc0 con 0x7f4e6006f900 2024-02-02T11:49:03.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.339+0000 7f044ffff640 1 -- 172.21.15.161:0/4029102528 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f04600efbb0 con 0x7f046814af00 2024-02-02T11:49:03.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.339+0000 7f4e65d39640 1 -- 172.21.15.161:0/3970466073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e6006f900 msgr2=0x7f4e600bc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.339+0000 7f4e65d39640 1 --2- 172.21.15.161:0/3970466073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e6006f900 0x7f4e600bc480 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009a50 tx=0x7f4e5801cc90 comp rx=0 tx=0).stop 2024-02-02T11:49:03.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.339+0000 7f4e65d39640 1 -- 172.21.15.161:0/3970466073 shutdown_connections 2024-02-02T11:49:03.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.339+0000 7f4e65d39640 1 --2- 172.21.15.161:0/3970466073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e6006f900 0x7f4e600bc480 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.339+0000 7f4e65d39640 1 --2- 172.21.15.161:0/3970466073 >> v2:172.21.15.161:3300/0 conn(0x7f4e600b5e50 0x7f4e60149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.339+0000 7f4e65d39640 1 -- 172.21.15.161:0/3970466073 >> 172.21.15.161:0/3970466073 conn(0x7f4e60069d20 msgr2=0x7f4e6006a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:03.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.339+0000 7f4e65d39640 1 -- 172.21.15.161:0/3970466073 shutdown_connections 2024-02-02T11:49:03.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.339+0000 7f4e65d39640 1 -- 172.21.15.161:0/3970466073 wait complete. 2024-02-02T11:49:03.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.339+0000 7f4e65d39640 1 Processor -- start 2024-02-02T11:49:03.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.339+0000 7fbd05ffb640 1 -- 172.21.15.161:0/1737582051 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbd08003d40 con 0x7fbd1015b8c0 2024-02-02T11:49:03.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.339+0000 7fbd05ffb640 1 --2- 172.21.15.161:0/1737582051 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbcf4065a60 0x7fbcf4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.339+0000 7fbd05ffb640 1 -- 172.21.15.161:0/1737582051 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd0808c570 con 0x7fbd1015b8c0 2024-02-02T11:49:03.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.339+0000 7fbd05ffb640 1 -- 172.21.15.161:0/1737582051 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbd0805d150 con 0x7fbd1015b8c0 2024-02-02T11:49:03.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.339+0000 7fbd154fd640 1 --2- 172.21.15.161:0/1737582051 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbcf4065a60 0x7fbcf4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.339+0000 7fbd154fd640 1 --2- 172.21.15.161:0/1737582051 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbcf4065a60 0x7fbcf4067f20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c006fd0 tx=0x7fbd0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.343+0000 7f9937fff640 1 -- 172.21.15.161:0/4180862513 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940125600 con 0x7f99380cf220 2024-02-02T11:49:03.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.343+0000 7f4e65d39640 1 -- start start 2024-02-02T11:49:03.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.343+0000 7f4e65d39640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e6006f900 0x7f4e601f0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.343+0000 7f4e65d39640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e600b5e50 0x7f4e60146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.343+0000 7f4e65d39640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e600b84b0 0x7f4e601f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.343+0000 7f4e65d39640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e60142d80 con 0x7f4e6006f900 2024-02-02T11:49:03.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.343+0000 7f4e65d39640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6014b420 con 0x7f4e600b5e50 2024-02-02T11:49:03.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.343+0000 7f4e65d39640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e60142a10 con 0x7f4e600b84b0 2024-02-02T11:49:03.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.343+0000 7f4e5f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e6006f900 0x7f4e601f0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.343+0000 7f4e5f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e6006f900 0x7f4e601f0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39730/0 (socket says 172.21.15.161:39730) 2024-02-02T11:49:03.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.343+0000 7f4e5f7fe640 1 -- 172.21.15.161:0/1197753334 learned_addr learned my addr 172.21.15.161:0/1197753334 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:03.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.343+0000 7f4e57fff640 1 --2- 172.21.15.161:0/1197753334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e600b5e50 0x7f4e60146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.343+0000 7f4e5f7fe640 1 -- 172.21.15.161:0/1197753334 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e600b84b0 msgr2=0x7f4e601f3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.343+0000 7f4e5f7fe640 1 --2- 172.21.15.161:0/1197753334 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e600b84b0 0x7f4e601f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.343+0000 7f4e5f7fe640 1 -- 172.21.15.161:0/1197753334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e600b5e50 msgr2=0x7f4e60146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.343+0000 7f4e5f7fe640 1 --2- 172.21.15.161:0/1197753334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e600b5e50 0x7f4e60146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.343+0000 7f4e5f7fe640 1 -- 172.21.15.161:0/1197753334 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e580096b0 con 0x7f4e6006f900 2024-02-02T11:49:03.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.343+0000 7f4e57fff640 1 --2- 172.21.15.161:0/1197753334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e600b5e50 0x7f4e60146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:49:03.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.343+0000 7f4e5f7fe640 1 --2- 172.21.15.161:0/1197753334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e6006f900 0x7f4e601f0770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800da80 tx=0x7f4e4800df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.347+0000 7f4e5cff9640 1 -- 172.21.15.161:0/1197753334 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4800b1c0 con 0x7f4e6006f900 2024-02-02T11:49:03.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.347+0000 7f4747fff640 1 -- 172.21.15.161:0/896110662 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4758050fa0 con 0x7f47600b68b0 2024-02-02T11:49:03.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.347+0000 7f9937fff640 1 -- 172.21.15.161:0/4180862513 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9940121050 con 0x7f99380cf220 2024-02-02T11:49:03.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.347+0000 7f9937fff640 1 -- 172.21.15.161:0/4180862513 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940125a60 con 0x7f99380cf220 2024-02-02T11:49:03.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.351+0000 7f4e5cff9640 1 -- 172.21.15.161:0/1197753334 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e48009af0 con 0x7f4e6006f900 2024-02-02T11:49:03.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.351+0000 7f4e5cff9640 1 -- 172.21.15.161:0/1197753334 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e48009ea0 con 0x7f4e6006f900 2024-02-02T11:49:03.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.351+0000 7f99460c8640 1 -- 172.21.15.161:0/4180862513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99380cf220 msgr2=0x7f993803c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.351+0000 7f99460c8640 1 --2- 172.21.15.161:0/4180862513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99380cf220 0x7f993803c880 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9940065790 tx=0x7f9940096480 comp rx=0 tx=0).stop 2024-02-02T11:49:03.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.351+0000 7f99460c8640 1 -- 172.21.15.161:0/4180862513 shutdown_connections 2024-02-02T11:49:03.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.351+0000 7f99460c8640 1 --2- 172.21.15.161:0/4180862513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99380cf220 0x7f993803c880 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.351+0000 7f99460c8640 1 --2- 172.21.15.161:0/4180862513 >> v2:172.21.15.162:3300/0 conn(0x7f99380cede0 0x7f99380c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.351+0000 7f99460c8640 1 --2- 172.21.15.161:0/4180862513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9938006f90 0x7f9938007370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.351+0000 7f99460c8640 1 -- 172.21.15.161:0/4180862513 >> 172.21.15.161:0/4180862513 conn(0x7f9938006210 msgr2=0x7f9938006620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:03.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.351+0000 7f4e65d39640 1 -- 172.21.15.161:0/1197753334 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6014c820 con 0x7f4e6006f900 2024-02-02T11:49:03.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.351+0000 7f99460c8640 1 -- 172.21.15.161:0/4180862513 shutdown_connections 2024-02-02T11:49:03.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.351+0000 7f4e65d39640 1 -- 172.21.15.161:0/1197753334 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e601f0cb0 con 0x7f4e6006f900 2024-02-02T11:49:03.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.351+0000 7f4e55ffb640 1 -- 172.21.15.161:0/1197753334 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e38005260 con 0x7f4e6006f900 2024-02-02T11:49:03.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.351+0000 7f99460c8640 1 -- 172.21.15.161:0/4180862513 wait complete. 2024-02-02T11:49:03.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.351+0000 7f99460c8640 1 Processor -- start 2024-02-02T11:49:03.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.351+0000 7f99460c8640 1 -- start start 2024-02-02T11:49:03.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.351+0000 7f99460c8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9938006f90 0x7f99380c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f99460c8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99380cede0 0x7f99380c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f99460c8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99380cf220 0x7f99380ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f99460c8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9938167f50 con 0x7f9938006f90 2024-02-02T11:49:03.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f99460c8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99380c5990 con 0x7f99380cede0 2024-02-02T11:49:03.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f99460c8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993817a560 con 0x7f99380cf220 2024-02-02T11:49:03.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f99448c5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99380cede0 0x7f99380c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f99448c5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99380cede0 0x7f99380c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.161:55168/0 (socket says 172.21.15.161:55168) 2024-02-02T11:49:03.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f99448c5640 1 -- 172.21.15.161:0/3982339769 learned_addr learned my addr 172.21.15.161:0/3982339769 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:03.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f99458c7640 1 --2- 172.21.15.161:0/3982339769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99380cf220 0x7f99380ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f4e5cff9640 1 -- 172.21.15.161:0/1197753334 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4e48020400 con 0x7f4e6006f900 2024-02-02T11:49:03.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f4e5cff9640 1 --2- 172.21.15.161:0/1197753334 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4e4c065b80 0x7f4e4c068040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f4e5cff9640 1 -- 172.21.15.161:0/1197753334 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e48083330 con 0x7f4e6006f900 2024-02-02T11:49:03.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f4e57fff640 1 --2- 172.21.15.161:0/1197753334 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4e4c065b80 0x7f4e4c068040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f4e57fff640 1 --2- 172.21.15.161:0/1197753334 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4e4c065b80 0x7f4e4c068040 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4e60150380 tx=0x7f4e50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f99450c6640 1 --2- 172.21.15.161:0/3982339769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9938006f90 0x7f99380c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f99450c6640 1 -- 172.21.15.161:0/3982339769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99380cf220 msgr2=0x7f99380ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f99450c6640 1 --2- 172.21.15.161:0/3982339769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99380cf220 0x7f99380ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f99450c6640 1 -- 172.21.15.161:0/3982339769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99380cede0 msgr2=0x7f99380c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f99450c6640 1 --2- 172.21.15.161:0/3982339769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99380cede0 0x7f99380c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f99450c6640 1 -- 172.21.15.161:0/3982339769 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9930009420 con 0x7f9938006f90 2024-02-02T11:49:03.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.355+0000 7f99450c6640 1 --2- 172.21.15.161:0/3982339769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9938006f90 0x7f99380c5e20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f993c00e870 tx=0x7f993c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.359+0000 7f9935ffb640 1 -- 172.21.15.161:0/3982339769 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c00c940 con 0x7f9938006f90 2024-02-02T11:49:03.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.359+0000 7f4e5cff9640 1 -- 172.21.15.161:0/1197753334 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4e48050ce0 con 0x7f4e6006f900 2024-02-02T11:49:03.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.359+0000 7f99460c8640 1 -- 172.21.15.161:0/3982339769 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993817a840 con 0x7f9938006f90 2024-02-02T11:49:03.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.359+0000 7f99460c8640 1 -- 172.21.15.161:0/3982339769 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993817a130 con 0x7f9938006f90 2024-02-02T11:49:03.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.363+0000 7f9935ffb640 1 -- 172.21.15.161:0/3982339769 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c00caa0 con 0x7f9938006f90 2024-02-02T11:49:03.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.363+0000 7f9935ffb640 1 -- 172.21.15.161:0/3982339769 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c0095d0 con 0x7f9938006f90 2024-02-02T11:49:03.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.363+0000 7f9935ffb640 1 -- 172.21.15.161:0/3982339769 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f993c013470 con 0x7f9938006f90 2024-02-02T11:49:03.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.363+0000 7f9935ffb640 1 --2- 172.21.15.161:0/3982339769 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9924065ae0 0x7f9924067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.363+0000 7f9935ffb640 1 -- 172.21.15.161:0/3982339769 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f993c083780 con 0x7f9938006f90 2024-02-02T11:49:03.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.363+0000 7f99448c5640 1 --2- 172.21.15.161:0/3982339769 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9924065ae0 0x7f9924067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.367+0000 7f99448c5640 1 --2- 172.21.15.161:0/3982339769 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9924065ae0 0x7f9924067fa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f993803cd40 tx=0x7f9930009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.367+0000 7f99460c8640 1 -- 172.21.15.161:0/3982339769 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9920005260 con 0x7f9938006f90 2024-02-02T11:49:03.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.375+0000 7f9935ffb640 1 -- 172.21.15.161:0/3982339769 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f993c051140 con 0x7f9938006f90 2024-02-02T11:49:03.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.543+0000 7f23486ad640 1 -- 172.21.15.161:0/3389011247 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2328005510 con 0x7f23400b7950 2024-02-02T11:49:03.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.543+0000 7f2336ffd640 1 -- 172.21.15.161:0/3389011247 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f233c021020 con 0x7f23400b7950 2024-02-02T11:49:03.545 INFO:teuthology.orchestra.run.smithi161.stdout:55834574855 2024-02-02T11:49:03.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.547+0000 7f2334ff9640 1 -- 172.21.15.161:0/3389011247 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2324065ab0 msgr2=0x7f2324067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.547+0000 7f2334ff9640 1 --2- 172.21.15.161:0/3389011247 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2324065ab0 0x7f2324067f70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f23380b2000 tx=0x7f23380ab000 comp rx=0 tx=0).stop 2024-02-02T11:49:03.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.547+0000 7f2334ff9640 1 -- 172.21.15.161:0/3389011247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23400b7950 msgr2=0x7f2340098d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.547+0000 7f2334ff9640 1 --2- 172.21.15.161:0/3389011247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23400b7950 0x7f2340098d30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f233c00e960 tx=0x7f233c00ee20 comp rx=0 tx=0).stop 2024-02-02T11:49:03.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.547+0000 7f2334ff9640 1 -- 172.21.15.161:0/3389011247 shutdown_connections 2024-02-02T11:49:03.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.547+0000 7f2334ff9640 1 --2- 172.21.15.161:0/3389011247 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2324065ab0 0x7f2324067f70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.547+0000 7f2334ff9640 1 --2- 172.21.15.161:0/3389011247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2340146fe0 0x7f23401e4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.547+0000 7f2334ff9640 1 --2- 172.21.15.161:0/3389011247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23400b7d30 0x7f23400b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.547+0000 7f2334ff9640 1 --2- 172.21.15.161:0/3389011247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23400b7950 0x7f2340098d30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.547+0000 7f2334ff9640 1 -- 172.21.15.161:0/3389011247 >> 172.21.15.161:0/3389011247 conn(0x7f23400bbd20 msgr2=0x7f2340146020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:03.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.547+0000 7f2334ff9640 1 -- 172.21.15.161:0/3389011247 shutdown_connections 2024-02-02T11:49:03.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.547+0000 7f2334ff9640 1 -- 172.21.15.161:0/3389011247 wait complete. 2024-02-02T11:49:03.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-02-02T11:49:03.572 DEBUG:teuthology.parallel:result is None 2024-02-02T11:49:03.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.595+0000 7fdc3e1dd640 1 -- 172.21.15.161:0/1461129352 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdc18005510 con 0x7fdc380b7d30 2024-02-02T11:49:03.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.595+0000 7fdc1ffff640 1 -- 172.21.15.161:0/1461129352 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdc300eb8d0 con 0x7fdc380b7d30 2024-02-02T11:49:03.599 INFO:teuthology.orchestra.run.smithi161.stdout:55834574856 2024-02-02T11:49:03.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.595+0000 7fdc3e1dd640 1 -- 172.21.15.161:0/1461129352 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fdc24065bb0 msgr2=0x7fdc24068070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.595+0000 7fdc3e1dd640 1 --2- 172.21.15.161:0/1461129352 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fdc24065bb0 0x7fdc24068070 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdc381dfa50 tx=0x7fdc2c009040 comp rx=0 tx=0).stop 2024-02-02T11:49:03.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.595+0000 7fdc3e1dd640 1 -- 172.21.15.161:0/1461129352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc380b7d30 msgr2=0x7fdc380b9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.595+0000 7fdc3e1dd640 1 --2- 172.21.15.161:0/1461129352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc380b7d30 0x7fdc380b9d60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdc3001b5a0 tx=0x7fdc3001a710 comp rx=0 tx=0).stop 2024-02-02T11:49:03.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.595+0000 7fdc3e1dd640 1 -- 172.21.15.161:0/1461129352 shutdown_connections 2024-02-02T11:49:03.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.595+0000 7fdc3e1dd640 1 --2- 172.21.15.161:0/1461129352 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fdc24065bb0 0x7fdc24068070 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.595+0000 7fdc3e1dd640 1 --2- 172.21.15.161:0/1461129352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc38149110 0x7fdc380b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.595+0000 7fdc3e1dd640 1 --2- 172.21.15.161:0/1461129352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc38146fe0 0x7fdc380b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.595+0000 7fdc3e1dd640 1 --2- 172.21.15.161:0/1461129352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc380b7d30 0x7fdc380b9d60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.595+0000 7fdc3e1dd640 1 -- 172.21.15.161:0/1461129352 >> 172.21.15.161:0/1461129352 conn(0x7fdc380bbd20 msgr2=0x7fdc381d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:03.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.599+0000 7fdc3e1dd640 1 -- 172.21.15.161:0/1461129352 shutdown_connections 2024-02-02T11:49:03.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.599+0000 7fdc3e1dd640 1 -- 172.21.15.161:0/1461129352 wait complete. 2024-02-02T11:49:03.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-02-02T11:49:03.622 DEBUG:teuthology.parallel:result is None 2024-02-02T11:49:03.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.627+0000 7f99460c8640 1 -- 172.21.15.161:0/3982339769 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9920005510 con 0x7f9938006f90 2024-02-02T11:49:03.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.627+0000 7f9935ffb640 1 -- 172.21.15.161:0/3982339769 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f993c021070 con 0x7f9938006f90 2024-02-02T11:49:03.630 INFO:teuthology.orchestra.run.smithi161.stdout:55834574855 2024-02-02T11:49:03.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.627+0000 7f99460c8640 1 -- 172.21.15.161:0/3982339769 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9924065ae0 msgr2=0x7f9924067fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.627+0000 7f99460c8640 1 --2- 172.21.15.161:0/3982339769 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9924065ae0 0x7f9924067fa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f993803cd40 tx=0x7f9930009190 comp rx=0 tx=0).stop 2024-02-02T11:49:03.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.627+0000 7f99460c8640 1 -- 172.21.15.161:0/3982339769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9938006f90 msgr2=0x7f99380c5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.627+0000 7f99460c8640 1 --2- 172.21.15.161:0/3982339769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9938006f90 0x7f99380c5e20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f993c00e870 tx=0x7f993c00ed30 comp rx=0 tx=0).stop 2024-02-02T11:49:03.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.627+0000 7f99460c8640 1 -- 172.21.15.161:0/3982339769 shutdown_connections 2024-02-02T11:49:03.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.627+0000 7f99460c8640 1 --2- 172.21.15.161:0/3982339769 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9924065ae0 0x7f9924067fa0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.627+0000 7f99460c8640 1 --2- 172.21.15.161:0/3982339769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99380cf220 0x7f99380ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.627+0000 7f99460c8640 1 --2- 172.21.15.161:0/3982339769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99380cede0 0x7f99380c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.627+0000 7f99460c8640 1 --2- 172.21.15.161:0/3982339769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9938006f90 0x7f99380c5e20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.627+0000 7f99460c8640 1 -- 172.21.15.161:0/3982339769 >> 172.21.15.161:0/3982339769 conn(0x7f9938006210 msgr2=0x7f9938037710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:03.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.627+0000 7f99460c8640 1 -- 172.21.15.161:0/3982339769 shutdown_connections 2024-02-02T11:49:03.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.627+0000 7f99460c8640 1 -- 172.21.15.161:0/3982339769 wait complete. 2024-02-02T11:49:03.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.635+0000 7f046df95640 1 -- 172.21.15.161:0/4029102528 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f04681441c0 con 0x7f046814af00 2024-02-02T11:49:03.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.635+0000 7f044ffff640 1 -- 172.21.15.161:0/4029102528 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f04681441c0 con 0x7f046814af00 2024-02-02T11:49:03.638 INFO:teuthology.orchestra.run.smithi161.stdout:55834574856 2024-02-02T11:49:03.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.635+0000 7f1e93b7d640 1 -- 172.21.15.161:0/513655452 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1e74005510 con 0x7f1e8402fb80 2024-02-02T11:49:03.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.635+0000 7f046df95640 1 -- 172.21.15.161:0/4029102528 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0454065a60 msgr2=0x7f0454067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.635+0000 7f046df95640 1 --2- 172.21.15.161:0/4029102528 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0454065a60 0x7f0454067f20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f04580016c0 tx=0x7f0458009040 comp rx=0 tx=0).stop 2024-02-02T11:49:03.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.635+0000 7f046df95640 1 -- 172.21.15.161:0/4029102528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f046814af00 msgr2=0x7f046813e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.635+0000 7f046df95640 1 --2- 172.21.15.161:0/4029102528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f046814af00 0x7f046813e3f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f046001af80 tx=0x7f0460019670 comp rx=0 tx=0).stop 2024-02-02T11:49:03.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.639+0000 7f046df95640 1 -- 172.21.15.161:0/4029102528 shutdown_connections 2024-02-02T11:49:03.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.639+0000 7f046df95640 1 --2- 172.21.15.161:0/4029102528 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0454065a60 0x7f0454067f20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.639+0000 7f046df95640 1 --2- 172.21.15.161:0/4029102528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f046814af00 0x7f046813e3f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.639+0000 7f046df95640 1 --2- 172.21.15.161:0/4029102528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f046814aa90 0x7f04681e4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.639+0000 7f046df95640 1 --2- 172.21.15.161:0/4029102528 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04680bc590 0x7f04681e65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.639+0000 7f046df95640 1 -- 172.21.15.161:0/4029102528 >> 172.21.15.161:0/4029102528 conn(0x7f0468069d20 msgr2=0x7f04680b8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:03.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.639+0000 7f046df95640 1 -- 172.21.15.161:0/4029102528 shutdown_connections 2024-02-02T11:49:03.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.639+0000 7f046df95640 1 -- 172.21.15.161:0/4029102528 wait complete. 2024-02-02T11:49:03.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.639+0000 7f1e827fc640 1 -- 172.21.15.161:0/513655452 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1e880d6020 con 0x7f1e8402fb80 2024-02-02T11:49:03.642 INFO:teuthology.orchestra.run.smithi161.stdout:55834574857 2024-02-02T11:49:03.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.639+0000 7f1e93b7d640 1 -- 172.21.15.161:0/513655452 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1e78069b70 msgr2=0x7f1e7806c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.639+0000 7f1e93b7d640 1 --2- 172.21.15.161:0/513655452 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1e78069b70 0x7f1e7806c030 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c006fd0 tx=0x7f1e7c006d80 comp rx=0 tx=0).stop 2024-02-02T11:49:03.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.639+0000 7f1e93b7d640 1 -- 172.21.15.161:0/513655452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e8402fb80 msgr2=0x7f1e84030000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.639+0000 7f1e93b7d640 1 --2- 172.21.15.161:0/513655452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e8402fb80 0x7f1e84030000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1e88009000 tx=0x7f1e78007a10 comp rx=0 tx=0).stop 2024-02-02T11:49:03.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.643+0000 7f1e93b7d640 1 -- 172.21.15.161:0/513655452 shutdown_connections 2024-02-02T11:49:03.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.643+0000 7f1e93b7d640 1 --2- 172.21.15.161:0/513655452 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1e78069b70 0x7f1e7806c030 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.643+0000 7f1e93b7d640 1 --2- 172.21.15.161:0/513655452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e8402ebe0 0x7f1e8402f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.643+0000 7f1e93b7d640 1 --2- 172.21.15.161:0/513655452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e8402fb80 0x7f1e84030000 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.643+0000 7f1e93b7d640 1 --2- 172.21.15.161:0/513655452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e840e9690 0x7f1e840e9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.643+0000 7f1e93b7d640 1 -- 172.21.15.161:0/513655452 >> 172.21.15.161:0/513655452 conn(0x7f1e8403ee70 msgr2=0x7f1e84041990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:03.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.643+0000 7f1e93b7d640 1 -- 172.21.15.161:0/513655452 shutdown_connections 2024-02-02T11:49:03.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.643+0000 7f1e93b7d640 1 -- 172.21.15.161:0/513655452 wait complete. 2024-02-02T11:49:03.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-02-02T11:49:03.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.651+0000 7fbd17761640 1 -- 172.21.15.161:0/1737582051 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbd101598a0 con 0x7fbd1015b8c0 2024-02-02T11:49:03.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.651+0000 7fbd05ffb640 1 -- 172.21.15.161:0/1737582051 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbd0805d3e0 con 0x7fbd1015b8c0 2024-02-02T11:49:03.654 DEBUG:teuthology.parallel:result is None 2024-02-02T11:49:03.654 INFO:teuthology.orchestra.run.smithi161.stdout:55834574856 2024-02-02T11:49:03.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.655+0000 7fbd17761640 1 -- 172.21.15.161:0/1737582051 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbcf4065a60 msgr2=0x7fbcf4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.655+0000 7fbd17761640 1 --2- 172.21.15.161:0/1737582051 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbcf4065a60 0x7fbcf4067f20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c006fd0 tx=0x7fbd0c008040 comp rx=0 tx=0).stop 2024-02-02T11:49:03.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.655+0000 7fbd17761640 1 -- 172.21.15.161:0/1737582051 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd1015b8c0 msgr2=0x7fbd101ecf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.655+0000 7fbd17761640 1 --2- 172.21.15.161:0/1737582051 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd1015b8c0 0x7fbd101ecf80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbd080099b0 tx=0x7fbd08009e70 comp rx=0 tx=0).stop 2024-02-02T11:49:03.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.655+0000 7fbd17761640 1 -- 172.21.15.161:0/1737582051 shutdown_connections 2024-02-02T11:49:03.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.655+0000 7fbd17761640 1 --2- 172.21.15.161:0/1737582051 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbcf4065a60 0x7fbcf4067f20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.655+0000 7fbd17761640 1 --2- 172.21.15.161:0/1737582051 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd1015b8c0 0x7fbd101ecf80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.655+0000 7fbd17761640 1 --2- 172.21.15.161:0/1737582051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd100b7f40 0x7fbd101eca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.655+0000 7fbd17761640 1 --2- 172.21.15.161:0/1737582051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd1006ee70 0x7fbd10158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.655+0000 7fbd17761640 1 -- 172.21.15.161:0/1737582051 >> 172.21.15.161:0/1737582051 conn(0x7fbd10069d20 msgr2=0x7fbd100b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.655+0000 7fbd17761640 1 -- 172.21.15.161:0/1737582051 shutdown_connections 2024-02-02T11:49:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.655+0000 7fbd17761640 1 -- 172.21.15.161:0/1737582051 wait complete. 2024-02-02T11:49:03.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2024-02-02T11:49:03.664 DEBUG:teuthology.parallel:result is None 2024-02-02T11:49:03.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.667+0000 7f475ffff640 1 -- 172.21.15.161:0/896110662 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f476014a040 con 0x7f47600b68b0 2024-02-02T11:49:03.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.667+0000 7f4747fff640 1 -- 172.21.15.161:0/896110662 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f47580545c0 con 0x7f47600b68b0 2024-02-02T11:49:03.670 INFO:teuthology.orchestra.run.smithi161.stdout:55834574856 2024-02-02T11:49:03.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2024-02-02T11:49:03.671 DEBUG:teuthology.parallel:result is None 2024-02-02T11:49:03.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.667+0000 7f475ffff640 1 -- 172.21.15.161:0/896110662 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f474c065ab0 msgr2=0x7f474c067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.667+0000 7f475ffff640 1 --2- 172.21.15.161:0/896110662 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f474c065ab0 0x7f474c067f70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4754001770 tx=0x7f4754009040 comp rx=0 tx=0).stop 2024-02-02T11:49:03.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.667+0000 7f475ffff640 1 -- 172.21.15.161:0/896110662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47600b68b0 msgr2=0x7f476014a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.667+0000 7f475ffff640 1 --2- 172.21.15.161:0/896110662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47600b68b0 0x7f476014a710 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4758009d90 tx=0x7f475800c490 comp rx=0 tx=0).stop 2024-02-02T11:49:03.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.667+0000 7f475ffff640 1 -- 172.21.15.161:0/896110662 shutdown_connections 2024-02-02T11:49:03.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.667+0000 7f475ffff640 1 --2- 172.21.15.161:0/896110662 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f474c065ab0 0x7f474c067f70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.667+0000 7f475ffff640 1 --2- 172.21.15.161:0/896110662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47600b68b0 0x7f476014a710 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.667+0000 7f475ffff640 1 --2- 172.21.15.161:0/896110662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4760070070 0x7f476014b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.671+0000 7f475ffff640 1 --2- 172.21.15.161:0/896110662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f476006a260 0x7f476013c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.671+0000 7f475ffff640 1 -- 172.21.15.161:0/896110662 >> 172.21.15.161:0/896110662 conn(0x7f47600b98f0 msgr2=0x7f47600b76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:03.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.671+0000 7f475ffff640 1 -- 172.21.15.161:0/896110662 shutdown_connections 2024-02-02T11:49:03.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.671+0000 7f475ffff640 1 -- 172.21.15.161:0/896110662 wait complete. 2024-02-02T11:49:03.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.671+0000 7f4e55ffb640 1 -- 172.21.15.161:0/1197753334 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4e38005510 con 0x7f4e6006f900 2024-02-02T11:49:03.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.671+0000 7f4e5cff9640 1 -- 172.21.15.161:0/1197753334 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4e48054300 con 0x7f4e6006f900 2024-02-02T11:49:03.674 INFO:teuthology.orchestra.run.smithi161.stdout:55834574855 2024-02-02T11:49:03.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.671+0000 7f4e55ffb640 1 -- 172.21.15.161:0/1197753334 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4e4c065b80 msgr2=0x7f4e4c068040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.671+0000 7f4e55ffb640 1 --2- 172.21.15.161:0/1197753334 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4e4c065b80 0x7f4e4c068040 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4e60150380 tx=0x7f4e50009040 comp rx=0 tx=0).stop 2024-02-02T11:49:03.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.671+0000 7f4e55ffb640 1 -- 172.21.15.161:0/1197753334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e6006f900 msgr2=0x7f4e601f0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.671+0000 7f4e55ffb640 1 --2- 172.21.15.161:0/1197753334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e6006f900 0x7f4e601f0770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800da80 tx=0x7f4e4800df40 comp rx=0 tx=0).stop 2024-02-02T11:49:03.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.671+0000 7f4e55ffb640 1 -- 172.21.15.161:0/1197753334 shutdown_connections 2024-02-02T11:49:03.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.671+0000 7f4e55ffb640 1 --2- 172.21.15.161:0/1197753334 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4e4c065b80 0x7f4e4c068040 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.671+0000 7f4e55ffb640 1 --2- 172.21.15.161:0/1197753334 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e600b84b0 0x7f4e601f3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.671+0000 7f4e55ffb640 1 --2- 172.21.15.161:0/1197753334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e600b5e50 0x7f4e60146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.671+0000 7f4e55ffb640 1 --2- 172.21.15.161:0/1197753334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e6006f900 0x7f4e601f0770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.671+0000 7f4e55ffb640 1 -- 172.21.15.161:0/1197753334 >> 172.21.15.161:0/1197753334 conn(0x7f4e60069d20 msgr2=0x7f4e60150920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:03.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.671+0000 7f4e55ffb640 1 -- 172.21.15.161:0/1197753334 shutdown_connections 2024-02-02T11:49:03.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.671+0000 7f4e55ffb640 1 -- 172.21.15.161:0/1197753334 wait complete. 2024-02-02T11:49:03.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2024-02-02T11:49:03.680 DEBUG:teuthology.parallel:result is None 2024-02-02T11:49:03.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2024-02-02T11:49:03.692 DEBUG:teuthology.parallel:result is None 2024-02-02T11:49:03.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-02-02T11:49:03.694 DEBUG:teuthology.parallel:result is None 2024-02-02T11:49:03.694 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-02T11:49:03.694 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-02T11:49:03.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.835+0000 7f1d2f3a8640 1 Processor -- start 2024-02-02T11:49:03.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.835+0000 7f1d2f3a8640 1 -- start start 2024-02-02T11:49:03.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.839+0000 7f1d2f3a8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d280708d0 0x7f1d28070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.839+0000 7f1d2f3a8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1d28147920 0x7f1d281440d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.839+0000 7f1d2f3a8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d280b2c80 con 0x7f1d28071a20 2024-02-02T11:49:03.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.839+0000 7f1d2f3a8640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d2806fdb0 con 0x7f1d28147920 2024-02-02T11:49:03.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.839+0000 7f1d2f3a8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d28070370 con 0x7f1d280708d0 2024-02-02T11:49:03.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.839+0000 7f1d2d945640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1d28147920 0x7f1d281440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.839+0000 7f1d2d945640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1d28147920 0x7f1d281440d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39742/0 (socket says 172.21.15.161:39742) 2024-02-02T11:49:03.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.839+0000 7f1d2d945640 1 -- 172.21.15.161:0/3565026832 learned_addr learned my addr 172.21.15.161:0/3565026832 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:03.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.839+0000 7f1d2d144640 1 --2- 172.21.15.161:0/3565026832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d280708d0 0x7f1d28070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.839+0000 7f1d2d945640 1 -- 172.21.15.161:0/3565026832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d280708d0 msgr2=0x7f1d28070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:03.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.839+0000 7f1d2d945640 1 --2- 172.21.15.161:0/3565026832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d280708d0 0x7f1d28070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.839+0000 7f1d2d945640 1 -- 172.21.15.161:0/3565026832 >> v1:172.21.15.162:6789/0 conn(0x7f1d28071a20 legacy=0x7f1d28147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:03.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.839+0000 7f1d2d945640 1 -- 172.21.15.161:0/3565026832 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d280b2ed0 con 0x7f1d28147920 2024-02-02T11:49:03.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.839+0000 7f1d2d945640 1 --2- 172.21.15.161:0/3565026832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d28147920 0x7f1d281440d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000af60 tx=0x7f1d2001daa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61621f07dc3f7acd server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.839+0000 7f1d1ffff640 1 -- 172.21.15.161:0/3565026832 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2000a2d0 con 0x7f1d28147920 2024-02-02T11:49:03.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.839+0000 7f1d1ffff640 1 -- 172.21.15.161:0/3565026832 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d200a6960 con 0x7f1d28147920 2024-02-02T11:49:03.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.839+0000 7f1d1ffff640 1 -- 172.21.15.161:0/3565026832 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d200a6cf0 con 0x7f1d28147920 2024-02-02T11:49:03.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2f3a8640 1 -- 172.21.15.161:0/3565026832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d28147920 msgr2=0x7f1d281440d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2f3a8640 1 --2- 172.21.15.161:0/3565026832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d28147920 0x7f1d281440d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000af60 tx=0x7f1d2001daa0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2f3a8640 1 -- 172.21.15.161:0/3565026832 shutdown_connections 2024-02-02T11:49:03.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2f3a8640 1 --2- 172.21.15.161:0/3565026832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d28147920 0x7f1d281440d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2f3a8640 1 --2- 172.21.15.161:0/3565026832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d280708d0 0x7f1d28070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2f3a8640 1 -- 172.21.15.161:0/3565026832 >> 172.21.15.161:0/3565026832 conn(0x7f1d28069ef0 msgr2=0x7f1d2806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:03.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2f3a8640 1 -- 172.21.15.161:0/3565026832 shutdown_connections 2024-02-02T11:49:03.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2f3a8640 1 -- 172.21.15.161:0/3565026832 wait complete. 2024-02-02T11:49:03.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2f3a8640 1 Processor -- start 2024-02-02T11:49:03.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2f3a8640 1 -- start start 2024-02-02T11:49:03.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2f3a8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d280708d0 0x7f1d2813d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2f3a8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d28071a20 0x7f1d28142f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2f3a8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d28147920 0x7f1d28135ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2f3a8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d28141060 con 0x7f1d280708d0 2024-02-02T11:49:03.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2f3a8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2813dd30 con 0x7f1d28147920 2024-02-02T11:49:03.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2f3a8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d28141cb0 con 0x7f1d28071a20 2024-02-02T11:49:03.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2d144640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d280708d0 0x7f1d2813d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2d144640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d280708d0 0x7f1d2813d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39754/0 (socket says 172.21.15.161:39754) 2024-02-02T11:49:03.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2d144640 1 -- 172.21.15.161:0/2061658888 learned_addr learned my addr 172.21.15.161:0/2061658888 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:03.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2d945640 1 --2- 172.21.15.161:0/2061658888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d28147920 0x7f1d28135ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2c943640 1 --2- 172.21.15.161:0/2061658888 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d28071a20 0x7f1d28142f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2d144640 1 -- 172.21.15.161:0/2061658888 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d28071a20 msgr2=0x7f1d28142f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2d144640 1 --2- 172.21.15.161:0/2061658888 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d28071a20 0x7f1d28142f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2d144640 1 -- 172.21.15.161:0/2061658888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d28147920 msgr2=0x7f1d28135ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:03.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2d144640 1 --2- 172.21.15.161:0/2061658888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d28147920 0x7f1d28135ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:03.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2d144640 1 -- 172.21.15.161:0/2061658888 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2000ac40 con 0x7f1d280708d0 2024-02-02T11:49:03.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2d144640 1 --2- 172.21.15.161:0/2061658888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d280708d0 0x7f1d2813d7f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400c7f0 tx=0x7f1d2400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d1dffb640 1 -- 172.21.15.161:0/2061658888 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24004220 con 0x7f1d280708d0 2024-02-02T11:49:03.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d1dffb640 1 -- 172.21.15.161:0/2061658888 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d240043a0 con 0x7f1d280708d0 2024-02-02T11:49:03.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2f3a8640 1 -- 172.21.15.161:0/2061658888 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2813f0f0 con 0x7f1d280708d0 2024-02-02T11:49:03.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d1dffb640 1 -- 172.21.15.161:0/2061658888 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24004510 con 0x7f1d280708d0 2024-02-02T11:49:03.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2f3a8640 1 -- 172.21.15.161:0/2061658888 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d28142420 con 0x7f1d280708d0 2024-02-02T11:49:03.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d2f3a8640 1 -- 172.21.15.161:0/2061658888 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d28067050 con 0x7f1d280708d0 2024-02-02T11:49:03.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.843+0000 7f1d1dffb640 1 -- 172.21.15.161:0/2061658888 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1d24003a70 con 0x7f1d280708d0 2024-02-02T11:49:03.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.847+0000 7f1d1dffb640 1 --2- 172.21.15.161:0/2061658888 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1d0c065a60 0x7f1d0c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:03.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.847+0000 7f1d1dffb640 1 -- 172.21.15.161:0/2061658888 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d240830d0 con 0x7f1d280708d0 2024-02-02T11:49:03.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.847+0000 7f1d2c943640 1 --2- 172.21.15.161:0/2061658888 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1d0c065a60 0x7f1d0c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:03.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.847+0000 7f1d2c943640 1 --2- 172.21.15.161:0/2061658888 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1d0c065a60 0x7f1d0c067f20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d280bb710 tx=0x7f1d18009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:03.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.851+0000 7f1d1dffb640 1 -- 172.21.15.161:0/2061658888 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1d24050b20 con 0x7f1d280708d0 2024-02-02T11:49:03.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.991+0000 7f1d2f3a8640 1 -- 172.21.15.161:0/2061658888 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d2804e000 con 0x7f1d0c065a60 2024-02-02T11:49:04.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.999+0000 7f1d1dffb640 1 -- 172.21.15.161:0/2061658888 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264522 (secure 0 0 0) 0x7f1d2804e000 con 0x7f1d0c065a60 2024-02-02T11:49:04.004 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:04.006 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-02-02T11:49:04.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.999+0000 7f1d2f3a8640 1 -- 172.21.15.161:0/2061658888 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1d0c065a60 msgr2=0x7f1d0c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:04.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.999+0000 7f1d2f3a8640 1 --2- 172.21.15.161:0/2061658888 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1d0c065a60 0x7f1d0c067f20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d280bb710 tx=0x7f1d18009040 comp rx=0 tx=0).stop 2024-02-02T11:49:04.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.999+0000 7f1d2f3a8640 1 -- 172.21.15.161:0/2061658888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d280708d0 msgr2=0x7f1d2813d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:04.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.999+0000 7f1d2f3a8640 1 --2- 172.21.15.161:0/2061658888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d280708d0 0x7f1d2813d7f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400c7f0 tx=0x7f1d2400ccb0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.999+0000 7f1d2f3a8640 1 -- 172.21.15.161:0/2061658888 shutdown_connections 2024-02-02T11:49:04.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.999+0000 7f1d2f3a8640 1 --2- 172.21.15.161:0/2061658888 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1d0c065a60 0x7f1d0c067f20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.999+0000 7f1d2f3a8640 1 --2- 172.21.15.161:0/2061658888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d28147920 0x7f1d28135ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.999+0000 7f1d2f3a8640 1 --2- 172.21.15.161:0/2061658888 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d28071a20 0x7f1d28142f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.999+0000 7f1d2f3a8640 1 --2- 172.21.15.161:0/2061658888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d280708d0 0x7f1d2813d7f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.999+0000 7f1d2f3a8640 1 -- 172.21.15.161:0/2061658888 >> 172.21.15.161:0/2061658888 conn(0x7f1d28069ef0 msgr2=0x7f1d28140040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:04.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:03.999+0000 7f1d2f3a8640 1 -- 172.21.15.161:0/2061658888 shutdown_connections 2024-02-02T11:49:04.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.003+0000 7f1d2f3a8640 1 -- 172.21.15.161:0/2061658888 wait complete. 2024-02-02T11:49:04.020 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-02-02T11:49:02.255342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223080,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":220146,"kb_avail":754751640,"statfs":{"total":773094113280,"available":772865679360,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225429592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002676"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014159+0000","last_change":"2024-02-02T11:48:51.897055+0000","last_active":"2024-02-02T11:48:53.014159+0000","last_peered":"2024-02-02T11:48:53.014159+0000","last_clean":"2024-02-02T11:48:53.014159+0000","last_became_active":"2024-02-02T11:48:51.896591+0000","last_became_peered":"2024-02-02T11:48:51.896591+0000","last_unstale":"2024-02-02T11:48:53.014159+0000","last_undegraded":"2024-02-02T11:48:53.014159+0000","last_fullsized":"2024-02-02T11:48:53.014159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825415+0000","last_change":"2024-02-02T11:48:51.849203+0000","last_active":"2024-02-02T11:48:52.825415+0000","last_peered":"2024-02-02T11:48:52.825415+0000","last_clean":"2024-02-02T11:48:52.825415+0000","last_became_active":"2024-02-02T11:48:51.848773+0000","last_became_peered":"2024-02-02T11:48:51.848773+0000","last_unstale":"2024-02-02T11:48:52.825415+0000","last_undegraded":"2024-02-02T11:48:52.825415+0000","last_fullsized":"2024-02-02T11:48:52.825415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:26:18.517358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014636+0000","last_change":"2024-02-02T11:48:51.848120+0000","last_active":"2024-02-02T11:48:53.014636+0000","last_peered":"2024-02-02T11:48:53.014636+0000","last_clean":"2024-02-02T11:48:53.014636+0000","last_became_active":"2024-02-02T11:48:51.847834+0000","last_became_peered":"2024-02-02T11:48:51.847834+0000","last_unstale":"2024-02-02T11:48:53.014636+0000","last_undegraded":"2024-02-02T11:48:53.014636+0000","last_fullsized":"2024-02-02T11:48:53.014636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:14.049200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828595+0000","last_change":"2024-02-02T11:48:51.873374+0000","last_active":"2024-02-02T11:48:52.828595+0000","last_peered":"2024-02-02T11:48:52.828595+0000","last_clean":"2024-02-02T11:48:52.828595+0000","last_became_active":"2024-02-02T11:48:51.872600+0000","last_became_peered":"2024-02-02T11:48:51.872600+0000","last_unstale":"2024-02-02T11:48:52.828595+0000","last_undegraded":"2024-02-02T11:48:52.828595+0000","last_fullsized":"2024-02-02T11:48:52.828595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:31:27.082147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013509+0000","last_change":"2024-02-02T11:48:51.886196+0000","last_active":"2024-02-02T11:48:53.013509+0000","last_peered":"2024-02-02T11:48:53.013509+0000","last_clean":"2024-02-02T11:48:53.013509+0000","last_became_active":"2024-02-02T11:48:51.885504+0000","last_became_peered":"2024-02-02T11:48:51.885504+0000","last_unstale":"2024-02-02T11:48:53.013509+0000","last_undegraded":"2024-02-02T11:48:53.013509+0000","last_fullsized":"2024-02-02T11:48:53.013509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:55:40.677428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828565+0000","last_change":"2024-02-02T11:48:51.890332+0000","last_active":"2024-02-02T11:48:52.828565+0000","last_peered":"2024-02-02T11:48:52.828565+0000","last_clean":"2024-02-02T11:48:52.828565+0000","last_became_active":"2024-02-02T11:48:51.889165+0000","last_became_peered":"2024-02-02T11:48:51.889165+0000","last_unstale":"2024-02-02T11:48:52.828565+0000","last_undegraded":"2024-02-02T11:48:52.828565+0000","last_fullsized":"2024-02-02T11:48:52.828565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:01:26.016064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013297+0000","last_change":"2024-02-02T11:48:51.884543+0000","last_active":"2024-02-02T11:48:53.013297+0000","last_peered":"2024-02-02T11:48:53.013297+0000","last_clean":"2024-02-02T11:48:53.013297+0000","last_became_active":"2024-02-02T11:48:51.884113+0000","last_became_peered":"2024-02-02T11:48:51.884113+0000","last_unstale":"2024-02-02T11:48:53.013297+0000","last_undegraded":"2024-02-02T11:48:53.013297+0000","last_fullsized":"2024-02-02T11:48:53.013297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:31:27.082147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013204+0000","last_change":"2024-02-02T11:48:51.873291+0000","last_active":"2024-02-02T11:48:53.013204+0000","last_peered":"2024-02-02T11:48:53.013204+0000","last_clean":"2024-02-02T11:48:53.013204+0000","last_became_active":"2024-02-02T11:48:51.872981+0000","last_became_peered":"2024-02-02T11:48:51.872981+0000","last_unstale":"2024-02-02T11:48:53.013204+0000","last_undegraded":"2024-02-02T11:48:53.013204+0000","last_fullsized":"2024-02-02T11:48:53.013204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:14.049200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014205+0000","last_change":"2024-02-02T11:48:51.898237+0000","last_active":"2024-02-02T11:48:53.014205+0000","last_peered":"2024-02-02T11:48:53.014205+0000","last_clean":"2024-02-02T11:48:53.014205+0000","last_became_active":"2024-02-02T11:48:51.897065+0000","last_became_peered":"2024-02-02T11:48:51.897065+0000","last_unstale":"2024-02-02T11:48:53.014205+0000","last_undegraded":"2024-02-02T11:48:53.014205+0000","last_fullsized":"2024-02-02T11:48:53.014205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:56:59.771841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993307+0000","last_change":"2024-02-02T11:48:51.864449+0000","last_active":"2024-02-02T11:48:52.993307+0000","last_peered":"2024-02-02T11:48:52.993307+0000","last_clean":"2024-02-02T11:48:52.993307+0000","last_became_active":"2024-02-02T11:48:51.863664+0000","last_became_peered":"2024-02-02T11:48:51.863664+0000","last_unstale":"2024-02-02T11:48:52.993307+0000","last_undegraded":"2024-02-02T11:48:52.993307+0000","last_fullsized":"2024-02-02T11:48:52.993307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993018+0000","last_change":"2024-02-02T11:48:51.890353+0000","last_active":"2024-02-02T11:48:52.993018+0000","last_peered":"2024-02-02T11:48:52.993018+0000","last_clean":"2024-02-02T11:48:52.993018+0000","last_became_active":"2024-02-02T11:48:51.889927+0000","last_became_peered":"2024-02-02T11:48:51.889927+0000","last_unstale":"2024-02-02T11:48:52.993018+0000","last_undegraded":"2024-02-02T11:48:52.993018+0000","last_fullsized":"2024-02-02T11:48:52.993018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:44:05.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.827212+0000","last_change":"2024-02-02T11:48:51.865778+0000","last_active":"2024-02-02T11:48:52.827212+0000","last_peered":"2024-02-02T11:48:52.827212+0000","last_clean":"2024-02-02T11:48:52.827212+0000","last_became_active":"2024-02-02T11:48:51.864513+0000","last_became_peered":"2024-02-02T11:48:51.864513+0000","last_unstale":"2024-02-02T11:48:52.827212+0000","last_undegraded":"2024-02-02T11:48:52.827212+0000","last_fullsized":"2024-02-02T11:48:52.827212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:33.128561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014047+0000","last_change":"2024-02-02T11:48:51.871880+0000","last_active":"2024-02-02T11:48:53.014047+0000","last_peered":"2024-02-02T11:48:53.014047+0000","last_clean":"2024-02-02T11:48:53.014047+0000","last_became_active":"2024-02-02T11:48:51.871683+0000","last_became_peered":"2024-02-02T11:48:51.871683+0000","last_unstale":"2024-02-02T11:48:53.014047+0000","last_undegraded":"2024-02-02T11:48:53.014047+0000","last_fullsized":"2024-02-02T11:48:53.014047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:32:50.539652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016221+0000","last_change":"2024-02-02T11:48:51.843150+0000","last_active":"2024-02-02T11:48:53.016221+0000","last_peered":"2024-02-02T11:48:53.016221+0000","last_clean":"2024-02-02T11:48:53.016221+0000","last_became_active":"2024-02-02T11:48:51.842884+0000","last_became_peered":"2024-02-02T11:48:51.842884+0000","last_unstale":"2024-02-02T11:48:53.016221+0000","last_undegraded":"2024-02-02T11:48:53.016221+0000","last_fullsized":"2024-02-02T11:48:53.016221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:33:43.440229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.824851+0000","last_change":"2024-02-02T11:48:51.835634+0000","last_active":"2024-02-02T11:48:52.824851+0000","last_peered":"2024-02-02T11:48:52.824851+0000","last_clean":"2024-02-02T11:48:52.824851+0000","last_became_active":"2024-02-02T11:48:51.835378+0000","last_became_peered":"2024-02-02T11:48:51.835378+0000","last_unstale":"2024-02-02T11:48:52.824851+0000","last_undegraded":"2024-02-02T11:48:52.824851+0000","last_fullsized":"2024-02-02T11:48:52.824851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828051+0000","last_change":"2024-02-02T11:48:51.873754+0000","last_active":"2024-02-02T11:48:52.828051+0000","last_peered":"2024-02-02T11:48:52.828051+0000","last_clean":"2024-02-02T11:48:52.828051+0000","last_became_active":"2024-02-02T11:48:51.864819+0000","last_became_peered":"2024-02-02T11:48:51.864819+0000","last_unstale":"2024-02-02T11:48:52.828051+0000","last_undegraded":"2024-02-02T11:48:52.828051+0000","last_fullsized":"2024-02-02T11:48:52.828051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:02:09.899239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829342+0000","last_change":"2024-02-02T11:48:51.884635+0000","last_active":"2024-02-02T11:48:52.829342+0000","last_peered":"2024-02-02T11:48:52.829342+0000","last_clean":"2024-02-02T11:48:52.829342+0000","last_became_active":"2024-02-02T11:48:51.884182+0000","last_became_peered":"2024-02-02T11:48:51.884182+0000","last_unstale":"2024-02-02T11:48:52.829342+0000","last_undegraded":"2024-02-02T11:48:52.829342+0000","last_fullsized":"2024-02-02T11:48:52.829342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:15:46.872789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015398+0000","last_change":"2024-02-02T11:48:51.870210+0000","last_active":"2024-02-02T11:48:53.015398+0000","last_peered":"2024-02-02T11:48:53.015398+0000","last_clean":"2024-02-02T11:48:53.015398+0000","last_became_active":"2024-02-02T11:48:51.869889+0000","last_became_peered":"2024-02-02T11:48:51.869889+0000","last_unstale":"2024-02-02T11:48:53.015398+0000","last_undegraded":"2024-02-02T11:48:53.015398+0000","last_fullsized":"2024-02-02T11:48:53.015398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:33.128561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014093+0000","last_change":"2024-02-02T11:48:51.888159+0000","last_active":"2024-02-02T11:48:53.014093+0000","last_peered":"2024-02-02T11:48:53.014093+0000","last_clean":"2024-02-02T11:48:53.014093+0000","last_became_active":"2024-02-02T11:48:51.887546+0000","last_became_peered":"2024-02-02T11:48:51.887546+0000","last_unstale":"2024-02-02T11:48:53.014093+0000","last_undegraded":"2024-02-02T11:48:53.014093+0000","last_fullsized":"2024-02-02T11:48:53.014093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:36:48.786870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992872+0000","last_change":"2024-02-02T11:48:51.862691+0000","last_active":"2024-02-02T11:48:52.992872+0000","last_peered":"2024-02-02T11:48:52.992872+0000","last_clean":"2024-02-02T11:48:52.992872+0000","last_became_active":"2024-02-02T11:48:51.862032+0000","last_became_peered":"2024-02-02T11:48:51.862032+0000","last_unstale":"2024-02-02T11:48:52.992872+0000","last_undegraded":"2024-02-02T11:48:52.992872+0000","last_fullsized":"2024-02-02T11:48:52.992872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:17:07.932896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015727+0000","last_change":"2024-02-02T11:48:51.884441+0000","last_active":"2024-02-02T11:48:53.015727+0000","last_peered":"2024-02-02T11:48:53.015727+0000","last_clean":"2024-02-02T11:48:53.015727+0000","last_became_active":"2024-02-02T11:48:51.884033+0000","last_became_peered":"2024-02-02T11:48:51.884033+0000","last_unstale":"2024-02-02T11:48:53.015727+0000","last_undegraded":"2024-02-02T11:48:53.015727+0000","last_fullsized":"2024-02-02T11:48:53.015727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828714+0000","last_change":"2024-02-02T11:48:51.884667+0000","last_active":"2024-02-02T11:48:52.828714+0000","last_peered":"2024-02-02T11:48:52.828714+0000","last_clean":"2024-02-02T11:48:52.828714+0000","last_became_active":"2024-02-02T11:48:51.884211+0000","last_became_peered":"2024-02-02T11:48:51.884211+0000","last_unstale":"2024-02-02T11:48:52.828714+0000","last_undegraded":"2024-02-02T11:48:52.828714+0000","last_fullsized":"2024-02-02T11:48:52.828714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:34:16.623804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.017166+0000","last_change":"2024-02-02T11:48:51.844344+0000","last_active":"2024-02-02T11:48:53.017166+0000","last_peered":"2024-02-02T11:48:53.017166+0000","last_clean":"2024-02-02T11:48:53.017166+0000","last_became_active":"2024-02-02T11:48:51.844068+0000","last_became_peered":"2024-02-02T11:48:51.844068+0000","last_unstale":"2024-02-02T11:48:53.017166+0000","last_undegraded":"2024-02-02T11:48:53.017166+0000","last_fullsized":"2024-02-02T11:48:53.017166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:31:27.082147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829389+0000","last_change":"2024-02-02T11:48:51.863370+0000","last_active":"2024-02-02T11:48:52.829389+0000","last_peered":"2024-02-02T11:48:52.829389+0000","last_clean":"2024-02-02T11:48:52.829389+0000","last_became_active":"2024-02-02T11:48:51.862502+0000","last_became_peered":"2024-02-02T11:48:51.862502+0000","last_unstale":"2024-02-02T11:48:52.829389+0000","last_undegraded":"2024-02-02T11:48:52.829389+0000","last_fullsized":"2024-02-02T11:48:52.829389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:55:40.677428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015018+0000","last_change":"2024-02-02T11:48:51.844587+0000","last_active":"2024-02-02T11:48:53.015018+0000","last_peered":"2024-02-02T11:48:53.015018+0000","last_clean":"2024-02-02T11:48:53.015018+0000","last_became_active":"2024-02-02T11:48:51.844279+0000","last_became_peered":"2024-02-02T11:48:51.844279+0000","last_unstale":"2024-02-02T11:48:53.015018+0000","last_undegraded":"2024-02-02T11:48:53.015018+0000","last_fullsized":"2024-02-02T11:48:53.015018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:56:59.771841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993316+0000","last_change":"2024-02-02T11:48:51.886760+0000","last_active":"2024-02-02T11:48:52.993316+0000","last_peered":"2024-02-02T11:48:52.993316+0000","last_clean":"2024-02-02T11:48:52.993316+0000","last_became_active":"2024-02-02T11:48:51.886352+0000","last_became_peered":"2024-02-02T11:48:51.886352+0000","last_unstale":"2024-02-02T11:48:52.993316+0000","last_undegraded":"2024-02-02T11:48:52.993316+0000","last_fullsized":"2024-02-02T11:48:52.993316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825142+0000","last_change":"2024-02-02T11:48:51.836508+0000","last_active":"2024-02-02T11:48:52.825142+0000","last_peered":"2024-02-02T11:48:52.825142+0000","last_clean":"2024-02-02T11:48:52.825142+0000","last_became_active":"2024-02-02T11:48:51.836243+0000","last_became_peered":"2024-02-02T11:48:51.836243+0000","last_unstale":"2024-02-02T11:48:52.825142+0000","last_undegraded":"2024-02-02T11:48:52.825142+0000","last_fullsized":"2024-02-02T11:48:52.825142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:17:07.932896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015447+0000","last_change":"2024-02-02T11:48:51.857222+0000","last_active":"2024-02-02T11:48:53.015447+0000","last_peered":"2024-02-02T11:48:53.015447+0000","last_clean":"2024-02-02T11:48:53.015447+0000","last_became_active":"2024-02-02T11:48:51.857008+0000","last_became_peered":"2024-02-02T11:48:51.857008+0000","last_unstale":"2024-02-02T11:48:53.015447+0000","last_undegraded":"2024-02-02T11:48:53.015447+0000","last_fullsized":"2024-02-02T11:48:53.015447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:55:40.677428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015969+0000","last_change":"2024-02-02T11:48:51.848918+0000","last_active":"2024-02-02T11:48:53.015969+0000","last_peered":"2024-02-02T11:48:53.015969+0000","last_clean":"2024-02-02T11:48:53.015969+0000","last_became_active":"2024-02-02T11:48:51.847820+0000","last_became_peered":"2024-02-02T11:48:51.847820+0000","last_unstale":"2024-02-02T11:48:53.015969+0000","last_undegraded":"2024-02-02T11:48:53.015969+0000","last_fullsized":"2024-02-02T11:48:53.015969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:44:05.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828816+0000","last_change":"2024-02-02T11:48:51.863180+0000","last_active":"2024-02-02T11:48:52.828816+0000","last_peered":"2024-02-02T11:48:52.828816+0000","last_clean":"2024-02-02T11:48:52.828816+0000","last_became_active":"2024-02-02T11:48:51.862533+0000","last_became_peered":"2024-02-02T11:48:51.862533+0000","last_unstale":"2024-02-02T11:48:52.828816+0000","last_undegraded":"2024-02-02T11:48:52.828816+0000","last_fullsized":"2024-02-02T11:48:52.828816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:32:50.539652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013102+0000","last_change":"2024-02-02T11:48:51.862936+0000","last_active":"2024-02-02T11:48:53.013102+0000","last_peered":"2024-02-02T11:48:53.013102+0000","last_clean":"2024-02-02T11:48:53.013102+0000","last_became_active":"2024-02-02T11:48:51.862663+0000","last_became_peered":"2024-02-02T11:48:51.862663+0000","last_unstale":"2024-02-02T11:48:53.013102+0000","last_undegraded":"2024-02-02T11:48:53.013102+0000","last_fullsized":"2024-02-02T11:48:53.013102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:27.396890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992606+0000","last_change":"2024-02-02T11:48:51.865648+0000","last_active":"2024-02-02T11:48:52.992606+0000","last_peered":"2024-02-02T11:48:52.992606+0000","last_clean":"2024-02-02T11:48:52.992606+0000","last_became_active":"2024-02-02T11:48:51.864078+0000","last_became_peered":"2024-02-02T11:48:51.864078+0000","last_unstale":"2024-02-02T11:48:52.992606+0000","last_undegraded":"2024-02-02T11:48:52.992606+0000","last_fullsized":"2024-02-02T11:48:52.992606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:14.049200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.826642+0000","last_change":"2024-02-02T11:48:51.837010+0000","last_active":"2024-02-02T11:48:52.826642+0000","last_peered":"2024-02-02T11:48:52.826642+0000","last_clean":"2024-02-02T11:48:52.826642+0000","last_became_active":"2024-02-02T11:48:51.836245+0000","last_became_peered":"2024-02-02T11:48:51.836245+0000","last_unstale":"2024-02-02T11:48:52.826642+0000","last_undegraded":"2024-02-02T11:48:52.826642+0000","last_fullsized":"2024-02-02T11:48:52.826642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:05:40.202784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014518+0000","last_change":"2024-02-02T11:48:51.490158+0000","last_active":"2024-02-02T11:48:53.014518+0000","last_peered":"2024-02-02T11:48:53.014518+0000","last_clean":"2024-02-02T11:48:53.014518+0000","last_became_active":"2024-02-02T11:48:51.489826+0000","last_became_peered":"2024-02-02T11:48:51.489826+0000","last_unstale":"2024-02-02T11:48:53.014518+0000","last_undegraded":"2024-02-02T11:48:53.014518+0000","last_fullsized":"2024-02-02T11:48:53.014518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:06:13.971694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016208+0000","last_change":"2024-02-02T11:48:51.848592+0000","last_active":"2024-02-02T11:48:53.016208+0000","last_peered":"2024-02-02T11:48:53.016208+0000","last_clean":"2024-02-02T11:48:53.016208+0000","last_became_active":"2024-02-02T11:48:51.848379+0000","last_became_peered":"2024-02-02T11:48:51.848379+0000","last_unstale":"2024-02-02T11:48:53.016208+0000","last_undegraded":"2024-02-02T11:48:53.016208+0000","last_fullsized":"2024-02-02T11:48:53.016208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:17:07.932896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992668+0000","last_change":"2024-02-02T11:48:51.481701+0000","last_active":"2024-02-02T11:48:52.992668+0000","last_peered":"2024-02-02T11:48:52.992668+0000","last_clean":"2024-02-02T11:48:52.992668+0000","last_became_active":"2024-02-02T11:48:51.480901+0000","last_became_peered":"2024-02-02T11:48:51.480901+0000","last_unstale":"2024-02-02T11:48:52.992668+0000","last_undegraded":"2024-02-02T11:48:52.992668+0000","last_fullsized":"2024-02-02T11:48:52.992668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.017353+0000","last_change":"2024-02-02T11:48:51.482357+0000","last_active":"2024-02-02T11:48:53.017353+0000","last_peered":"2024-02-02T11:48:53.017353+0000","last_clean":"2024-02-02T11:48:53.017353+0000","last_became_active":"2024-02-02T11:48:51.482055+0000","last_became_peered":"2024-02-02T11:48:51.482055+0000","last_unstale":"2024-02-02T11:48:53.017353+0000","last_undegraded":"2024-02-02T11:48:53.017353+0000","last_fullsized":"2024-02-02T11:48:53.017353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:12:40.411121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013783+0000","last_change":"2024-02-02T11:48:51.843584+0000","last_active":"2024-02-02T11:48:53.013783+0000","last_peered":"2024-02-02T11:48:53.013783+0000","last_clean":"2024-02-02T11:48:53.013783+0000","last_became_active":"2024-02-02T11:48:51.843299+0000","last_became_peered":"2024-02-02T11:48:51.843299+0000","last_unstale":"2024-02-02T11:48:53.013783+0000","last_undegraded":"2024-02-02T11:48:53.013783+0000","last_fullsized":"2024-02-02T11:48:53.013783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:26:18.517358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828293+0000","last_change":"2024-02-02T11:48:51.475843+0000","last_active":"2024-02-02T11:48:52.828293+0000","last_peered":"2024-02-02T11:48:52.828293+0000","last_clean":"2024-02-02T11:48:52.828293+0000","last_became_active":"2024-02-02T11:48:51.474780+0000","last_became_peered":"2024-02-02T11:48:51.474780+0000","last_unstale":"2024-02-02T11:48:52.828293+0000","last_undegraded":"2024-02-02T11:48:52.828293+0000","last_fullsized":"2024-02-02T11:48:52.828293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:06:13.971694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825017+0000","last_change":"2024-02-02T11:48:51.836833+0000","last_active":"2024-02-02T11:48:52.825017+0000","last_peered":"2024-02-02T11:48:52.825017+0000","last_clean":"2024-02-02T11:48:52.825017+0000","last_became_active":"2024-02-02T11:48:51.836528+0000","last_became_peered":"2024-02-02T11:48:51.836528+0000","last_unstale":"2024-02-02T11:48:52.825017+0000","last_undegraded":"2024-02-02T11:48:52.825017+0000","last_fullsized":"2024-02-02T11:48:52.825017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:44:05.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993305+0000","last_change":"2024-02-02T11:48:51.487441+0000","last_active":"2024-02-02T11:48:52.993305+0000","last_peered":"2024-02-02T11:48:52.993305+0000","last_clean":"2024-02-02T11:48:52.993305+0000","last_became_active":"2024-02-02T11:48:51.486655+0000","last_became_peered":"2024-02-02T11:48:51.486655+0000","last_unstale":"2024-02-02T11:48:52.993305+0000","last_undegraded":"2024-02-02T11:48:52.993305+0000","last_fullsized":"2024-02-02T11:48:52.993305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:22:40.437082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829603+0000","last_change":"2024-02-02T11:48:51.886180+0000","last_active":"2024-02-02T11:48:52.829603+0000","last_peered":"2024-02-02T11:48:52.829603+0000","last_clean":"2024-02-02T11:48:52.829603+0000","last_became_active":"2024-02-02T11:48:51.885591+0000","last_became_peered":"2024-02-02T11:48:51.885591+0000","last_unstale":"2024-02-02T11:48:52.829603+0000","last_undegraded":"2024-02-02T11:48:52.829603+0000","last_fullsized":"2024-02-02T11:48:52.829603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:31:31.979723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829725+0000","last_change":"2024-02-02T11:48:51.485465+0000","last_active":"2024-02-02T11:48:52.829725+0000","last_peered":"2024-02-02T11:48:52.829725+0000","last_clean":"2024-02-02T11:48:52.829725+0000","last_became_active":"2024-02-02T11:48:51.484749+0000","last_became_peered":"2024-02-02T11:48:51.484749+0000","last_unstale":"2024-02-02T11:48:52.829725+0000","last_undegraded":"2024-02-02T11:48:52.829725+0000","last_fullsized":"2024-02-02T11:48:52.829725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:12:40.411121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015866+0000","last_change":"2024-02-02T11:48:51.890561+0000","last_active":"2024-02-02T11:48:53.015866+0000","last_peered":"2024-02-02T11:48:53.015866+0000","last_clean":"2024-02-02T11:48:53.015866+0000","last_became_active":"2024-02-02T11:48:51.890385+0000","last_became_peered":"2024-02-02T11:48:51.890385+0000","last_unstale":"2024-02-02T11:48:53.015866+0000","last_undegraded":"2024-02-02T11:48:53.015866+0000","last_fullsized":"2024-02-02T11:48:53.015866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:26:18.517358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825200+0000","last_change":"2024-02-02T11:48:51.467792+0000","last_active":"2024-02-02T11:48:52.825200+0000","last_peered":"2024-02-02T11:48:52.825200+0000","last_clean":"2024-02-02T11:48:52.825200+0000","last_became_active":"2024-02-02T11:48:51.467447+0000","last_became_peered":"2024-02-02T11:48:51.467447+0000","last_unstale":"2024-02-02T11:48:52.825200+0000","last_undegraded":"2024-02-02T11:48:52.825200+0000","last_fullsized":"2024-02-02T11:48:52.825200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:32.118220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.827459+0000","last_change":"2024-02-02T11:48:51.886539+0000","last_active":"2024-02-02T11:48:52.827459+0000","last_peered":"2024-02-02T11:48:52.827459+0000","last_clean":"2024-02-02T11:48:52.827459+0000","last_became_active":"2024-02-02T11:48:51.886091+0000","last_became_peered":"2024-02-02T11:48:51.886091+0000","last_unstale":"2024-02-02T11:48:52.827459+0000","last_undegraded":"2024-02-02T11:48:52.827459+0000","last_fullsized":"2024-02-02T11:48:52.827459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:41:08.293554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992948+0000","last_change":"2024-02-02T11:48:51.478707+0000","last_active":"2024-02-02T11:48:52.992948+0000","last_peered":"2024-02-02T11:48:52.992948+0000","last_clean":"2024-02-02T11:48:52.992948+0000","last_became_active":"2024-02-02T11:48:51.477592+0000","last_became_peered":"2024-02-02T11:48:51.477592+0000","last_unstale":"2024-02-02T11:48:52.992948+0000","last_undegraded":"2024-02-02T11:48:52.992948+0000","last_fullsized":"2024-02-02T11:48:52.992948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:02:58.430952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013767+0000","last_change":"2024-02-02T11:48:51.885728+0000","last_active":"2024-02-02T11:48:53.013767+0000","last_peered":"2024-02-02T11:48:53.013767+0000","last_clean":"2024-02-02T11:48:53.013767+0000","last_became_active":"2024-02-02T11:48:51.885343+0000","last_became_peered":"2024-02-02T11:48:51.885343+0000","last_unstale":"2024-02-02T11:48:53.013767+0000","last_undegraded":"2024-02-02T11:48:53.013767+0000","last_fullsized":"2024-02-02T11:48:53.013767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:02:09.899239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016432+0000","last_change":"2024-02-02T11:48:51.489735+0000","last_active":"2024-02-02T11:48:53.016432+0000","last_peered":"2024-02-02T11:48:53.016432+0000","last_clean":"2024-02-02T11:48:53.016432+0000","last_became_active":"2024-02-02T11:48:51.489394+0000","last_became_peered":"2024-02-02T11:48:51.489394+0000","last_unstale":"2024-02-02T11:48:53.016432+0000","last_undegraded":"2024-02-02T11:48:53.016432+0000","last_fullsized":"2024-02-02T11:48:53.016432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:18:12.503377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016349+0000","last_change":"2024-02-02T11:48:51.884370+0000","last_active":"2024-02-02T11:48:53.016349+0000","last_peered":"2024-02-02T11:48:53.016349+0000","last_clean":"2024-02-02T11:48:53.016349+0000","last_became_active":"2024-02-02T11:48:51.884044+0000","last_became_peered":"2024-02-02T11:48:51.884044+0000","last_unstale":"2024-02-02T11:48:53.016349+0000","last_undegraded":"2024-02-02T11:48:53.016349+0000","last_fullsized":"2024-02-02T11:48:53.016349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:33.128561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828935+0000","last_change":"2024-02-02T11:48:51.466861+0000","last_active":"2024-02-02T11:48:52.828935+0000","last_peered":"2024-02-02T11:48:52.828935+0000","last_clean":"2024-02-02T11:48:52.828935+0000","last_became_active":"2024-02-02T11:48:51.466097+0000","last_became_peered":"2024-02-02T11:48:51.466097+0000","last_unstale":"2024-02-02T11:48:52.828935+0000","last_undegraded":"2024-02-02T11:48:52.828935+0000","last_fullsized":"2024-02-02T11:48:52.828935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:02:58.430952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013799+0000","last_change":"2024-02-02T11:48:51.885012+0000","last_active":"2024-02-02T11:48:53.013799+0000","last_peered":"2024-02-02T11:48:53.013799+0000","last_clean":"2024-02-02T11:48:53.013799+0000","last_became_active":"2024-02-02T11:48:51.884374+0000","last_became_peered":"2024-02-02T11:48:51.884374+0000","last_unstale":"2024-02-02T11:48:53.013799+0000","last_undegraded":"2024-02-02T11:48:53.013799+0000","last_fullsized":"2024-02-02T11:48:53.013799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T17:33:10.421610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992599+0000","last_change":"2024-02-02T11:48:51.478572+0000","last_active":"2024-02-02T11:48:52.992599+0000","last_peered":"2024-02-02T11:48:52.992599+0000","last_clean":"2024-02-02T11:48:52.992599+0000","last_became_active":"2024-02-02T11:48:51.477722+0000","last_became_peered":"2024-02-02T11:48:51.477722+0000","last_unstale":"2024-02-02T11:48:52.992599+0000","last_undegraded":"2024-02-02T11:48:52.992599+0000","last_fullsized":"2024-02-02T11:48:52.992599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:06:13.971694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992588+0000","last_change":"2024-02-02T11:48:51.869232+0000","last_active":"2024-02-02T11:48:52.992588+0000","last_peered":"2024-02-02T11:48:52.992588+0000","last_clean":"2024-02-02T11:48:52.992588+0000","last_became_active":"2024-02-02T11:48:51.864926+0000","last_became_peered":"2024-02-02T11:48:51.864926+0000","last_unstale":"2024-02-02T11:48:52.992588+0000","last_undegraded":"2024-02-02T11:48:52.992588+0000","last_fullsized":"2024-02-02T11:48:52.992588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:42:12.424582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013003+0000","last_change":"2024-02-02T11:48:51.470192+0000","last_active":"2024-02-02T11:48:53.013003+0000","last_peered":"2024-02-02T11:48:53.013003+0000","last_clean":"2024-02-02T11:48:53.013003+0000","last_became_active":"2024-02-02T11:48:51.469834+0000","last_became_peered":"2024-02-02T11:48:51.469834+0000","last_unstale":"2024-02-02T11:48:53.013003+0000","last_undegraded":"2024-02-02T11:48:53.013003+0000","last_fullsized":"2024-02-02T11:48:53.013003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:12:40.411121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013456+0000","last_change":"2024-02-02T11:48:51.884838+0000","last_active":"2024-02-02T11:48:53.013456+0000","last_peered":"2024-02-02T11:48:53.013456+0000","last_clean":"2024-02-02T11:48:53.013456+0000","last_became_active":"2024-02-02T11:48:51.884185+0000","last_became_peered":"2024-02-02T11:48:51.884185+0000","last_unstale":"2024-02-02T11:48:53.013456+0000","last_undegraded":"2024-02-02T11:48:53.013456+0000","last_fullsized":"2024-02-02T11:48:53.013456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:15:46.872789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.827152+0000","last_change":"2024-02-02T11:48:51.474818+0000","last_active":"2024-02-02T11:48:52.827152+0000","last_peered":"2024-02-02T11:48:52.827152+0000","last_clean":"2024-02-02T11:48:52.827152+0000","last_became_active":"2024-02-02T11:48:51.474087+0000","last_became_peered":"2024-02-02T11:48:51.474087+0000","last_unstale":"2024-02-02T11:48:52.827152+0000","last_undegraded":"2024-02-02T11:48:52.827152+0000","last_fullsized":"2024-02-02T11:48:52.827152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:18:12.503377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014027+0000","last_change":"2024-02-02T11:48:51.897044+0000","last_active":"2024-02-02T11:48:53.014027+0000","last_peered":"2024-02-02T11:48:53.014027+0000","last_clean":"2024-02-02T11:48:53.014027+0000","last_became_active":"2024-02-02T11:48:51.896554+0000","last_became_peered":"2024-02-02T11:48:51.896554+0000","last_unstale":"2024-02-02T11:48:53.014027+0000","last_undegraded":"2024-02-02T11:48:53.014027+0000","last_fullsized":"2024-02-02T11:48:53.014027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:34:16.623804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015526+0000","last_change":"2024-02-02T11:48:51.464028+0000","last_active":"2024-02-02T11:48:53.015526+0000","last_peered":"2024-02-02T11:48:53.015526+0000","last_clean":"2024-02-02T11:48:53.015526+0000","last_became_active":"2024-02-02T11:48:51.463717+0000","last_became_peered":"2024-02-02T11:48:51.463717+0000","last_unstale":"2024-02-02T11:48:53.015526+0000","last_undegraded":"2024-02-02T11:48:53.015526+0000","last_fullsized":"2024-02-02T11:48:53.015526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:18:12.503377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014400+0000","last_change":"2024-02-02T11:48:51.897969+0000","last_active":"2024-02-02T11:48:53.014400+0000","last_peered":"2024-02-02T11:48:53.014400+0000","last_clean":"2024-02-02T11:48:53.014400+0000","last_became_active":"2024-02-02T11:48:51.897552+0000","last_became_peered":"2024-02-02T11:48:51.897552+0000","last_unstale":"2024-02-02T11:48:53.014400+0000","last_undegraded":"2024-02-02T11:48:53.014400+0000","last_fullsized":"2024-02-02T11:48:53.014400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:31:31.979723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825340+0000","last_change":"2024-02-02T11:48:51.489925+0000","last_active":"2024-02-02T11:48:52.825340+0000","last_peered":"2024-02-02T11:48:52.825340+0000","last_clean":"2024-02-02T11:48:52.825340+0000","last_became_active":"2024-02-02T11:48:51.489586+0000","last_became_peered":"2024-02-02T11:48:51.489586+0000","last_unstale":"2024-02-02T11:48:52.825340+0000","last_undegraded":"2024-02-02T11:48:52.825340+0000","last_fullsized":"2024-02-02T11:48:52.825340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:26.386549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829151+0000","last_change":"2024-02-02T11:48:51.863155+0000","last_active":"2024-02-02T11:48:52.829151+0000","last_peered":"2024-02-02T11:48:52.829151+0000","last_clean":"2024-02-02T11:48:52.829151+0000","last_became_active":"2024-02-02T11:48:51.862353+0000","last_became_peered":"2024-02-02T11:48:51.862353+0000","last_unstale":"2024-02-02T11:48:52.829151+0000","last_undegraded":"2024-02-02T11:48:52.829151+0000","last_fullsized":"2024-02-02T11:48:52.829151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:56:59.771841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014144+0000","last_change":"2024-02-02T11:48:51.476119+0000","last_active":"2024-02-02T11:48:53.014144+0000","last_peered":"2024-02-02T11:48:53.014144+0000","last_clean":"2024-02-02T11:48:53.014144+0000","last_became_active":"2024-02-02T11:48:51.475833+0000","last_became_peered":"2024-02-02T11:48:51.475833+0000","last_unstale":"2024-02-02T11:48:53.014144+0000","last_undegraded":"2024-02-02T11:48:53.014144+0000","last_fullsized":"2024-02-02T11:48:53.014144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013759+0000","last_change":"2024-02-02T11:48:51.891228+0000","last_active":"2024-02-02T11:48:53.013759+0000","last_peered":"2024-02-02T11:48:53.013759+0000","last_clean":"2024-02-02T11:48:53.013759+0000","last_became_active":"2024-02-02T11:48:51.890322+0000","last_became_peered":"2024-02-02T11:48:51.890322+0000","last_unstale":"2024-02-02T11:48:53.013759+0000","last_undegraded":"2024-02-02T11:48:53.013759+0000","last_fullsized":"2024-02-02T11:48:53.013759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:01:26.016064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-02T11:48:51.857399+0000","last_change":"2024-02-02T11:48:41.563754+0000","last_active":"2024-02-02T11:48:51.857399+0000","last_peered":"2024-02-02T11:48:51.857399+0000","last_clean":"2024-02-02T11:48:51.857399+0000","last_became_active":"2024-02-02T11:48:41.562629+0000","last_became_peered":"2024-02-02T11:48:41.562629+0000","last_unstale":"2024-02-02T11:48:51.857399+0000","last_undegraded":"2024-02-02T11:48:51.857399+0000","last_fullsized":"2024-02-02T11:48:51.857399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_clean_scrub_stamp":"2024-02-02T11:48:40.536978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:22:02.923582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828445+0000","last_change":"2024-02-02T11:48:51.467641+0000","last_active":"2024-02-02T11:48:52.828445+0000","last_peered":"2024-02-02T11:48:52.828445+0000","last_clean":"2024-02-02T11:48:52.828445+0000","last_became_active":"2024-02-02T11:48:51.466793+0000","last_became_peered":"2024-02-02T11:48:51.466793+0000","last_unstale":"2024-02-02T11:48:52.828445+0000","last_undegraded":"2024-02-02T11:48:52.828445+0000","last_fullsized":"2024-02-02T11:48:52.828445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:22:40.437082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014197+0000","last_change":"2024-02-02T11:48:51.889165+0000","last_active":"2024-02-02T11:48:53.014197+0000","last_peered":"2024-02-02T11:48:53.014197+0000","last_clean":"2024-02-02T11:48:53.014197+0000","last_became_active":"2024-02-02T11:48:51.888946+0000","last_became_peered":"2024-02-02T11:48:51.888946+0000","last_unstale":"2024-02-02T11:48:53.014197+0000","last_undegraded":"2024-02-02T11:48:53.014197+0000","last_fullsized":"2024-02-02T11:48:53.014197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:44:05.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013178+0000","last_change":"2024-02-02T11:48:51.490450+0000","last_active":"2024-02-02T11:48:53.013178+0000","last_peered":"2024-02-02T11:48:53.013178+0000","last_clean":"2024-02-02T11:48:53.013178+0000","last_became_active":"2024-02-02T11:48:51.489819+0000","last_became_peered":"2024-02-02T11:48:51.489819+0000","last_unstale":"2024-02-02T11:48:53.013178+0000","last_undegraded":"2024-02-02T11:48:53.013178+0000","last_fullsized":"2024-02-02T11:48:53.013178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:11:06.903511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015117+0000","last_change":"2024-02-02T11:48:51.844140+0000","last_active":"2024-02-02T11:48:53.015117+0000","last_peered":"2024-02-02T11:48:53.015117+0000","last_clean":"2024-02-02T11:48:53.015117+0000","last_became_active":"2024-02-02T11:48:51.843865+0000","last_became_peered":"2024-02-02T11:48:51.843865+0000","last_unstale":"2024-02-02T11:48:53.015117+0000","last_undegraded":"2024-02-02T11:48:53.015117+0000","last_fullsized":"2024-02-02T11:48:53.015117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:10:43.379183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013460+0000","last_change":"2024-02-02T11:48:51.468449+0000","last_active":"2024-02-02T11:48:53.013460+0000","last_peered":"2024-02-02T11:48:53.013460+0000","last_clean":"2024-02-02T11:48:53.013460+0000","last_became_active":"2024-02-02T11:48:51.468136+0000","last_became_peered":"2024-02-02T11:48:51.468136+0000","last_unstale":"2024-02-02T11:48:53.013460+0000","last_undegraded":"2024-02-02T11:48:53.013460+0000","last_fullsized":"2024-02-02T11:48:53.013460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:06:13.971694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825256+0000","last_change":"2024-02-02T11:48:51.836358+0000","last_active":"2024-02-02T11:48:52.825256+0000","last_peered":"2024-02-02T11:48:52.825256+0000","last_clean":"2024-02-02T11:48:52.825256+0000","last_became_active":"2024-02-02T11:48:51.836089+0000","last_became_peered":"2024-02-02T11:48:51.836089+0000","last_unstale":"2024-02-02T11:48:52.825256+0000","last_undegraded":"2024-02-02T11:48:52.825256+0000","last_fullsized":"2024-02-02T11:48:52.825256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829035+0000","last_change":"2024-02-02T11:48:51.472708+0000","last_active":"2024-02-02T11:48:52.829035+0000","last_peered":"2024-02-02T11:48:52.829035+0000","last_clean":"2024-02-02T11:48:52.829035+0000","last_became_active":"2024-02-02T11:48:51.471927+0000","last_became_peered":"2024-02-02T11:48:51.471927+0000","last_unstale":"2024-02-02T11:48:52.829035+0000","last_undegraded":"2024-02-02T11:48:52.829035+0000","last_fullsized":"2024-02-02T11:48:52.829035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:11:06.903511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.827116+0000","last_change":"2024-02-02T11:48:51.854118+0000","last_active":"2024-02-02T11:48:52.827116+0000","last_peered":"2024-02-02T11:48:52.827116+0000","last_clean":"2024-02-02T11:48:52.827116+0000","last_became_active":"2024-02-02T11:48:51.852712+0000","last_became_peered":"2024-02-02T11:48:51.852712+0000","last_unstale":"2024-02-02T11:48:52.827116+0000","last_undegraded":"2024-02-02T11:48:52.827116+0000","last_fullsized":"2024-02-02T11:48:52.827116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:55:18.720031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825177+0000","last_change":"2024-02-02T11:48:51.470060+0000","last_active":"2024-02-02T11:48:52.825177+0000","last_peered":"2024-02-02T11:48:52.825177+0000","last_clean":"2024-02-02T11:48:52.825177+0000","last_became_active":"2024-02-02T11:48:51.469761+0000","last_became_peered":"2024-02-02T11:48:51.469761+0000","last_unstale":"2024-02-02T11:48:52.825177+0000","last_undegraded":"2024-02-02T11:48:52.825177+0000","last_fullsized":"2024-02-02T11:48:52.825177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829453+0000","last_change":"2024-02-02T11:48:51.873107+0000","last_active":"2024-02-02T11:48:52.829453+0000","last_peered":"2024-02-02T11:48:52.829453+0000","last_clean":"2024-02-02T11:48:52.829453+0000","last_became_active":"2024-02-02T11:48:51.863234+0000","last_became_peered":"2024-02-02T11:48:51.863234+0000","last_unstale":"2024-02-02T11:48:52.829453+0000","last_undegraded":"2024-02-02T11:48:52.829453+0000","last_fullsized":"2024-02-02T11:48:52.829453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:36:48.786870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014135+0000","last_change":"2024-02-02T11:48:51.495141+0000","last_active":"2024-02-02T11:48:53.014135+0000","last_peered":"2024-02-02T11:48:53.014135+0000","last_clean":"2024-02-02T11:48:53.014135+0000","last_became_active":"2024-02-02T11:48:51.494357+0000","last_became_peered":"2024-02-02T11:48:51.494357+0000","last_unstale":"2024-02-02T11:48:53.014135+0000","last_undegraded":"2024-02-02T11:48:53.014135+0000","last_fullsized":"2024-02-02T11:48:53.014135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:26.386549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825161+0000","last_change":"2024-02-02T11:48:51.834937+0000","last_active":"2024-02-02T11:48:52.825161+0000","last_peered":"2024-02-02T11:48:52.825161+0000","last_clean":"2024-02-02T11:48:52.825161+0000","last_became_active":"2024-02-02T11:48:51.834659+0000","last_became_peered":"2024-02-02T11:48:51.834659+0000","last_unstale":"2024-02-02T11:48:52.825161+0000","last_undegraded":"2024-02-02T11:48:52.825161+0000","last_fullsized":"2024-02-02T11:48:52.825161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:14.049200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:55.286866+0000","last_change":"2024-02-02T11:48:51.487838+0000","last_active":"2024-02-02T11:48:55.286866+0000","last_peered":"2024-02-02T11:48:55.286866+0000","last_clean":"2024-02-02T11:48:55.286866+0000","last_became_active":"2024-02-02T11:48:51.487608+0000","last_became_peered":"2024-02-02T11:48:51.487608+0000","last_unstale":"2024-02-02T11:48:55.286866+0000","last_undegraded":"2024-02-02T11:48:55.286866+0000","last_fullsized":"2024-02-02T11:48:55.286866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:22:40.437082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015208+0000","last_change":"2024-02-02T11:48:51.884253+0000","last_active":"2024-02-02T11:48:53.015208+0000","last_peered":"2024-02-02T11:48:53.015208+0000","last_clean":"2024-02-02T11:48:53.015208+0000","last_became_active":"2024-02-02T11:48:51.883954+0000","last_became_peered":"2024-02-02T11:48:51.883954+0000","last_unstale":"2024-02-02T11:48:53.015208+0000","last_undegraded":"2024-02-02T11:48:53.015208+0000","last_fullsized":"2024-02-02T11:48:53.015208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993422+0000","last_change":"2024-02-02T11:48:51.492938+0000","last_active":"2024-02-02T11:48:52.993422+0000","last_peered":"2024-02-02T11:48:52.993422+0000","last_clean":"2024-02-02T11:48:52.993422+0000","last_became_active":"2024-02-02T11:48:51.492303+0000","last_became_peered":"2024-02-02T11:48:51.492303+0000","last_unstale":"2024-02-02T11:48:52.993422+0000","last_undegraded":"2024-02-02T11:48:52.993422+0000","last_fullsized":"2024-02-02T11:48:52.993422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:11:06.903511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016684+0000","last_change":"2024-02-02T11:48:51.848144+0000","last_active":"2024-02-02T11:48:53.016684+0000","last_peered":"2024-02-02T11:48:53.016684+0000","last_clean":"2024-02-02T11:48:53.016684+0000","last_became_active":"2024-02-02T11:48:51.847887+0000","last_became_peered":"2024-02-02T11:48:51.847887+0000","last_unstale":"2024-02-02T11:48:53.016684+0000","last_undegraded":"2024-02-02T11:48:53.016684+0000","last_fullsized":"2024-02-02T11:48:53.016684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:11:37.650346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013207+0000","last_change":"2024-02-02T11:48:51.482652+0000","last_active":"2024-02-02T11:48:53.013207+0000","last_peered":"2024-02-02T11:48:53.013207+0000","last_clean":"2024-02-02T11:48:53.013207+0000","last_became_active":"2024-02-02T11:48:51.481995+0000","last_became_peered":"2024-02-02T11:48:51.481995+0000","last_unstale":"2024-02-02T11:48:53.013207+0000","last_undegraded":"2024-02-02T11:48:53.013207+0000","last_fullsized":"2024-02-02T11:48:53.013207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:22:40.437082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.826883+0000","last_change":"2024-02-02T11:48:51.833510+0000","last_active":"2024-02-02T11:48:52.826883+0000","last_peered":"2024-02-02T11:48:52.826883+0000","last_clean":"2024-02-02T11:48:52.826883+0000","last_became_active":"2024-02-02T11:48:51.830625+0000","last_became_peered":"2024-02-02T11:48:51.830625+0000","last_unstale":"2024-02-02T11:48:52.826883+0000","last_undegraded":"2024-02-02T11:48:52.826883+0000","last_fullsized":"2024-02-02T11:48:52.826883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:27.396890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.824977+0000","last_change":"2024-02-02T11:48:51.480505+0000","last_active":"2024-02-02T11:48:52.824977+0000","last_peered":"2024-02-02T11:48:52.824977+0000","last_clean":"2024-02-02T11:48:52.824977+0000","last_became_active":"2024-02-02T11:48:51.480230+0000","last_became_peered":"2024-02-02T11:48:51.480230+0000","last_unstale":"2024-02-02T11:48:52.824977+0000","last_undegraded":"2024-02-02T11:48:52.824977+0000","last_fullsized":"2024-02-02T11:48:52.824977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:11:06.903511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014049+0000","last_change":"2024-02-02T11:48:51.837394+0000","last_active":"2024-02-02T11:48:53.014049+0000","last_peered":"2024-02-02T11:48:53.014049+0000","last_clean":"2024-02-02T11:48:53.014049+0000","last_became_active":"2024-02-02T11:48:51.837092+0000","last_became_peered":"2024-02-02T11:48:51.837092+0000","last_unstale":"2024-02-02T11:48:53.014049+0000","last_undegraded":"2024-02-02T11:48:53.014049+0000","last_fullsized":"2024-02-02T11:48:53.014049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:17:07.932896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825011+0000","last_change":"2024-02-02T11:48:51.469411+0000","last_active":"2024-02-02T11:48:52.825011+0000","last_peered":"2024-02-02T11:48:52.825011+0000","last_clean":"2024-02-02T11:48:52.825011+0000","last_became_active":"2024-02-02T11:48:51.469142+0000","last_became_peered":"2024-02-02T11:48:51.469142+0000","last_unstale":"2024-02-02T11:48:52.825011+0000","last_undegraded":"2024-02-02T11:48:52.825011+0000","last_fullsized":"2024-02-02T11:48:52.825011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:02:58.430952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014321+0000","last_change":"2024-02-02T11:48:51.849339+0000","last_active":"2024-02-02T11:48:53.014321+0000","last_peered":"2024-02-02T11:48:53.014321+0000","last_clean":"2024-02-02T11:48:53.014321+0000","last_became_active":"2024-02-02T11:48:51.849074+0000","last_became_peered":"2024-02-02T11:48:51.849074+0000","last_unstale":"2024-02-02T11:48:53.014321+0000","last_undegraded":"2024-02-02T11:48:53.014321+0000","last_fullsized":"2024-02-02T11:48:53.014321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014003+0000","last_change":"2024-02-02T11:48:51.491708+0000","last_active":"2024-02-02T11:48:53.014003+0000","last_peered":"2024-02-02T11:48:53.014003+0000","last_clean":"2024-02-02T11:48:53.014003+0000","last_became_active":"2024-02-02T11:48:51.490530+0000","last_became_peered":"2024-02-02T11:48:51.490530+0000","last_unstale":"2024-02-02T11:48:53.014003+0000","last_undegraded":"2024-02-02T11:48:53.014003+0000","last_fullsized":"2024-02-02T11:48:53.014003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992605+0000","last_change":"2024-02-02T11:48:51.866340+0000","last_active":"2024-02-02T11:48:52.992605+0000","last_peered":"2024-02-02T11:48:52.992605+0000","last_clean":"2024-02-02T11:48:52.992605+0000","last_became_active":"2024-02-02T11:48:51.865769+0000","last_became_peered":"2024-02-02T11:48:51.865769+0000","last_unstale":"2024-02-02T11:48:52.992605+0000","last_undegraded":"2024-02-02T11:48:52.992605+0000","last_fullsized":"2024-02-02T11:48:52.992605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:26:18.517358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829215+0000","last_change":"2024-02-02T11:48:51.873724+0000","last_active":"2024-02-02T11:48:52.829215+0000","last_peered":"2024-02-02T11:48:52.829215+0000","last_clean":"2024-02-02T11:48:52.829215+0000","last_became_active":"2024-02-02T11:48:51.872899+0000","last_became_peered":"2024-02-02T11:48:51.872899+0000","last_unstale":"2024-02-02T11:48:52.829215+0000","last_undegraded":"2024-02-02T11:48:52.829215+0000","last_fullsized":"2024-02-02T11:48:52.829215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013728+0000","last_change":"2024-02-02T11:48:51.498148+0000","last_active":"2024-02-02T11:48:53.013728+0000","last_peered":"2024-02-02T11:48:53.013728+0000","last_clean":"2024-02-02T11:48:53.013728+0000","last_became_active":"2024-02-02T11:48:51.497318+0000","last_became_peered":"2024-02-02T11:48:51.497318+0000","last_unstale":"2024-02-02T11:48:53.013728+0000","last_undegraded":"2024-02-02T11:48:53.013728+0000","last_fullsized":"2024-02-02T11:48:53.013728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:55:17.709690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828889+0000","last_change":"2024-02-02T11:48:51.874421+0000","last_active":"2024-02-02T11:48:52.828889+0000","last_peered":"2024-02-02T11:48:52.828889+0000","last_clean":"2024-02-02T11:48:52.828889+0000","last_became_active":"2024-02-02T11:48:51.873913+0000","last_became_peered":"2024-02-02T11:48:51.873913+0000","last_unstale":"2024-02-02T11:48:52.828889+0000","last_undegraded":"2024-02-02T11:48:52.828889+0000","last_fullsized":"2024-02-02T11:48:52.828889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013994+0000","last_change":"2024-02-02T11:48:51.495990+0000","last_active":"2024-02-02T11:48:53.013994+0000","last_peered":"2024-02-02T11:48:53.013994+0000","last_clean":"2024-02-02T11:48:53.013994+0000","last_became_active":"2024-02-02T11:48:51.495310+0000","last_became_peered":"2024-02-02T11:48:51.495310+0000","last_unstale":"2024-02-02T11:48:53.013994+0000","last_undegraded":"2024-02-02T11:48:53.013994+0000","last_fullsized":"2024-02-02T11:48:53.013994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:32.118220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015727+0000","last_change":"2024-02-02T11:48:51.890655+0000","last_active":"2024-02-02T11:48:53.015727+0000","last_peered":"2024-02-02T11:48:53.015727+0000","last_clean":"2024-02-02T11:48:53.015727+0000","last_became_active":"2024-02-02T11:48:51.890435+0000","last_became_peered":"2024-02-02T11:48:51.890435+0000","last_unstale":"2024-02-02T11:48:53.015727+0000","last_undegraded":"2024-02-02T11:48:53.015727+0000","last_fullsized":"2024-02-02T11:48:53.015727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015002+0000","last_change":"2024-02-02T11:48:51.469696+0000","last_active":"2024-02-02T11:48:53.015002+0000","last_peered":"2024-02-02T11:48:53.015002+0000","last_clean":"2024-02-02T11:48:53.015002+0000","last_became_active":"2024-02-02T11:48:51.469392+0000","last_became_peered":"2024-02-02T11:48:51.469392+0000","last_unstale":"2024-02-02T11:48:53.015002+0000","last_undegraded":"2024-02-02T11:48:53.015002+0000","last_fullsized":"2024-02-02T11:48:53.015002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015320+0000","last_change":"2024-02-02T11:48:51.870169+0000","last_active":"2024-02-02T11:48:53.015320+0000","last_peered":"2024-02-02T11:48:53.015320+0000","last_clean":"2024-02-02T11:48:53.015320+0000","last_became_active":"2024-02-02T11:48:51.869883+0000","last_became_peered":"2024-02-02T11:48:51.869883+0000","last_unstale":"2024-02-02T11:48:53.015320+0000","last_undegraded":"2024-02-02T11:48:53.015320+0000","last_fullsized":"2024-02-02T11:48:53.015320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:36:48.786870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016079+0000","last_change":"2024-02-02T11:48:51.483548+0000","last_active":"2024-02-02T11:48:53.016079+0000","last_peered":"2024-02-02T11:48:53.016079+0000","last_clean":"2024-02-02T11:48:53.016079+0000","last_became_active":"2024-02-02T11:48:51.483219+0000","last_became_peered":"2024-02-02T11:48:51.483219+0000","last_unstale":"2024-02-02T11:48:53.016079+0000","last_undegraded":"2024-02-02T11:48:53.016079+0000","last_fullsized":"2024-02-02T11:48:53.016079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T17:21:41.030654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-02T11:49:04.024 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-02T11:49:04.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f44d48640 1 Processor -- start 2024-02-02T11:49:04.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f44d48640 1 -- start start 2024-02-02T11:49:04.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f44d48640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f400b8ad0 0x7f0f4014ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f44d48640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0f4014b370 0x7f0f401554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f44d48640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f4006cdc0 con 0x7f0f40144ea0 2024-02-02T11:49:04.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f44d48640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f40071610 con 0x7f0f4014b370 2024-02-02T11:49:04.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f44d48640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4006ee40 con 0x7f0f400b8ad0 2024-02-02T11:49:04.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3e59c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0f40144ea0 0x7f0f40070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:57540/0 (socket says 172.21.15.161:57540) 2024-02-02T11:49:04.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3e59c640 1 -- 172.21.15.161:0/478786658 learned_addr learned my addr 172.21.15.161:0/478786658 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:04.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3dd9b640 1 --2- 172.21.15.161:0/478786658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f400b8ad0 0x7f0f4014ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3d59a640 1 -- 172.21.15.161:0/478786658 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 353787722 0 0) 0x7f0f4006cdc0 con 0x7f0f40144ea0 2024-02-02T11:49:04.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3d59a640 1 -- 172.21.15.161:0/478786658 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f28003530 con 0x7f0f40144ea0 2024-02-02T11:49:04.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3ed9d640 1 --2- 172.21.15.161:0/478786658 >> v2:172.21.15.162:3300/0 conn(0x7f0f4014b370 0x7f0f401554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3d59a640 1 -- 172.21.15.161:0/478786658 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2306096345 0 0) 0x7f0f28003530 con 0x7f0f40144ea0 2024-02-02T11:49:04.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3d59a640 1 -- 172.21.15.161:0/478786658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f400b8ad0 msgr2=0x7f0f4014ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:04.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3d59a640 1 --2- 172.21.15.161:0/478786658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f400b8ad0 0x7f0f4014ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3d59a640 1 -- 172.21.15.161:0/478786658 >> v2:172.21.15.162:3300/0 conn(0x7f0f4014b370 msgr2=0x7f0f401554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:04.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3d59a640 1 --2- 172.21.15.161:0/478786658 >> v2:172.21.15.162:3300/0 conn(0x7f0f4014b370 0x7f0f401554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3d59a640 1 -- 172.21.15.161:0/478786658 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4014b7c0 con 0x7f0f40144ea0 2024-02-02T11:49:04.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3d59a640 1 -- 172.21.15.161:0/478786658 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f0f30001680 con 0x7f0f40144ea0 2024-02-02T11:49:04.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3ed9d640 1 --2- 172.21.15.161:0/478786658 >> v2:172.21.15.162:3300/0 conn(0x7f0f4014b370 0x7f0f401554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:49:04.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3d59a640 1 -- 172.21.15.161:0/478786658 >> v1:172.21.15.161:6789/0 conn(0x7f0f40144ea0 legacy=0x7f0f40070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:04.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3d59a640 1 --2- 172.21.15.161:0/478786658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f28003980 0x7f0f28003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3d59a640 1 --2- 172.21.15.161:0/478786658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f280047d0 0x7f0f28004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3d59a640 1 --2- 172.21.15.161:0/478786658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f400b8ad0 0x7f0f28005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3d59a640 1 -- 172.21.15.161:0/478786658 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f40071610 con 0x7f0f28003980 2024-02-02T11:49:04.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3d59a640 1 -- 172.21.15.161:0/478786658 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4006ee40 con 0x7f0f280047d0 2024-02-02T11:49:04.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3d59a640 1 -- 172.21.15.161:0/478786658 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2800bad0 con 0x7f0f400b8ad0 2024-02-02T11:49:04.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3e59c640 1 --2- 172.21.15.161:0/478786658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f28003980 0x7f0f28003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3dd9b640 1 --2- 172.21.15.161:0/478786658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f280047d0 0x7f0f28004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3ed9d640 1 --2- 172.21.15.161:0/478786658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f400b8ad0 0x7f0f28005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3e59c640 1 -- 172.21.15.161:0/478786658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f400b8ad0 msgr2=0x7f0f28005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:04.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3e59c640 1 --2- 172.21.15.161:0/478786658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f400b8ad0 0x7f0f28005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3e59c640 1 -- 172.21.15.161:0/478786658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f280047d0 msgr2=0x7f0f28004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:04.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3e59c640 1 --2- 172.21.15.161:0/478786658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f280047d0 0x7f0f28004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3e59c640 1 -- 172.21.15.161:0/478786658 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f28003530 con 0x7f0f28003980 2024-02-02T11:49:04.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.167+0000 7f0f3ed9d640 1 --2- 172.21.15.161:0/478786658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f400b8ad0 0x7f0f28005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:04.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f3e59c640 1 --2- 172.21.15.161:0/478786658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f28003980 0x7f0f28003da0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000c210 tx=0x7f0f3001f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e4acf4e69bb0cd server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:04.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f3d59a640 1 -- 172.21.15.161:0/478786658 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30005ae0 con 0x7f0f28003980 2024-02-02T11:49:04.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f3d59a640 1 -- 172.21.15.161:0/478786658 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f300ab070 con 0x7f0f28003980 2024-02-02T11:49:04.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f3d59a640 1 -- 172.21.15.161:0/478786658 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30005ea0 con 0x7f0f28003980 2024-02-02T11:49:04.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f44d48640 1 -- 172.21.15.161:0/478786658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f28003980 msgr2=0x7f0f28003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:04.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f44d48640 1 --2- 172.21.15.161:0/478786658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f28003980 0x7f0f28003da0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000c210 tx=0x7f0f3001f370 comp rx=0 tx=0).stop 2024-02-02T11:49:04.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f3ed9d640 1 -- 172.21.15.161:0/478786658 reap_dead start 2024-02-02T11:49:04.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f44d48640 1 -- 172.21.15.161:0/478786658 shutdown_connections 2024-02-02T11:49:04.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f44d48640 1 -- 172.21.15.161:0/478786658 >> 172.21.15.161:0/478786658 conn(0x7f0f400be150 msgr2=0x7f0f400be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:04.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f44d48640 1 -- 172.21.15.161:0/478786658 shutdown_connections 2024-02-02T11:49:04.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f44d48640 1 -- 172.21.15.161:0/478786658 wait complete. 2024-02-02T11:49:04.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f44d48640 1 Processor -- start 2024-02-02T11:49:04.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f44d48640 1 -- start start 2024-02-02T11:49:04.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f44d48640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f28003980 0x7f0f400bd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f44d48640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f4013f0f0 0x7f0f400a2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f44d48640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f4013a390 0x7f0f4013a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f44d48640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f400bded0 con 0x7f0f4013f0f0 2024-02-02T11:49:04.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f44d48640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f400a30b0 con 0x7f0f28003980 2024-02-02T11:49:04.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f44d48640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f40143610 con 0x7f0f4013a390 2024-02-02T11:49:04.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f3dd9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f4013f0f0 0x7f0f400a2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f3dd9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f4013f0f0 0x7f0f400a2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39774/0 (socket says 172.21.15.161:39774) 2024-02-02T11:49:04.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f3dd9b640 1 -- 172.21.15.161:0/387245607 learned_addr learned my addr 172.21.15.161:0/387245607 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:04.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f3ed9d640 1 --2- 172.21.15.161:0/387245607 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f4013a390 0x7f0f4013a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f3e59c640 1 --2- 172.21.15.161:0/387245607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f28003980 0x7f0f400bd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f3dd9b640 1 -- 172.21.15.161:0/387245607 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f4013a390 msgr2=0x7f0f4013a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:04.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f3dd9b640 1 --2- 172.21.15.161:0/387245607 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f4013a390 0x7f0f4013a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f3dd9b640 1 -- 172.21.15.161:0/387245607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f28003980 msgr2=0x7f0f400bd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:04.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f3dd9b640 1 --2- 172.21.15.161:0/387245607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f28003980 0x7f0f400bd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f3dd9b640 1 -- 172.21.15.161:0/387245607 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4013ad50 con 0x7f0f4013f0f0 2024-02-02T11:49:04.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f3dd9b640 1 --2- 172.21.15.161:0/387245607 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f4013f0f0 0x7f0f400a2b70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400f5b0 tx=0x7f0f3400fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:04.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f2effd640 1 -- 172.21.15.161:0/387245607 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34014870 con 0x7f0f4013f0f0 2024-02-02T11:49:04.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f2effd640 1 -- 172.21.15.161:0/387245607 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f340149d0 con 0x7f0f4013f0f0 2024-02-02T11:49:04.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f44d48640 1 -- 172.21.15.161:0/387245607 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f4013feb0 con 0x7f0f4013f0f0 2024-02-02T11:49:04.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f2effd640 1 -- 172.21.15.161:0/387245607 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34014d60 con 0x7f0f4013f0f0 2024-02-02T11:49:04.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.171+0000 7f0f44d48640 1 -- 172.21.15.161:0/387245607 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f4013f8f0 con 0x7f0f4013f0f0 2024-02-02T11:49:04.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.175+0000 7f0f44d48640 1 -- 172.21.15.161:0/387245607 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f40071a20 con 0x7f0f4013f0f0 2024-02-02T11:49:04.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.175+0000 7f0f2effd640 1 -- 172.21.15.161:0/387245607 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0f34015410 con 0x7f0f4013f0f0 2024-02-02T11:49:04.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.175+0000 7f0f2effd640 1 --2- 172.21.15.161:0/387245607 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0f20065a90 0x7f0f20067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.175+0000 7f0f2effd640 1 -- 172.21.15.161:0/387245607 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f34083b00 con 0x7f0f4013f0f0 2024-02-02T11:49:04.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.175+0000 7f0f3e59c640 1 --2- 172.21.15.161:0/387245607 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0f20065a90 0x7f0f20067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.175+0000 7f0f3e59c640 1 --2- 172.21.15.161:0/387245607 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0f20065a90 0x7f0f20067f50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0f300ae000 tx=0x7f0f30001a80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:04.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.179+0000 7f0f2effd640 1 -- 172.21.15.161:0/387245607 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0f34051550 con 0x7f0f4013f0f0 2024-02-02T11:49:04.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.319+0000 7f0f44d48640 1 -- 172.21.15.161:0/387245607 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0f4006c770 con 0x7f0f20065a90 2024-02-02T11:49:04.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.323+0000 7f0f2effd640 1 -- 172.21.15.161:0/387245607 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264522 (secure 0 0 0) 0x7f0f300014c0 con 0x7f0f20065a90 2024-02-02T11:49:04.330 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:04.331 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-02-02T11:49:04.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.327+0000 7f0f44d48640 1 -- 172.21.15.161:0/387245607 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0f20065a90 msgr2=0x7f0f20067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:04.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.327+0000 7f0f44d48640 1 --2- 172.21.15.161:0/387245607 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0f20065a90 0x7f0f20067f50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0f300ae000 tx=0x7f0f30001a80 comp rx=0 tx=0).stop 2024-02-02T11:49:04.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.327+0000 7f0f44d48640 1 -- 172.21.15.161:0/387245607 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f4013f0f0 msgr2=0x7f0f400a2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:04.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.327+0000 7f0f44d48640 1 --2- 172.21.15.161:0/387245607 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f4013f0f0 0x7f0f400a2b70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400f5b0 tx=0x7f0f3400fa70 comp rx=0 tx=0).stop 2024-02-02T11:49:04.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.327+0000 7f0f44d48640 1 -- 172.21.15.161:0/387245607 shutdown_connections 2024-02-02T11:49:04.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.327+0000 7f0f44d48640 1 --2- 172.21.15.161:0/387245607 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0f20065a90 0x7f0f20067f50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.327+0000 7f0f44d48640 1 --2- 172.21.15.161:0/387245607 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f4013a390 0x7f0f4013a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.327+0000 7f0f44d48640 1 --2- 172.21.15.161:0/387245607 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f4013f0f0 0x7f0f400a2b70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.327+0000 7f0f44d48640 1 --2- 172.21.15.161:0/387245607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f28003980 0x7f0f400bd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.327+0000 7f0f44d48640 1 -- 172.21.15.161:0/387245607 >> 172.21.15.161:0/387245607 conn(0x7f0f400be150 msgr2=0x7f0f4013d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:04.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.327+0000 7f0f44d48640 1 -- 172.21.15.161:0/387245607 shutdown_connections 2024-02-02T11:49:04.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.327+0000 7f0f44d48640 1 -- 172.21.15.161:0/387245607 wait complete. 2024-02-02T11:49:04.346 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-02-02T11:49:04.256233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223080,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":220146,"kb_avail":754751640,"statfs":{"total":773094113280,"available":772865679360,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225429592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.434634"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014159+0000","last_change":"2024-02-02T11:48:51.897055+0000","last_active":"2024-02-02T11:48:53.014159+0000","last_peered":"2024-02-02T11:48:53.014159+0000","last_clean":"2024-02-02T11:48:53.014159+0000","last_became_active":"2024-02-02T11:48:51.896591+0000","last_became_peered":"2024-02-02T11:48:51.896591+0000","last_unstale":"2024-02-02T11:48:53.014159+0000","last_undegraded":"2024-02-02T11:48:53.014159+0000","last_fullsized":"2024-02-02T11:48:53.014159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825415+0000","last_change":"2024-02-02T11:48:51.849203+0000","last_active":"2024-02-02T11:48:52.825415+0000","last_peered":"2024-02-02T11:48:52.825415+0000","last_clean":"2024-02-02T11:48:52.825415+0000","last_became_active":"2024-02-02T11:48:51.848773+0000","last_became_peered":"2024-02-02T11:48:51.848773+0000","last_unstale":"2024-02-02T11:48:52.825415+0000","last_undegraded":"2024-02-02T11:48:52.825415+0000","last_fullsized":"2024-02-02T11:48:52.825415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:26:18.517358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014636+0000","last_change":"2024-02-02T11:48:51.848120+0000","last_active":"2024-02-02T11:48:53.014636+0000","last_peered":"2024-02-02T11:48:53.014636+0000","last_clean":"2024-02-02T11:48:53.014636+0000","last_became_active":"2024-02-02T11:48:51.847834+0000","last_became_peered":"2024-02-02T11:48:51.847834+0000","last_unstale":"2024-02-02T11:48:53.014636+0000","last_undegraded":"2024-02-02T11:48:53.014636+0000","last_fullsized":"2024-02-02T11:48:53.014636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:14.049200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828595+0000","last_change":"2024-02-02T11:48:51.873374+0000","last_active":"2024-02-02T11:48:52.828595+0000","last_peered":"2024-02-02T11:48:52.828595+0000","last_clean":"2024-02-02T11:48:52.828595+0000","last_became_active":"2024-02-02T11:48:51.872600+0000","last_became_peered":"2024-02-02T11:48:51.872600+0000","last_unstale":"2024-02-02T11:48:52.828595+0000","last_undegraded":"2024-02-02T11:48:52.828595+0000","last_fullsized":"2024-02-02T11:48:52.828595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:31:27.082147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013509+0000","last_change":"2024-02-02T11:48:51.886196+0000","last_active":"2024-02-02T11:48:53.013509+0000","last_peered":"2024-02-02T11:48:53.013509+0000","last_clean":"2024-02-02T11:48:53.013509+0000","last_became_active":"2024-02-02T11:48:51.885504+0000","last_became_peered":"2024-02-02T11:48:51.885504+0000","last_unstale":"2024-02-02T11:48:53.013509+0000","last_undegraded":"2024-02-02T11:48:53.013509+0000","last_fullsized":"2024-02-02T11:48:53.013509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:55:40.677428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828565+0000","last_change":"2024-02-02T11:48:51.890332+0000","last_active":"2024-02-02T11:48:52.828565+0000","last_peered":"2024-02-02T11:48:52.828565+0000","last_clean":"2024-02-02T11:48:52.828565+0000","last_became_active":"2024-02-02T11:48:51.889165+0000","last_became_peered":"2024-02-02T11:48:51.889165+0000","last_unstale":"2024-02-02T11:48:52.828565+0000","last_undegraded":"2024-02-02T11:48:52.828565+0000","last_fullsized":"2024-02-02T11:48:52.828565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:01:26.016064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013297+0000","last_change":"2024-02-02T11:48:51.884543+0000","last_active":"2024-02-02T11:48:53.013297+0000","last_peered":"2024-02-02T11:48:53.013297+0000","last_clean":"2024-02-02T11:48:53.013297+0000","last_became_active":"2024-02-02T11:48:51.884113+0000","last_became_peered":"2024-02-02T11:48:51.884113+0000","last_unstale":"2024-02-02T11:48:53.013297+0000","last_undegraded":"2024-02-02T11:48:53.013297+0000","last_fullsized":"2024-02-02T11:48:53.013297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:31:27.082147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013204+0000","last_change":"2024-02-02T11:48:51.873291+0000","last_active":"2024-02-02T11:48:53.013204+0000","last_peered":"2024-02-02T11:48:53.013204+0000","last_clean":"2024-02-02T11:48:53.013204+0000","last_became_active":"2024-02-02T11:48:51.872981+0000","last_became_peered":"2024-02-02T11:48:51.872981+0000","last_unstale":"2024-02-02T11:48:53.013204+0000","last_undegraded":"2024-02-02T11:48:53.013204+0000","last_fullsized":"2024-02-02T11:48:53.013204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:14.049200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014205+0000","last_change":"2024-02-02T11:48:51.898237+0000","last_active":"2024-02-02T11:48:53.014205+0000","last_peered":"2024-02-02T11:48:53.014205+0000","last_clean":"2024-02-02T11:48:53.014205+0000","last_became_active":"2024-02-02T11:48:51.897065+0000","last_became_peered":"2024-02-02T11:48:51.897065+0000","last_unstale":"2024-02-02T11:48:53.014205+0000","last_undegraded":"2024-02-02T11:48:53.014205+0000","last_fullsized":"2024-02-02T11:48:53.014205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:56:59.771841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993307+0000","last_change":"2024-02-02T11:48:51.864449+0000","last_active":"2024-02-02T11:48:52.993307+0000","last_peered":"2024-02-02T11:48:52.993307+0000","last_clean":"2024-02-02T11:48:52.993307+0000","last_became_active":"2024-02-02T11:48:51.863664+0000","last_became_peered":"2024-02-02T11:48:51.863664+0000","last_unstale":"2024-02-02T11:48:52.993307+0000","last_undegraded":"2024-02-02T11:48:52.993307+0000","last_fullsized":"2024-02-02T11:48:52.993307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993018+0000","last_change":"2024-02-02T11:48:51.890353+0000","last_active":"2024-02-02T11:48:52.993018+0000","last_peered":"2024-02-02T11:48:52.993018+0000","last_clean":"2024-02-02T11:48:52.993018+0000","last_became_active":"2024-02-02T11:48:51.889927+0000","last_became_peered":"2024-02-02T11:48:51.889927+0000","last_unstale":"2024-02-02T11:48:52.993018+0000","last_undegraded":"2024-02-02T11:48:52.993018+0000","last_fullsized":"2024-02-02T11:48:52.993018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:44:05.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.827212+0000","last_change":"2024-02-02T11:48:51.865778+0000","last_active":"2024-02-02T11:48:52.827212+0000","last_peered":"2024-02-02T11:48:52.827212+0000","last_clean":"2024-02-02T11:48:52.827212+0000","last_became_active":"2024-02-02T11:48:51.864513+0000","last_became_peered":"2024-02-02T11:48:51.864513+0000","last_unstale":"2024-02-02T11:48:52.827212+0000","last_undegraded":"2024-02-02T11:48:52.827212+0000","last_fullsized":"2024-02-02T11:48:52.827212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:33.128561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014047+0000","last_change":"2024-02-02T11:48:51.871880+0000","last_active":"2024-02-02T11:48:53.014047+0000","last_peered":"2024-02-02T11:48:53.014047+0000","last_clean":"2024-02-02T11:48:53.014047+0000","last_became_active":"2024-02-02T11:48:51.871683+0000","last_became_peered":"2024-02-02T11:48:51.871683+0000","last_unstale":"2024-02-02T11:48:53.014047+0000","last_undegraded":"2024-02-02T11:48:53.014047+0000","last_fullsized":"2024-02-02T11:48:53.014047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:32:50.539652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016221+0000","last_change":"2024-02-02T11:48:51.843150+0000","last_active":"2024-02-02T11:48:53.016221+0000","last_peered":"2024-02-02T11:48:53.016221+0000","last_clean":"2024-02-02T11:48:53.016221+0000","last_became_active":"2024-02-02T11:48:51.842884+0000","last_became_peered":"2024-02-02T11:48:51.842884+0000","last_unstale":"2024-02-02T11:48:53.016221+0000","last_undegraded":"2024-02-02T11:48:53.016221+0000","last_fullsized":"2024-02-02T11:48:53.016221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:33:43.440229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.824851+0000","last_change":"2024-02-02T11:48:51.835634+0000","last_active":"2024-02-02T11:48:52.824851+0000","last_peered":"2024-02-02T11:48:52.824851+0000","last_clean":"2024-02-02T11:48:52.824851+0000","last_became_active":"2024-02-02T11:48:51.835378+0000","last_became_peered":"2024-02-02T11:48:51.835378+0000","last_unstale":"2024-02-02T11:48:52.824851+0000","last_undegraded":"2024-02-02T11:48:52.824851+0000","last_fullsized":"2024-02-02T11:48:52.824851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828051+0000","last_change":"2024-02-02T11:48:51.873754+0000","last_active":"2024-02-02T11:48:52.828051+0000","last_peered":"2024-02-02T11:48:52.828051+0000","last_clean":"2024-02-02T11:48:52.828051+0000","last_became_active":"2024-02-02T11:48:51.864819+0000","last_became_peered":"2024-02-02T11:48:51.864819+0000","last_unstale":"2024-02-02T11:48:52.828051+0000","last_undegraded":"2024-02-02T11:48:52.828051+0000","last_fullsized":"2024-02-02T11:48:52.828051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:02:09.899239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829342+0000","last_change":"2024-02-02T11:48:51.884635+0000","last_active":"2024-02-02T11:48:52.829342+0000","last_peered":"2024-02-02T11:48:52.829342+0000","last_clean":"2024-02-02T11:48:52.829342+0000","last_became_active":"2024-02-02T11:48:51.884182+0000","last_became_peered":"2024-02-02T11:48:51.884182+0000","last_unstale":"2024-02-02T11:48:52.829342+0000","last_undegraded":"2024-02-02T11:48:52.829342+0000","last_fullsized":"2024-02-02T11:48:52.829342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:15:46.872789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015398+0000","last_change":"2024-02-02T11:48:51.870210+0000","last_active":"2024-02-02T11:48:53.015398+0000","last_peered":"2024-02-02T11:48:53.015398+0000","last_clean":"2024-02-02T11:48:53.015398+0000","last_became_active":"2024-02-02T11:48:51.869889+0000","last_became_peered":"2024-02-02T11:48:51.869889+0000","last_unstale":"2024-02-02T11:48:53.015398+0000","last_undegraded":"2024-02-02T11:48:53.015398+0000","last_fullsized":"2024-02-02T11:48:53.015398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:33.128561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014093+0000","last_change":"2024-02-02T11:48:51.888159+0000","last_active":"2024-02-02T11:48:53.014093+0000","last_peered":"2024-02-02T11:48:53.014093+0000","last_clean":"2024-02-02T11:48:53.014093+0000","last_became_active":"2024-02-02T11:48:51.887546+0000","last_became_peered":"2024-02-02T11:48:51.887546+0000","last_unstale":"2024-02-02T11:48:53.014093+0000","last_undegraded":"2024-02-02T11:48:53.014093+0000","last_fullsized":"2024-02-02T11:48:53.014093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:36:48.786870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992872+0000","last_change":"2024-02-02T11:48:51.862691+0000","last_active":"2024-02-02T11:48:52.992872+0000","last_peered":"2024-02-02T11:48:52.992872+0000","last_clean":"2024-02-02T11:48:52.992872+0000","last_became_active":"2024-02-02T11:48:51.862032+0000","last_became_peered":"2024-02-02T11:48:51.862032+0000","last_unstale":"2024-02-02T11:48:52.992872+0000","last_undegraded":"2024-02-02T11:48:52.992872+0000","last_fullsized":"2024-02-02T11:48:52.992872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:17:07.932896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015727+0000","last_change":"2024-02-02T11:48:51.884441+0000","last_active":"2024-02-02T11:48:53.015727+0000","last_peered":"2024-02-02T11:48:53.015727+0000","last_clean":"2024-02-02T11:48:53.015727+0000","last_became_active":"2024-02-02T11:48:51.884033+0000","last_became_peered":"2024-02-02T11:48:51.884033+0000","last_unstale":"2024-02-02T11:48:53.015727+0000","last_undegraded":"2024-02-02T11:48:53.015727+0000","last_fullsized":"2024-02-02T11:48:53.015727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828714+0000","last_change":"2024-02-02T11:48:51.884667+0000","last_active":"2024-02-02T11:48:52.828714+0000","last_peered":"2024-02-02T11:48:52.828714+0000","last_clean":"2024-02-02T11:48:52.828714+0000","last_became_active":"2024-02-02T11:48:51.884211+0000","last_became_peered":"2024-02-02T11:48:51.884211+0000","last_unstale":"2024-02-02T11:48:52.828714+0000","last_undegraded":"2024-02-02T11:48:52.828714+0000","last_fullsized":"2024-02-02T11:48:52.828714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:34:16.623804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.017166+0000","last_change":"2024-02-02T11:48:51.844344+0000","last_active":"2024-02-02T11:48:53.017166+0000","last_peered":"2024-02-02T11:48:53.017166+0000","last_clean":"2024-02-02T11:48:53.017166+0000","last_became_active":"2024-02-02T11:48:51.844068+0000","last_became_peered":"2024-02-02T11:48:51.844068+0000","last_unstale":"2024-02-02T11:48:53.017166+0000","last_undegraded":"2024-02-02T11:48:53.017166+0000","last_fullsized":"2024-02-02T11:48:53.017166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:31:27.082147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829389+0000","last_change":"2024-02-02T11:48:51.863370+0000","last_active":"2024-02-02T11:48:52.829389+0000","last_peered":"2024-02-02T11:48:52.829389+0000","last_clean":"2024-02-02T11:48:52.829389+0000","last_became_active":"2024-02-02T11:48:51.862502+0000","last_became_peered":"2024-02-02T11:48:51.862502+0000","last_unstale":"2024-02-02T11:48:52.829389+0000","last_undegraded":"2024-02-02T11:48:52.829389+0000","last_fullsized":"2024-02-02T11:48:52.829389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:55:40.677428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015018+0000","last_change":"2024-02-02T11:48:51.844587+0000","last_active":"2024-02-02T11:48:53.015018+0000","last_peered":"2024-02-02T11:48:53.015018+0000","last_clean":"2024-02-02T11:48:53.015018+0000","last_became_active":"2024-02-02T11:48:51.844279+0000","last_became_peered":"2024-02-02T11:48:51.844279+0000","last_unstale":"2024-02-02T11:48:53.015018+0000","last_undegraded":"2024-02-02T11:48:53.015018+0000","last_fullsized":"2024-02-02T11:48:53.015018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:56:59.771841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993316+0000","last_change":"2024-02-02T11:48:51.886760+0000","last_active":"2024-02-02T11:48:52.993316+0000","last_peered":"2024-02-02T11:48:52.993316+0000","last_clean":"2024-02-02T11:48:52.993316+0000","last_became_active":"2024-02-02T11:48:51.886352+0000","last_became_peered":"2024-02-02T11:48:51.886352+0000","last_unstale":"2024-02-02T11:48:52.993316+0000","last_undegraded":"2024-02-02T11:48:52.993316+0000","last_fullsized":"2024-02-02T11:48:52.993316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825142+0000","last_change":"2024-02-02T11:48:51.836508+0000","last_active":"2024-02-02T11:48:52.825142+0000","last_peered":"2024-02-02T11:48:52.825142+0000","last_clean":"2024-02-02T11:48:52.825142+0000","last_became_active":"2024-02-02T11:48:51.836243+0000","last_became_peered":"2024-02-02T11:48:51.836243+0000","last_unstale":"2024-02-02T11:48:52.825142+0000","last_undegraded":"2024-02-02T11:48:52.825142+0000","last_fullsized":"2024-02-02T11:48:52.825142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:17:07.932896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015447+0000","last_change":"2024-02-02T11:48:51.857222+0000","last_active":"2024-02-02T11:48:53.015447+0000","last_peered":"2024-02-02T11:48:53.015447+0000","last_clean":"2024-02-02T11:48:53.015447+0000","last_became_active":"2024-02-02T11:48:51.857008+0000","last_became_peered":"2024-02-02T11:48:51.857008+0000","last_unstale":"2024-02-02T11:48:53.015447+0000","last_undegraded":"2024-02-02T11:48:53.015447+0000","last_fullsized":"2024-02-02T11:48:53.015447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:55:40.677428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015969+0000","last_change":"2024-02-02T11:48:51.848918+0000","last_active":"2024-02-02T11:48:53.015969+0000","last_peered":"2024-02-02T11:48:53.015969+0000","last_clean":"2024-02-02T11:48:53.015969+0000","last_became_active":"2024-02-02T11:48:51.847820+0000","last_became_peered":"2024-02-02T11:48:51.847820+0000","last_unstale":"2024-02-02T11:48:53.015969+0000","last_undegraded":"2024-02-02T11:48:53.015969+0000","last_fullsized":"2024-02-02T11:48:53.015969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:44:05.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828816+0000","last_change":"2024-02-02T11:48:51.863180+0000","last_active":"2024-02-02T11:48:52.828816+0000","last_peered":"2024-02-02T11:48:52.828816+0000","last_clean":"2024-02-02T11:48:52.828816+0000","last_became_active":"2024-02-02T11:48:51.862533+0000","last_became_peered":"2024-02-02T11:48:51.862533+0000","last_unstale":"2024-02-02T11:48:52.828816+0000","last_undegraded":"2024-02-02T11:48:52.828816+0000","last_fullsized":"2024-02-02T11:48:52.828816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:32:50.539652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013102+0000","last_change":"2024-02-02T11:48:51.862936+0000","last_active":"2024-02-02T11:48:53.013102+0000","last_peered":"2024-02-02T11:48:53.013102+0000","last_clean":"2024-02-02T11:48:53.013102+0000","last_became_active":"2024-02-02T11:48:51.862663+0000","last_became_peered":"2024-02-02T11:48:51.862663+0000","last_unstale":"2024-02-02T11:48:53.013102+0000","last_undegraded":"2024-02-02T11:48:53.013102+0000","last_fullsized":"2024-02-02T11:48:53.013102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:27.396890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992606+0000","last_change":"2024-02-02T11:48:51.865648+0000","last_active":"2024-02-02T11:48:52.992606+0000","last_peered":"2024-02-02T11:48:52.992606+0000","last_clean":"2024-02-02T11:48:52.992606+0000","last_became_active":"2024-02-02T11:48:51.864078+0000","last_became_peered":"2024-02-02T11:48:51.864078+0000","last_unstale":"2024-02-02T11:48:52.992606+0000","last_undegraded":"2024-02-02T11:48:52.992606+0000","last_fullsized":"2024-02-02T11:48:52.992606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:14.049200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.826642+0000","last_change":"2024-02-02T11:48:51.837010+0000","last_active":"2024-02-02T11:48:52.826642+0000","last_peered":"2024-02-02T11:48:52.826642+0000","last_clean":"2024-02-02T11:48:52.826642+0000","last_became_active":"2024-02-02T11:48:51.836245+0000","last_became_peered":"2024-02-02T11:48:51.836245+0000","last_unstale":"2024-02-02T11:48:52.826642+0000","last_undegraded":"2024-02-02T11:48:52.826642+0000","last_fullsized":"2024-02-02T11:48:52.826642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:05:40.202784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014518+0000","last_change":"2024-02-02T11:48:51.490158+0000","last_active":"2024-02-02T11:48:53.014518+0000","last_peered":"2024-02-02T11:48:53.014518+0000","last_clean":"2024-02-02T11:48:53.014518+0000","last_became_active":"2024-02-02T11:48:51.489826+0000","last_became_peered":"2024-02-02T11:48:51.489826+0000","last_unstale":"2024-02-02T11:48:53.014518+0000","last_undegraded":"2024-02-02T11:48:53.014518+0000","last_fullsized":"2024-02-02T11:48:53.014518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:06:13.971694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016208+0000","last_change":"2024-02-02T11:48:51.848592+0000","last_active":"2024-02-02T11:48:53.016208+0000","last_peered":"2024-02-02T11:48:53.016208+0000","last_clean":"2024-02-02T11:48:53.016208+0000","last_became_active":"2024-02-02T11:48:51.848379+0000","last_became_peered":"2024-02-02T11:48:51.848379+0000","last_unstale":"2024-02-02T11:48:53.016208+0000","last_undegraded":"2024-02-02T11:48:53.016208+0000","last_fullsized":"2024-02-02T11:48:53.016208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:17:07.932896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992668+0000","last_change":"2024-02-02T11:48:51.481701+0000","last_active":"2024-02-02T11:48:52.992668+0000","last_peered":"2024-02-02T11:48:52.992668+0000","last_clean":"2024-02-02T11:48:52.992668+0000","last_became_active":"2024-02-02T11:48:51.480901+0000","last_became_peered":"2024-02-02T11:48:51.480901+0000","last_unstale":"2024-02-02T11:48:52.992668+0000","last_undegraded":"2024-02-02T11:48:52.992668+0000","last_fullsized":"2024-02-02T11:48:52.992668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.017353+0000","last_change":"2024-02-02T11:48:51.482357+0000","last_active":"2024-02-02T11:48:53.017353+0000","last_peered":"2024-02-02T11:48:53.017353+0000","last_clean":"2024-02-02T11:48:53.017353+0000","last_became_active":"2024-02-02T11:48:51.482055+0000","last_became_peered":"2024-02-02T11:48:51.482055+0000","last_unstale":"2024-02-02T11:48:53.017353+0000","last_undegraded":"2024-02-02T11:48:53.017353+0000","last_fullsized":"2024-02-02T11:48:53.017353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:12:40.411121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013783+0000","last_change":"2024-02-02T11:48:51.843584+0000","last_active":"2024-02-02T11:48:53.013783+0000","last_peered":"2024-02-02T11:48:53.013783+0000","last_clean":"2024-02-02T11:48:53.013783+0000","last_became_active":"2024-02-02T11:48:51.843299+0000","last_became_peered":"2024-02-02T11:48:51.843299+0000","last_unstale":"2024-02-02T11:48:53.013783+0000","last_undegraded":"2024-02-02T11:48:53.013783+0000","last_fullsized":"2024-02-02T11:48:53.013783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:26:18.517358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828293+0000","last_change":"2024-02-02T11:48:51.475843+0000","last_active":"2024-02-02T11:48:52.828293+0000","last_peered":"2024-02-02T11:48:52.828293+0000","last_clean":"2024-02-02T11:48:52.828293+0000","last_became_active":"2024-02-02T11:48:51.474780+0000","last_became_peered":"2024-02-02T11:48:51.474780+0000","last_unstale":"2024-02-02T11:48:52.828293+0000","last_undegraded":"2024-02-02T11:48:52.828293+0000","last_fullsized":"2024-02-02T11:48:52.828293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:06:13.971694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825017+0000","last_change":"2024-02-02T11:48:51.836833+0000","last_active":"2024-02-02T11:48:52.825017+0000","last_peered":"2024-02-02T11:48:52.825017+0000","last_clean":"2024-02-02T11:48:52.825017+0000","last_became_active":"2024-02-02T11:48:51.836528+0000","last_became_peered":"2024-02-02T11:48:51.836528+0000","last_unstale":"2024-02-02T11:48:52.825017+0000","last_undegraded":"2024-02-02T11:48:52.825017+0000","last_fullsized":"2024-02-02T11:48:52.825017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:44:05.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993305+0000","last_change":"2024-02-02T11:48:51.487441+0000","last_active":"2024-02-02T11:48:52.993305+0000","last_peered":"2024-02-02T11:48:52.993305+0000","last_clean":"2024-02-02T11:48:52.993305+0000","last_became_active":"2024-02-02T11:48:51.486655+0000","last_became_peered":"2024-02-02T11:48:51.486655+0000","last_unstale":"2024-02-02T11:48:52.993305+0000","last_undegraded":"2024-02-02T11:48:52.993305+0000","last_fullsized":"2024-02-02T11:48:52.993305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:22:40.437082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829603+0000","last_change":"2024-02-02T11:48:51.886180+0000","last_active":"2024-02-02T11:48:52.829603+0000","last_peered":"2024-02-02T11:48:52.829603+0000","last_clean":"2024-02-02T11:48:52.829603+0000","last_became_active":"2024-02-02T11:48:51.885591+0000","last_became_peered":"2024-02-02T11:48:51.885591+0000","last_unstale":"2024-02-02T11:48:52.829603+0000","last_undegraded":"2024-02-02T11:48:52.829603+0000","last_fullsized":"2024-02-02T11:48:52.829603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:31:31.979723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829725+0000","last_change":"2024-02-02T11:48:51.485465+0000","last_active":"2024-02-02T11:48:52.829725+0000","last_peered":"2024-02-02T11:48:52.829725+0000","last_clean":"2024-02-02T11:48:52.829725+0000","last_became_active":"2024-02-02T11:48:51.484749+0000","last_became_peered":"2024-02-02T11:48:51.484749+0000","last_unstale":"2024-02-02T11:48:52.829725+0000","last_undegraded":"2024-02-02T11:48:52.829725+0000","last_fullsized":"2024-02-02T11:48:52.829725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:12:40.411121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015866+0000","last_change":"2024-02-02T11:48:51.890561+0000","last_active":"2024-02-02T11:48:53.015866+0000","last_peered":"2024-02-02T11:48:53.015866+0000","last_clean":"2024-02-02T11:48:53.015866+0000","last_became_active":"2024-02-02T11:48:51.890385+0000","last_became_peered":"2024-02-02T11:48:51.890385+0000","last_unstale":"2024-02-02T11:48:53.015866+0000","last_undegraded":"2024-02-02T11:48:53.015866+0000","last_fullsized":"2024-02-02T11:48:53.015866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:26:18.517358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825200+0000","last_change":"2024-02-02T11:48:51.467792+0000","last_active":"2024-02-02T11:48:52.825200+0000","last_peered":"2024-02-02T11:48:52.825200+0000","last_clean":"2024-02-02T11:48:52.825200+0000","last_became_active":"2024-02-02T11:48:51.467447+0000","last_became_peered":"2024-02-02T11:48:51.467447+0000","last_unstale":"2024-02-02T11:48:52.825200+0000","last_undegraded":"2024-02-02T11:48:52.825200+0000","last_fullsized":"2024-02-02T11:48:52.825200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:32.118220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.827459+0000","last_change":"2024-02-02T11:48:51.886539+0000","last_active":"2024-02-02T11:48:52.827459+0000","last_peered":"2024-02-02T11:48:52.827459+0000","last_clean":"2024-02-02T11:48:52.827459+0000","last_became_active":"2024-02-02T11:48:51.886091+0000","last_became_peered":"2024-02-02T11:48:51.886091+0000","last_unstale":"2024-02-02T11:48:52.827459+0000","last_undegraded":"2024-02-02T11:48:52.827459+0000","last_fullsized":"2024-02-02T11:48:52.827459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:41:08.293554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992948+0000","last_change":"2024-02-02T11:48:51.478707+0000","last_active":"2024-02-02T11:48:52.992948+0000","last_peered":"2024-02-02T11:48:52.992948+0000","last_clean":"2024-02-02T11:48:52.992948+0000","last_became_active":"2024-02-02T11:48:51.477592+0000","last_became_peered":"2024-02-02T11:48:51.477592+0000","last_unstale":"2024-02-02T11:48:52.992948+0000","last_undegraded":"2024-02-02T11:48:52.992948+0000","last_fullsized":"2024-02-02T11:48:52.992948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:02:58.430952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013767+0000","last_change":"2024-02-02T11:48:51.885728+0000","last_active":"2024-02-02T11:48:53.013767+0000","last_peered":"2024-02-02T11:48:53.013767+0000","last_clean":"2024-02-02T11:48:53.013767+0000","last_became_active":"2024-02-02T11:48:51.885343+0000","last_became_peered":"2024-02-02T11:48:51.885343+0000","last_unstale":"2024-02-02T11:48:53.013767+0000","last_undegraded":"2024-02-02T11:48:53.013767+0000","last_fullsized":"2024-02-02T11:48:53.013767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:02:09.899239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016432+0000","last_change":"2024-02-02T11:48:51.489735+0000","last_active":"2024-02-02T11:48:53.016432+0000","last_peered":"2024-02-02T11:48:53.016432+0000","last_clean":"2024-02-02T11:48:53.016432+0000","last_became_active":"2024-02-02T11:48:51.489394+0000","last_became_peered":"2024-02-02T11:48:51.489394+0000","last_unstale":"2024-02-02T11:48:53.016432+0000","last_undegraded":"2024-02-02T11:48:53.016432+0000","last_fullsized":"2024-02-02T11:48:53.016432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:18:12.503377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016349+0000","last_change":"2024-02-02T11:48:51.884370+0000","last_active":"2024-02-02T11:48:53.016349+0000","last_peered":"2024-02-02T11:48:53.016349+0000","last_clean":"2024-02-02T11:48:53.016349+0000","last_became_active":"2024-02-02T11:48:51.884044+0000","last_became_peered":"2024-02-02T11:48:51.884044+0000","last_unstale":"2024-02-02T11:48:53.016349+0000","last_undegraded":"2024-02-02T11:48:53.016349+0000","last_fullsized":"2024-02-02T11:48:53.016349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:33.128561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828935+0000","last_change":"2024-02-02T11:48:51.466861+0000","last_active":"2024-02-02T11:48:52.828935+0000","last_peered":"2024-02-02T11:48:52.828935+0000","last_clean":"2024-02-02T11:48:52.828935+0000","last_became_active":"2024-02-02T11:48:51.466097+0000","last_became_peered":"2024-02-02T11:48:51.466097+0000","last_unstale":"2024-02-02T11:48:52.828935+0000","last_undegraded":"2024-02-02T11:48:52.828935+0000","last_fullsized":"2024-02-02T11:48:52.828935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:02:58.430952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013799+0000","last_change":"2024-02-02T11:48:51.885012+0000","last_active":"2024-02-02T11:48:53.013799+0000","last_peered":"2024-02-02T11:48:53.013799+0000","last_clean":"2024-02-02T11:48:53.013799+0000","last_became_active":"2024-02-02T11:48:51.884374+0000","last_became_peered":"2024-02-02T11:48:51.884374+0000","last_unstale":"2024-02-02T11:48:53.013799+0000","last_undegraded":"2024-02-02T11:48:53.013799+0000","last_fullsized":"2024-02-02T11:48:53.013799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T17:33:10.421610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992599+0000","last_change":"2024-02-02T11:48:51.478572+0000","last_active":"2024-02-02T11:48:52.992599+0000","last_peered":"2024-02-02T11:48:52.992599+0000","last_clean":"2024-02-02T11:48:52.992599+0000","last_became_active":"2024-02-02T11:48:51.477722+0000","last_became_peered":"2024-02-02T11:48:51.477722+0000","last_unstale":"2024-02-02T11:48:52.992599+0000","last_undegraded":"2024-02-02T11:48:52.992599+0000","last_fullsized":"2024-02-02T11:48:52.992599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:06:13.971694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992588+0000","last_change":"2024-02-02T11:48:51.869232+0000","last_active":"2024-02-02T11:48:52.992588+0000","last_peered":"2024-02-02T11:48:52.992588+0000","last_clean":"2024-02-02T11:48:52.992588+0000","last_became_active":"2024-02-02T11:48:51.864926+0000","last_became_peered":"2024-02-02T11:48:51.864926+0000","last_unstale":"2024-02-02T11:48:52.992588+0000","last_undegraded":"2024-02-02T11:48:52.992588+0000","last_fullsized":"2024-02-02T11:48:52.992588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:42:12.424582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013003+0000","last_change":"2024-02-02T11:48:51.470192+0000","last_active":"2024-02-02T11:48:53.013003+0000","last_peered":"2024-02-02T11:48:53.013003+0000","last_clean":"2024-02-02T11:48:53.013003+0000","last_became_active":"2024-02-02T11:48:51.469834+0000","last_became_peered":"2024-02-02T11:48:51.469834+0000","last_unstale":"2024-02-02T11:48:53.013003+0000","last_undegraded":"2024-02-02T11:48:53.013003+0000","last_fullsized":"2024-02-02T11:48:53.013003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:12:40.411121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013456+0000","last_change":"2024-02-02T11:48:51.884838+0000","last_active":"2024-02-02T11:48:53.013456+0000","last_peered":"2024-02-02T11:48:53.013456+0000","last_clean":"2024-02-02T11:48:53.013456+0000","last_became_active":"2024-02-02T11:48:51.884185+0000","last_became_peered":"2024-02-02T11:48:51.884185+0000","last_unstale":"2024-02-02T11:48:53.013456+0000","last_undegraded":"2024-02-02T11:48:53.013456+0000","last_fullsized":"2024-02-02T11:48:53.013456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:15:46.872789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.827152+0000","last_change":"2024-02-02T11:48:51.474818+0000","last_active":"2024-02-02T11:48:52.827152+0000","last_peered":"2024-02-02T11:48:52.827152+0000","last_clean":"2024-02-02T11:48:52.827152+0000","last_became_active":"2024-02-02T11:48:51.474087+0000","last_became_peered":"2024-02-02T11:48:51.474087+0000","last_unstale":"2024-02-02T11:48:52.827152+0000","last_undegraded":"2024-02-02T11:48:52.827152+0000","last_fullsized":"2024-02-02T11:48:52.827152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:18:12.503377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014027+0000","last_change":"2024-02-02T11:48:51.897044+0000","last_active":"2024-02-02T11:48:53.014027+0000","last_peered":"2024-02-02T11:48:53.014027+0000","last_clean":"2024-02-02T11:48:53.014027+0000","last_became_active":"2024-02-02T11:48:51.896554+0000","last_became_peered":"2024-02-02T11:48:51.896554+0000","last_unstale":"2024-02-02T11:48:53.014027+0000","last_undegraded":"2024-02-02T11:48:53.014027+0000","last_fullsized":"2024-02-02T11:48:53.014027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:34:16.623804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015526+0000","last_change":"2024-02-02T11:48:51.464028+0000","last_active":"2024-02-02T11:48:53.015526+0000","last_peered":"2024-02-02T11:48:53.015526+0000","last_clean":"2024-02-02T11:48:53.015526+0000","last_became_active":"2024-02-02T11:48:51.463717+0000","last_became_peered":"2024-02-02T11:48:51.463717+0000","last_unstale":"2024-02-02T11:48:53.015526+0000","last_undegraded":"2024-02-02T11:48:53.015526+0000","last_fullsized":"2024-02-02T11:48:53.015526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:18:12.503377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014400+0000","last_change":"2024-02-02T11:48:51.897969+0000","last_active":"2024-02-02T11:48:53.014400+0000","last_peered":"2024-02-02T11:48:53.014400+0000","last_clean":"2024-02-02T11:48:53.014400+0000","last_became_active":"2024-02-02T11:48:51.897552+0000","last_became_peered":"2024-02-02T11:48:51.897552+0000","last_unstale":"2024-02-02T11:48:53.014400+0000","last_undegraded":"2024-02-02T11:48:53.014400+0000","last_fullsized":"2024-02-02T11:48:53.014400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:31:31.979723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825340+0000","last_change":"2024-02-02T11:48:51.489925+0000","last_active":"2024-02-02T11:48:52.825340+0000","last_peered":"2024-02-02T11:48:52.825340+0000","last_clean":"2024-02-02T11:48:52.825340+0000","last_became_active":"2024-02-02T11:48:51.489586+0000","last_became_peered":"2024-02-02T11:48:51.489586+0000","last_unstale":"2024-02-02T11:48:52.825340+0000","last_undegraded":"2024-02-02T11:48:52.825340+0000","last_fullsized":"2024-02-02T11:48:52.825340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:26.386549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829151+0000","last_change":"2024-02-02T11:48:51.863155+0000","last_active":"2024-02-02T11:48:52.829151+0000","last_peered":"2024-02-02T11:48:52.829151+0000","last_clean":"2024-02-02T11:48:52.829151+0000","last_became_active":"2024-02-02T11:48:51.862353+0000","last_became_peered":"2024-02-02T11:48:51.862353+0000","last_unstale":"2024-02-02T11:48:52.829151+0000","last_undegraded":"2024-02-02T11:48:52.829151+0000","last_fullsized":"2024-02-02T11:48:52.829151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:56:59.771841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014144+0000","last_change":"2024-02-02T11:48:51.476119+0000","last_active":"2024-02-02T11:48:53.014144+0000","last_peered":"2024-02-02T11:48:53.014144+0000","last_clean":"2024-02-02T11:48:53.014144+0000","last_became_active":"2024-02-02T11:48:51.475833+0000","last_became_peered":"2024-02-02T11:48:51.475833+0000","last_unstale":"2024-02-02T11:48:53.014144+0000","last_undegraded":"2024-02-02T11:48:53.014144+0000","last_fullsized":"2024-02-02T11:48:53.014144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013759+0000","last_change":"2024-02-02T11:48:51.891228+0000","last_active":"2024-02-02T11:48:53.013759+0000","last_peered":"2024-02-02T11:48:53.013759+0000","last_clean":"2024-02-02T11:48:53.013759+0000","last_became_active":"2024-02-02T11:48:51.890322+0000","last_became_peered":"2024-02-02T11:48:51.890322+0000","last_unstale":"2024-02-02T11:48:53.013759+0000","last_undegraded":"2024-02-02T11:48:53.013759+0000","last_fullsized":"2024-02-02T11:48:53.013759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:01:26.016064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-02-02T11:48:51.857399+0000","last_change":"2024-02-02T11:48:41.563754+0000","last_active":"2024-02-02T11:48:51.857399+0000","last_peered":"2024-02-02T11:48:51.857399+0000","last_clean":"2024-02-02T11:48:51.857399+0000","last_became_active":"2024-02-02T11:48:41.562629+0000","last_became_peered":"2024-02-02T11:48:41.562629+0000","last_unstale":"2024-02-02T11:48:51.857399+0000","last_undegraded":"2024-02-02T11:48:51.857399+0000","last_fullsized":"2024-02-02T11:48:51.857399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_clean_scrub_stamp":"2024-02-02T11:48:40.536978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:22:02.923582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828445+0000","last_change":"2024-02-02T11:48:51.467641+0000","last_active":"2024-02-02T11:48:52.828445+0000","last_peered":"2024-02-02T11:48:52.828445+0000","last_clean":"2024-02-02T11:48:52.828445+0000","last_became_active":"2024-02-02T11:48:51.466793+0000","last_became_peered":"2024-02-02T11:48:51.466793+0000","last_unstale":"2024-02-02T11:48:52.828445+0000","last_undegraded":"2024-02-02T11:48:52.828445+0000","last_fullsized":"2024-02-02T11:48:52.828445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:22:40.437082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014197+0000","last_change":"2024-02-02T11:48:51.889165+0000","last_active":"2024-02-02T11:48:53.014197+0000","last_peered":"2024-02-02T11:48:53.014197+0000","last_clean":"2024-02-02T11:48:53.014197+0000","last_became_active":"2024-02-02T11:48:51.888946+0000","last_became_peered":"2024-02-02T11:48:51.888946+0000","last_unstale":"2024-02-02T11:48:53.014197+0000","last_undegraded":"2024-02-02T11:48:53.014197+0000","last_fullsized":"2024-02-02T11:48:53.014197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:44:05.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013178+0000","last_change":"2024-02-02T11:48:51.490450+0000","last_active":"2024-02-02T11:48:53.013178+0000","last_peered":"2024-02-02T11:48:53.013178+0000","last_clean":"2024-02-02T11:48:53.013178+0000","last_became_active":"2024-02-02T11:48:51.489819+0000","last_became_peered":"2024-02-02T11:48:51.489819+0000","last_unstale":"2024-02-02T11:48:53.013178+0000","last_undegraded":"2024-02-02T11:48:53.013178+0000","last_fullsized":"2024-02-02T11:48:53.013178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:11:06.903511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015117+0000","last_change":"2024-02-02T11:48:51.844140+0000","last_active":"2024-02-02T11:48:53.015117+0000","last_peered":"2024-02-02T11:48:53.015117+0000","last_clean":"2024-02-02T11:48:53.015117+0000","last_became_active":"2024-02-02T11:48:51.843865+0000","last_became_peered":"2024-02-02T11:48:51.843865+0000","last_unstale":"2024-02-02T11:48:53.015117+0000","last_undegraded":"2024-02-02T11:48:53.015117+0000","last_fullsized":"2024-02-02T11:48:53.015117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:10:43.379183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013460+0000","last_change":"2024-02-02T11:48:51.468449+0000","last_active":"2024-02-02T11:48:53.013460+0000","last_peered":"2024-02-02T11:48:53.013460+0000","last_clean":"2024-02-02T11:48:53.013460+0000","last_became_active":"2024-02-02T11:48:51.468136+0000","last_became_peered":"2024-02-02T11:48:51.468136+0000","last_unstale":"2024-02-02T11:48:53.013460+0000","last_undegraded":"2024-02-02T11:48:53.013460+0000","last_fullsized":"2024-02-02T11:48:53.013460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:06:13.971694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825256+0000","last_change":"2024-02-02T11:48:51.836358+0000","last_active":"2024-02-02T11:48:52.825256+0000","last_peered":"2024-02-02T11:48:52.825256+0000","last_clean":"2024-02-02T11:48:52.825256+0000","last_became_active":"2024-02-02T11:48:51.836089+0000","last_became_peered":"2024-02-02T11:48:51.836089+0000","last_unstale":"2024-02-02T11:48:52.825256+0000","last_undegraded":"2024-02-02T11:48:52.825256+0000","last_fullsized":"2024-02-02T11:48:52.825256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829035+0000","last_change":"2024-02-02T11:48:51.472708+0000","last_active":"2024-02-02T11:48:52.829035+0000","last_peered":"2024-02-02T11:48:52.829035+0000","last_clean":"2024-02-02T11:48:52.829035+0000","last_became_active":"2024-02-02T11:48:51.471927+0000","last_became_peered":"2024-02-02T11:48:51.471927+0000","last_unstale":"2024-02-02T11:48:52.829035+0000","last_undegraded":"2024-02-02T11:48:52.829035+0000","last_fullsized":"2024-02-02T11:48:52.829035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:11:06.903511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.827116+0000","last_change":"2024-02-02T11:48:51.854118+0000","last_active":"2024-02-02T11:48:52.827116+0000","last_peered":"2024-02-02T11:48:52.827116+0000","last_clean":"2024-02-02T11:48:52.827116+0000","last_became_active":"2024-02-02T11:48:51.852712+0000","last_became_peered":"2024-02-02T11:48:51.852712+0000","last_unstale":"2024-02-02T11:48:52.827116+0000","last_undegraded":"2024-02-02T11:48:52.827116+0000","last_fullsized":"2024-02-02T11:48:52.827116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:55:18.720031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825177+0000","last_change":"2024-02-02T11:48:51.470060+0000","last_active":"2024-02-02T11:48:52.825177+0000","last_peered":"2024-02-02T11:48:52.825177+0000","last_clean":"2024-02-02T11:48:52.825177+0000","last_became_active":"2024-02-02T11:48:51.469761+0000","last_became_peered":"2024-02-02T11:48:51.469761+0000","last_unstale":"2024-02-02T11:48:52.825177+0000","last_undegraded":"2024-02-02T11:48:52.825177+0000","last_fullsized":"2024-02-02T11:48:52.825177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829453+0000","last_change":"2024-02-02T11:48:51.873107+0000","last_active":"2024-02-02T11:48:52.829453+0000","last_peered":"2024-02-02T11:48:52.829453+0000","last_clean":"2024-02-02T11:48:52.829453+0000","last_became_active":"2024-02-02T11:48:51.863234+0000","last_became_peered":"2024-02-02T11:48:51.863234+0000","last_unstale":"2024-02-02T11:48:52.829453+0000","last_undegraded":"2024-02-02T11:48:52.829453+0000","last_fullsized":"2024-02-02T11:48:52.829453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:36:48.786870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014135+0000","last_change":"2024-02-02T11:48:51.495141+0000","last_active":"2024-02-02T11:48:53.014135+0000","last_peered":"2024-02-02T11:48:53.014135+0000","last_clean":"2024-02-02T11:48:53.014135+0000","last_became_active":"2024-02-02T11:48:51.494357+0000","last_became_peered":"2024-02-02T11:48:51.494357+0000","last_unstale":"2024-02-02T11:48:53.014135+0000","last_undegraded":"2024-02-02T11:48:53.014135+0000","last_fullsized":"2024-02-02T11:48:53.014135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:26.386549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825161+0000","last_change":"2024-02-02T11:48:51.834937+0000","last_active":"2024-02-02T11:48:52.825161+0000","last_peered":"2024-02-02T11:48:52.825161+0000","last_clean":"2024-02-02T11:48:52.825161+0000","last_became_active":"2024-02-02T11:48:51.834659+0000","last_became_peered":"2024-02-02T11:48:51.834659+0000","last_unstale":"2024-02-02T11:48:52.825161+0000","last_undegraded":"2024-02-02T11:48:52.825161+0000","last_fullsized":"2024-02-02T11:48:52.825161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:14.049200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:55.286866+0000","last_change":"2024-02-02T11:48:51.487838+0000","last_active":"2024-02-02T11:48:55.286866+0000","last_peered":"2024-02-02T11:48:55.286866+0000","last_clean":"2024-02-02T11:48:55.286866+0000","last_became_active":"2024-02-02T11:48:51.487608+0000","last_became_peered":"2024-02-02T11:48:51.487608+0000","last_unstale":"2024-02-02T11:48:55.286866+0000","last_undegraded":"2024-02-02T11:48:55.286866+0000","last_fullsized":"2024-02-02T11:48:55.286866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:22:40.437082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015208+0000","last_change":"2024-02-02T11:48:51.884253+0000","last_active":"2024-02-02T11:48:53.015208+0000","last_peered":"2024-02-02T11:48:53.015208+0000","last_clean":"2024-02-02T11:48:53.015208+0000","last_became_active":"2024-02-02T11:48:51.883954+0000","last_became_peered":"2024-02-02T11:48:51.883954+0000","last_unstale":"2024-02-02T11:48:53.015208+0000","last_undegraded":"2024-02-02T11:48:53.015208+0000","last_fullsized":"2024-02-02T11:48:53.015208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.993422+0000","last_change":"2024-02-02T11:48:51.492938+0000","last_active":"2024-02-02T11:48:52.993422+0000","last_peered":"2024-02-02T11:48:52.993422+0000","last_clean":"2024-02-02T11:48:52.993422+0000","last_became_active":"2024-02-02T11:48:51.492303+0000","last_became_peered":"2024-02-02T11:48:51.492303+0000","last_unstale":"2024-02-02T11:48:52.993422+0000","last_undegraded":"2024-02-02T11:48:52.993422+0000","last_fullsized":"2024-02-02T11:48:52.993422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:11:06.903511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016684+0000","last_change":"2024-02-02T11:48:51.848144+0000","last_active":"2024-02-02T11:48:53.016684+0000","last_peered":"2024-02-02T11:48:53.016684+0000","last_clean":"2024-02-02T11:48:53.016684+0000","last_became_active":"2024-02-02T11:48:51.847887+0000","last_became_peered":"2024-02-02T11:48:51.847887+0000","last_unstale":"2024-02-02T11:48:53.016684+0000","last_undegraded":"2024-02-02T11:48:53.016684+0000","last_fullsized":"2024-02-02T11:48:53.016684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:11:37.650346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013207+0000","last_change":"2024-02-02T11:48:51.482652+0000","last_active":"2024-02-02T11:48:53.013207+0000","last_peered":"2024-02-02T11:48:53.013207+0000","last_clean":"2024-02-02T11:48:53.013207+0000","last_became_active":"2024-02-02T11:48:51.481995+0000","last_became_peered":"2024-02-02T11:48:51.481995+0000","last_unstale":"2024-02-02T11:48:53.013207+0000","last_undegraded":"2024-02-02T11:48:53.013207+0000","last_fullsized":"2024-02-02T11:48:53.013207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:22:40.437082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.826883+0000","last_change":"2024-02-02T11:48:51.833510+0000","last_active":"2024-02-02T11:48:52.826883+0000","last_peered":"2024-02-02T11:48:52.826883+0000","last_clean":"2024-02-02T11:48:52.826883+0000","last_became_active":"2024-02-02T11:48:51.830625+0000","last_became_peered":"2024-02-02T11:48:51.830625+0000","last_unstale":"2024-02-02T11:48:52.826883+0000","last_undegraded":"2024-02-02T11:48:52.826883+0000","last_fullsized":"2024-02-02T11:48:52.826883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:27.396890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.824977+0000","last_change":"2024-02-02T11:48:51.480505+0000","last_active":"2024-02-02T11:48:52.824977+0000","last_peered":"2024-02-02T11:48:52.824977+0000","last_clean":"2024-02-02T11:48:52.824977+0000","last_became_active":"2024-02-02T11:48:51.480230+0000","last_became_peered":"2024-02-02T11:48:51.480230+0000","last_unstale":"2024-02-02T11:48:52.824977+0000","last_undegraded":"2024-02-02T11:48:52.824977+0000","last_fullsized":"2024-02-02T11:48:52.824977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:11:06.903511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014049+0000","last_change":"2024-02-02T11:48:51.837394+0000","last_active":"2024-02-02T11:48:53.014049+0000","last_peered":"2024-02-02T11:48:53.014049+0000","last_clean":"2024-02-02T11:48:53.014049+0000","last_became_active":"2024-02-02T11:48:51.837092+0000","last_became_peered":"2024-02-02T11:48:51.837092+0000","last_unstale":"2024-02-02T11:48:53.014049+0000","last_undegraded":"2024-02-02T11:48:53.014049+0000","last_fullsized":"2024-02-02T11:48:53.014049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:17:07.932896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.825011+0000","last_change":"2024-02-02T11:48:51.469411+0000","last_active":"2024-02-02T11:48:52.825011+0000","last_peered":"2024-02-02T11:48:52.825011+0000","last_clean":"2024-02-02T11:48:52.825011+0000","last_became_active":"2024-02-02T11:48:51.469142+0000","last_became_peered":"2024-02-02T11:48:51.469142+0000","last_unstale":"2024-02-02T11:48:52.825011+0000","last_undegraded":"2024-02-02T11:48:52.825011+0000","last_fullsized":"2024-02-02T11:48:52.825011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:02:58.430952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014321+0000","last_change":"2024-02-02T11:48:51.849339+0000","last_active":"2024-02-02T11:48:53.014321+0000","last_peered":"2024-02-02T11:48:53.014321+0000","last_clean":"2024-02-02T11:48:53.014321+0000","last_became_active":"2024-02-02T11:48:51.849074+0000","last_became_peered":"2024-02-02T11:48:51.849074+0000","last_unstale":"2024-02-02T11:48:53.014321+0000","last_undegraded":"2024-02-02T11:48:53.014321+0000","last_fullsized":"2024-02-02T11:48:53.014321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.014003+0000","last_change":"2024-02-02T11:48:51.491708+0000","last_active":"2024-02-02T11:48:53.014003+0000","last_peered":"2024-02-02T11:48:53.014003+0000","last_clean":"2024-02-02T11:48:53.014003+0000","last_became_active":"2024-02-02T11:48:51.490530+0000","last_became_peered":"2024-02-02T11:48:51.490530+0000","last_unstale":"2024-02-02T11:48:53.014003+0000","last_undegraded":"2024-02-02T11:48:53.014003+0000","last_fullsized":"2024-02-02T11:48:53.014003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.992605+0000","last_change":"2024-02-02T11:48:51.866340+0000","last_active":"2024-02-02T11:48:52.992605+0000","last_peered":"2024-02-02T11:48:52.992605+0000","last_clean":"2024-02-02T11:48:52.992605+0000","last_became_active":"2024-02-02T11:48:51.865769+0000","last_became_peered":"2024-02-02T11:48:51.865769+0000","last_unstale":"2024-02-02T11:48:52.992605+0000","last_undegraded":"2024-02-02T11:48:52.992605+0000","last_fullsized":"2024-02-02T11:48:52.992605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:26:18.517358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.829215+0000","last_change":"2024-02-02T11:48:51.873724+0000","last_active":"2024-02-02T11:48:52.829215+0000","last_peered":"2024-02-02T11:48:52.829215+0000","last_clean":"2024-02-02T11:48:52.829215+0000","last_became_active":"2024-02-02T11:48:51.872899+0000","last_became_peered":"2024-02-02T11:48:51.872899+0000","last_unstale":"2024-02-02T11:48:52.829215+0000","last_undegraded":"2024-02-02T11:48:52.829215+0000","last_fullsized":"2024-02-02T11:48:52.829215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013728+0000","last_change":"2024-02-02T11:48:51.498148+0000","last_active":"2024-02-02T11:48:53.013728+0000","last_peered":"2024-02-02T11:48:53.013728+0000","last_clean":"2024-02-02T11:48:53.013728+0000","last_became_active":"2024-02-02T11:48:51.497318+0000","last_became_peered":"2024-02-02T11:48:51.497318+0000","last_unstale":"2024-02-02T11:48:53.013728+0000","last_undegraded":"2024-02-02T11:48:53.013728+0000","last_fullsized":"2024-02-02T11:48:53.013728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T16:55:17.709690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:52.828889+0000","last_change":"2024-02-02T11:48:51.874421+0000","last_active":"2024-02-02T11:48:52.828889+0000","last_peered":"2024-02-02T11:48:52.828889+0000","last_clean":"2024-02-02T11:48:52.828889+0000","last_became_active":"2024-02-02T11:48:51.873913+0000","last_became_peered":"2024-02-02T11:48:51.873913+0000","last_unstale":"2024-02-02T11:48:52.828889+0000","last_undegraded":"2024-02-02T11:48:52.828889+0000","last_fullsized":"2024-02-02T11:48:52.828889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:31:40.455301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.013994+0000","last_change":"2024-02-02T11:48:51.495990+0000","last_active":"2024-02-02T11:48:53.013994+0000","last_peered":"2024-02-02T11:48:53.013994+0000","last_clean":"2024-02-02T11:48:53.013994+0000","last_became_active":"2024-02-02T11:48:51.495310+0000","last_became_peered":"2024-02-02T11:48:51.495310+0000","last_unstale":"2024-02-02T11:48:53.013994+0000","last_undegraded":"2024-02-02T11:48:53.013994+0000","last_fullsized":"2024-02-02T11:48:53.013994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:53:32.118220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015727+0000","last_change":"2024-02-02T11:48:51.890655+0000","last_active":"2024-02-02T11:48:53.015727+0000","last_peered":"2024-02-02T11:48:53.015727+0000","last_clean":"2024-02-02T11:48:53.015727+0000","last_became_active":"2024-02-02T11:48:51.890435+0000","last_became_peered":"2024-02-02T11:48:51.890435+0000","last_unstale":"2024-02-02T11:48:53.015727+0000","last_undegraded":"2024-02-02T11:48:53.015727+0000","last_fullsized":"2024-02-02T11:48:53.015727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:50:48.152550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015002+0000","last_change":"2024-02-02T11:48:51.469696+0000","last_active":"2024-02-02T11:48:53.015002+0000","last_peered":"2024-02-02T11:48:53.015002+0000","last_clean":"2024-02-02T11:48:53.015002+0000","last_became_active":"2024-02-02T11:48:51.469392+0000","last_became_peered":"2024-02-02T11:48:51.469392+0000","last_unstale":"2024-02-02T11:48:53.015002+0000","last_undegraded":"2024-02-02T11:48:53.015002+0000","last_fullsized":"2024-02-02T11:48:53.015002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:12:58.066879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.015320+0000","last_change":"2024-02-02T11:48:51.870169+0000","last_active":"2024-02-02T11:48:53.015320+0000","last_peered":"2024-02-02T11:48:53.015320+0000","last_clean":"2024-02-02T11:48:53.015320+0000","last_became_active":"2024-02-02T11:48:51.869883+0000","last_became_peered":"2024-02-02T11:48:51.869883+0000","last_unstale":"2024-02-02T11:48:53.015320+0000","last_undegraded":"2024-02-02T11:48:53.015320+0000","last_fullsized":"2024-02-02T11:48:53.015320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:51.433234+0000","last_clean_scrub_stamp":"2024-02-02T11:48:51.433234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:36:48.786870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-02T11:48:53.016079+0000","last_change":"2024-02-02T11:48:51.483548+0000","last_active":"2024-02-02T11:48:53.016079+0000","last_peered":"2024-02-02T11:48:53.016079+0000","last_clean":"2024-02-02T11:48:53.016079+0000","last_became_active":"2024-02-02T11:48:51.483219+0000","last_became_peered":"2024-02-02T11:48:51.483219+0000","last_unstale":"2024-02-02T11:48:53.016079+0000","last_undegraded":"2024-02-02T11:48:53.016079+0000","last_fullsized":"2024-02-02T11:48:53.016079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:50.422893+0000","last_clean_scrub_stamp":"2024-02-02T11:48:50.422893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T17:21:41.030654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-02T11:49:04.351 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-02T11:49:04.351 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-02T11:49:04.351 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-02T11:49:04.351 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-02T11:49:04.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.499+0000 7f4366164640 1 Processor -- start 2024-02-02T11:49:04.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.499+0000 7f4366164640 1 -- start start 2024-02-02T11:49:04.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.499+0000 7f4366164640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f436006a4c0 0x7f436006a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.499+0000 7f4366164640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f43601532f0 0x7f43601556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.499+0000 7f4366164640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43600bb370 con 0x7f436014b540 2024-02-02T11:49:04.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.499+0000 7f4366164640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436006ae40 con 0x7f43601532f0 2024-02-02T11:49:04.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.499+0000 7f4366164640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43600bc320 con 0x7f436006a4c0 2024-02-02T11:49:04.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.499+0000 7f435f7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f436014b540 0x7f43600bac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:57550/0 (socket says 172.21.15.161:57550) 2024-02-02T11:49:04.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.499+0000 7f435f7fe640 1 -- 172.21.15.161:0/3913132985 learned_addr learned my addr 172.21.15.161:0/3913132985 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:04.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.499+0000 7f4357fff640 1 --2- 172.21.15.161:0/3913132985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f436006a4c0 0x7f436006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.499+0000 7f435ffff640 1 --2- 172.21.15.161:0/3913132985 >> v2:172.21.15.162:3300/0 conn(0x7f43601532f0 0x7f43601556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.499+0000 7f435effd640 1 -- 172.21.15.161:0/3913132985 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128892599 0 0) 0x7f43600bb370 con 0x7f436014b540 2024-02-02T11:49:04.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.499+0000 7f435effd640 1 -- 172.21.15.161:0/3913132985 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f434c003530 con 0x7f436014b540 2024-02-02T11:49:04.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435effd640 1 -- 172.21.15.161:0/3913132985 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1870029119 0 0) 0x7f434c003530 con 0x7f436014b540 2024-02-02T11:49:04.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435effd640 1 -- 172.21.15.161:0/3913132985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f436006a4c0 msgr2=0x7f436006a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:04.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435effd640 1 --2- 172.21.15.161:0/3913132985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f436006a4c0 0x7f436006a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435effd640 1 -- 172.21.15.161:0/3913132985 >> v2:172.21.15.162:3300/0 conn(0x7f43601532f0 msgr2=0x7f43601556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:04.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435effd640 1 --2- 172.21.15.161:0/3913132985 >> v2:172.21.15.162:3300/0 conn(0x7f43601532f0 0x7f43601556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435effd640 1 -- 172.21.15.161:0/3913132985 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43600bc590 con 0x7f436014b540 2024-02-02T11:49:04.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435effd640 1 -- 172.21.15.161:0/3913132985 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f4350001680 con 0x7f436014b540 2024-02-02T11:49:04.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435effd640 1 -- 172.21.15.161:0/3913132985 >> v1:172.21.15.161:6789/0 conn(0x7f436014b540 legacy=0x7f43600bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:04.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435effd640 1 --2- 172.21.15.161:0/3913132985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f436006a4c0 0x7f434c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435effd640 1 --2- 172.21.15.161:0/3913132985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f434c003f50 0x7f434c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435effd640 1 --2- 172.21.15.161:0/3913132985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f434c004d10 0x7f434c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435effd640 1 -- 172.21.15.161:0/3913132985 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436006ae40 con 0x7f434c004d10 2024-02-02T11:49:04.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435effd640 1 -- 172.21.15.161:0/3913132985 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c00b990 con 0x7f434c003f50 2024-02-02T11:49:04.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435effd640 1 -- 172.21.15.161:0/3913132985 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434c00bb50 con 0x7f436006a4c0 2024-02-02T11:49:04.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435ffff640 1 --2- 172.21.15.161:0/3913132985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f434c004d10 0x7f434c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435f7fe640 1 --2- 172.21.15.161:0/3913132985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f436006a4c0 0x7f434c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f4357fff640 1 --2- 172.21.15.161:0/3913132985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f434c003f50 0x7f434c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435ffff640 1 -- 172.21.15.161:0/3913132985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f436006a4c0 msgr2=0x7f434c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:04.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435ffff640 1 --2- 172.21.15.161:0/3913132985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f436006a4c0 0x7f434c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435ffff640 1 -- 172.21.15.161:0/3913132985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f434c003f50 msgr2=0x7f434c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:04.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435ffff640 1 --2- 172.21.15.161:0/3913132985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f434c003f50 0x7f434c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435ffff640 1 -- 172.21.15.161:0/3913132985 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434c003530 con 0x7f434c004d10 2024-02-02T11:49:04.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f4357fff640 1 --2- 172.21.15.161:0/3913132985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f434c003f50 0x7f434c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:04.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435ffff640 1 --2- 172.21.15.161:0/3913132985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f434c004d10 0x7f434c005190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4358009f90 tx=0x7f435801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8092f6705ecc673 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:04.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435effd640 1 -- 172.21.15.161:0/3913132985 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43580a5c70 con 0x7f434c004d10 2024-02-02T11:49:04.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435effd640 1 -- 172.21.15.161:0/3913132985 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435800f040 con 0x7f434c004d10 2024-02-02T11:49:04.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435effd640 1 -- 172.21.15.161:0/3913132985 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43580ad440 con 0x7f434c004d10 2024-02-02T11:49:04.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f4366164640 1 -- 172.21.15.161:0/3913132985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f434c004d10 msgr2=0x7f434c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:04.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f4366164640 1 --2- 172.21.15.161:0/3913132985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f434c004d10 0x7f434c005190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4358009f90 tx=0x7f435801cc60 comp rx=0 tx=0).stop 2024-02-02T11:49:04.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f435ffff640 1 -- 172.21.15.161:0/3913132985 reap_dead start 2024-02-02T11:49:04.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f4366164640 1 -- 172.21.15.161:0/3913132985 shutdown_connections 2024-02-02T11:49:04.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f4366164640 1 -- 172.21.15.161:0/3913132985 >> 172.21.15.161:0/3913132985 conn(0x7f43600c02e0 msgr2=0x7f43600c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:04.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f4366164640 1 -- 172.21.15.161:0/3913132985 shutdown_connections 2024-02-02T11:49:04.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.503+0000 7f4366164640 1 -- 172.21.15.161:0/3913132985 wait complete. 2024-02-02T11:49:04.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f4366164640 1 Processor -- start 2024-02-02T11:49:04.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f4366164640 1 -- start start 2024-02-02T11:49:04.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f4366164640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43600a5660 0x7f43601e3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f4366164640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43601df940 0x7f43601dff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f4366164640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f436006a940 0x7f43601e04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f4366164640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43600b3550 con 0x7f43600a5660 2024-02-02T11:49:04.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f4366164640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43601e32a0 con 0x7f43601df940 2024-02-02T11:49:04.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f4366164640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43601e2f30 con 0x7f436006a940 2024-02-02T11:49:04.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f435f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43600a5660 0x7f43601e3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f435f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43600a5660 0x7f43601e3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39786/0 (socket says 172.21.15.161:39786) 2024-02-02T11:49:04.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f435f7fe640 1 -- 172.21.15.161:0/3828421154 learned_addr learned my addr 172.21.15.161:0/3828421154 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:04.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f435f7fe640 1 -- 172.21.15.161:0/3828421154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f436006a940 msgr2=0x7f43601e04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:04.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f435f7fe640 1 --2- 172.21.15.161:0/3828421154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f436006a940 0x7f43601e04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f435f7fe640 1 -- 172.21.15.161:0/3828421154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43601df940 msgr2=0x7f43601dff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:04.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f435f7fe640 1 --2- 172.21.15.161:0/3828421154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43601df940 0x7f43601dff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f435f7fe640 1 -- 172.21.15.161:0/3828421154 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4360153050 con 0x7f43600a5660 2024-02-02T11:49:04.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f435f7fe640 1 --2- 172.21.15.161:0/3828421154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43600a5660 0x7f43601e3730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f435000eaa0 tx=0x7f435000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:04.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f435cff9640 1 -- 172.21.15.161:0/3828421154 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435000c8a0 con 0x7f43600a5660 2024-02-02T11:49:04.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f435cff9640 1 -- 172.21.15.161:0/3828421154 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435000ca00 con 0x7f43600a5660 2024-02-02T11:49:04.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f435cff9640 1 -- 172.21.15.161:0/3828421154 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435000cdb0 con 0x7f43600a5660 2024-02-02T11:49:04.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f4366164640 1 -- 172.21.15.161:0/3828421154 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43600ba370 con 0x7f43600a5660 2024-02-02T11:49:04.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f4366164640 1 -- 172.21.15.161:0/3828421154 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43601e3c70 con 0x7f43600a5660 2024-02-02T11:49:04.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f4366164640 1 -- 172.21.15.161:0/3828421154 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436004e000 con 0x7f43600a5660 2024-02-02T11:49:04.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f435cff9640 1 -- 172.21.15.161:0/3828421154 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f435001d460 con 0x7f43600a5660 2024-02-02T11:49:04.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f435cff9640 1 --2- 172.21.15.161:0/3828421154 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4340065a60 0x7f4340067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f435cff9640 1 -- 172.21.15.161:0/3828421154 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43500831a0 con 0x7f43600a5660 2024-02-02T11:49:04.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.507+0000 7f4357fff640 1 --2- 172.21.15.161:0/3828421154 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4340065a60 0x7f4340067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.511+0000 7f4357fff640 1 --2- 172.21.15.161:0/3828421154 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4340065a60 0x7f4340067f20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f43600bea40 tx=0x7f4348008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:04.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.511+0000 7f435cff9640 1 -- 172.21.15.161:0/3828421154 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4350050ad0 con 0x7f43600a5660 2024-02-02T11:49:04.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.691+0000 7f4366164640 1 -- 172.21.15.161:0/3828421154 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f436006b120 con 0x7f43600a5660 2024-02-02T11:49:04.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.691+0000 7f435cff9640 1 -- 172.21.15.161:0/3828421154 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f43500540f0 con 0x7f43600a5660 2024-02-02T11:49:04.694 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:04.694 INFO:teuthology.orchestra.run.smithi161.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-02T11:49:04.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.691+0000 7f4366164640 1 -- 172.21.15.161:0/3828421154 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4340065a60 msgr2=0x7f4340067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:04.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.691+0000 7f4366164640 1 --2- 172.21.15.161:0/3828421154 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4340065a60 0x7f4340067f20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f43600bea40 tx=0x7f4348008040 comp rx=0 tx=0).stop 2024-02-02T11:49:04.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.691+0000 7f4366164640 1 -- 172.21.15.161:0/3828421154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43600a5660 msgr2=0x7f43601e3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:04.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.691+0000 7f4366164640 1 --2- 172.21.15.161:0/3828421154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43600a5660 0x7f43601e3730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f435000eaa0 tx=0x7f435000ef60 comp rx=0 tx=0).stop 2024-02-02T11:49:04.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.691+0000 7f4366164640 1 -- 172.21.15.161:0/3828421154 shutdown_connections 2024-02-02T11:49:04.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.691+0000 7f4366164640 1 --2- 172.21.15.161:0/3828421154 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4340065a60 0x7f4340067f20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.691+0000 7f4366164640 1 --2- 172.21.15.161:0/3828421154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f436006a940 0x7f43601e04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.691+0000 7f4366164640 1 --2- 172.21.15.161:0/3828421154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43601df940 0x7f43601dff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.691+0000 7f4366164640 1 --2- 172.21.15.161:0/3828421154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43600a5660 0x7f43601e3730 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.691+0000 7f4366164640 1 -- 172.21.15.161:0/3828421154 >> 172.21.15.161:0/3828421154 conn(0x7f43600c02e0 msgr2=0x7f43601460e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:04.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.691+0000 7f4366164640 1 -- 172.21.15.161:0/3828421154 shutdown_connections 2024-02-02T11:49:04.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.691+0000 7f4366164640 1 -- 172.21.15.161:0/3828421154 wait complete. 2024-02-02T11:49:04.711 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-02T11:49:04.711 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:49:04.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.819+0000 7f2d15999640 1 Processor -- start 2024-02-02T11:49:04.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.819+0000 7f2d15999640 1 -- start start 2024-02-02T11:49:04.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d15999640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2d100bc340 0x7f2d101415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d15999640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2d10141b30 0x7f2d10147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d15999640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d100b8020 0x7f2d101481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d15999640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d10071550 con 0x7f2d10141b30 2024-02-02T11:49:04.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d15999640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d10071810 con 0x7f2d100bc340 2024-02-02T11:49:04.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d15999640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100bc720 con 0x7f2d100b8020 2024-02-02T11:49:04.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d0e7fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2d10141b30 0x7f2d10147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d0e7fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2d10141b30 0x7f2d10147c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39798/0 (socket says 172.21.15.161:39798) 2024-02-02T11:49:04.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d0e7fc640 1 -- 172.21.15.161:0/2855229001 learned_addr learned my addr 172.21.15.161:0/2855229001 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:04.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d0f7fe640 1 --2- 172.21.15.161:0/2855229001 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d100b8020 0x7f2d101481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d0effd640 1 --2- 172.21.15.161:0/2855229001 >> v2:172.21.15.162:3300/0 conn(0x7f2d100bc340 0x7f2d101415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d0e7fc640 1 -- 172.21.15.161:0/2855229001 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d100b8020 msgr2=0x7f2d101481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:04.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d0e7fc640 1 --2- 172.21.15.161:0/2855229001 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d100b8020 0x7f2d101481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d0e7fc640 1 -- 172.21.15.161:0/2855229001 >> v2:172.21.15.162:3300/0 conn(0x7f2d100bc340 msgr2=0x7f2d101415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:04.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d0e7fc640 1 --2- 172.21.15.161:0/2855229001 >> v2:172.21.15.162:3300/0 conn(0x7f2d100bc340 0x7f2d101415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d0e7fc640 1 -- 172.21.15.161:0/2855229001 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d100b2d90 con 0x7f2d10141b30 2024-02-02T11:49:04.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d0e7fc640 1 --2- 172.21.15.161:0/2855229001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d10141b30 0x7f2d10147c60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2d1006d0c0 tx=0x7f2d0001eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e289016f975cc3c server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:04.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d0dffb640 1 -- 172.21.15.161:0/2855229001 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d000a79d0 con 0x7f2d10141b30 2024-02-02T11:49:04.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d0dffb640 1 -- 172.21.15.161:0/2855229001 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d000a7b30 con 0x7f2d10141b30 2024-02-02T11:49:04.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.823+0000 7f2d0dffb640 1 -- 172.21.15.161:0/2855229001 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d000af440 con 0x7f2d10141b30 2024-02-02T11:49:04.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 -- 172.21.15.161:0/2855229001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d10141b30 msgr2=0x7f2d10147c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:04.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 --2- 172.21.15.161:0/2855229001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d10141b30 0x7f2d10147c60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2d1006d0c0 tx=0x7f2d0001eb40 comp rx=0 tx=0).stop 2024-02-02T11:49:04.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 -- 172.21.15.161:0/2855229001 shutdown_connections 2024-02-02T11:49:04.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 --2- 172.21.15.161:0/2855229001 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d100b8020 0x7f2d101481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 --2- 172.21.15.161:0/2855229001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d10141b30 0x7f2d10147c60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 --2- 172.21.15.161:0/2855229001 >> v2:172.21.15.162:3300/0 conn(0x7f2d100bc340 0x7f2d101415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 -- 172.21.15.161:0/2855229001 >> 172.21.15.161:0/2855229001 conn(0x7f2d10069ef0 msgr2=0x7f2d1006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:04.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 -- 172.21.15.161:0/2855229001 shutdown_connections 2024-02-02T11:49:04.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 -- 172.21.15.161:0/2855229001 wait complete. 2024-02-02T11:49:04.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 Processor -- start 2024-02-02T11:49:04.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 -- start start 2024-02-02T11:49:04.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d100b8020 0x7f2d100bb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d100bc340 0x7f2d1013b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d10141b30 0x7f2d10139060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100bb5d0 con 0x7f2d100bc340 2024-02-02T11:49:04.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1013be70 con 0x7f2d100b8020 2024-02-02T11:49:04.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100b4cc0 con 0x7f2d10141b30 2024-02-02T11:49:04.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d0e7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d100bc340 0x7f2d1013b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d0e7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d100bc340 0x7f2d1013b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39804/0 (socket says 172.21.15.161:39804) 2024-02-02T11:49:04.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d0e7fc640 1 -- 172.21.15.161:0/2332316421 learned_addr learned my addr 172.21.15.161:0/2332316421 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:04.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d0effd640 1 --2- 172.21.15.161:0/2332316421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d100b8020 0x7f2d100bb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d0f7fe640 1 --2- 172.21.15.161:0/2332316421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d10141b30 0x7f2d10139060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d0e7fc640 1 -- 172.21.15.161:0/2332316421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d10141b30 msgr2=0x7f2d10139060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:04.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d0e7fc640 1 --2- 172.21.15.161:0/2332316421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d10141b30 0x7f2d10139060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d0e7fc640 1 -- 172.21.15.161:0/2332316421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d100b8020 msgr2=0x7f2d100bb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:04.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d0e7fc640 1 --2- 172.21.15.161:0/2332316421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d100b8020 0x7f2d100bb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d0e7fc640 1 -- 172.21.15.161:0/2332316421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0000b770 con 0x7f2d100bc340 2024-02-02T11:49:04.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d0f7fe640 1 --2- 172.21.15.161:0/2332316421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d10141b30 0x7f2d10139060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:04.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d0e7fc640 1 --2- 172.21.15.161:0/2332316421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d100bc340 0x7f2d1013b930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2d0001d1f0 tx=0x7f2d0001b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:04.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2cf7fff640 1 -- 172.21.15.161:0/2332316421 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d000ba620 con 0x7f2d100bc340 2024-02-02T11:49:04.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2cf7fff640 1 -- 172.21.15.161:0/2332316421 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d000ba7a0 con 0x7f2d100bc340 2024-02-02T11:49:04.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 -- 172.21.15.161:0/2332316421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d100b4fa0 con 0x7f2d100bc340 2024-02-02T11:49:04.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2cf7fff640 1 -- 172.21.15.161:0/2332316421 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d000bab50 con 0x7f2d100bc340 2024-02-02T11:49:04.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 -- 172.21.15.161:0/2332316421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1013cec0 con 0x7f2d100bc340 2024-02-02T11:49:04.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.827+0000 7f2d15999640 1 -- 172.21.15.161:0/2332316421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1004e000 con 0x7f2d100bc340 2024-02-02T11:49:04.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.831+0000 7f2cf7fff640 1 -- 172.21.15.161:0/2332316421 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2d000b6040 con 0x7f2d100bc340 2024-02-02T11:49:04.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.831+0000 7f2cf7fff640 1 --2- 172.21.15.161:0/2332316421 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2cfc065a60 0x7f2cfc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:04.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.831+0000 7f2cf7fff640 1 -- 172.21.15.161:0/2332316421 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d0011ffb0 con 0x7f2d100bc340 2024-02-02T11:49:04.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.831+0000 7f2d0effd640 1 --2- 172.21.15.161:0/2332316421 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2cfc065a60 0x7f2cfc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:04.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.831+0000 7f2d0effd640 1 --2- 172.21.15.161:0/2332316421 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2cfc065a60 0x7f2cfc067f20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400b9d0 tx=0x7f2d04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:04.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.835+0000 7f2cf7fff640 1 -- 172.21.15.161:0/2332316421 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2d001510a0 con 0x7f2d100bc340 2024-02-02T11:49:04.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.975+0000 7f2d15999640 1 -- 172.21.15.161:0/2332316421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d101405b0 con 0x7f2d100bc340 2024-02-02T11:49:04.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.979+0000 7f2cf7fff640 1 -- 172.21.15.161:0/2332316421 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f2d000eda00 con 0x7f2d100bc340 2024-02-02T11:49:04.982 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:04.982 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":20,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:52.816101+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:48:50.155565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-02T11:48:50.795158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:49:04.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.979+0000 7f2d15999640 1 -- 172.21.15.161:0/2332316421 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2cfc065a60 msgr2=0x7f2cfc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:04.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.979+0000 7f2d15999640 1 --2- 172.21.15.161:0/2332316421 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2cfc065a60 0x7f2cfc067f20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400b9d0 tx=0x7f2d04008040 comp rx=0 tx=0).stop 2024-02-02T11:49:04.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.979+0000 7f2d15999640 1 -- 172.21.15.161:0/2332316421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d100bc340 msgr2=0x7f2d1013b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:04.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.979+0000 7f2d15999640 1 --2- 172.21.15.161:0/2332316421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d100bc340 0x7f2d1013b930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2d0001d1f0 tx=0x7f2d0001b8e0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.979+0000 7f2d15999640 1 -- 172.21.15.161:0/2332316421 shutdown_connections 2024-02-02T11:49:04.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.979+0000 7f2d15999640 1 --2- 172.21.15.161:0/2332316421 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2cfc065a60 0x7f2cfc067f20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.979+0000 7f2d15999640 1 --2- 172.21.15.161:0/2332316421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d10141b30 0x7f2d10139060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.979+0000 7f2d15999640 1 --2- 172.21.15.161:0/2332316421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d100bc340 0x7f2d1013b930 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.979+0000 7f2d15999640 1 --2- 172.21.15.161:0/2332316421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d100b8020 0x7f2d100bb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:04.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.979+0000 7f2d15999640 1 -- 172.21.15.161:0/2332316421 >> 172.21.15.161:0/2332316421 conn(0x7f2d10069ef0 msgr2=0x7f2d10140ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:04.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.979+0000 7f2d15999640 1 -- 172.21.15.161:0/2332316421 shutdown_connections 2024-02-02T11:49:04.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:04.979+0000 7f2d15999640 1 -- 172.21.15.161:0/2332316421 wait complete. 2024-02-02T11:49:05.000 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-02T11:48:40.330782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-02T11:48:50.155565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-02T11:48:50.795158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-02T11:49:05.000 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-02T11:49:05.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.111+0000 7fec078ba640 1 Processor -- start 2024-02-02T11:49:05.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.111+0000 7fec078ba640 1 -- start start 2024-02-02T11:49:05.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.111+0000 7fec078ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec000b8b40 0x7fec000b8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.111+0000 7fec078ba640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fec0014b370 0x7fec001552e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.111+0000 7fec078ba640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec000b6e80 con 0x7fec00144a80 2024-02-02T11:49:05.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.111+0000 7fec078ba640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec000b7160 con 0x7fec0014b370 2024-02-02T11:49:05.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.111+0000 7fec078ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec000bc6c0 con 0x7fec000b8b40 2024-02-02T11:49:05.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.111+0000 7fec05656640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec000b8b40 0x7fec000b8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.111+0000 7fec05e57640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fec0014b370 0x7fec001552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.111+0000 7fec05656640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec000b8b40 0x7fec000b8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.161:58646/0 (socket says 172.21.15.161:58646) 2024-02-02T11:49:05.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.111+0000 7fec05e57640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fec0014b370 0x7fec001552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.161:55220/0 (socket says 172.21.15.161:55220) 2024-02-02T11:49:05.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.111+0000 7fec05656640 1 -- 172.21.15.161:0/1983401184 learned_addr learned my addr 172.21.15.161:0/1983401184 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:05.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.111+0000 7fec05656640 1 -- 172.21.15.161:0/1983401184 >> v2:172.21.15.162:3300/0 conn(0x7fec0014b370 msgr2=0x7fec001552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:05.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.111+0000 7fec05656640 1 --2- 172.21.15.161:0/1983401184 >> v2:172.21.15.162:3300/0 conn(0x7fec0014b370 0x7fec001552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.111+0000 7fec05656640 1 -- 172.21.15.161:0/1983401184 >> v1:172.21.15.162:6789/0 conn(0x7fec00144a80 legacy=0x7fec0014ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.111+0000 7fec05656640 1 -- 172.21.15.161:0/1983401184 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec000bc9a0 con 0x7fec000b8b40 2024-02-02T11:49:05.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec05656640 1 --2- 172.21.15.161:0/1983401184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec000b8b40 0x7fec000b8f20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7febfc009e50 tx=0x7febfc01f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2968c05292ed36a server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:05.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7febf7fff640 1 -- 172.21.15.161:0/1983401184 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc0af400 con 0x7fec000b8b40 2024-02-02T11:49:05.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7febf7fff640 1 -- 172.21.15.161:0/1983401184 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc0ab050 con 0x7fec000b8b40 2024-02-02T11:49:05.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7febf7fff640 1 -- 172.21.15.161:0/1983401184 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc0af780 con 0x7fec000b8b40 2024-02-02T11:49:05.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec078ba640 1 -- 172.21.15.161:0/1983401184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec000b8b40 msgr2=0x7fec000b8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec078ba640 1 --2- 172.21.15.161:0/1983401184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec000b8b40 0x7fec000b8f20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7febfc009e50 tx=0x7febfc01f1f0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec078ba640 1 -- 172.21.15.161:0/1983401184 shutdown_connections 2024-02-02T11:49:05.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec078ba640 1 --2- 172.21.15.161:0/1983401184 >> v2:172.21.15.162:3300/0 conn(0x7fec0014b370 0x7fec001552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec078ba640 1 --2- 172.21.15.161:0/1983401184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec000b8b40 0x7fec000b8f20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec078ba640 1 -- 172.21.15.161:0/1983401184 >> 172.21.15.161:0/1983401184 conn(0x7fec000c02f0 msgr2=0x7fec000c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:05.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec078ba640 1 -- 172.21.15.161:0/1983401184 shutdown_connections 2024-02-02T11:49:05.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec078ba640 1 -- 172.21.15.161:0/1983401184 wait complete. 2024-02-02T11:49:05.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec078ba640 1 Processor -- start 2024-02-02T11:49:05.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec078ba640 1 -- start start 2024-02-02T11:49:05.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec078ba640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec000b8b40 0x7fec00145d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec078ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec00144a80 0x7fec00147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec078ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec0014b370 0x7fec001e0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec078ba640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec00146290 con 0x7fec000b8b40 2024-02-02T11:49:05.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec078ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec00148050 con 0x7fec0014b370 2024-02-02T11:49:05.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec078ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec00148330 con 0x7fec00144a80 2024-02-02T11:49:05.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec05656640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec000b8b40 0x7fec00145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec05656640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec000b8b40 0x7fec00145d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39816/0 (socket says 172.21.15.161:39816) 2024-02-02T11:49:05.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec05656640 1 -- 172.21.15.161:0/607957151 learned_addr learned my addr 172.21.15.161:0/607957151 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:05.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec05e57640 1 --2- 172.21.15.161:0/607957151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec0014b370 0x7fec001e0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec04e55640 1 --2- 172.21.15.161:0/607957151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec00144a80 0x7fec00147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec05656640 1 -- 172.21.15.161:0/607957151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec00144a80 msgr2=0x7fec00147810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec05656640 1 --2- 172.21.15.161:0/607957151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec00144a80 0x7fec00147810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec05656640 1 -- 172.21.15.161:0/607957151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec0014b370 msgr2=0x7fec001e0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec05656640 1 --2- 172.21.15.161:0/607957151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec0014b370 0x7fec001e0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec05656640 1 -- 172.21.15.161:0/607957151 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc009b30 con 0x7fec000b8b40 2024-02-02T11:49:05.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec05656640 1 --2- 172.21.15.161:0/607957151 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec000b8b40 0x7fec00145d50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7febfc01ce20 tx=0x7febfc01bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:05.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7febf5ffb640 1 -- 172.21.15.161:0/607957151 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc0afdb0 con 0x7fec000b8b40 2024-02-02T11:49:05.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7febf5ffb640 1 -- 172.21.15.161:0/607957151 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc009510 con 0x7fec000b8b40 2024-02-02T11:49:05.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec078ba640 1 -- 172.21.15.161:0/607957151 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec001e0140 con 0x7fec000b8b40 2024-02-02T11:49:05.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7febf5ffb640 1 -- 172.21.15.161:0/607957151 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc0b9610 con 0x7fec000b8b40 2024-02-02T11:49:05.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.115+0000 7fec078ba640 1 -- 172.21.15.161:0/607957151 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec001473f0 con 0x7fec000b8b40 2024-02-02T11:49:05.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.119+0000 7fec078ba640 1 -- 172.21.15.161:0/607957151 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0004e000 con 0x7fec000b8b40 2024-02-02T11:49:05.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.119+0000 7febf5ffb640 1 -- 172.21.15.161:0/607957151 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7febfc0b6070 con 0x7fec000b8b40 2024-02-02T11:49:05.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.119+0000 7febf5ffb640 1 --2- 172.21.15.161:0/607957151 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7febe4065a60 0x7febe4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.119+0000 7febf5ffb640 1 -- 172.21.15.161:0/607957151 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febfc1212e0 con 0x7fec000b8b40 2024-02-02T11:49:05.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.119+0000 7fec04e55640 1 --2- 172.21.15.161:0/607957151 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7febe4065a60 0x7febe4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.119+0000 7fec04e55640 1 --2- 172.21.15.161:0/607957151 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7febe4065a60 0x7febe4067f20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fec000c0ef0 tx=0x7febf0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:05.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.123+0000 7febf5ffb640 1 -- 172.21.15.161:0/607957151 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7febfc0eed30 con 0x7fec000b8b40 2024-02-02T11:49:05.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.263+0000 7fec078ba640 1 -- 172.21.15.161:0/607957151 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec00148470 con 0x7fec000b8b40 2024-02-02T11:49:05.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.267+0000 7febf5ffb640 1 -- 172.21.15.161:0/607957151 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec00148470 con 0x7fec000b8b40 2024-02-02T11:49:05.269 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-02-02T11:49:05.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.267+0000 7fec078ba640 1 -- 172.21.15.161:0/607957151 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7febe4065a60 msgr2=0x7febe4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.267+0000 7fec078ba640 1 --2- 172.21.15.161:0/607957151 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7febe4065a60 0x7febe4067f20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fec000c0ef0 tx=0x7febf0009040 comp rx=0 tx=0).stop 2024-02-02T11:49:05.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.267+0000 7fec078ba640 1 -- 172.21.15.161:0/607957151 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec000b8b40 msgr2=0x7fec00145d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.267+0000 7fec078ba640 1 --2- 172.21.15.161:0/607957151 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec000b8b40 0x7fec00145d50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7febfc01ce20 tx=0x7febfc01bf90 comp rx=0 tx=0).stop 2024-02-02T11:49:05.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.267+0000 7fec078ba640 1 -- 172.21.15.161:0/607957151 shutdown_connections 2024-02-02T11:49:05.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.267+0000 7fec078ba640 1 --2- 172.21.15.161:0/607957151 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7febe4065a60 0x7febe4067f20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.267+0000 7fec078ba640 1 --2- 172.21.15.161:0/607957151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec0014b370 0x7fec001e0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.267+0000 7fec078ba640 1 --2- 172.21.15.161:0/607957151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec00144a80 0x7fec00147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.267+0000 7fec078ba640 1 --2- 172.21.15.161:0/607957151 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec000b8b40 0x7fec00145d50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.267+0000 7fec078ba640 1 -- 172.21.15.161:0/607957151 >> 172.21.15.161:0/607957151 conn(0x7fec000c02f0 msgr2=0x7fec000c06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:05.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.267+0000 7fec078ba640 1 -- 172.21.15.161:0/607957151 shutdown_connections 2024-02-02T11:49:05.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.267+0000 7fec078ba640 1 -- 172.21.15.161:0/607957151 wait complete. 2024-02-02T11:49:05.286 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-02T11:49:05.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.403+0000 7f71637b2640 1 Processor -- start 2024-02-02T11:49:05.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.403+0000 7f71637b2640 1 -- start start 2024-02-02T11:49:05.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f71637b2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715c0b8b40 0x7f715c0b8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f71637b2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f715c14b370 0x7f715c1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f71637b2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f715c0b6e80 con 0x7f715c144a80 2024-02-02T11:49:05.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f71637b2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715c0b7160 con 0x7f715c14b370 2024-02-02T11:49:05.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f71637b2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715c0bc6c0 con 0x7f715c0b8b40 2024-02-02T11:49:05.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7160d4d640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f715c144a80 0x7f715c14ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:57560/0 (socket says 172.21.15.161:57560) 2024-02-02T11:49:05.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7160d4d640 1 -- 172.21.15.161:0/2043808890 learned_addr learned my addr 172.21.15.161:0/2043808890 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:05.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7161d4f640 1 --2- 172.21.15.161:0/2043808890 >> v2:172.21.15.162:3300/0 conn(0x7f715c14b370 0x7f715c1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f716154e640 1 --2- 172.21.15.161:0/2043808890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715c0b8b40 0x7f715c0b8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7153fff640 1 -- 172.21.15.161:0/2043808890 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399663182 0 0) 0x7f715c0b6e80 con 0x7f715c144a80 2024-02-02T11:49:05.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7153fff640 1 -- 172.21.15.161:0/2043808890 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7148003530 con 0x7f715c144a80 2024-02-02T11:49:05.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7153fff640 1 -- 172.21.15.161:0/2043808890 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4201720520 0 0) 0x7f7148003530 con 0x7f715c144a80 2024-02-02T11:49:05.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7153fff640 1 -- 172.21.15.161:0/2043808890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715c0b8b40 msgr2=0x7f715c0b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:05.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7153fff640 1 --2- 172.21.15.161:0/2043808890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715c0b8b40 0x7f715c0b8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7153fff640 1 -- 172.21.15.161:0/2043808890 >> v2:172.21.15.162:3300/0 conn(0x7f715c14b370 msgr2=0x7f715c1552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:05.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7153fff640 1 --2- 172.21.15.161:0/2043808890 >> v2:172.21.15.162:3300/0 conn(0x7f715c14b370 0x7f715c1552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7153fff640 1 -- 172.21.15.161:0/2043808890 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715c0bc9a0 con 0x7f715c144a80 2024-02-02T11:49:05.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7153fff640 1 -- 172.21.15.161:0/2043808890 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f714c001680 con 0x7f715c144a80 2024-02-02T11:49:05.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7153fff640 1 -- 172.21.15.161:0/2043808890 >> v1:172.21.15.161:6789/0 conn(0x7f715c144a80 legacy=0x7f715c14ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7153fff640 1 --2- 172.21.15.161:0/2043808890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715c0b8b40 0x7f7148003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7153fff640 1 --2- 172.21.15.161:0/2043808890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7148003f00 0x7f71480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7153fff640 1 --2- 172.21.15.161:0/2043808890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7148004d10 0x7f7148005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7153fff640 1 -- 172.21.15.161:0/2043808890 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c0b7160 con 0x7f7148003f00 2024-02-02T11:49:05.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7153fff640 1 -- 172.21.15.161:0/2043808890 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c0bc6c0 con 0x7f7148004d10 2024-02-02T11:49:05.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7153fff640 1 -- 172.21.15.161:0/2043808890 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714800b9c0 con 0x7f715c0b8b40 2024-02-02T11:49:05.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7160d4d640 1 --2- 172.21.15.161:0/2043808890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7148003f00 0x7f71480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f716154e640 1 --2- 172.21.15.161:0/2043808890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715c0b8b40 0x7f7148003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7161d4f640 1 --2- 172.21.15.161:0/2043808890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7148004d10 0x7f7148005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7160d4d640 1 -- 172.21.15.161:0/2043808890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715c0b8b40 msgr2=0x7f7148003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:05.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7160d4d640 1 --2- 172.21.15.161:0/2043808890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715c0b8b40 0x7f7148003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7160d4d640 1 -- 172.21.15.161:0/2043808890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7148004d10 msgr2=0x7f7148005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:05.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7160d4d640 1 --2- 172.21.15.161:0/2043808890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7148004d10 0x7f7148005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f7160d4d640 1 -- 172.21.15.161:0/2043808890 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7148003530 con 0x7f7148003f00 2024-02-02T11:49:05.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.407+0000 7f716154e640 1 --2- 172.21.15.161:0/2043808890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715c0b8b40 0x7f7148003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:05.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f7160d4d640 1 --2- 172.21.15.161:0/2043808890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7148003f00 0x7f71480047d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f714c00c290 tx=0x7f714c01cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758bb5bef8650707 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:05.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f7153fff640 1 -- 172.21.15.161:0/2043808890 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c0a5950 con 0x7f7148003f00 2024-02-02T11:49:05.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f7153fff640 1 -- 172.21.15.161:0/2043808890 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c0a5ab0 con 0x7f7148003f00 2024-02-02T11:49:05.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f7153fff640 1 -- 172.21.15.161:0/2043808890 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c0a5e60 con 0x7f7148003f00 2024-02-02T11:49:05.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f71637b2640 1 -- 172.21.15.161:0/2043808890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7148003f00 msgr2=0x7f71480047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f71637b2640 1 --2- 172.21.15.161:0/2043808890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7148003f00 0x7f71480047d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f714c00c290 tx=0x7f714c01cce0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f7161d4f640 1 -- 172.21.15.161:0/2043808890 reap_dead start 2024-02-02T11:49:05.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f71637b2640 1 -- 172.21.15.161:0/2043808890 shutdown_connections 2024-02-02T11:49:05.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f71637b2640 1 -- 172.21.15.161:0/2043808890 >> 172.21.15.161:0/2043808890 conn(0x7f715c0c02f0 msgr2=0x7f715c0c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:05.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f71637b2640 1 -- 172.21.15.161:0/2043808890 shutdown_connections 2024-02-02T11:49:05.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f71637b2640 1 -- 172.21.15.161:0/2043808890 wait complete. 2024-02-02T11:49:05.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f71637b2640 1 Processor -- start 2024-02-02T11:49:05.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f71637b2640 1 -- start start 2024-02-02T11:49:05.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f71637b2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7148003f00 0x7f715c0b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f71637b2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f715c1d0ac0 0x7f715c146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f71637b2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715c147270 0x7f715c0b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f71637b2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c0b56b0 con 0x7f7148003f00 2024-02-02T11:49:05.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f71637b2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c1476f0 con 0x7f715c1d0ac0 2024-02-02T11:49:05.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f71637b2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715c1d0fe0 con 0x7f715c147270 2024-02-02T11:49:05.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f716154e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7148003f00 0x7f715c0b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f716154e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7148003f00 0x7f715c0b5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39828/0 (socket says 172.21.15.161:39828) 2024-02-02T11:49:05.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f716154e640 1 -- 172.21.15.161:0/2743345941 learned_addr learned my addr 172.21.15.161:0/2743345941 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:05.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f7161d4f640 1 --2- 172.21.15.161:0/2743345941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715c147270 0x7f715c0b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f716154e640 1 -- 172.21.15.161:0/2743345941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715c147270 msgr2=0x7f715c0b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f716154e640 1 --2- 172.21.15.161:0/2743345941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715c147270 0x7f715c0b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f716154e640 1 -- 172.21.15.161:0/2743345941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f715c1d0ac0 msgr2=0x7f715c146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f716154e640 1 --2- 172.21.15.161:0/2743345941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f715c1d0ac0 0x7f715c146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f716154e640 1 -- 172.21.15.161:0/2743345941 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715c1d44f0 con 0x7f7148003f00 2024-02-02T11:49:05.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f7161d4f640 1 --2- 172.21.15.161:0/2743345941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715c147270 0x7f715c0b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:05.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f716154e640 1 --2- 172.21.15.161:0/2743345941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7148003f00 0x7f715c0b5170 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f715800f350 tx=0x7f715800f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:05.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f7151ffb640 1 -- 172.21.15.161:0/2743345941 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158003ba0 con 0x7f7148003f00 2024-02-02T11:49:05.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f7151ffb640 1 -- 172.21.15.161:0/2743345941 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7158011040 con 0x7f7148003f00 2024-02-02T11:49:05.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f7151ffb640 1 -- 172.21.15.161:0/2743345941 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158004020 con 0x7f7148003f00 2024-02-02T11:49:05.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.411+0000 7f71637b2640 1 -- 172.21.15.161:0/2743345941 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715c1d47d0 con 0x7f7148003f00 2024-02-02T11:49:05.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.415+0000 7f71637b2640 1 -- 172.21.15.161:0/2743345941 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715c147900 con 0x7f7148003f00 2024-02-02T11:49:05.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.415+0000 7f71637b2640 1 -- 172.21.15.161:0/2743345941 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f715c1d4350 con 0x7f7148003f00 2024-02-02T11:49:05.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.415+0000 7f7151ffb640 1 -- 172.21.15.161:0/2743345941 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7158004180 con 0x7f7148003f00 2024-02-02T11:49:05.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.415+0000 7f7151ffb640 1 --2- 172.21.15.161:0/2743345941 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7140065a60 0x7f7140067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.415+0000 7f7151ffb640 1 -- 172.21.15.161:0/2743345941 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7158083750 con 0x7f7148003f00 2024-02-02T11:49:05.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.415+0000 7f7160d4d640 1 --2- 172.21.15.161:0/2743345941 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7140065a60 0x7f7140067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.415+0000 7f7160d4d640 1 --2- 172.21.15.161:0/2743345941 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7140065a60 0x7f7140067f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f714c0aa000 tx=0x7f714c000ff0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:05.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.419+0000 7f7151ffb640 1 -- 172.21.15.161:0/2743345941 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f715c1d4350 con 0x7f7148003f00 2024-02-02T11:49:05.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.571+0000 7f71637b2640 1 -- 172.21.15.161:0/2743345941 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f715c1d4350 con 0x7f7148003f00 2024-02-02T11:49:05.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.575+0000 7f7151ffb640 1 -- 172.21.15.161:0/2743345941 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f715c1d4350 con 0x7f7148003f00 2024-02-02T11:49:05.577 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-02-02T11:49:05.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.575+0000 7f71637b2640 1 -- 172.21.15.161:0/2743345941 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7140065a60 msgr2=0x7f7140067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.575+0000 7f71637b2640 1 --2- 172.21.15.161:0/2743345941 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7140065a60 0x7f7140067f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f714c0aa000 tx=0x7f714c000ff0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.575+0000 7f71637b2640 1 -- 172.21.15.161:0/2743345941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7148003f00 msgr2=0x7f715c0b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.575+0000 7f71637b2640 1 --2- 172.21.15.161:0/2743345941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7148003f00 0x7f715c0b5170 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f715800f350 tx=0x7f715800f810 comp rx=0 tx=0).stop 2024-02-02T11:49:05.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.575+0000 7f71637b2640 1 -- 172.21.15.161:0/2743345941 shutdown_connections 2024-02-02T11:49:05.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.575+0000 7f71637b2640 1 --2- 172.21.15.161:0/2743345941 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7140065a60 0x7f7140067f20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.575+0000 7f71637b2640 1 --2- 172.21.15.161:0/2743345941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715c147270 0x7f715c0b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.575+0000 7f71637b2640 1 --2- 172.21.15.161:0/2743345941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f715c1d0ac0 0x7f715c146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.575+0000 7f71637b2640 1 --2- 172.21.15.161:0/2743345941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7148003f00 0x7f715c0b5170 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.575+0000 7f71637b2640 1 -- 172.21.15.161:0/2743345941 >> 172.21.15.161:0/2743345941 conn(0x7f715c0c02f0 msgr2=0x7f715c0bf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:05.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.575+0000 7f71637b2640 1 -- 172.21.15.161:0/2743345941 shutdown_connections 2024-02-02T11:49:05.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.575+0000 7f71637b2640 1 -- 172.21.15.161:0/2743345941 wait complete. 2024-02-02T11:49:05.595 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-02T11:49:05.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.707+0000 7f9b73475640 1 Processor -- start 2024-02-02T11:49:05.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.707+0000 7f9b73475640 1 -- start start 2024-02-02T11:49:05.710 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.707+0000 7f9b73475640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9b6c0b8df0 0x7f9b6c142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.710 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.707+0000 7f9b73475640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b6c142d80 0x7f9b6c1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.710 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.707+0000 7f9b73475640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b6c148a80 con 0x7f9b6c0b8540 2024-02-02T11:49:05.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.707+0000 7f9b73475640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b6c0b3890 con 0x7f9b6c0b8df0 2024-02-02T11:49:05.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.707+0000 7f9b73475640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c0b3b70 con 0x7f9b6c142d80 2024-02-02T11:49:05.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.707+0000 7f9b71211640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9b6c0b8df0 0x7f9b6c142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.707+0000 7f9b71211640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9b6c0b8df0 0x7f9b6c142840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39842/0 (socket says 172.21.15.161:39842) 2024-02-02T11:49:05.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.707+0000 7f9b71211640 1 -- 172.21.15.161:0/3248719949 learned_addr learned my addr 172.21.15.161:0/3248719949 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:05.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.707+0000 7f9b71211640 1 -- 172.21.15.161:0/3248719949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b6c142d80 msgr2=0x7f9b6c1531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:05.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.707+0000 7f9b71211640 1 --2- 172.21.15.161:0/3248719949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b6c142d80 0x7f9b6c1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.707+0000 7f9b71211640 1 -- 172.21.15.161:0/3248719949 >> v1:172.21.15.161:6789/0 conn(0x7f9b6c0b8540 legacy=0x7f9b6c148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.707+0000 7f9b71211640 1 -- 172.21.15.161:0/3248719949 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6c0b3e50 con 0x7f9b6c0b8df0 2024-02-02T11:49:05.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.707+0000 7f9b71211640 1 --2- 172.21.15.161:0/3248719949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c0b8df0 0x7f9b6c142840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9b68009870 tx=0x7f9b6801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae866a9b3b91595 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:05.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.707+0000 7f9b63fff640 1 -- 172.21.15.161:0/3248719949 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c071930 con 0x7f9b6c0b8df0 2024-02-02T11:49:05.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.707+0000 7f9b63fff640 1 -- 172.21.15.161:0/3248719949 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b680a9620 con 0x7f9b6c0b8df0 2024-02-02T11:49:05.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.707+0000 7f9b63fff640 1 -- 172.21.15.161:0/3248719949 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b680a99b0 con 0x7f9b6c0b8df0 2024-02-02T11:49:05.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b73475640 1 -- 172.21.15.161:0/3248719949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c0b8df0 msgr2=0x7f9b6c142840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b73475640 1 --2- 172.21.15.161:0/3248719949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c0b8df0 0x7f9b6c142840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9b68009870 tx=0x7f9b6801c540 comp rx=0 tx=0).stop 2024-02-02T11:49:05.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b73475640 1 -- 172.21.15.161:0/3248719949 shutdown_connections 2024-02-02T11:49:05.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b73475640 1 --2- 172.21.15.161:0/3248719949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b6c142d80 0x7f9b6c1531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b73475640 1 --2- 172.21.15.161:0/3248719949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c0b8df0 0x7f9b6c142840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b73475640 1 -- 172.21.15.161:0/3248719949 >> 172.21.15.161:0/3248719949 conn(0x7f9b6c06a120 msgr2=0x7f9b6c06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:05.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b73475640 1 -- 172.21.15.161:0/3248719949 shutdown_connections 2024-02-02T11:49:05.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b73475640 1 -- 172.21.15.161:0/3248719949 wait complete. 2024-02-02T11:49:05.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b73475640 1 Processor -- start 2024-02-02T11:49:05.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b73475640 1 -- start start 2024-02-02T11:49:05.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b73475640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b6c0b8540 0x7f9b6c13e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b73475640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c0b8df0 0x7f9b6c1476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b73475640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b6c142d80 0x7f9b6c1e4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b73475640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c13e950 con 0x7f9b6c0b8df0 2024-02-02T11:49:05.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b73475640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c147c10 con 0x7f9b6c0b8540 2024-02-02T11:49:05.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b73475640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c14b900 con 0x7f9b6c142d80 2024-02-02T11:49:05.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b70a10640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c0b8df0 0x7f9b6c1476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b70a10640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c0b8df0 0x7f9b6c1476d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39858/0 (socket says 172.21.15.161:39858) 2024-02-02T11:49:05.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b70a10640 1 -- 172.21.15.161:0/1017731960 learned_addr learned my addr 172.21.15.161:0/1017731960 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:05.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b70a10640 1 -- 172.21.15.161:0/1017731960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b6c142d80 msgr2=0x7f9b6c1e4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b70a10640 1 --2- 172.21.15.161:0/1017731960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b6c142d80 0x7f9b6c1e4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b70a10640 1 -- 172.21.15.161:0/1017731960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b6c0b8540 msgr2=0x7f9b6c13e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b70a10640 1 --2- 172.21.15.161:0/1017731960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b6c0b8540 0x7f9b6c13e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b70a10640 1 -- 172.21.15.161:0/1017731960 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b680094d0 con 0x7f9b6c0b8df0 2024-02-02T11:49:05.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b70a10640 1 --2- 172.21.15.161:0/1017731960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c0b8df0 0x7f9b6c1476d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c00c500 tx=0x7f9b5c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:05.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b61ffb640 1 -- 172.21.15.161:0/1017731960 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c005220 con 0x7f9b6c0b8df0 2024-02-02T11:49:05.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b61ffb640 1 -- 172.21.15.161:0/1017731960 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5c005380 con 0x7f9b6c0b8df0 2024-02-02T11:49:05.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b73475640 1 -- 172.21.15.161:0/1017731960 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6c14bbe0 con 0x7f9b6c0b8df0 2024-02-02T11:49:05.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b61ffb640 1 -- 172.21.15.161:0/1017731960 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c007270 con 0x7f9b6c0b8df0 2024-02-02T11:49:05.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b73475640 1 -- 172.21.15.161:0/1017731960 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6c146a60 con 0x7f9b6c0b8df0 2024-02-02T11:49:05.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.711+0000 7f9b73475640 1 -- 172.21.15.161:0/1017731960 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b6c04e000 con 0x7f9b6c0b8df0 2024-02-02T11:49:05.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.715+0000 7f9b61ffb640 1 -- 172.21.15.161:0/1017731960 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9b5c0073d0 con 0x7f9b6c0b8df0 2024-02-02T11:49:05.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.715+0000 7f9b61ffb640 1 --2- 172.21.15.161:0/1017731960 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9b50065a60 0x7f9b50067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.715+0000 7f9b61ffb640 1 -- 172.21.15.161:0/1017731960 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b5c082af0 con 0x7f9b6c0b8df0 2024-02-02T11:49:05.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.715+0000 7f9b71211640 1 --2- 172.21.15.161:0/1017731960 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9b50065a60 0x7f9b50067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.715+0000 7f9b71211640 1 --2- 172.21.15.161:0/1017731960 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9b50065a60 0x7f9b50067f20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9b680ae000 tx=0x7f9b68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:05.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.719+0000 7f9b61ffb640 1 -- 172.21.15.161:0/1017731960 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9b5c0504c0 con 0x7f9b6c0b8df0 2024-02-02T11:49:05.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.859+0000 7f9b73475640 1 -- 172.21.15.161:0/1017731960 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b6c141860 con 0x7f9b6c0b8df0 2024-02-02T11:49:05.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.863+0000 7f9b61ffb640 1 -- 172.21.15.161:0/1017731960 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b5c053ae0 con 0x7f9b6c0b8df0 2024-02-02T11:49:05.865 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2024-02-02T11:49:05.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.863+0000 7f9b73475640 1 -- 172.21.15.161:0/1017731960 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9b50065a60 msgr2=0x7f9b50067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.863+0000 7f9b73475640 1 --2- 172.21.15.161:0/1017731960 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9b50065a60 0x7f9b50067f20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9b680ae000 tx=0x7f9b68008040 comp rx=0 tx=0).stop 2024-02-02T11:49:05.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.863+0000 7f9b73475640 1 -- 172.21.15.161:0/1017731960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c0b8df0 msgr2=0x7f9b6c1476d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.863+0000 7f9b73475640 1 --2- 172.21.15.161:0/1017731960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c0b8df0 0x7f9b6c1476d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c00c500 tx=0x7f9b5c00c9c0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.863+0000 7f9b73475640 1 -- 172.21.15.161:0/1017731960 shutdown_connections 2024-02-02T11:49:05.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.863+0000 7f9b73475640 1 --2- 172.21.15.161:0/1017731960 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9b50065a60 0x7f9b50067f20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.863+0000 7f9b73475640 1 --2- 172.21.15.161:0/1017731960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b6c142d80 0x7f9b6c1e4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.863+0000 7f9b73475640 1 --2- 172.21.15.161:0/1017731960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c0b8df0 0x7f9b6c1476d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.863+0000 7f9b73475640 1 --2- 172.21.15.161:0/1017731960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b6c0b8540 0x7f9b6c13e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.863+0000 7f9b73475640 1 -- 172.21.15.161:0/1017731960 >> 172.21.15.161:0/1017731960 conn(0x7f9b6c06a120 msgr2=0x7f9b6c13ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:05.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.863+0000 7f9b73475640 1 -- 172.21.15.161:0/1017731960 shutdown_connections 2024-02-02T11:49:05.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.863+0000 7f9b73475640 1 -- 172.21.15.161:0/1017731960 wait complete. 2024-02-02T11:49:05.882 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-02T11:49:05.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.983+0000 7f2848fd8640 1 Processor -- start 2024-02-02T11:49:05.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.987+0000 7f2848fd8640 1 -- start start 2024-02-02T11:49:05.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.987+0000 7f2848fd8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2844070010 0x7f2844070910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.987+0000 7f2848fd8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2844141700 0x7f2844151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.987+0000 7f2848fd8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2844071180 con 0x7f2844071610 2024-02-02T11:49:05.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.987+0000 7f2848fd8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28440ba1d0 con 0x7f2844070010 2024-02-02T11:49:05.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.987+0000 7f2848fd8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28440b47f0 con 0x7f2844141700 2024-02-02T11:49:05.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.987+0000 7f284259c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2844070010 0x7f2844070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.987+0000 7f2842d9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2844141700 0x7f2844151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.987+0000 7f2841d9b640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f2844071610 0x7f2844147630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.161:39328/0 (socket says 172.21.15.161:39328) 2024-02-02T11:49:05.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.987+0000 7f284259c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2844070010 0x7f2844070910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.161:55286/0 (socket says 172.21.15.161:55286) 2024-02-02T11:49:05.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.987+0000 7f2842d9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2844141700 0x7f2844151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.161:58690/0 (socket says 172.21.15.161:58690) 2024-02-02T11:49:05.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.987+0000 7f2841d9b640 1 -- 172.21.15.161:0/2407547577 learned_addr learned my addr 172.21.15.161:0/2407547577 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:05.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.987+0000 7f2842d9d640 1 -- 172.21.15.161:0/2407547577 >> v2:172.21.15.162:3300/0 conn(0x7f2844070010 msgr2=0x7f2844070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:05.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.987+0000 7f2842d9d640 1 --2- 172.21.15.161:0/2407547577 >> v2:172.21.15.162:3300/0 conn(0x7f2844070010 0x7f2844070910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.987+0000 7f2842d9d640 1 -- 172.21.15.161:0/2407547577 >> v1:172.21.15.162:6789/0 conn(0x7f2844071610 legacy=0x7f2844147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.987+0000 7f2842d9d640 1 -- 172.21.15.161:0/2407547577 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28440b9c10 con 0x7f2844141700 2024-02-02T11:49:05.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2842d9d640 1 --2- 172.21.15.161:0/2407547577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2844141700 0x7f2844151f70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2834009d90 tx=0x7f283401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d6840dcb954eb3c server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:05.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f284159a640 1 -- 172.21.15.161:0/2407547577 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28340a5810 con 0x7f2844141700 2024-02-02T11:49:05.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f284159a640 1 -- 172.21.15.161:0/2407547577 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28340a5970 con 0x7f2844141700 2024-02-02T11:49:05.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f284159a640 1 -- 172.21.15.161:0/2407547577 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28340a5d00 con 0x7f2844141700 2024-02-02T11:49:05.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2848fd8640 1 -- 172.21.15.161:0/2407547577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2844141700 msgr2=0x7f2844151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2848fd8640 1 --2- 172.21.15.161:0/2407547577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2844141700 0x7f2844151f70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2834009d90 tx=0x7f283401c950 comp rx=0 tx=0).stop 2024-02-02T11:49:05.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2848fd8640 1 -- 172.21.15.161:0/2407547577 shutdown_connections 2024-02-02T11:49:05.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2848fd8640 1 --2- 172.21.15.161:0/2407547577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2844141700 0x7f2844151f70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2848fd8640 1 --2- 172.21.15.161:0/2407547577 >> v2:172.21.15.162:3300/0 conn(0x7f2844070010 0x7f2844070910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2848fd8640 1 -- 172.21.15.161:0/2407547577 >> 172.21.15.161:0/2407547577 conn(0x7f284406ae30 msgr2=0x7f284406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:05.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2848fd8640 1 -- 172.21.15.161:0/2407547577 shutdown_connections 2024-02-02T11:49:05.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2848fd8640 1 -- 172.21.15.161:0/2407547577 wait complete. 2024-02-02T11:49:05.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2848fd8640 1 Processor -- start 2024-02-02T11:49:05.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2848fd8640 1 -- start start 2024-02-02T11:49:05.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2848fd8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2844070010 0x7f28441e19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2848fd8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2844071610 0x7f2844146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2848fd8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2844141700 0x7f2844145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2848fd8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284413cc10 con 0x7f2844141700 2024-02-02T11:49:05.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2848fd8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2844130e60 con 0x7f2844071610 2024-02-02T11:49:05.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2848fd8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28441e1510 con 0x7f2844070010 2024-02-02T11:49:05.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2842d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2844141700 0x7f2844145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2842d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2844141700 0x7f2844145ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39868/0 (socket says 172.21.15.161:39868) 2024-02-02T11:49:05.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2842d9d640 1 -- 172.21.15.161:0/611768140 learned_addr learned my addr 172.21.15.161:0/611768140 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:05.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f284259c640 1 --2- 172.21.15.161:0/611768140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2844070010 0x7f28441e19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2841d9b640 1 --2- 172.21.15.161:0/611768140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2844071610 0x7f2844146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2842d9d640 1 -- 172.21.15.161:0/611768140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2844070010 msgr2=0x7f28441e19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2842d9d640 1 --2- 172.21.15.161:0/611768140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2844070010 0x7f28441e19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2842d9d640 1 -- 172.21.15.161:0/611768140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2844071610 msgr2=0x7f2844146c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:05.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2842d9d640 1 --2- 172.21.15.161:0/611768140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2844071610 0x7f2844146c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:05.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2842d9d640 1 -- 172.21.15.161:0/611768140 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2834009a70 con 0x7f2844141700 2024-02-02T11:49:05.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2842d9d640 1 --2- 172.21.15.161:0/611768140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2844141700 0x7f2844145ed0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f283401a580 tx=0x7f28340196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:05.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f283affd640 1 -- 172.21.15.161:0/611768140 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28340ad640 con 0x7f2844141700 2024-02-02T11:49:05.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f283affd640 1 -- 172.21.15.161:0/611768140 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28340ad7a0 con 0x7f2844141700 2024-02-02T11:49:05.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2848fd8640 1 -- 172.21.15.161:0/611768140 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284413e540 con 0x7f2844141700 2024-02-02T11:49:05.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f283affd640 1 -- 172.21.15.161:0/611768140 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28340adb30 con 0x7f2844141700 2024-02-02T11:49:05.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.991+0000 7f2848fd8640 1 -- 172.21.15.161:0/611768140 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28441e11a0 con 0x7f2844141700 2024-02-02T11:49:05.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.995+0000 7f2848fd8640 1 -- 172.21.15.161:0/611768140 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284404e000 con 0x7f2844141700 2024-02-02T11:49:05.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.995+0000 7f283affd640 1 -- 172.21.15.161:0/611768140 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f28340b4070 con 0x7f2844141700 2024-02-02T11:49:05.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.995+0000 7f283affd640 1 --2- 172.21.15.161:0/611768140 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2824065a60 0x7f2824067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:05.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.995+0000 7f283affd640 1 -- 172.21.15.161:0/611768140 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f283411dc60 con 0x7f2844141700 2024-02-02T11:49:05.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.995+0000 7f284259c640 1 --2- 172.21.15.161:0/611768140 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2824065a60 0x7f2824067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:05.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.995+0000 7f284259c640 1 --2- 172.21.15.161:0/611768140 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2824065a60 0x7f2824067f20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f283c009b60 tx=0x7f283c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:06.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:05.999+0000 7f283affd640 1 -- 172.21.15.161:0/611768140 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f28340eb6e0 con 0x7f2844141700 2024-02-02T11:49:06.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.187+0000 7f2848fd8640 1 -- 172.21.15.161:0/611768140 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28441e1650 con 0x7f2844141700 2024-02-02T11:49:06.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.187+0000 7f283affd640 1 -- 172.21.15.161:0/611768140 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3953 (secure 0 0 0) 0x7f28340eed00 con 0x7f2844141700 2024-02-02T11:49:06.191 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:06.191 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3677988163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3677988163},{"type":"v1","addr":"172.21.15.162:6833","nonce":3677988163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/456037269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":456037269},{"type":"v1","addr":"172.21.15.161:6835","nonce":456037269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-02T11:48:51.812809+0000","modified":"2024-02-02T11:48:54.494091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/2509813318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":2509813318},{"type":"v1","addr":"172.21.15.161:6837","nonce":2509813318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-02T11:49:06.191 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 7 2024-02-02T11:49:06.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.191+0000 7f2848fd8640 1 -- 172.21.15.161:0/611768140 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2824065a60 msgr2=0x7f2824067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:06.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.191+0000 7f2848fd8640 1 --2- 172.21.15.161:0/611768140 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2824065a60 0x7f2824067f20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f283c009b60 tx=0x7f283c009190 comp rx=0 tx=0).stop 2024-02-02T11:49:06.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.191+0000 7f2848fd8640 1 -- 172.21.15.161:0/611768140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2844141700 msgr2=0x7f2844145ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:06.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.191+0000 7f2848fd8640 1 --2- 172.21.15.161:0/611768140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2844141700 0x7f2844145ed0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f283401a580 tx=0x7f28340196f0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.191+0000 7f2848fd8640 1 -- 172.21.15.161:0/611768140 shutdown_connections 2024-02-02T11:49:06.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.191+0000 7f2848fd8640 1 --2- 172.21.15.161:0/611768140 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2824065a60 0x7f2824067f20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.191+0000 7f2848fd8640 1 --2- 172.21.15.161:0/611768140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2844141700 0x7f2844145ed0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.191+0000 7f2848fd8640 1 --2- 172.21.15.161:0/611768140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2844071610 0x7f2844146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.191+0000 7f2848fd8640 1 --2- 172.21.15.161:0/611768140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2844070010 0x7f28441e19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.191+0000 7f2848fd8640 1 -- 172.21.15.161:0/611768140 >> 172.21.15.161:0/611768140 conn(0x7f284406ae30 msgr2=0x7f284406b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:06.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.191+0000 7f2848fd8640 1 -- 172.21.15.161:0/611768140 shutdown_connections 2024-02-02T11:49:06.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.191+0000 7f2848fd8640 1 -- 172.21.15.161:0/611768140 wait complete. 2024-02-02T11:49:06.209 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:49:06.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.327+0000 7fe839139640 1 Processor -- start 2024-02-02T11:49:06.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.327+0000 7fe839139640 1 -- start start 2024-02-02T11:49:06.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.327+0000 7fe839139640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8340bc340 0x7fe834142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.327+0000 7fe839139640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe834142d50 0x7fe834148d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.327+0000 7fe839139640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe834071770 con 0x7fe8341492a0 2024-02-02T11:49:06.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.327+0000 7fe839139640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8341496d0 con 0x7fe834142d50 2024-02-02T11:49:06.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.327+0000 7fe839139640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8340b37e0 con 0x7fe8340bc340 2024-02-02T11:49:06.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.327+0000 7fe82bfff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe834142d50 0x7fe834148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.327+0000 7fe832d9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8340bc340 0x7fe834142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.327+0000 7fe83359e640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe8341492a0 0x7fe8340b53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.161:39334/0 (socket says 172.21.15.161:39334) 2024-02-02T11:49:06.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.327+0000 7fe83359e640 1 -- 172.21.15.161:0/1804672517 learned_addr learned my addr 172.21.15.161:0/1804672517 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:06.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.327+0000 7fe832d9d640 1 -- 172.21.15.161:0/1804672517 >> v2:172.21.15.162:3300/0 conn(0x7fe834142d50 msgr2=0x7fe834148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:06.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.327+0000 7fe832d9d640 1 --2- 172.21.15.161:0/1804672517 >> v2:172.21.15.162:3300/0 conn(0x7fe834142d50 0x7fe834148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.327+0000 7fe83259c640 1 -- 172.21.15.161:0/1804672517 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418973919 0 0) 0x7fe834071770 con 0x7fe8341492a0 2024-02-02T11:49:06.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.327+0000 7fe832d9d640 1 -- 172.21.15.161:0/1804672517 >> v1:172.21.15.162:6789/0 conn(0x7fe8341492a0 legacy=0x7fe8340b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:06.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.327+0000 7fe832d9d640 1 -- 172.21.15.161:0/1804672517 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8340b3ac0 con 0x7fe8340bc340 2024-02-02T11:49:06.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe832d9d640 1 --2- 172.21.15.161:0/1804672517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8340bc340 0x7fe834142810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe8240097c0 tx=0x7fe82401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=295503fe739f10c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:06.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe83259c640 1 -- 172.21.15.161:0/1804672517 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8240a8970 con 0x7fe8340bc340 2024-02-02T11:49:06.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe83259c640 1 -- 172.21.15.161:0/1804672517 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8240a8ad0 con 0x7fe8340bc340 2024-02-02T11:49:06.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe83259c640 1 -- 172.21.15.161:0/1804672517 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8240a8e60 con 0x7fe8340bc340 2024-02-02T11:49:06.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe839139640 1 -- 172.21.15.161:0/1804672517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8340bc340 msgr2=0x7fe834142810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:06.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe839139640 1 --2- 172.21.15.161:0/1804672517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8340bc340 0x7fe834142810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe8240097c0 tx=0x7fe82401ec70 comp rx=0 tx=0).stop 2024-02-02T11:49:06.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe839139640 1 -- 172.21.15.161:0/1804672517 shutdown_connections 2024-02-02T11:49:06.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe839139640 1 --2- 172.21.15.161:0/1804672517 >> v2:172.21.15.162:3300/0 conn(0x7fe834142d50 0x7fe834148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe839139640 1 --2- 172.21.15.161:0/1804672517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8340bc340 0x7fe834142810 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe839139640 1 -- 172.21.15.161:0/1804672517 >> 172.21.15.161:0/1804672517 conn(0x7fe834069ef0 msgr2=0x7fe83406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:06.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe839139640 1 -- 172.21.15.161:0/1804672517 shutdown_connections 2024-02-02T11:49:06.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe839139640 1 -- 172.21.15.161:0/1804672517 wait complete. 2024-02-02T11:49:06.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe839139640 1 Processor -- start 2024-02-02T11:49:06.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe839139640 1 -- start start 2024-02-02T11:49:06.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe839139640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8340bc340 0x7fe8340bb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe839139640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8341492a0 0x7fe834146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe839139640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe834146f40 0x7fe8341e1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe839139640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe834146600 con 0x7fe8341492a0 2024-02-02T11:49:06.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe839139640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe834143e60 con 0x7fe834146f40 2024-02-02T11:49:06.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe839139640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83413e1f0 con 0x7fe8340bc340 2024-02-02T11:49:06.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe82bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8341492a0 0x7fe834146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe82bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8341492a0 0x7fe834146a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39880/0 (socket says 172.21.15.161:39880) 2024-02-02T11:49:06.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe82bfff640 1 -- 172.21.15.161:0/3001088251 learned_addr learned my addr 172.21.15.161:0/3001088251 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:06.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe83359e640 1 --2- 172.21.15.161:0/3001088251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe834146f40 0x7fe8341e1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe832d9d640 1 --2- 172.21.15.161:0/3001088251 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8340bc340 0x7fe8340bb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe82bfff640 1 -- 172.21.15.161:0/3001088251 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8340bc340 msgr2=0x7fe8340bb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:06.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe82bfff640 1 --2- 172.21.15.161:0/3001088251 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8340bc340 0x7fe8340bb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe82bfff640 1 -- 172.21.15.161:0/3001088251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe834146f40 msgr2=0x7fe8341e1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:06.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe82bfff640 1 --2- 172.21.15.161:0/3001088251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe834146f40 0x7fe8341e1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe82bfff640 1 -- 172.21.15.161:0/3001088251 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe824009420 con 0x7fe8341492a0 2024-02-02T11:49:06.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe82bfff640 1 --2- 172.21.15.161:0/3001088251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8341492a0 0x7fe834146a00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00e960 tx=0x7fe81c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:06.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe82b7fe640 1 -- 172.21.15.161:0/3001088251 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c009690 con 0x7fe8341492a0 2024-02-02T11:49:06.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe82b7fe640 1 -- 172.21.15.161:0/3001088251 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81c00ca00 con 0x7fe8341492a0 2024-02-02T11:49:06.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe82b7fe640 1 -- 172.21.15.161:0/3001088251 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c00cd70 con 0x7fe8341492a0 2024-02-02T11:49:06.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe839139640 1 -- 172.21.15.161:0/3001088251 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe834147ca0 con 0x7fe8341492a0 2024-02-02T11:49:06.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.331+0000 7fe839139640 1 -- 172.21.15.161:0/3001088251 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe834148260 con 0x7fe8341492a0 2024-02-02T11:49:06.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.335+0000 7fe839139640 1 -- 172.21.15.161:0/3001088251 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe83404e000 con 0x7fe8341492a0 2024-02-02T11:49:06.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.335+0000 7fe82b7fe640 1 -- 172.21.15.161:0/3001088251 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe81c013470 con 0x7fe8341492a0 2024-02-02T11:49:06.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.335+0000 7fe82b7fe640 1 --2- 172.21.15.161:0/3001088251 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fe814065a60 0x7fe814067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.335+0000 7fe82b7fe640 1 -- 172.21.15.161:0/3001088251 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe81c083330 con 0x7fe8341492a0 2024-02-02T11:49:06.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.335+0000 7fe832d9d640 1 --2- 172.21.15.161:0/3001088251 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fe814065a60 0x7fe814067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.335+0000 7fe832d9d640 1 --2- 172.21.15.161:0/3001088251 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fe814065a60 0x7fe814067f20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe8240b2000 tx=0x7fe8240aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:06.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.339+0000 7fe82b7fe640 1 -- 172.21.15.161:0/3001088251 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe81c050d80 con 0x7fe8341492a0 2024-02-02T11:49:06.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.483+0000 7fe839139640 1 -- 172.21.15.161:0/3001088251 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8341e0f50 con 0x7fe8341492a0 2024-02-02T11:49:06.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.483+0000 7fe82b7fe640 1 -- 172.21.15.161:0/3001088251 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fe81c0543a0 con 0x7fe8341492a0 2024-02-02T11:49:06.487 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:06.487 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":20,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:52.816101+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:48:50.155565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-02T11:48:50.795158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:49:06.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.487+0000 7fe839139640 1 -- 172.21.15.161:0/3001088251 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fe814065a60 msgr2=0x7fe814067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:06.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.487+0000 7fe839139640 1 --2- 172.21.15.161:0/3001088251 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fe814065a60 0x7fe814067f20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe8240b2000 tx=0x7fe8240aa070 comp rx=0 tx=0).stop 2024-02-02T11:49:06.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.487+0000 7fe839139640 1 -- 172.21.15.161:0/3001088251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8341492a0 msgr2=0x7fe834146a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:06.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.487+0000 7fe839139640 1 --2- 172.21.15.161:0/3001088251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8341492a0 0x7fe834146a00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00e960 tx=0x7fe81c00ee20 comp rx=0 tx=0).stop 2024-02-02T11:49:06.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.487+0000 7fe839139640 1 -- 172.21.15.161:0/3001088251 shutdown_connections 2024-02-02T11:49:06.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.487+0000 7fe839139640 1 --2- 172.21.15.161:0/3001088251 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fe814065a60 0x7fe814067f20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.487+0000 7fe839139640 1 --2- 172.21.15.161:0/3001088251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe834146f40 0x7fe8341e1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.487+0000 7fe839139640 1 --2- 172.21.15.161:0/3001088251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8341492a0 0x7fe834146a00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.487+0000 7fe839139640 1 --2- 172.21.15.161:0/3001088251 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8340bc340 0x7fe8340bb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.487+0000 7fe839139640 1 -- 172.21.15.161:0/3001088251 >> 172.21.15.161:0/3001088251 conn(0x7fe834069ef0 msgr2=0x7fe83413ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:06.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.487+0000 7fe839139640 1 -- 172.21.15.161:0/3001088251 shutdown_connections 2024-02-02T11:49:06.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.487+0000 7fe839139640 1 -- 172.21.15.161:0/3001088251 wait complete. 2024-02-02T11:49:06.505 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-02T11:48:40.330782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-02T11:48:50.155565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-02T11:48:50.795158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-02T11:49:06.505 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-02T11:49:06.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.623+0000 7f80c09a2640 1 Processor -- start 2024-02-02T11:49:06.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.623+0000 7f80c09a2640 1 -- start start 2024-02-02T11:49:06.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80c09a2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f80bc0b8df0 0x7f80bc14df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80c09a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80bc0b2b80 0x7f80bc144960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80c09a2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80bc14e5c0 con 0x7f80bc144ea0 2024-02-02T11:49:06.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80c09a2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc0b8800 con 0x7f80bc0b8df0 2024-02-02T11:49:06.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80c09a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc14e8a0 con 0x7f80bc0b2b80 2024-02-02T11:49:06.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80ba59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f80bc0b8df0 0x7f80bc14df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80ba59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f80bc0b8df0 0x7f80bc14df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39882/0 (socket says 172.21.15.161:39882) 2024-02-02T11:49:06.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80ba59c640 1 -- 172.21.15.161:0/2153187549 learned_addr learned my addr 172.21.15.161:0/2153187549 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:06.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80ba59c640 1 -- 172.21.15.161:0/2153187549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80bc0b2b80 msgr2=0x7f80bc144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:06.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80ba59c640 1 --2- 172.21.15.161:0/2153187549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80bc0b2b80 0x7f80bc144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80ba59c640 1 -- 172.21.15.161:0/2153187549 >> v1:172.21.15.162:6789/0 conn(0x7f80bc144ea0 legacy=0x7f80bc0b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:06.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80ba59c640 1 -- 172.21.15.161:0/2153187549 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc14eb80 con 0x7f80bc0b8df0 2024-02-02T11:49:06.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80ba59c640 1 --2- 172.21.15.161:0/2153187549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80bc0b8df0 0x7f80bc14df10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009870 tx=0x7f80ac01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e093631c5655b296 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:06.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80b959a640 1 -- 172.21.15.161:0/2153187549 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0ab600 con 0x7f80bc0b8df0 2024-02-02T11:49:06.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80b959a640 1 -- 172.21.15.161:0/2153187549 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac0a7050 con 0x7f80bc0b8df0 2024-02-02T11:49:06.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80b959a640 1 -- 172.21.15.161:0/2153187549 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0ab980 con 0x7f80bc0b8df0 2024-02-02T11:49:06.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80c09a2640 1 -- 172.21.15.161:0/2153187549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80bc0b8df0 msgr2=0x7f80bc14df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:06.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80c09a2640 1 --2- 172.21.15.161:0/2153187549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80bc0b8df0 0x7f80bc14df10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009870 tx=0x7f80ac01c500 comp rx=0 tx=0).stop 2024-02-02T11:49:06.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80c09a2640 1 -- 172.21.15.161:0/2153187549 shutdown_connections 2024-02-02T11:49:06.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80c09a2640 1 --2- 172.21.15.161:0/2153187549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80bc0b2b80 0x7f80bc144960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80c09a2640 1 --2- 172.21.15.161:0/2153187549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80bc0b8df0 0x7f80bc14df10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80c09a2640 1 -- 172.21.15.161:0/2153187549 >> 172.21.15.161:0/2153187549 conn(0x7f80bc06a120 msgr2=0x7f80bc06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:06.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80c09a2640 1 -- 172.21.15.161:0/2153187549 shutdown_connections 2024-02-02T11:49:06.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.627+0000 7f80c09a2640 1 -- 172.21.15.161:0/2153187549 wait complete. 2024-02-02T11:49:06.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80c09a2640 1 Processor -- start 2024-02-02T11:49:06.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80c09a2640 1 -- start start 2024-02-02T11:49:06.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80c09a2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80bc0b2b80 0x7f80bc13e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80c09a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80bc0b8df0 0x7f80bc1e2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80c09a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80bc144ea0 0x7f80bc1e3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80c09a2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc13ee70 con 0x7f80bc0b2b80 2024-02-02T11:49:06.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80c09a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc143a00 con 0x7f80bc144ea0 2024-02-02T11:49:06.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80c09a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc149b70 con 0x7f80bc0b8df0 2024-02-02T11:49:06.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80ba59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80bc0b2b80 0x7f80bc13e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80ba59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80bc0b2b80 0x7f80bc13e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39894/0 (socket says 172.21.15.161:39894) 2024-02-02T11:49:06.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80ba59c640 1 -- 172.21.15.161:0/3047798225 learned_addr learned my addr 172.21.15.161:0/3047798225 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:06.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80bad9d640 1 --2- 172.21.15.161:0/3047798225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80bc144ea0 0x7f80bc1e3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80b9d9b640 1 --2- 172.21.15.161:0/3047798225 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80bc0b8df0 0x7f80bc1e2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80ba59c640 1 -- 172.21.15.161:0/3047798225 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80bc0b8df0 msgr2=0x7f80bc1e2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:06.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80ba59c640 1 --2- 172.21.15.161:0/3047798225 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80bc0b8df0 0x7f80bc1e2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80ba59c640 1 -- 172.21.15.161:0/3047798225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80bc144ea0 msgr2=0x7f80bc1e3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:06.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80ba59c640 1 --2- 172.21.15.161:0/3047798225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80bc144ea0 0x7f80bc1e3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80ba59c640 1 -- 172.21.15.161:0/3047798225 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac0094d0 con 0x7f80bc0b2b80 2024-02-02T11:49:06.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80b9d9b640 1 --2- 172.21.15.161:0/3047798225 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80bc0b8df0 0x7f80bc1e2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:06.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80bad9d640 1 --2- 172.21.15.161:0/3047798225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80bc144ea0 0x7f80bc1e3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:06.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80ba59c640 1 --2- 172.21.15.161:0/3047798225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80bc0b2b80 0x7f80bc13e930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f80ac0ae040 tx=0x7f80ac01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:06.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80aaffd640 1 -- 172.21.15.161:0/3047798225 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0abea0 con 0x7f80bc0b2b80 2024-02-02T11:49:06.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80aaffd640 1 -- 172.21.15.161:0/3047798225 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac0b6850 con 0x7f80bc0b2b80 2024-02-02T11:49:06.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80c09a2640 1 -- 172.21.15.161:0/3047798225 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80bc143c50 con 0x7f80bc0b2b80 2024-02-02T11:49:06.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80aaffd640 1 -- 172.21.15.161:0/3047798225 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0b6c00 con 0x7f80bc0b2b80 2024-02-02T11:49:06.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80c09a2640 1 -- 172.21.15.161:0/3047798225 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80bc144210 con 0x7f80bc0b2b80 2024-02-02T11:49:06.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80c09a2640 1 -- 172.21.15.161:0/3047798225 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80bc144400 con 0x7f80bc0b2b80 2024-02-02T11:49:06.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80aaffd640 1 -- 172.21.15.161:0/3047798225 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f80ac0b2040 con 0x7f80bc0b2b80 2024-02-02T11:49:06.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80aaffd640 1 --2- 172.21.15.161:0/3047798225 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f809c065a90 0x7f809c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80aaffd640 1 -- 172.21.15.161:0/3047798225 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80ac11d6e0 con 0x7f80bc0b2b80 2024-02-02T11:49:06.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.631+0000 7f80b9d9b640 1 --2- 172.21.15.161:0/3047798225 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f809c065a90 0x7f809c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.635+0000 7f80b9d9b640 1 --2- 172.21.15.161:0/3047798225 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f809c065a90 0x7f809c067f50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f80bc14e330 tx=0x7f80b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:06.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.635+0000 7f80aaffd640 1 -- 172.21.15.161:0/3047798225 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f80ac0eb0a0 con 0x7f80bc0b2b80 2024-02-02T11:49:06.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.779+0000 7f80c09a2640 1 -- 172.21.15.161:0/3047798225 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80bc04e000 con 0x7f80bc0b2b80 2024-02-02T11:49:06.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.779+0000 7f80aaffd640 1 -- 172.21.15.161:0/3047798225 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f80ac0ee6c0 con 0x7f80bc0b2b80 2024-02-02T11:49:06.783 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-02-02T11:49:06.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.783+0000 7f80c09a2640 1 -- 172.21.15.161:0/3047798225 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f809c065a90 msgr2=0x7f809c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:06.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.783+0000 7f80c09a2640 1 --2- 172.21.15.161:0/3047798225 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f809c065a90 0x7f809c067f50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f80bc14e330 tx=0x7f80b0008040 comp rx=0 tx=0).stop 2024-02-02T11:49:06.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.783+0000 7f80c09a2640 1 -- 172.21.15.161:0/3047798225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80bc0b2b80 msgr2=0x7f80bc13e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:06.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.783+0000 7f80c09a2640 1 --2- 172.21.15.161:0/3047798225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80bc0b2b80 0x7f80bc13e930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f80ac0ae040 tx=0x7f80ac01ad40 comp rx=0 tx=0).stop 2024-02-02T11:49:06.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.783+0000 7f80c09a2640 1 -- 172.21.15.161:0/3047798225 shutdown_connections 2024-02-02T11:49:06.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.783+0000 7f80c09a2640 1 --2- 172.21.15.161:0/3047798225 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f809c065a90 0x7f809c067f50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.783+0000 7f80c09a2640 1 --2- 172.21.15.161:0/3047798225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80bc144ea0 0x7f80bc1e3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.783+0000 7f80c09a2640 1 --2- 172.21.15.161:0/3047798225 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80bc0b8df0 0x7f80bc1e2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.783+0000 7f80c09a2640 1 --2- 172.21.15.161:0/3047798225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80bc0b2b80 0x7f80bc13e930 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.783+0000 7f80c09a2640 1 -- 172.21.15.161:0/3047798225 >> 172.21.15.161:0/3047798225 conn(0x7f80bc06a120 msgr2=0x7f80bc06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:06.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.783+0000 7f80c09a2640 1 -- 172.21.15.161:0/3047798225 shutdown_connections 2024-02-02T11:49:06.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.783+0000 7f80c09a2640 1 -- 172.21.15.161:0/3047798225 wait complete. 2024-02-02T11:49:06.801 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-02T11:49:06.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb2dec8640 1 Processor -- start 2024-02-02T11:49:06.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb2dec8640 1 -- start start 2024-02-02T11:49:06.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb2dec8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffb2806fc30 0x7ffb280709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb2dec8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb28144100 0x7ffb28144590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb2dec8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb28070ef0 con 0x7ffb281474b0 2024-02-02T11:49:06.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb2dec8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb28071640 con 0x7ffb2806fc30 2024-02-02T11:49:06.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb2dec8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2806ecc0 con 0x7ffb28144100 2024-02-02T11:49:06.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb26ffd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ffb281474b0 0x7ffb281478f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:57572/0 (socket says 172.21.15.161:57572) 2024-02-02T11:49:06.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb26ffd640 1 -- 172.21.15.161:0/1957244291 learned_addr learned my addr 172.21.15.161:0/1957244291 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:06.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb277fe640 1 --2- 172.21.15.161:0/1957244291 >> v2:172.21.15.162:3300/0 conn(0x7ffb2806fc30 0x7ffb280709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb267fc640 1 -- 172.21.15.161:0/1957244291 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756432224 0 0) 0x7ffb200014a0 con 0x7ffb281474b0 2024-02-02T11:49:06.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb27fff640 1 --2- 172.21.15.161:0/1957244291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb28144100 0x7ffb28144590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb267fc640 1 -- 172.21.15.161:0/1957244291 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb14003450 con 0x7ffb281474b0 2024-02-02T11:49:06.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb267fc640 1 -- 172.21.15.161:0/1957244291 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3507832179 0 0) 0x7ffb14003450 con 0x7ffb281474b0 2024-02-02T11:49:06.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb267fc640 1 -- 172.21.15.161:0/1957244291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb28144100 msgr2=0x7ffb28144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:06.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb267fc640 1 --2- 172.21.15.161:0/1957244291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb28144100 0x7ffb28144590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb267fc640 1 -- 172.21.15.161:0/1957244291 >> v2:172.21.15.162:3300/0 conn(0x7ffb2806fc30 msgr2=0x7ffb280709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:06.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb267fc640 1 --2- 172.21.15.161:0/1957244291 >> v2:172.21.15.162:3300/0 conn(0x7ffb2806fc30 0x7ffb280709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb267fc640 1 -- 172.21.15.161:0/1957244291 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2806ef30 con 0x7ffb281474b0 2024-02-02T11:49:06.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb267fc640 1 -- 172.21.15.161:0/1957244291 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7ffb20001b90 con 0x7ffb281474b0 2024-02-02T11:49:06.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb267fc640 1 -- 172.21.15.161:0/1957244291 >> v1:172.21.15.161:6789/0 conn(0x7ffb281474b0 legacy=0x7ffb281478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:06.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb267fc640 1 --2- 172.21.15.161:0/1957244291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb14003a70 0x7ffb14003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb267fc640 1 --2- 172.21.15.161:0/1957244291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb28144100 0x7ffb14008660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb267fc640 1 --2- 172.21.15.161:0/1957244291 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb14008bf0 0x7ffb1400b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb267fc640 1 -- 172.21.15.161:0/1957244291 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2806ecc0 con 0x7ffb14008bf0 2024-02-02T11:49:06.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb267fc640 1 -- 172.21.15.161:0/1957244291 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1400b890 con 0x7ffb14003a70 2024-02-02T11:49:06.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb267fc640 1 -- 172.21.15.161:0/1957244291 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1400ba50 con 0x7ffb28144100 2024-02-02T11:49:06.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb27fff640 1 --2- 172.21.15.161:0/1957244291 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb14008bf0 0x7ffb1400b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb277fe640 1 --2- 172.21.15.161:0/1957244291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb14003a70 0x7ffb14003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb26ffd640 1 --2- 172.21.15.161:0/1957244291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb28144100 0x7ffb14008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb27fff640 1 -- 172.21.15.161:0/1957244291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb28144100 msgr2=0x7ffb14008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:06.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb27fff640 1 --2- 172.21.15.161:0/1957244291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb28144100 0x7ffb14008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb27fff640 1 -- 172.21.15.161:0/1957244291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb14003a70 msgr2=0x7ffb14003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:06.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb27fff640 1 --2- 172.21.15.161:0/1957244291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb14003a70 0x7ffb14003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb27fff640 1 -- 172.21.15.161:0/1957244291 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb14003450 con 0x7ffb14008bf0 2024-02-02T11:49:06.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.911+0000 7ffb26ffd640 1 --2- 172.21.15.161:0/1957244291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb28144100 0x7ffb14008660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:06.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb27fff640 1 --2- 172.21.15.161:0/1957244291 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb14008bf0 0x7ffb1400b080 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000bf90 tx=0x7ffb1001ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8999293ea6634040 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:06.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb267fc640 1 -- 172.21.15.161:0/1957244291 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb100a7c10 con 0x7ffb14008bf0 2024-02-02T11:49:06.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb267fc640 1 -- 172.21.15.161:0/1957244291 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb10011040 con 0x7ffb14008bf0 2024-02-02T11:49:06.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb267fc640 1 -- 172.21.15.161:0/1957244291 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb100af440 con 0x7ffb14008bf0 2024-02-02T11:49:06.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb2dec8640 1 -- 172.21.15.161:0/1957244291 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb14008bf0 msgr2=0x7ffb1400b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:06.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb2dec8640 1 --2- 172.21.15.161:0/1957244291 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb14008bf0 0x7ffb1400b080 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000bf90 tx=0x7ffb1001ec00 comp rx=0 tx=0).stop 2024-02-02T11:49:06.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb27fff640 1 -- 172.21.15.161:0/1957244291 reap_dead start 2024-02-02T11:49:06.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb2dec8640 1 -- 172.21.15.161:0/1957244291 shutdown_connections 2024-02-02T11:49:06.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb2dec8640 1 -- 172.21.15.161:0/1957244291 >> 172.21.15.161:0/1957244291 conn(0x7ffb2806a120 msgr2=0x7ffb2806a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:06.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb2dec8640 1 -- 172.21.15.161:0/1957244291 shutdown_connections 2024-02-02T11:49:06.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb2dec8640 1 -- 172.21.15.161:0/1957244291 wait complete. 2024-02-02T11:49:06.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb2dec8640 1 Processor -- start 2024-02-02T11:49:06.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb2dec8640 1 -- start start 2024-02-02T11:49:06.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb2dec8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb28142e60 0x7ffb281cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb2dec8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb28141fe0 0x7ffb28142440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb2dec8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb281ce2f0 0x7ffb281ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb2dec8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb280b5100 con 0x7ffb281ce2f0 2024-02-02T11:49:06.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb2dec8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb28141750 con 0x7ffb28142e60 2024-02-02T11:49:06.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb2dec8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb281d0010 con 0x7ffb28141fe0 2024-02-02T11:49:06.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb27fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb281ce2f0 0x7ffb281ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb27fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb281ce2f0 0x7ffb281ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39914/0 (socket says 172.21.15.161:39914) 2024-02-02T11:49:06.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb27fff640 1 -- 172.21.15.161:0/1201283350 learned_addr learned my addr 172.21.15.161:0/1201283350 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:06.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb277fe640 1 --2- 172.21.15.161:0/1201283350 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb28142e60 0x7ffb281cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb26ffd640 1 --2- 172.21.15.161:0/1201283350 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb28141fe0 0x7ffb28142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb27fff640 1 -- 172.21.15.161:0/1201283350 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb28141fe0 msgr2=0x7ffb28142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:06.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb27fff640 1 --2- 172.21.15.161:0/1201283350 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb28141fe0 0x7ffb28142440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb27fff640 1 -- 172.21.15.161:0/1201283350 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb28142e60 msgr2=0x7ffb281cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:06.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb27fff640 1 --2- 172.21.15.161:0/1201283350 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb28142e60 0x7ffb281cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:06.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb27fff640 1 -- 172.21.15.161:0/1201283350 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb281419c0 con 0x7ffb281ce2f0 2024-02-02T11:49:06.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb277fe640 1 --2- 172.21.15.161:0/1201283350 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb28142e60 0x7ffb281cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:49:06.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb27fff640 1 --2- 172.21.15.161:0/1201283350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb281ce2f0 0x7ffb281ce770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000bf90 tx=0x7ffb1000b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:06.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb1ffff640 1 -- 172.21.15.161:0/1201283350 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb10004230 con 0x7ffb281ce2f0 2024-02-02T11:49:06.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb1ffff640 1 -- 172.21.15.161:0/1201283350 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb10004390 con 0x7ffb281ce2f0 2024-02-02T11:49:06.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb2dec8640 1 -- 172.21.15.161:0/1201283350 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb280b4ab0 con 0x7ffb281ce2f0 2024-02-02T11:49:06.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb1ffff640 1 -- 172.21.15.161:0/1201283350 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb100afa80 con 0x7ffb281ce2f0 2024-02-02T11:49:06.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.915+0000 7ffb2dec8640 1 -- 172.21.15.161:0/1201283350 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2813fd70 con 0x7ffb281ce2f0 2024-02-02T11:49:06.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.919+0000 7ffb2dec8640 1 -- 172.21.15.161:0/1201283350 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2804e000 con 0x7ffb281ce2f0 2024-02-02T11:49:06.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.919+0000 7ffb1ffff640 1 -- 172.21.15.161:0/1201283350 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffb100b6040 con 0x7ffb281ce2f0 2024-02-02T11:49:06.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.919+0000 7ffb1ffff640 1 --2- 172.21.15.161:0/1201283350 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ffb08065a60 0x7ffb08067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:06.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.919+0000 7ffb1ffff640 1 -- 172.21.15.161:0/1201283350 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb1011f080 con 0x7ffb281ce2f0 2024-02-02T11:49:06.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.919+0000 7ffb277fe640 1 --2- 172.21.15.161:0/1201283350 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ffb08065a60 0x7ffb08067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:06.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.919+0000 7ffb277fe640 1 --2- 172.21.15.161:0/1201283350 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ffb08065a60 0x7ffb08067f20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009af0 tx=0x7ffb18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:06.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:06.923+0000 7ffb1ffff640 1 -- 172.21.15.161:0/1201283350 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffb100ecaf0 con 0x7ffb281ce2f0 2024-02-02T11:49:07.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.063+0000 7ffb2dec8640 1 -- 172.21.15.161:0/1201283350 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb28143b70 con 0x7ffb281ce2f0 2024-02-02T11:49:07.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.063+0000 7ffb1ffff640 1 -- 172.21.15.161:0/1201283350 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffb100f0110 con 0x7ffb281ce2f0 2024-02-02T11:49:07.067 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-02-02T11:49:07.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.067+0000 7ffb2dec8640 1 -- 172.21.15.161:0/1201283350 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ffb08065a60 msgr2=0x7ffb08067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:07.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.067+0000 7ffb2dec8640 1 --2- 172.21.15.161:0/1201283350 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ffb08065a60 0x7ffb08067f20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009af0 tx=0x7ffb18008040 comp rx=0 tx=0).stop 2024-02-02T11:49:07.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.067+0000 7ffb2dec8640 1 -- 172.21.15.161:0/1201283350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb281ce2f0 msgr2=0x7ffb281ce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:07.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.067+0000 7ffb2dec8640 1 --2- 172.21.15.161:0/1201283350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb281ce2f0 0x7ffb281ce770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000bf90 tx=0x7ffb1000b750 comp rx=0 tx=0).stop 2024-02-02T11:49:07.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.067+0000 7ffb2dec8640 1 -- 172.21.15.161:0/1201283350 shutdown_connections 2024-02-02T11:49:07.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.067+0000 7ffb2dec8640 1 --2- 172.21.15.161:0/1201283350 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ffb08065a60 0x7ffb08067f20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.067+0000 7ffb2dec8640 1 --2- 172.21.15.161:0/1201283350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb281ce2f0 0x7ffb281ce770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.067+0000 7ffb2dec8640 1 --2- 172.21.15.161:0/1201283350 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb28141fe0 0x7ffb28142440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.067+0000 7ffb2dec8640 1 --2- 172.21.15.161:0/1201283350 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb28142e60 0x7ffb281cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.067+0000 7ffb2dec8640 1 -- 172.21.15.161:0/1201283350 >> 172.21.15.161:0/1201283350 conn(0x7ffb2806a120 msgr2=0x7ffb28070430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:07.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.067+0000 7ffb2dec8640 1 -- 172.21.15.161:0/1201283350 shutdown_connections 2024-02-02T11:49:07.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.067+0000 7ffb2dec8640 1 -- 172.21.15.161:0/1201283350 wait complete. 2024-02-02T11:49:07.084 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-02T11:49:07.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.191+0000 7fd939e28640 1 Processor -- start 2024-02-02T11:49:07.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.191+0000 7fd939e28640 1 -- start start 2024-02-02T11:49:07.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd939e28640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd934070e40 0x7fd934141620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd939e28640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93406ec30 con 0x7fd9340b8df0 2024-02-02T11:49:07.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd939e28640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd934071890 con 0x7fd9340b8530 2024-02-02T11:49:07.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd939e28640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9340b30e0 con 0x7fd934070e40 2024-02-02T11:49:07.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9337fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd9340b8df0 0x7fd934147eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:57582/0 (socket says 172.21.15.161:57582) 2024-02-02T11:49:07.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9337fe640 1 -- 172.21.15.161:0/637068498 learned_addr learned my addr 172.21.15.161:0/637068498 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:07.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd932ffd640 1 --2- 172.21.15.161:0/637068498 >> v2:172.21.15.162:3300/0 conn(0x7fd934070e40 0x7fd934141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:07.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9327fc640 1 -- 172.21.15.161:0/637068498 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349997960 0 0) 0x7fd93406ec30 con 0x7fd9340b8df0 2024-02-02T11:49:07.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9327fc640 1 -- 172.21.15.161:0/637068498 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd91c003530 con 0x7fd9340b8df0 2024-02-02T11:49:07.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9327fc640 1 -- 172.21.15.161:0/637068498 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3085078706 0 0) 0x7fd91c003530 con 0x7fd9340b8df0 2024-02-02T11:49:07.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9327fc640 1 -- 172.21.15.161:0/637068498 >> v2:172.21.15.162:3300/0 conn(0x7fd934070e40 msgr2=0x7fd934141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:07.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9327fc640 1 --2- 172.21.15.161:0/637068498 >> v2:172.21.15.162:3300/0 conn(0x7fd934070e40 0x7fd934141620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9327fc640 1 -- 172.21.15.161:0/637068498 >> v1:172.21.15.162:6789/0 conn(0x7fd9340b8530 legacy=0x7fd934152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:07.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9327fc640 1 -- 172.21.15.161:0/637068498 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9340712d0 con 0x7fd9340b8df0 2024-02-02T11:49:07.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9327fc640 1 -- 172.21.15.161:0/637068498 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7fd924001a00 con 0x7fd9340b8df0 2024-02-02T11:49:07.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9327fc640 1 -- 172.21.15.161:0/637068498 >> v1:172.21.15.161:6789/0 conn(0x7fd9340b8df0 legacy=0x7fd934147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:07.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9327fc640 1 --2- 172.21.15.161:0/637068498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd91c003980 0x7fd91c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9327fc640 1 --2- 172.21.15.161:0/637068498 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd91c0047d0 0x7fd91c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9327fc640 1 --2- 172.21.15.161:0/637068498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd91c005190 0x7fd91c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9327fc640 1 -- 172.21.15.161:0/637068498 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340b30e0 con 0x7fd91c003980 2024-02-02T11:49:07.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9327fc640 1 -- 172.21.15.161:0/637068498 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c00c030 con 0x7fd91c005190 2024-02-02T11:49:07.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9327fc640 1 -- 172.21.15.161:0/637068498 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c00c1f0 con 0x7fd91c0047d0 2024-02-02T11:49:07.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9337fe640 1 --2- 172.21.15.161:0/637068498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd91c003980 0x7fd91c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:07.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd932ffd640 1 --2- 172.21.15.161:0/637068498 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd91c0047d0 0x7fd91c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:07.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9337fe640 1 -- 172.21.15.161:0/637068498 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd91c0047d0 msgr2=0x7fd91c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:07.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd933fff640 1 --2- 172.21.15.161:0/637068498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd91c005190 0x7fd91c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:07.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9337fe640 1 --2- 172.21.15.161:0/637068498 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd91c0047d0 0x7fd91c004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9337fe640 1 -- 172.21.15.161:0/637068498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd91c005190 msgr2=0x7fd91c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:07.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9337fe640 1 --2- 172.21.15.161:0/637068498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd91c005190 0x7fd91c00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd9337fe640 1 -- 172.21.15.161:0/637068498 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c003530 con 0x7fd91c003980 2024-02-02T11:49:07.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.195+0000 7fd933fff640 1 -- 172.21.15.161:0/637068498 reap_dead start 2024-02-02T11:49:07.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd9337fe640 1 --2- 172.21.15.161:0/637068498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd91c003980 0x7fd91c003da0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd92400a830 tx=0x7fd92401d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154f116a1ec49e26 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:07.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd9327fc640 1 -- 172.21.15.161:0/637068498 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9240070d0 con 0x7fd91c003980 2024-02-02T11:49:07.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd9327fc640 1 -- 172.21.15.161:0/637068498 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9240a8070 con 0x7fd91c003980 2024-02-02T11:49:07.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd9327fc640 1 -- 172.21.15.161:0/637068498 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9240074f0 con 0x7fd91c003980 2024-02-02T11:49:07.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd939e28640 1 -- 172.21.15.161:0/637068498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd91c003980 msgr2=0x7fd91c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:07.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd939e28640 1 --2- 172.21.15.161:0/637068498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd91c003980 0x7fd91c003da0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd92400a830 tx=0x7fd92401d340 comp rx=0 tx=0).stop 2024-02-02T11:49:07.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd939e28640 1 -- 172.21.15.161:0/637068498 shutdown_connections 2024-02-02T11:49:07.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd939e28640 1 --2- 172.21.15.161:0/637068498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd91c003980 0x7fd91c003da0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd939e28640 1 -- 172.21.15.161:0/637068498 >> 172.21.15.161:0/637068498 conn(0x7fd93406a120 msgr2=0x7fd93406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:07.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd939e28640 1 -- 172.21.15.161:0/637068498 shutdown_connections 2024-02-02T11:49:07.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd939e28640 1 -- 172.21.15.161:0/637068498 wait complete. 2024-02-02T11:49:07.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd939e28640 1 Processor -- start 2024-02-02T11:49:07.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd939e28640 1 -- start start 2024-02-02T11:49:07.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd939e28640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd91c003980 0x7fd9341e27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd939e28640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9341e2d30 0x7fd9340b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd939e28640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9341464e0 0x7fd9340b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd939e28640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340b5cb0 con 0x7fd9341464e0 2024-02-02T11:49:07.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd939e28640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340b6140 con 0x7fd9341e2d30 2024-02-02T11:49:07.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd939e28640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9341469c0 con 0x7fd91c003980 2024-02-02T11:49:07.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd933fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9341464e0 0x7fd9340b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:07.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd933fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9341464e0 0x7fd9340b4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39940/0 (socket says 172.21.15.161:39940) 2024-02-02T11:49:07.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd933fff640 1 -- 172.21.15.161:0/2963392876 learned_addr learned my addr 172.21.15.161:0/2963392876 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:07.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd932ffd640 1 --2- 172.21.15.161:0/2963392876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9341e2d30 0x7fd9340b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:07.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd933fff640 1 -- 172.21.15.161:0/2963392876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd91c003980 msgr2=0x7fd9341e27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:07.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd9337fe640 1 --2- 172.21.15.161:0/2963392876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd91c003980 0x7fd9341e27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:07.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd933fff640 1 --2- 172.21.15.161:0/2963392876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd91c003980 0x7fd9341e27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd933fff640 1 -- 172.21.15.161:0/2963392876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9341e2d30 msgr2=0x7fd9340b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:07.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd933fff640 1 --2- 172.21.15.161:0/2963392876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9341e2d30 0x7fd9340b48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.199+0000 7fd933fff640 1 -- 172.21.15.161:0/2963392876 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9341455d0 con 0x7fd9341464e0 2024-02-02T11:49:07.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.203+0000 7fd933fff640 1 --2- 172.21.15.161:0/2963392876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9341464e0 0x7fd9340b4df0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd9340b4230 tx=0x7fd92c00d5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:07.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.203+0000 7fd91bfff640 1 -- 172.21.15.161:0/2963392876 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c00b070 con 0x7fd9341464e0 2024-02-02T11:49:07.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.203+0000 7fd91bfff640 1 -- 172.21.15.161:0/2963392876 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92c0052d0 con 0x7fd9341464e0 2024-02-02T11:49:07.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.203+0000 7fd939e28640 1 -- 172.21.15.161:0/2963392876 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9341458b0 con 0x7fd9341464e0 2024-02-02T11:49:07.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.203+0000 7fd91bfff640 1 -- 172.21.15.161:0/2963392876 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c003600 con 0x7fd9341464e0 2024-02-02T11:49:07.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.203+0000 7fd939e28640 1 -- 172.21.15.161:0/2963392876 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9340b5330 con 0x7fd9341464e0 2024-02-02T11:49:07.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.203+0000 7fd939e28640 1 -- 172.21.15.161:0/2963392876 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9340b5e60 con 0x7fd9341464e0 2024-02-02T11:49:07.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.203+0000 7fd91bfff640 1 -- 172.21.15.161:0/2963392876 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd92c003780 con 0x7fd9341464e0 2024-02-02T11:49:07.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.203+0000 7fd91bfff640 1 --2- 172.21.15.161:0/2963392876 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd920065a90 0x7fd920067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.203+0000 7fd91bfff640 1 -- 172.21.15.161:0/2963392876 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd92c082660 con 0x7fd9341464e0 2024-02-02T11:49:07.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.203+0000 7fd9337fe640 1 --2- 172.21.15.161:0/2963392876 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd920065a90 0x7fd920067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:07.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.203+0000 7fd9337fe640 1 --2- 172.21.15.161:0/2963392876 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd920065a90 0x7fd920067f50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9240ad000 tx=0x7fd924009050 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:07.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.207+0000 7fd91bfff640 1 -- 172.21.15.161:0/2963392876 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd9340b5e60 con 0x7fd9341464e0 2024-02-02T11:49:07.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.347+0000 7fd939e28640 1 -- 172.21.15.161:0/2963392876 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd9340b5e60 con 0x7fd9341464e0 2024-02-02T11:49:07.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.347+0000 7fd91bfff640 1 -- 172.21.15.161:0/2963392876 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd92c018020 con 0x7fd9341464e0 2024-02-02T11:49:07.352 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2024-02-02T11:49:07.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.351+0000 7fd939e28640 1 -- 172.21.15.161:0/2963392876 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd920065a90 msgr2=0x7fd920067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:07.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.351+0000 7fd939e28640 1 --2- 172.21.15.161:0/2963392876 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd920065a90 0x7fd920067f50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9240ad000 tx=0x7fd924009050 comp rx=0 tx=0).stop 2024-02-02T11:49:07.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.351+0000 7fd939e28640 1 -- 172.21.15.161:0/2963392876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9341464e0 msgr2=0x7fd9340b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:07.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.351+0000 7fd939e28640 1 --2- 172.21.15.161:0/2963392876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9341464e0 0x7fd9340b4df0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd9340b4230 tx=0x7fd92c00d5e0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.351+0000 7fd939e28640 1 -- 172.21.15.161:0/2963392876 shutdown_connections 2024-02-02T11:49:07.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.351+0000 7fd939e28640 1 --2- 172.21.15.161:0/2963392876 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd920065a90 0x7fd920067f50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.351+0000 7fd939e28640 1 --2- 172.21.15.161:0/2963392876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9341464e0 0x7fd9340b4df0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.351+0000 7fd939e28640 1 --2- 172.21.15.161:0/2963392876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9341e2d30 0x7fd9340b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.351+0000 7fd939e28640 1 --2- 172.21.15.161:0/2963392876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd91c003980 0x7fd9341e27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.351+0000 7fd939e28640 1 -- 172.21.15.161:0/2963392876 >> 172.21.15.161:0/2963392876 conn(0x7fd93406a120 msgr2=0x7fd934072f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:07.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.351+0000 7fd939e28640 1 -- 172.21.15.161:0/2963392876 shutdown_connections 2024-02-02T11:49:07.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.351+0000 7fd939e28640 1 -- 172.21.15.161:0/2963392876 wait complete. 2024-02-02T11:49:07.369 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-02T11:49:07.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.471+0000 7f4847bbe640 1 Processor -- start 2024-02-02T11:49:07.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.471+0000 7f4847bbe640 1 -- start start 2024-02-02T11:49:07.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.471+0000 7f4847bbe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f48400b8020 0x7f4840147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.471+0000 7f4847bbe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4840070980 0x7f48401481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.471+0000 7f4847bbe640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4840071550 con 0x7f48400bc340 2024-02-02T11:49:07.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.471+0000 7f4847bbe640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4840141d00 con 0x7f48400b8020 2024-02-02T11:49:07.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.471+0000 7f4847bbe640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4840071810 con 0x7f4840070980 2024-02-02T11:49:07.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.471+0000 7f4845159640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f48400b8020 0x7f4840147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:07.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.471+0000 7f4845159640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f48400b8020 0x7f4840147c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39944/0 (socket says 172.21.15.161:39944) 2024-02-02T11:49:07.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.471+0000 7f4845159640 1 -- 172.21.15.161:0/1149931413 learned_addr learned my addr 172.21.15.161:0/1149931413 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:07.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.471+0000 7f484615b640 1 --2- 172.21.15.161:0/1149931413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4840070980 0x7f48401481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:07.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.471+0000 7f4845159640 1 -- 172.21.15.161:0/1149931413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4840070980 msgr2=0x7f48401481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:07.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.471+0000 7f4845159640 1 --2- 172.21.15.161:0/1149931413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4840070980 0x7f48401481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.471+0000 7f4845159640 1 -- 172.21.15.161:0/1149931413 >> v1:172.21.15.162:6789/0 conn(0x7f48400bc340 legacy=0x7f48401415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:07.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.471+0000 7f4845159640 1 -- 172.21.15.161:0/1149931413 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48400bc720 con 0x7f48400b8020 2024-02-02T11:49:07.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.471+0000 7f484615b640 1 --2- 172.21.15.161:0/1149931413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4840070980 0x7f48401481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:07.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.475+0000 7f4845159640 1 --2- 172.21.15.161:0/1149931413 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48400b8020 0x7f4840147c60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4830009870 tx=0x7f483001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6026c2d7a0ea43aa server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:07.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.475+0000 7f4844958640 1 -- 172.21.15.161:0/1149931413 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48300ab600 con 0x7f48400b8020 2024-02-02T11:49:07.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.475+0000 7f4844958640 1 -- 172.21.15.161:0/1149931413 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48300a7050 con 0x7f48400b8020 2024-02-02T11:49:07.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.475+0000 7f4844958640 1 -- 172.21.15.161:0/1149931413 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48300ab980 con 0x7f48400b8020 2024-02-02T11:49:07.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.475+0000 7f4847bbe640 1 -- 172.21.15.161:0/1149931413 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48400b8020 msgr2=0x7f4840147c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:07.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.475+0000 7f4847bbe640 1 --2- 172.21.15.161:0/1149931413 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48400b8020 0x7f4840147c60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4830009870 tx=0x7f483001c470 comp rx=0 tx=0).stop 2024-02-02T11:49:07.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.475+0000 7f4847bbe640 1 -- 172.21.15.161:0/1149931413 shutdown_connections 2024-02-02T11:49:07.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.475+0000 7f4847bbe640 1 --2- 172.21.15.161:0/1149931413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4840070980 0x7f48401481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.475+0000 7f4847bbe640 1 --2- 172.21.15.161:0/1149931413 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48400b8020 0x7f4840147c60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.475+0000 7f4847bbe640 1 -- 172.21.15.161:0/1149931413 >> 172.21.15.161:0/1149931413 conn(0x7f4840069ef0 msgr2=0x7f484006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:07.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.475+0000 7f4847bbe640 1 -- 172.21.15.161:0/1149931413 shutdown_connections 2024-02-02T11:49:07.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.475+0000 7f4847bbe640 1 -- 172.21.15.161:0/1149931413 wait complete. 2024-02-02T11:49:07.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.475+0000 7f4847bbe640 1 Processor -- start 2024-02-02T11:49:07.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.475+0000 7f4847bbe640 1 -- start start 2024-02-02T11:49:07.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f4847bbe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4840070980 0x7f48400bb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f4847bbe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48400b8020 0x7f484013bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f4847bbe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48400bc340 0x7f484013c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f4847bbe640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484013b7a0 con 0x7f4840070980 2024-02-02T11:49:07.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f4847bbe640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48400bb8e0 con 0x7f48400b8020 2024-02-02T11:49:07.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f4847bbe640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48401472d0 con 0x7f48400bc340 2024-02-02T11:49:07.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f484595a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4840070980 0x7f48400bb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:07.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f484595a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4840070980 0x7f48400bb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39952/0 (socket says 172.21.15.161:39952) 2024-02-02T11:49:07.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f484595a640 1 -- 172.21.15.161:0/1144217014 learned_addr learned my addr 172.21.15.161:0/1144217014 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:07.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f4845159640 1 --2- 172.21.15.161:0/1144217014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48400b8020 0x7f484013bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:07.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f484615b640 1 --2- 172.21.15.161:0/1144217014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48400bc340 0x7f484013c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:07.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f484595a640 1 -- 172.21.15.161:0/1144217014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48400bc340 msgr2=0x7f484013c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:07.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f484595a640 1 --2- 172.21.15.161:0/1144217014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48400bc340 0x7f484013c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f484595a640 1 -- 172.21.15.161:0/1144217014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48400b8020 msgr2=0x7f484013bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:07.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f484595a640 1 --2- 172.21.15.161:0/1144217014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48400b8020 0x7f484013bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f484595a640 1 -- 172.21.15.161:0/1144217014 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48300094d0 con 0x7f4840070980 2024-02-02T11:49:07.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f4845159640 1 --2- 172.21.15.161:0/1144217014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48400b8020 0x7f484013bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:07.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f484595a640 1 --2- 172.21.15.161:0/1144217014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4840070980 0x7f48400bb3a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f483c00c480 tx=0x7f483c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:07.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f48367fc640 1 -- 172.21.15.161:0/1144217014 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c012830 con 0x7f4840070980 2024-02-02T11:49:07.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f48367fc640 1 -- 172.21.15.161:0/1144217014 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483c0129b0 con 0x7f4840070980 2024-02-02T11:49:07.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f48367fc640 1 -- 172.21.15.161:0/1144217014 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c012d60 con 0x7f4840070980 2024-02-02T11:49:07.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f4847bbe640 1 -- 172.21.15.161:0/1144217014 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4840140550 con 0x7f4840070980 2024-02-02T11:49:07.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f4847bbe640 1 -- 172.21.15.161:0/1144217014 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4840140b00 con 0x7f4840070980 2024-02-02T11:49:07.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f4847bbe640 1 -- 172.21.15.161:0/1144217014 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484013ba10 con 0x7f4840070980 2024-02-02T11:49:07.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f48367fc640 1 -- 172.21.15.161:0/1144217014 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f483c01c460 con 0x7f4840070980 2024-02-02T11:49:07.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f48367fc640 1 --2- 172.21.15.161:0/1144217014 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4824065a60 0x7f4824067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f48367fc640 1 -- 172.21.15.161:0/1144217014 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f483c0830a0 con 0x7f4840070980 2024-02-02T11:49:07.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f4845159640 1 --2- 172.21.15.161:0/1144217014 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4824065a60 0x7f4824067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:07.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.479+0000 7f4845159640 1 --2- 172.21.15.161:0/1144217014 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4824065a60 0x7f4824067f20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f48300ad000 tx=0x7f4830008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:07.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.483+0000 7f48367fc640 1 -- 172.21.15.161:0/1144217014 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f483c050a60 con 0x7f4840070980 2024-02-02T11:49:07.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.667+0000 7f4847bbe640 1 -- 172.21.15.161:0/1144217014 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f484004e000 con 0x7f4840070980 2024-02-02T11:49:07.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.667+0000 7f48367fc640 1 -- 172.21.15.161:0/1144217014 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3953 (secure 0 0 0) 0x7f483c054080 con 0x7f4840070980 2024-02-02T11:49:07.672 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:07.673 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3677988163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3677988163},{"type":"v1","addr":"172.21.15.162:6833","nonce":3677988163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/456037269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":456037269},{"type":"v1","addr":"172.21.15.161:6835","nonce":456037269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-02T11:48:51.812809+0000","modified":"2024-02-02T11:48:54.494091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/2509813318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":2509813318},{"type":"v1","addr":"172.21.15.161:6837","nonce":2509813318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-02T11:49:07.673 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 7 2024-02-02T11:49:07.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.671+0000 7f4847bbe640 1 -- 172.21.15.161:0/1144217014 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4824065a60 msgr2=0x7f4824067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:07.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.671+0000 7f4847bbe640 1 --2- 172.21.15.161:0/1144217014 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4824065a60 0x7f4824067f20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f48300ad000 tx=0x7f4830008040 comp rx=0 tx=0).stop 2024-02-02T11:49:07.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.671+0000 7f4847bbe640 1 -- 172.21.15.161:0/1144217014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4840070980 msgr2=0x7f48400bb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:07.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.671+0000 7f4847bbe640 1 --2- 172.21.15.161:0/1144217014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4840070980 0x7f48400bb3a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f483c00c480 tx=0x7f483c00c940 comp rx=0 tx=0).stop 2024-02-02T11:49:07.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.671+0000 7f4847bbe640 1 -- 172.21.15.161:0/1144217014 shutdown_connections 2024-02-02T11:49:07.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.671+0000 7f4847bbe640 1 --2- 172.21.15.161:0/1144217014 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4824065a60 0x7f4824067f20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.671+0000 7f4847bbe640 1 --2- 172.21.15.161:0/1144217014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48400bc340 0x7f484013c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.671+0000 7f4847bbe640 1 --2- 172.21.15.161:0/1144217014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48400b8020 0x7f484013bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.671+0000 7f4847bbe640 1 --2- 172.21.15.161:0/1144217014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4840070980 0x7f48400bb3a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.671+0000 7f4847bbe640 1 -- 172.21.15.161:0/1144217014 >> 172.21.15.161:0/1144217014 conn(0x7f4840069ef0 msgr2=0x7f4840150480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:07.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.671+0000 7f4847bbe640 1 -- 172.21.15.161:0/1144217014 shutdown_connections 2024-02-02T11:49:07.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.671+0000 7f4847bbe640 1 -- 172.21.15.161:0/1144217014 wait complete. 2024-02-02T11:49:07.690 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:49:07.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.795+0000 7f3bb8c71640 1 Processor -- start 2024-02-02T11:49:07.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.795+0000 7f3bb8c71640 1 -- start start 2024-02-02T11:49:07.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.795+0000 7f3bb8c71640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3bb40bc340 0x7f3bb41415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.795+0000 7f3bb8c71640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bb4141b30 0x7f3bb4147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.795+0000 7f3bb8c71640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3bb40b8020 0x7f3bb41481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.795+0000 7f3bb8c71640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb4071550 con 0x7f3bb40bc340 2024-02-02T11:49:07.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.795+0000 7f3bb8c71640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb4071810 con 0x7f3bb40b8020 2024-02-02T11:49:07.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.795+0000 7f3bb8c71640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40bc720 con 0x7f3bb4141b30 2024-02-02T11:49:07.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.795+0000 7f3bb259c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3bb40bc340 0x7f3bb41415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:07.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.795+0000 7f3bb259c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3bb40bc340 0x7f3bb41415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39958/0 (socket says 172.21.15.161:39958) 2024-02-02T11:49:07.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.795+0000 7f3bb259c640 1 -- 172.21.15.161:0/4131495369 learned_addr learned my addr 172.21.15.161:0/4131495369 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:07.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.795+0000 7f3bb259c640 1 -- 172.21.15.161:0/4131495369 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bb4141b30 msgr2=0x7f3bb4147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:07.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.795+0000 7f3bb259c640 1 --2- 172.21.15.161:0/4131495369 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bb4141b30 0x7f3bb4147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.795+0000 7f3bb259c640 1 -- 172.21.15.161:0/4131495369 >> v2:172.21.15.162:3300/0 conn(0x7f3bb40b8020 msgr2=0x7f3bb41481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:07.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.795+0000 7f3bb259c640 1 --2- 172.21.15.161:0/4131495369 >> v2:172.21.15.162:3300/0 conn(0x7f3bb40b8020 0x7f3bb41481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.795+0000 7f3bb259c640 1 -- 172.21.15.161:0/4131495369 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb40b2d90 con 0x7f3bb40bc340 2024-02-02T11:49:07.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb259c640 1 --2- 172.21.15.161:0/4131495369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bb40bc340 0x7f3bb41415f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40b4090 tx=0x7f3bac01eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3a7884f49540d4 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:07.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb159a640 1 -- 172.21.15.161:0/4131495369 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0a7800 con 0x7f3bb40bc340 2024-02-02T11:49:07.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb159a640 1 -- 172.21.15.161:0/4131495369 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac0a7960 con 0x7f3bb40bc340 2024-02-02T11:49:07.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb159a640 1 -- 172.21.15.161:0/4131495369 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0a7cf0 con 0x7f3bb40bc340 2024-02-02T11:49:07.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb8c71640 1 -- 172.21.15.161:0/4131495369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bb40bc340 msgr2=0x7f3bb41415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:07.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb8c71640 1 --2- 172.21.15.161:0/4131495369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bb40bc340 0x7f3bb41415f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40b4090 tx=0x7f3bac01eb70 comp rx=0 tx=0).stop 2024-02-02T11:49:07.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb8c71640 1 -- 172.21.15.161:0/4131495369 shutdown_connections 2024-02-02T11:49:07.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb8c71640 1 --2- 172.21.15.161:0/4131495369 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bb4141b30 0x7f3bb4147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb8c71640 1 --2- 172.21.15.161:0/4131495369 >> v2:172.21.15.162:3300/0 conn(0x7f3bb40b8020 0x7f3bb41481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb8c71640 1 --2- 172.21.15.161:0/4131495369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bb40bc340 0x7f3bb41415f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb8c71640 1 -- 172.21.15.161:0/4131495369 >> 172.21.15.161:0/4131495369 conn(0x7f3bb4069ef0 msgr2=0x7f3bb406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:07.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb8c71640 1 -- 172.21.15.161:0/4131495369 shutdown_connections 2024-02-02T11:49:07.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb8c71640 1 -- 172.21.15.161:0/4131495369 wait complete. 2024-02-02T11:49:07.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb8c71640 1 Processor -- start 2024-02-02T11:49:07.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb8c71640 1 -- start start 2024-02-02T11:49:07.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb8c71640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bb40b8020 0x7f3bb4145b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb8c71640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bb40bc340 0x7f3bb414a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb8c71640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bb4141b30 0x7f3bb4133740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb8c71640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb414a890 con 0x7f3bb40b8020 2024-02-02T11:49:07.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb8c71640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb4146690 con 0x7f3bb4141b30 2024-02-02T11:49:07.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb8c71640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb4149c50 con 0x7f3bb40bc340 2024-02-02T11:49:07.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bb40b8020 0x7f3bb4145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:07.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bb40b8020 0x7f3bb4145b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39966/0 (socket says 172.21.15.161:39966) 2024-02-02T11:49:07.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.799+0000 7f3bb259c640 1 -- 172.21.15.161:0/2711973501 learned_addr learned my addr 172.21.15.161:0/2711973501 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:07.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3bb2d9d640 1 --2- 172.21.15.161:0/2711973501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bb4141b30 0x7f3bb4133740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:07.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3bb1d9b640 1 --2- 172.21.15.161:0/2711973501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bb40bc340 0x7f3bb414a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:07.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3bb259c640 1 -- 172.21.15.161:0/2711973501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bb40bc340 msgr2=0x7f3bb414a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:07.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3bb259c640 1 --2- 172.21.15.161:0/2711973501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bb40bc340 0x7f3bb414a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3bb259c640 1 -- 172.21.15.161:0/2711973501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bb4141b30 msgr2=0x7f3bb4133740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:07.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3bb259c640 1 --2- 172.21.15.161:0/2711973501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bb4141b30 0x7f3bb4133740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3bb259c640 1 -- 172.21.15.161:0/2711973501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac009b30 con 0x7f3bb40b8020 2024-02-02T11:49:07.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3bb2d9d640 1 --2- 172.21.15.161:0/2711973501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bb4141b30 0x7f3bb4133740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:07.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3bb1d9b640 1 --2- 172.21.15.161:0/2711973501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bb40bc340 0x7f3bb414a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:07.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3bb259c640 1 --2- 172.21.15.161:0/2711973501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bb40b8020 0x7f3bb4145b60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0b1040 tx=0x7f3bac01b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:07.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3baaffd640 1 -- 172.21.15.161:0/2711973501 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac007c30 con 0x7f3bb40b8020 2024-02-02T11:49:07.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3baaffd640 1 -- 172.21.15.161:0/2711973501 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac007dd0 con 0x7f3bb40b8020 2024-02-02T11:49:07.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3bb8c71640 1 -- 172.21.15.161:0/2711973501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb4146270 con 0x7f3bb40b8020 2024-02-02T11:49:07.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3baaffd640 1 -- 172.21.15.161:0/2711973501 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0ba6b0 con 0x7f3bb40b8020 2024-02-02T11:49:07.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3bb8c71640 1 -- 172.21.15.161:0/2711973501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb4146ba0 con 0x7f3bb40b8020 2024-02-02T11:49:07.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3bb8c71640 1 -- 172.21.15.161:0/2711973501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb404e000 con 0x7f3bb40b8020 2024-02-02T11:49:07.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3baaffd640 1 -- 172.21.15.161:0/2711973501 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3bac0ba810 con 0x7f3bb40b8020 2024-02-02T11:49:07.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3baaffd640 1 --2- 172.21.15.161:0/2711973501 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3b94065a60 0x7f3b94067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:07.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3baaffd640 1 -- 172.21.15.161:0/2711973501 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bac120eb0 con 0x7f3bb40b8020 2024-02-02T11:49:07.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3bb1d9b640 1 --2- 172.21.15.161:0/2711973501 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3b94065a60 0x7f3b94067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:07.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.803+0000 7f3bb1d9b640 1 --2- 172.21.15.161:0/2711973501 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3b94065a60 0x7f3b94067f20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40b64d0 tx=0x7f3b9c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:07.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.807+0000 7f3baaffd640 1 -- 172.21.15.161:0/2711973501 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3bac0eeaa0 con 0x7f3bb40b8020 2024-02-02T11:49:07.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.955+0000 7f3bb8c71640 1 -- 172.21.15.161:0/2711973501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bb41487a0 con 0x7f3bb40b8020 2024-02-02T11:49:07.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.959+0000 7f3baaffd640 1 -- 172.21.15.161:0/2711973501 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f3bac0f20c0 con 0x7f3bb40b8020 2024-02-02T11:49:07.961 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:07.961 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":20,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:52.816101+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:48:50.155565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-02T11:48:50.795158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:49:07.963 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.959+0000 7f3bb8c71640 1 -- 172.21.15.161:0/2711973501 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3b94065a60 msgr2=0x7f3b94067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:07.963 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.959+0000 7f3bb8c71640 1 --2- 172.21.15.161:0/2711973501 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3b94065a60 0x7f3b94067f20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40b64d0 tx=0x7f3b9c008040 comp rx=0 tx=0).stop 2024-02-02T11:49:07.963 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.959+0000 7f3bb8c71640 1 -- 172.21.15.161:0/2711973501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bb40b8020 msgr2=0x7f3bb4145b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:07.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.959+0000 7f3bb8c71640 1 --2- 172.21.15.161:0/2711973501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bb40b8020 0x7f3bb4145b60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0b1040 tx=0x7f3bac01b910 comp rx=0 tx=0).stop 2024-02-02T11:49:07.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.959+0000 7f3bb8c71640 1 -- 172.21.15.161:0/2711973501 shutdown_connections 2024-02-02T11:49:07.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.959+0000 7f3bb8c71640 1 --2- 172.21.15.161:0/2711973501 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3b94065a60 0x7f3b94067f20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.959+0000 7f3bb8c71640 1 --2- 172.21.15.161:0/2711973501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bb4141b30 0x7f3bb4133740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.959+0000 7f3bb8c71640 1 --2- 172.21.15.161:0/2711973501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bb40bc340 0x7f3bb414a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.959+0000 7f3bb8c71640 1 --2- 172.21.15.161:0/2711973501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bb40b8020 0x7f3bb4145b60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:07.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.959+0000 7f3bb8c71640 1 -- 172.21.15.161:0/2711973501 >> 172.21.15.161:0/2711973501 conn(0x7f3bb4069ef0 msgr2=0x7f3bb413f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:07.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.959+0000 7f3bb8c71640 1 -- 172.21.15.161:0/2711973501 shutdown_connections 2024-02-02T11:49:07.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:07.959+0000 7f3bb8c71640 1 -- 172.21.15.161:0/2711973501 wait complete. 2024-02-02T11:49:07.978 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-02T11:49:08.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.083+0000 7fd1745cf640 1 Processor -- start 2024-02-02T11:49:08.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.083+0000 7fd1745cf640 1 -- start start 2024-02-02T11:49:08.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.083+0000 7fd1745cf640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd16c0b8020 0x7fd16c147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.083+0000 7fd1745cf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd16c070980 0x7fd16c1481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.083+0000 7fd1745cf640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd16c071550 con 0x7fd16c0bc340 2024-02-02T11:49:08.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.083+0000 7fd1745cf640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd16c141d00 con 0x7fd16c0b8020 2024-02-02T11:49:08.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.083+0000 7fd1745cf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c071810 con 0x7fd16c070980 2024-02-02T11:49:08.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.083+0000 7fd171b6a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd16c0b8020 0x7fd16c147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.083+0000 7fd17236b640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fd16c0bc340 0x7fd16c1415f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.161:39370/0 (socket says 172.21.15.161:39370) 2024-02-02T11:49:08.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.083+0000 7fd17236b640 1 -- 172.21.15.161:0/2031239969 learned_addr learned my addr 172.21.15.161:0/2031239969 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:08.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.083+0000 7fd172b6c640 1 --2- 172.21.15.161:0/2031239969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd16c070980 0x7fd16c1481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.083+0000 7fd171369640 1 -- 172.21.15.161:0/2031239969 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879550961 0 0) 0x7fd16c071550 con 0x7fd16c0bc340 2024-02-02T11:49:08.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.083+0000 7fd171369640 1 -- 172.21.15.161:0/2031239969 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd158003530 con 0x7fd16c0bc340 2024-02-02T11:49:08.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.083+0000 7fd171b6a640 1 -- 172.21.15.161:0/2031239969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd16c070980 msgr2=0x7fd16c1481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:08.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.083+0000 7fd171b6a640 1 --2- 172.21.15.161:0/2031239969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd16c070980 0x7fd16c1481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.083+0000 7fd171b6a640 1 -- 172.21.15.161:0/2031239969 >> v1:172.21.15.162:6789/0 conn(0x7fd16c0bc340 legacy=0x7fd16c1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:08.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.083+0000 7fd171b6a640 1 -- 172.21.15.161:0/2031239969 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16c0bc720 con 0x7fd16c0b8020 2024-02-02T11:49:08.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.083+0000 7fd172b6c640 1 --2- 172.21.15.161:0/2031239969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd16c070980 0x7fd16c1481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-02T11:49:08.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd171b6a640 1 --2- 172.21.15.161:0/2031239969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd16c0b8020 0x7fd16c147c60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd160009d90 tx=0x7fd16001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8f6eb4b71cb04f4 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:08.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd171369640 1 -- 172.21.15.161:0/2031239969 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1600a6680 con 0x7fd16c0b8020 2024-02-02T11:49:08.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd171369640 1 -- 172.21.15.161:0/2031239969 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1600a67e0 con 0x7fd16c0b8020 2024-02-02T11:49:08.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd171369640 1 -- 172.21.15.161:0/2031239969 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1600a6b70 con 0x7fd16c0b8020 2024-02-02T11:49:08.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd1745cf640 1 -- 172.21.15.161:0/2031239969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd16c0b8020 msgr2=0x7fd16c147c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:08.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd1745cf640 1 --2- 172.21.15.161:0/2031239969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd16c0b8020 0x7fd16c147c60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd160009d90 tx=0x7fd16001c8c0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd1745cf640 1 -- 172.21.15.161:0/2031239969 shutdown_connections 2024-02-02T11:49:08.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd1745cf640 1 --2- 172.21.15.161:0/2031239969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd16c070980 0x7fd16c1481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd1745cf640 1 --2- 172.21.15.161:0/2031239969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd16c0b8020 0x7fd16c147c60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd1745cf640 1 -- 172.21.15.161:0/2031239969 >> 172.21.15.161:0/2031239969 conn(0x7fd16c069ef0 msgr2=0x7fd16c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:08.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd1745cf640 1 -- 172.21.15.161:0/2031239969 shutdown_connections 2024-02-02T11:49:08.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd1745cf640 1 -- 172.21.15.161:0/2031239969 wait complete. 2024-02-02T11:49:08.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd1745cf640 1 Processor -- start 2024-02-02T11:49:08.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd1745cf640 1 -- start start 2024-02-02T11:49:08.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd1745cf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd16c070980 0x7fd16c1e3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd1745cf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd16c0b8020 0x7fd16c0ba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd1745cf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd16c0bc340 0x7fd16c0b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd1745cf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c0b5c50 con 0x7fd16c070980 2024-02-02T11:49:08.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd1745cf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c137160 con 0x7fd16c0b8020 2024-02-02T11:49:08.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd1745cf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c136ba0 con 0x7fd16c0bc340 2024-02-02T11:49:08.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd17236b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd16c070980 0x7fd16c1e3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd17236b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd16c070980 0x7fd16c1e3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39968/0 (socket says 172.21.15.161:39968) 2024-02-02T11:49:08.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.087+0000 7fd17236b640 1 -- 172.21.15.161:0/4171351813 learned_addr learned my addr 172.21.15.161:0/4171351813 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:08.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.091+0000 7fd171b6a640 1 --2- 172.21.15.161:0/4171351813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd16c0b8020 0x7fd16c0ba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.091+0000 7fd172b6c640 1 --2- 172.21.15.161:0/4171351813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd16c0bc340 0x7fd16c0b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.091+0000 7fd17236b640 1 -- 172.21.15.161:0/4171351813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd16c0bc340 msgr2=0x7fd16c0b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:08.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.091+0000 7fd17236b640 1 --2- 172.21.15.161:0/4171351813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd16c0bc340 0x7fd16c0b5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.091+0000 7fd17236b640 1 -- 172.21.15.161:0/4171351813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd16c0b8020 msgr2=0x7fd16c0ba4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:08.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.091+0000 7fd17236b640 1 --2- 172.21.15.161:0/4171351813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd16c0b8020 0x7fd16c0ba4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.091+0000 7fd17236b640 1 -- 172.21.15.161:0/4171351813 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd164009420 con 0x7fd16c070980 2024-02-02T11:49:08.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.091+0000 7fd17236b640 1 --2- 172.21.15.161:0/4171351813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd16c070980 0x7fd16c1e3630 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd16800c500 tx=0x7fd16800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:08.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.091+0000 7fd15effd640 1 -- 172.21.15.161:0/4171351813 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd168005cf0 con 0x7fd16c070980 2024-02-02T11:49:08.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.091+0000 7fd15effd640 1 -- 172.21.15.161:0/4171351813 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd168005e50 con 0x7fd16c070980 2024-02-02T11:49:08.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.091+0000 7fd15effd640 1 -- 172.21.15.161:0/4171351813 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1680072f0 con 0x7fd16c070980 2024-02-02T11:49:08.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.091+0000 7fd1745cf640 1 -- 172.21.15.161:0/4171351813 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd160009a70 con 0x7fd16c070980 2024-02-02T11:49:08.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.091+0000 7fd1745cf640 1 -- 172.21.15.161:0/4171351813 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16c0b9fd0 con 0x7fd16c070980 2024-02-02T11:49:08.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.091+0000 7fd1745cf640 1 -- 172.21.15.161:0/4171351813 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd16c0ba1c0 con 0x7fd16c070980 2024-02-02T11:49:08.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.091+0000 7fd15effd640 1 -- 172.21.15.161:0/4171351813 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd168007450 con 0x7fd16c070980 2024-02-02T11:49:08.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.091+0000 7fd15effd640 1 --2- 172.21.15.161:0/4171351813 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd150065a60 0x7fd150067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.091+0000 7fd15effd640 1 -- 172.21.15.161:0/4171351813 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd168082660 con 0x7fd16c070980 2024-02-02T11:49:08.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.091+0000 7fd171b6a640 1 --2- 172.21.15.161:0/4171351813 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd150065a60 0x7fd150067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.091+0000 7fd171b6a640 1 --2- 172.21.15.161:0/4171351813 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd150065a60 0x7fd150067f20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd1600ae000 tx=0x7fd1600a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:08.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.095+0000 7fd15effd640 1 -- 172.21.15.161:0/4171351813 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd168050160 con 0x7fd16c070980 2024-02-02T11:49:08.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.267+0000 7fd1745cf640 1 -- 172.21.15.161:0/4171351813 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd16c04e000 con 0x7fd16c070980 2024-02-02T11:49:08.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.267+0000 7fd15effd640 1 -- 172.21.15.161:0/4171351813 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3953 (secure 0 0 0) 0x7fd168053780 con 0x7fd16c070980 2024-02-02T11:49:08.271 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:08.272 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3677988163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3677988163},{"type":"v1","addr":"172.21.15.162:6833","nonce":3677988163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/456037269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":456037269},{"type":"v1","addr":"172.21.15.161:6835","nonce":456037269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-02T11:48:51.812809+0000","modified":"2024-02-02T11:48:54.494091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/2509813318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":2509813318},{"type":"v1","addr":"172.21.15.161:6837","nonce":2509813318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-02T11:49:08.272 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 7 2024-02-02T11:49:08.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.271+0000 7fd1745cf640 1 -- 172.21.15.161:0/4171351813 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd150065a60 msgr2=0x7fd150067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:08.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.271+0000 7fd1745cf640 1 --2- 172.21.15.161:0/4171351813 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd150065a60 0x7fd150067f20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd1600ae000 tx=0x7fd1600a7000 comp rx=0 tx=0).stop 2024-02-02T11:49:08.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.271+0000 7fd1745cf640 1 -- 172.21.15.161:0/4171351813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd16c070980 msgr2=0x7fd16c1e3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:08.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.271+0000 7fd1745cf640 1 --2- 172.21.15.161:0/4171351813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd16c070980 0x7fd16c1e3630 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd16800c500 tx=0x7fd16800c9c0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.271+0000 7fd1745cf640 1 -- 172.21.15.161:0/4171351813 shutdown_connections 2024-02-02T11:49:08.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.271+0000 7fd1745cf640 1 --2- 172.21.15.161:0/4171351813 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd150065a60 0x7fd150067f20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.271+0000 7fd1745cf640 1 --2- 172.21.15.161:0/4171351813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd16c0bc340 0x7fd16c0b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.271+0000 7fd1745cf640 1 --2- 172.21.15.161:0/4171351813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd16c0b8020 0x7fd16c0ba4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.271+0000 7fd1745cf640 1 --2- 172.21.15.161:0/4171351813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd16c070980 0x7fd16c1e3630 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.271+0000 7fd1745cf640 1 -- 172.21.15.161:0/4171351813 >> 172.21.15.161:0/4171351813 conn(0x7fd16c069ef0 msgr2=0x7fd16c1413c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:08.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.271+0000 7fd1745cf640 1 -- 172.21.15.161:0/4171351813 shutdown_connections 2024-02-02T11:49:08.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.271+0000 7fd1745cf640 1 -- 172.21.15.161:0/4171351813 wait complete. 2024-02-02T11:49:08.591 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-02T11:48:51.812809+0000', 'modified': '2024-02-02T11:48:54.494091+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4263}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4263': {'gid': 4263, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.161:6837/2509813318', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6836', 'nonce': 2509813318}, {'type': 'v1', 'addr': '172.21.15.161:6837', 'nonce': 2509813318}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-02T11:49:08.591 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-02T11:49:08.591 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-02-02T11:49:08.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.711+0000 7fbe37ad5640 1 Processor -- start 2024-02-02T11:49:08.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.711+0000 7fbe37ad5640 1 -- start start 2024-02-02T11:49:08.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.711+0000 7fbe37ad5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbe3006f4f0 0x7fbe3006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.711+0000 7fbe37ad5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe3014ded0 0x7fbe3014e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.711+0000 7fbe37ad5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe300707e0 con 0x7fbe300bc340 2024-02-02T11:49:08.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.711+0000 7fbe37ad5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe300703c0 con 0x7fbe3006f4f0 2024-02-02T11:49:08.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.711+0000 7fbe37ad5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe300b8750 con 0x7fbe3014ded0 2024-02-02T11:49:08.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.711+0000 7fbe35070640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbe3006f4f0 0x7fbe3006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.711+0000 7fbe35070640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbe3006f4f0 0x7fbe3006eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39984/0 (socket says 172.21.15.161:39984) 2024-02-02T11:49:08.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.711+0000 7fbe35070640 1 -- 172.21.15.161:0/4046059797 learned_addr learned my addr 172.21.15.161:0/4046059797 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:08.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.711+0000 7fbe36072640 1 --2- 172.21.15.161:0/4046059797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe3014ded0 0x7fbe3014e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.711+0000 7fbe35070640 1 -- 172.21.15.161:0/4046059797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe3014ded0 msgr2=0x7fbe3014e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:08.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.711+0000 7fbe35070640 1 --2- 172.21.15.161:0/4046059797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe3014ded0 0x7fbe3014e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.711+0000 7fbe35070640 1 -- 172.21.15.161:0/4046059797 >> v1:172.21.15.162:6789/0 conn(0x7fbe300bc340 legacy=0x7fbe30144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:08.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.711+0000 7fbe35070640 1 -- 172.21.15.161:0/4046059797 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3006fa10 con 0x7fbe3006f4f0 2024-02-02T11:49:08.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe35070640 1 --2- 172.21.15.161:0/4046059797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe3006f4f0 0x7fbe3006eeb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbe24009e50 tx=0x7fbe2401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7281ff959f5f1f6a server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:08.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe3486f640 1 -- 172.21.15.161:0/4046059797 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe240a5800 con 0x7fbe3006f4f0 2024-02-02T11:49:08.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe3486f640 1 -- 172.21.15.161:0/4046059797 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe240a5960 con 0x7fbe3006f4f0 2024-02-02T11:49:08.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe3486f640 1 -- 172.21.15.161:0/4046059797 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe240a5cf0 con 0x7fbe3006f4f0 2024-02-02T11:49:08.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe37ad5640 1 -- 172.21.15.161:0/4046059797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe3006f4f0 msgr2=0x7fbe3006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:08.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe37ad5640 1 --2- 172.21.15.161:0/4046059797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe3006f4f0 0x7fbe3006eeb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbe24009e50 tx=0x7fbe2401c9a0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe37ad5640 1 -- 172.21.15.161:0/4046059797 shutdown_connections 2024-02-02T11:49:08.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe37ad5640 1 --2- 172.21.15.161:0/4046059797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe3014ded0 0x7fbe3014e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe37ad5640 1 --2- 172.21.15.161:0/4046059797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe3006f4f0 0x7fbe3006eeb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe37ad5640 1 -- 172.21.15.161:0/4046059797 >> 172.21.15.161:0/4046059797 conn(0x7fbe30069ef0 msgr2=0x7fbe3006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:08.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe37ad5640 1 -- 172.21.15.161:0/4046059797 shutdown_connections 2024-02-02T11:49:08.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe37ad5640 1 -- 172.21.15.161:0/4046059797 wait complete. 2024-02-02T11:49:08.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe37ad5640 1 Processor -- start 2024-02-02T11:49:08.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe37ad5640 1 -- start start 2024-02-02T11:49:08.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe37ad5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe3006f4f0 0x7fbe3013d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe37ad5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe300bc340 0x7fbe3013db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe37ad5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe3014ded0 0x7fbe30134910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe37ad5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3013ba30 con 0x7fbe300bc340 2024-02-02T11:49:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe37ad5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe30137400 con 0x7fbe3006f4f0 2024-02-02T11:49:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.715+0000 7fbe37ad5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3013e0c0 con 0x7fbe3014ded0 2024-02-02T11:49:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe35070640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe300bc340 0x7fbe3013db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe35070640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe300bc340 0x7fbe3013db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39990/0 (socket says 172.21.15.161:39990) 2024-02-02T11:49:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe35070640 1 -- 172.21.15.161:0/3242989032 learned_addr learned my addr 172.21.15.161:0/3242989032 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe36072640 1 --2- 172.21.15.161:0/3242989032 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe3014ded0 0x7fbe30134910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe35871640 1 --2- 172.21.15.161:0/3242989032 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe3006f4f0 0x7fbe3013d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe35070640 1 -- 172.21.15.161:0/3242989032 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe3014ded0 msgr2=0x7fbe30134910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe35070640 1 --2- 172.21.15.161:0/3242989032 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe3014ded0 0x7fbe30134910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe35070640 1 -- 172.21.15.161:0/3242989032 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe3006f4f0 msgr2=0x7fbe3013d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe35070640 1 --2- 172.21.15.161:0/3242989032 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe3006f4f0 0x7fbe3013d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe35070640 1 -- 172.21.15.161:0/3242989032 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe24009b30 con 0x7fbe300bc340 2024-02-02T11:49:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe35871640 1 --2- 172.21.15.161:0/3242989032 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe3006f4f0 0x7fbe3013d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:49:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe35070640 1 --2- 172.21.15.161:0/3242989032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe300bc340 0x7fbe3013db80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbe2401b050 tx=0x7fbe24019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe2e7fc640 1 -- 172.21.15.161:0/3242989032 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe240b8670 con 0x7fbe300bc340 2024-02-02T11:49:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe2e7fc640 1 -- 172.21.15.161:0/3242989032 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe240b87d0 con 0x7fbe300bc340 2024-02-02T11:49:08.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe2e7fc640 1 -- 172.21.15.161:0/3242989032 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe240b8b60 con 0x7fbe300bc340 2024-02-02T11:49:08.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe37ad5640 1 -- 172.21.15.161:0/3242989032 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe30139970 con 0x7fbe300bc340 2024-02-02T11:49:08.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe37ad5640 1 -- 172.21.15.161:0/3242989032 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe30134eb0 con 0x7fbe300bc340 2024-02-02T11:49:08.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe2e7fc640 1 -- 172.21.15.161:0/3242989032 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbe240b8cc0 con 0x7fbe300bc340 2024-02-02T11:49:08.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe2e7fc640 1 --2- 172.21.15.161:0/3242989032 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbe1c065a60 0x7fbe1c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe2e7fc640 1 -- 172.21.15.161:0/3242989032 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe2411e750 con 0x7fbe300bc340 2024-02-02T11:49:08.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe35871640 1 --2- 172.21.15.161:0/3242989032 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbe1c065a60 0x7fbe1c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe35871640 1 --2- 172.21.15.161:0/3242989032 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbe1c065a60 0x7fbe1c067f20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbe28003ec0 tx=0x7fbe28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:08.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe3abfe000 1 Processor -- start 2024-02-02T11:49:08.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe3abfe000 1 -- start start 2024-02-02T11:49:08.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe3abfe000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563754b5f6e0 0x563754b5fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe3abfe000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b60000 0x563754b603e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.719+0000 7fbe3abfe000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563754b60920 0x563754b6a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56375494ec90 con 0x563754b60000 2024-02-02T11:49:08.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563754980220 con 0x563754b5f6e0 2024-02-02T11:49:08.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x56375497d7f0 con 0x563754b60920 2024-02-02T11:49:08.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35070640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b60000 0x563754b603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35070640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b60000 0x563754b603e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40002/0 (socket says 172.21.15.161:40002) 2024-02-02T11:49:08.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35070640 1 -- 172.21.15.161:0/647697765 learned_addr learned my addr 172.21.15.161:0/647697765 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:08.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35871640 1 --2- 172.21.15.161:0/647697765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563754b5f6e0 0x563754b5fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35070640 1 -- 172.21.15.161:0/647697765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563754b60920 msgr2=0x563754b6a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:08.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe36072640 1 --2- 172.21.15.161:0/647697765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563754b60920 0x563754b6a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35070640 1 --2- 172.21.15.161:0/647697765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563754b60920 0x563754b6a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35070640 1 -- 172.21.15.161:0/647697765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563754b5f6e0 msgr2=0x563754b5fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:08.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35070640 1 --2- 172.21.15.161:0/647697765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563754b5f6e0 0x563754b5fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35070640 1 -- 172.21.15.161:0/647697765 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563754675890 con 0x563754b60000 2024-02-02T11:49:08.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35070640 1 --2- 172.21.15.161:0/647697765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b60000 0x563754b603e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbe240f7a10 tx=0x7fbe24009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3756c3e46553499d server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:08.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe177fe640 1 -- 172.21.15.161:0/647697765 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe240f3d90 con 0x563754b60000 2024-02-02T11:49:08.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe177fe640 1 -- 172.21.15.161:0/647697765 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe240f7f40 con 0x563754b60000 2024-02-02T11:49:08.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe177fe640 1 -- 172.21.15.161:0/647697765 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe240ec670 con 0x563754b60000 2024-02-02T11:49:08.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 -- 172.21.15.161:0/647697765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b60000 msgr2=0x563754b603e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:08.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/647697765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b60000 0x563754b603e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbe240f7a10 tx=0x7fbe24009810 comp rx=0 tx=0).stop 2024-02-02T11:49:08.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 -- 172.21.15.161:0/647697765 shutdown_connections 2024-02-02T11:49:08.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/647697765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563754b60920 0x563754b6a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/647697765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b60000 0x563754b603e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/647697765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563754b5f6e0 0x563754b5fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 -- 172.21.15.161:0/647697765 >> 172.21.15.161:0/647697765 conn(0x563754b5b490 msgr2=0x563754b5d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:08.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 -- 172.21.15.161:0/647697765 shutdown_connections 2024-02-02T11:49:08.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 -- 172.21.15.161:0/647697765 wait complete. 2024-02-02T11:49:08.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 -- start start 2024-02-02T11:49:08.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 Processor -- start 2024-02-02T11:49:08.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5f6e0 0x563754b5a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563754b60000 0x563754b5aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563754b60920 0x563754b2ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637549790e0 con 0x563754b5f6e0 2024-02-02T11:49:08.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563754918310 con 0x563754b60920 2024-02-02T11:49:08.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x563754936770 con 0x563754b60000 2024-02-02T11:49:08.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 10 client.0 _ll_register_callbacks cb 0x563754b16b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-02T11:49:08.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35871640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5f6e0 0x563754b5a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35871640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5f6e0 0x563754b5a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40012/0 (socket says 172.21.15.161:40012) 2024-02-02T11:49:08.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35871640 1 -- 172.21.15.161:0/2305856451 learned_addr learned my addr 172.21.15.161:0/2305856451 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:08.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35070640 1 --2- 172.21.15.161:0/2305856451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563754b60000 0x563754b5aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe36072640 1 --2- 172.21.15.161:0/2305856451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563754b60920 0x563754b2ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35871640 1 -- 172.21.15.161:0/2305856451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563754b60000 msgr2=0x563754b5aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:08.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35871640 1 --2- 172.21.15.161:0/2305856451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563754b60000 0x563754b5aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35871640 1 -- 172.21.15.161:0/2305856451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563754b60920 msgr2=0x563754b2ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:08.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35871640 1 --2- 172.21.15.161:0/2305856451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563754b60920 0x563754b2ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35871640 1 -- 172.21.15.161:0/2305856451 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe30134eb0 con 0x563754b5f6e0 2024-02-02T11:49:08.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35871640 1 --2- 172.21.15.161:0/2305856451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5f6e0 0x563754b5a660 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbe28006f00 tx=0x7fbe28003770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8612a4024b85487 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:08.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2024-02-02T11:49:08.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe14ff9640 1 -- 172.21.15.161:0/2305856451 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28003ad0 con 0x563754b5f6e0 2024-02-02T11:49:08.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe14ff9640 1 -- 172.21.15.161:0/2305856451 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe28024ab0 con 0x563754b5f6e0 2024-02-02T11:49:08.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 -- 172.21.15.161:0/2305856451 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563754948c10 con 0x563754b5f6e0 2024-02-02T11:49:08.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe14ff9640 1 -- 172.21.15.161:0/2305856451 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe28024cb0 con 0x563754b5f6e0 2024-02-02T11:49:08.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 10 client.4653 fetch_fsmap learned FSMap version 7 2024-02-02T11:49:08.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 -- 172.21.15.161:0/2305856451 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56375493e260 con 0x563754b5f6e0 2024-02-02T11:49:08.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe14ff9640 1 -- 172.21.15.161:0/2305856451 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563754948c10 con 0x563754b5f6e0 2024-02-02T11:49:08.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe14ff9640 1 -- 172.21.15.161:0/2305856451 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 7) v1 ==== 2569+0+0 (secure 0 0 0) 0x7fbe28021070 con 0x563754b5f6e0 2024-02-02T11:49:08.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 10 client.4653 fetch_fsmap finished waiting for FSMap version 7 2024-02-02T11:49:08.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 10 client.4653 resolve_mds: resolved name 'c' to daemon mds.c 2024-02-02T11:49:08.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 20 client.4653 populate_metadata read hostname 'smithi161' 2024-02-02T11:49:08.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/2305856451 >> [v2:172.21.15.161:6836/2509813318,v1:172.21.15.161:6837/2509813318] conn(0x563754b2d7f0 0x563754b2dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 4 client.4653 mds_command: new command op to 4263 tid=0[{"prefix": "get_command_descriptions"}] 2024-02-02T11:49:08.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe3abfe000 1 -- 172.21.15.161:0/2305856451 --> [v2:172.21.15.161:6836/2509813318,v1:172.21.15.161:6837/2509813318] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563754977a30 con 0x563754b2d7f0 2024-02-02T11:49:08.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.723+0000 7fbe35070640 1 --2- 172.21.15.161:0/2305856451 >> [v2:172.21.15.161:6836/2509813318,v1:172.21.15.161:6837/2509813318] conn(0x563754b2d7f0 0x563754b2dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.727+0000 7fbe35070640 1 --2- 172.21.15.161:0/2305856451 >> [v2:172.21.15.161:6836/2509813318,v1:172.21.15.161:6837/2509813318] conn(0x563754b2d7f0 0x563754b2dbd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7093b3721fb0bd6 server_cookie=4fc39885a597bf81 in_seq=0 out_seq=0 2024-02-02T11:49:08.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.727+0000 7fbe14ff9640 10 client.4653 ms_handle_connect on v2:172.21.15.161:6836/2509813318 2024-02-02T11:49:08.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.727+0000 7fbe14ff9640 1 -- 172.21.15.161:0/2305856451 <== mds.0 v2:172.21.15.161:6836/2509813318 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x563754977a30 con 0x563754b2d7f0 2024-02-02T11:49:08.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.727+0000 7fbe14ff9640 10 client.4653 handle_command_reply: tid=0 2024-02-02T11:49:08.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.727+0000 7fbe3abfe000 1 client.4653 shutdown 2024-02-02T11:49:08.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.727+0000 7fbe3abfe000 1 -- 172.21.15.161:0/2305856451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5f6e0 msgr2=0x563754b5a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:08.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.727+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/2305856451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5f6e0 0x563754b5a660 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbe28006f00 tx=0x7fbe28003770 comp rx=0 tx=0).stop 2024-02-02T11:49:08.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.727+0000 7fbe3abfe000 1 -- 172.21.15.161:0/2305856451 shutdown_connections 2024-02-02T11:49:08.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.727+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/2305856451 >> [v2:172.21.15.161:6836/2509813318,v1:172.21.15.161:6837/2509813318] conn(0x563754b2d7f0 0x563754b2dbd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.727+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/2305856451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563754b60920 0x563754b2ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.727+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/2305856451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563754b60000 0x563754b5aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.727+0000 7fbe14ff9640 0 client.4653 ms_handle_reset on v2:172.21.15.161:6836/2509813318 2024-02-02T11:49:08.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.727+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/2305856451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5f6e0 0x563754b5a660 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.727+0000 7fbe3abfe000 1 -- 172.21.15.161:0/2305856451 >> 172.21.15.161:0/2305856451 conn(0x563754b5b490 msgr2=0x563754b5d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:08.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.727+0000 7fbe3abfe000 1 -- 172.21.15.161:0/2305856451 shutdown_connections 2024-02-02T11:49:08.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.727+0000 7fbe3abfe000 1 -- 172.21.15.161:0/2305856451 wait complete. 2024-02-02T11:49:08.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.727+0000 7fbe3abfe000 20 client.4653 trim_cache size 0 max 16384 2024-02-02T11:49:08.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.739+0000 7fbe3abfe000 1 Processor -- start 2024-02-02T11:49:08.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.739+0000 7fbe3abfe000 1 -- start start 2024-02-02T11:49:08.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.739+0000 7fbe3abfe000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563754b5b490 0x563754b2c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.739+0000 7fbe3abfe000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5f6e0 0x563754b5ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.739+0000 7fbe3abfe000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563754b60000 0x563754b5d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.739+0000 7fbe3abfe000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563754636940 con 0x563754b5f6e0 2024-02-02T11:49:08.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.739+0000 7fbe3abfe000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563754977f70 con 0x563754b60000 2024-02-02T11:49:08.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.739+0000 7fbe3abfe000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x563754977c20 con 0x563754b5b490 2024-02-02T11:49:08.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35070640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5f6e0 0x563754b5ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35070640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5f6e0 0x563754b5ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40016/0 (socket says 172.21.15.161:40016) 2024-02-02T11:49:08.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35070640 1 -- 172.21.15.161:0/2848711977 learned_addr learned my addr 172.21.15.161:0/2848711977 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:08.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35070640 1 -- 172.21.15.161:0/2848711977 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563754b5b490 msgr2=0x563754b2c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:08.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35070640 1 --2- 172.21.15.161:0/2848711977 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563754b5b490 0x563754b2c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35070640 1 -- 172.21.15.161:0/2848711977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563754b60000 msgr2=0x563754b5d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:08.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35070640 1 --2- 172.21.15.161:0/2848711977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563754b60000 0x563754b5d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35070640 1 -- 172.21.15.161:0/2848711977 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637549243b0 con 0x563754b5f6e0 2024-02-02T11:49:08.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35070640 1 --2- 172.21.15.161:0/2848711977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5f6e0 0x563754b5ecb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbe240093e0 tx=0x7fbe240c3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1c564ed65ed114 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:08.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe17fff640 1 -- 172.21.15.161:0/2848711977 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2411c040 con 0x563754b5f6e0 2024-02-02T11:49:08.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe17fff640 1 -- 172.21.15.161:0/2848711977 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe240f3d90 con 0x563754b5f6e0 2024-02-02T11:49:08.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe17fff640 1 -- 172.21.15.161:0/2848711977 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe240ee300 con 0x563754b5f6e0 2024-02-02T11:49:08.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 -- 172.21.15.161:0/2848711977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5f6e0 msgr2=0x563754b5ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:08.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/2848711977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5f6e0 0x563754b5ecb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbe240093e0 tx=0x7fbe240c3000 comp rx=0 tx=0).stop 2024-02-02T11:49:08.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 -- 172.21.15.161:0/2848711977 shutdown_connections 2024-02-02T11:49:08.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/2848711977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563754b60000 0x563754b5d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/2848711977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5f6e0 0x563754b5ecb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/2848711977 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563754b5b490 0x563754b2c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 -- 172.21.15.161:0/2848711977 >> 172.21.15.161:0/2848711977 conn(0x563754b71a60 msgr2=0x563754b31010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:08.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 -- 172.21.15.161:0/2848711977 shutdown_connections 2024-02-02T11:49:08.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 -- 172.21.15.161:0/2848711977 wait complete. 2024-02-02T11:49:08.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 -- start start 2024-02-02T11:49:08.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 Processor -- start 2024-02-02T11:49:08.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5b490 0x563754b79cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563754b5f6e0 0x563754b781b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563754b60000 0x563754b786f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563754b7ac60 con 0x563754b5b490 2024-02-02T11:49:08.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563754b5ac50 con 0x563754b60000 2024-02-02T11:49:08.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x563754b5a6b0 con 0x563754b5f6e0 2024-02-02T11:49:08.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 10 client.0 _ll_register_callbacks cb 0x563754937540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-02T11:49:08.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35871640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5b490 0x563754b79cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35871640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5b490 0x563754b79cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40024/0 (socket says 172.21.15.161:40024) 2024-02-02T11:49:08.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35871640 1 -- 172.21.15.161:0/3529304722 learned_addr learned my addr 172.21.15.161:0/3529304722 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:08.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35871640 1 -- 172.21.15.161:0/3529304722 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563754b5f6e0 msgr2=0x563754b781b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:08.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35871640 1 --2- 172.21.15.161:0/3529304722 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563754b5f6e0 0x563754b781b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35871640 1 -- 172.21.15.161:0/3529304722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563754b60000 msgr2=0x563754b786f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:08.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35871640 1 --2- 172.21.15.161:0/3529304722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563754b60000 0x563754b786f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35871640 1 -- 172.21.15.161:0/3529304722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563754675890 con 0x563754b5b490 2024-02-02T11:49:08.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35871640 1 --2- 172.21.15.161:0/3529304722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5b490 0x563754b79cc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbe28000c10 tx=0x7fbe28012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f65c43266d1526d server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:08.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2024-02-02T11:49:08.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe14ff9640 1 -- 172.21.15.161:0/3529304722 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2802d670 con 0x563754b5b490 2024-02-02T11:49:08.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe14ff9640 1 -- 172.21.15.161:0/3529304722 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe2802d7d0 con 0x563754b5b490 2024-02-02T11:49:08.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 -- 172.21.15.161:0/3529304722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56375493ee00 con 0x563754b5b490 2024-02-02T11:49:08.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe14ff9640 1 -- 172.21.15.161:0/3529304722 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe28003ab0 con 0x563754b5b490 2024-02-02T11:49:08.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 10 client.4659 fetch_fsmap learned FSMap version 7 2024-02-02T11:49:08.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 -- 172.21.15.161:0/3529304722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x563754675cc0 con 0x563754b5b490 2024-02-02T11:49:08.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe14ff9640 1 -- 172.21.15.161:0/3529304722 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56375493ee00 con 0x563754b5b490 2024-02-02T11:49:08.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe14ff9640 1 -- 172.21.15.161:0/3529304722 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 7) v1 ==== 2569+0+0 (secure 0 0 0) 0x7fbe28021040 con 0x563754b5b490 2024-02-02T11:49:08.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 10 client.4659 fetch_fsmap finished waiting for FSMap version 7 2024-02-02T11:49:08.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 10 client.4659 resolve_mds: resolved name 'c' to daemon mds.c 2024-02-02T11:49:08.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 20 client.4659 populate_metadata read hostname 'smithi161' 2024-02-02T11:49:08.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/3529304722 >> [v2:172.21.15.161:6836/2509813318,v1:172.21.15.161:6837/2509813318] conn(0x563754b60920 0x563754b78c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:08.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 4 client.4659 mds_command: new command op to 4263 tid=0[{"prefix": "status"}] 2024-02-02T11:49:08.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe3abfe000 1 -- 172.21.15.161:0/3529304722 --> [v2:172.21.15.161:6836/2509813318,v1:172.21.15.161:6837/2509813318] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563754972160 con 0x563754b60920 2024-02-02T11:49:08.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35070640 1 --2- 172.21.15.161:0/3529304722 >> [v2:172.21.15.161:6836/2509813318,v1:172.21.15.161:6837/2509813318] conn(0x563754b60920 0x563754b78c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:08.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe14ff9640 10 client.4659 ms_handle_connect on v2:172.21.15.161:6836/2509813318 2024-02-02T11:49:08.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.743+0000 7fbe35070640 1 --2- 172.21.15.161:0/3529304722 >> [v2:172.21.15.161:6836/2509813318,v1:172.21.15.161:6837/2509813318] conn(0x563754b60920 0x563754b78c30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cad756aa539b6bb1 server_cookie=dc68fc94ef9cb4a5 in_seq=0 out_seq=0 2024-02-02T11:49:08.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe14ff9640 1 -- 172.21.15.161:0/3529304722 <== mds.0 v2:172.21.15.161:6836/2509813318 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x563754972160 con 0x563754b60920 2024-02-02T11:49:08.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe14ff9640 10 client.4659 handle_command_reply: tid=0 2024-02-02T11:49:08.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe3abfe000 1 client.4659 shutdown 2024-02-02T11:49:08.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe3abfe000 1 -- 172.21.15.161:0/3529304722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5b490 msgr2=0x563754b79cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:08.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/3529304722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5b490 0x563754b79cc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbe28000c10 tx=0x7fbe28012000 comp rx=0 tx=0).stop 2024-02-02T11:49:08.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe3abfe000 1 -- 172.21.15.161:0/3529304722 shutdown_connections 2024-02-02T11:49:08.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/3529304722 >> [v2:172.21.15.161:6836/2509813318,v1:172.21.15.161:6837/2509813318] conn(0x563754b60920 0x563754b78c30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/3529304722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563754b60000 0x563754b786f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/3529304722 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563754b5f6e0 0x563754b781b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe14ff9640 0 client.4659 ms_handle_reset on v2:172.21.15.161:6836/2509813318 2024-02-02T11:49:08.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe3abfe000 1 --2- 172.21.15.161:0/3529304722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x563754b5b490 0x563754b79cc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe3abfe000 1 -- 172.21.15.161:0/3529304722 >> 172.21.15.161:0/3529304722 conn(0x563754b71a60 msgr2=0x563754b30e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:08.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe3abfe000 1 -- 172.21.15.161:0/3529304722 shutdown_connections 2024-02-02T11:49:08.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe3abfe000 1 -- 172.21.15.161:0/3529304722 wait complete. 2024-02-02T11:49:08.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe3abfe000 20 client.4659 trim_cache size 0 max 16384 2024-02-02T11:49:08.756 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-02-02T11:49:08.756 INFO:teuthology.orchestra.run.smithi161.stdout: "cluster_fsid": "6072f293-dbe3-404b-82f1-eb0e17d96787", 2024-02-02T11:49:08.756 INFO:teuthology.orchestra.run.smithi161.stdout: "whoami": 0, 2024-02-02T11:49:08.756 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 4263, 2024-02-02T11:49:08.756 INFO:teuthology.orchestra.run.smithi161.stdout: "want_state": "up:active", 2024-02-02T11:49:08.756 INFO:teuthology.orchestra.run.smithi161.stdout: "state": "up:active", 2024-02-02T11:49:08.756 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs", 2024-02-02T11:49:08.756 INFO:teuthology.orchestra.run.smithi161.stdout: "rank_uptime": 16.932806770999999, 2024-02-02T11:49:08.756 INFO:teuthology.orchestra.run.smithi161.stdout: "mdsmap_epoch": 7, 2024-02-02T11:49:08.756 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch": 20, 2024-02-02T11:49:08.756 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch_barrier": 20, 2024-02-02T11:49:08.757 INFO:teuthology.orchestra.run.smithi161.stdout: "uptime": 22.973234176999998 2024-02-02T11:49:08.757 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-02-02T11:49:08.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe37ad5640 1 -- 172.21.15.161:0/3242989032 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbe1c065a60 msgr2=0x7fbe1c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:08.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe37ad5640 1 --2- 172.21.15.161:0/3242989032 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbe1c065a60 0x7fbe1c067f20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbe28003ec0 tx=0x7fbe28009040 comp rx=0 tx=0).stop 2024-02-02T11:49:08.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe37ad5640 1 -- 172.21.15.161:0/3242989032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe300bc340 msgr2=0x7fbe3013db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:08.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe37ad5640 1 --2- 172.21.15.161:0/3242989032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe300bc340 0x7fbe3013db80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbe2401b050 tx=0x7fbe24019740 comp rx=0 tx=0).stop 2024-02-02T11:49:08.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe37ad5640 1 -- 172.21.15.161:0/3242989032 shutdown_connections 2024-02-02T11:49:08.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe37ad5640 1 --2- 172.21.15.161:0/3242989032 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbe1c065a60 0x7fbe1c067f20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe37ad5640 1 --2- 172.21.15.161:0/3242989032 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe3014ded0 0x7fbe30134910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe37ad5640 1 --2- 172.21.15.161:0/3242989032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe300bc340 0x7fbe3013db80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe37ad5640 1 --2- 172.21.15.161:0/3242989032 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe3006f4f0 0x7fbe3013d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:08.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe37ad5640 1 -- 172.21.15.161:0/3242989032 >> 172.21.15.161:0/3242989032 conn(0x7fbe30069ef0 msgr2=0x7fbe30143720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:08.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe37ad5640 1 -- 172.21.15.161:0/3242989032 shutdown_connections 2024-02-02T11:49:08.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.747+0000 7fbe37ad5640 1 -- 172.21.15.161:0/3242989032 wait complete. 2024-02-02T11:49:08.764 INFO:teuthology.run_tasks:Running task kclient... 2024-02-02T11:49:08.789 INFO:tasks.kclient:Mounting kernel clients... 2024-02-02T11:49:08.789 INFO:tasks.kclient:config is {'client.0': {}} 2024-02-02T11:49:08.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:08.790 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-02-02T11:49:08.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:08.802 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2024-02-02T11:49:08.869 INFO:teuthology.orchestra.run.smithi177.stderr:Cannot find device "ceph-brx" 2024-02-02T11:49:08.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-02T11:49:08.871 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-02-02T11:49:08.871 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-02T11:49:08.871 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-02T11:49:08.872 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-02T11:49:08.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f2a0038a640 1 Processor -- start 2024-02-02T11:49:08.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f2a0038a640 1 -- start start 2024-02-02T11:49:08.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f2a0038a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29f80b9900 0x7f29f80b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:09.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f2a0038a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f29f81429f0 0x7f29f8142df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:09.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f2a0038a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f80b3c40 con 0x7f29f8071160 2024-02-02T11:49:09.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f2a0038a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f80b5140 con 0x7f29f81429f0 2024-02-02T11:49:09.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f2a0038a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80b9d70 con 0x7f29f80b9900 2024-02-02T11:49:09.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fe126640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f29f8071160 0x7f29f80b8ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:57596/0 (socket says 172.21.15.161:57596) 2024-02-02T11:49:09.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fe126640 1 -- 172.21.15.161:0/1284936227 learned_addr learned my addr 172.21.15.161:0/1284936227 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:09.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fd925640 1 --2- 172.21.15.161:0/1284936227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29f80b9900 0x7f29f80b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:09.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fe927640 1 --2- 172.21.15.161:0/1284936227 >> v2:172.21.15.162:3300/0 conn(0x7f29f81429f0 0x7f29f8142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:09.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fd124640 1 -- 172.21.15.161:0/1284936227 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35715957 0 0) 0x7f29f80b3c40 con 0x7f29f8071160 2024-02-02T11:49:09.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fd124640 1 -- 172.21.15.161:0/1284936227 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29e4003530 con 0x7f29f8071160 2024-02-02T11:49:09.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fd124640 1 -- 172.21.15.161:0/1284936227 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 188330514 0 0) 0x7f29e4003530 con 0x7f29f8071160 2024-02-02T11:49:09.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fd124640 1 -- 172.21.15.161:0/1284936227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29f80b9900 msgr2=0x7f29f80b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:09.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fd124640 1 --2- 172.21.15.161:0/1284936227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29f80b9900 0x7f29f80b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:09.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fd124640 1 -- 172.21.15.161:0/1284936227 >> v2:172.21.15.162:3300/0 conn(0x7f29f81429f0 msgr2=0x7f29f8142df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:09.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fd124640 1 --2- 172.21.15.161:0/1284936227 >> v2:172.21.15.162:3300/0 conn(0x7f29f81429f0 0x7f29f8142df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:09.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fd124640 1 -- 172.21.15.161:0/1284936227 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f80b9f60 con 0x7f29f8071160 2024-02-02T11:49:09.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fd124640 1 -- 172.21.15.161:0/1284936227 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f29f4001680 con 0x7f29f8071160 2024-02-02T11:49:09.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fd124640 1 -- 172.21.15.161:0/1284936227 >> v1:172.21.15.161:6789/0 conn(0x7f29f8071160 legacy=0x7f29f80b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:09.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fd124640 1 --2- 172.21.15.161:0/1284936227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29f80b9900 0x7f29e4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:09.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fd124640 1 --2- 172.21.15.161:0/1284936227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29e4003f00 0x7f29e40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:09.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fd124640 1 --2- 172.21.15.161:0/1284936227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29e4004d10 0x7f29e4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:09.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fd124640 1 -- 172.21.15.161:0/1284936227 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80b5140 con 0x7f29e4004d10 2024-02-02T11:49:09.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fd124640 1 -- 172.21.15.161:0/1284936227 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80b9d70 con 0x7f29e4003f00 2024-02-02T11:49:09.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fd124640 1 -- 172.21.15.161:0/1284936227 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e400b990 con 0x7f29f80b9900 2024-02-02T11:49:09.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fe927640 1 --2- 172.21.15.161:0/1284936227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29e4004d10 0x7f29e4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:09.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fd925640 1 --2- 172.21.15.161:0/1284936227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29e4003f00 0x7f29e40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:09.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fe126640 1 --2- 172.21.15.161:0/1284936227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29f80b9900 0x7f29e4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:09.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fe927640 1 -- 172.21.15.161:0/1284936227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29f80b9900 msgr2=0x7f29e4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:09.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fe927640 1 --2- 172.21.15.161:0/1284936227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29f80b9900 0x7f29e4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:09.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fe927640 1 -- 172.21.15.161:0/1284936227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29e4003f00 msgr2=0x7f29e40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:09.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fe927640 1 --2- 172.21.15.161:0/1284936227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29e4003f00 0x7f29e40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:09.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fe927640 1 -- 172.21.15.161:0/1284936227 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e4003530 con 0x7f29e4004d10 2024-02-02T11:49:09.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fe126640 1 --2- 172.21.15.161:0/1284936227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29f80b9900 0x7f29e4003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:09.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.995+0000 7f29fd925640 1 --2- 172.21.15.161:0/1284936227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29e4003f00 0x7f29e40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:09.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f29fe927640 1 --2- 172.21.15.161:0/1284936227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29e4004d10 0x7f29e4005190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009fc0 tx=0x7f29f001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e80993a7fc580 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:09.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f29fd124640 1 -- 172.21.15.161:0/1284936227 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f00a5cb0 con 0x7f29e4004d10 2024-02-02T11:49:09.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f29fd124640 1 -- 172.21.15.161:0/1284936227 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f000f040 con 0x7f29e4004d10 2024-02-02T11:49:09.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f29fd124640 1 -- 172.21.15.161:0/1284936227 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f00ad680 con 0x7f29e4004d10 2024-02-02T11:49:09.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f2a0038a640 1 -- 172.21.15.161:0/1284936227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29e4004d10 msgr2=0x7f29e4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:09.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f2a0038a640 1 --2- 172.21.15.161:0/1284936227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29e4004d10 0x7f29e4005190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009fc0 tx=0x7f29f001cc40 comp rx=0 tx=0).stop 2024-02-02T11:49:09.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f29fe927640 1 -- 172.21.15.161:0/1284936227 reap_dead start 2024-02-02T11:49:09.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f2a0038a640 1 -- 172.21.15.161:0/1284936227 shutdown_connections 2024-02-02T11:49:09.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f2a0038a640 1 -- 172.21.15.161:0/1284936227 >> 172.21.15.161:0/1284936227 conn(0x7f29f80be150 msgr2=0x7f29f80be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:09.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f2a0038a640 1 -- 172.21.15.161:0/1284936227 shutdown_connections 2024-02-02T11:49:09.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f2a0038a640 1 -- 172.21.15.161:0/1284936227 wait complete. 2024-02-02T11:49:09.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f2a0038a640 1 Processor -- start 2024-02-02T11:49:09.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f2a0038a640 1 -- start start 2024-02-02T11:49:09.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f2a0038a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29f8141b90 0x7f29f80b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:09.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f2a0038a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29f81e1750 0x7f29f81364a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:09.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f2a0038a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29f81e1bd0 0x7f29f81369e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:09.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f2a0038a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80b70e0 con 0x7f29f8141b90 2024-02-02T11:49:09.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f2a0038a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80b7cf0 con 0x7f29f81e1bd0 2024-02-02T11:49:09.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f2a0038a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80b72f0 con 0x7f29f81e1750 2024-02-02T11:49:09.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f29fe126640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29f8141b90 0x7f29f80b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:09.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f29fe126640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29f8141b90 0x7f29f80b6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40040/0 (socket says 172.21.15.161:40040) 2024-02-02T11:49:09.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f29fe126640 1 -- 172.21.15.161:0/2628371484 learned_addr learned my addr 172.21.15.161:0/2628371484 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:09.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:08.999+0000 7f29fe927640 1 --2- 172.21.15.161:0/2628371484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29f81e1bd0 0x7f29f81369e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:09.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.003+0000 7f29fe126640 1 -- 172.21.15.161:0/2628371484 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29f81e1750 msgr2=0x7f29f81364a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:09.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.003+0000 7f29fd925640 1 --2- 172.21.15.161:0/2628371484 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29f81e1750 0x7f29f81364a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:09.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.003+0000 7f29fe126640 1 --2- 172.21.15.161:0/2628371484 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29f81e1750 0x7f29f81364a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:09.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.003+0000 7f29fe126640 1 -- 172.21.15.161:0/2628371484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29f81e1bd0 msgr2=0x7f29f81369e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:09.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.003+0000 7f29fe126640 1 --2- 172.21.15.161:0/2628371484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29f81e1bd0 0x7f29f81369e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:09.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.003+0000 7f29fe126640 1 -- 172.21.15.161:0/2628371484 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f80b7f70 con 0x7f29f8141b90 2024-02-02T11:49:09.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.003+0000 7f29fe927640 1 --2- 172.21.15.161:0/2628371484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29f81e1bd0 0x7f29f81369e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:09.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.003+0000 7f29fe126640 1 --2- 172.21.15.161:0/2628371484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29f8141b90 0x7f29f80b6ba0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f29f400db10 tx=0x7f29f4007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:09.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.003+0000 7f29eeffd640 1 -- 172.21.15.161:0/2628371484 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f4004cc0 con 0x7f29f8141b90 2024-02-02T11:49:09.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.003+0000 7f29eeffd640 1 -- 172.21.15.161:0/2628371484 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f4004e20 con 0x7f29f8141b90 2024-02-02T11:49:09.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.003+0000 7f2a0038a640 1 -- 172.21.15.161:0/2628371484 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f80b8250 con 0x7f29f8141b90 2024-02-02T11:49:09.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.003+0000 7f29eeffd640 1 -- 172.21.15.161:0/2628371484 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f4007390 con 0x7f29f8141b90 2024-02-02T11:49:09.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.003+0000 7f2a0038a640 1 -- 172.21.15.161:0/2628371484 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f81e1230 con 0x7f29f8141b90 2024-02-02T11:49:09.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.003+0000 7f2a0038a640 1 -- 172.21.15.161:0/2628371484 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f804e000 con 0x7f29f8141b90 2024-02-02T11:49:09.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.003+0000 7f29eeffd640 1 -- 172.21.15.161:0/2628371484 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f29f40074f0 con 0x7f29f8141b90 2024-02-02T11:49:09.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.003+0000 7f29eeffd640 1 --2- 172.21.15.161:0/2628371484 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f29dc065a90 0x7f29dc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:09.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.003+0000 7f29eeffd640 1 -- 172.21.15.161:0/2628371484 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29f4082c50 con 0x7f29f8141b90 2024-02-02T11:49:09.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.003+0000 7f29fd925640 1 --2- 172.21.15.161:0/2628371484 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f29dc065a90 0x7f29dc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:09.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.003+0000 7f29fd925640 1 --2- 172.21.15.161:0/2628371484 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f29dc065a90 0x7f29dc067f50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f29f81390c0 tx=0x7f29e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:09.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.007+0000 7f29eeffd640 1 -- 172.21.15.161:0/2628371484 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f29f4088020 con 0x7f29f8141b90 2024-02-02T11:49:09.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.195+0000 7f2a0038a640 1 -- 172.21.15.161:0/2628371484 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f29f80b3070 con 0x7f29f8141b90 2024-02-02T11:49:09.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.195+0000 7f29eeffd640 1 -- 172.21.15.161:0/2628371484 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f29f4019070 con 0x7f29f8141b90 2024-02-02T11:49:09.199 INFO:teuthology.orchestra.run.smithi161.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-02T11:49:09.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.199+0000 7f2a0038a640 1 -- 172.21.15.161:0/2628371484 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f29dc065a90 msgr2=0x7f29dc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:09.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.199+0000 7f2a0038a640 1 --2- 172.21.15.161:0/2628371484 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f29dc065a90 0x7f29dc067f50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f29f81390c0 tx=0x7f29e8008040 comp rx=0 tx=0).stop 2024-02-02T11:49:09.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.199+0000 7f2a0038a640 1 -- 172.21.15.161:0/2628371484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29f8141b90 msgr2=0x7f29f80b6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:09.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.199+0000 7f2a0038a640 1 --2- 172.21.15.161:0/2628371484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29f8141b90 0x7f29f80b6ba0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f29f400db10 tx=0x7f29f4007ea0 comp rx=0 tx=0).stop 2024-02-02T11:49:09.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.199+0000 7f2a0038a640 1 -- 172.21.15.161:0/2628371484 shutdown_connections 2024-02-02T11:49:09.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.199+0000 7f2a0038a640 1 --2- 172.21.15.161:0/2628371484 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f29dc065a90 0x7f29dc067f50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:09.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.199+0000 7f2a0038a640 1 --2- 172.21.15.161:0/2628371484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29f81e1bd0 0x7f29f81369e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:09.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.199+0000 7f2a0038a640 1 --2- 172.21.15.161:0/2628371484 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29f81e1750 0x7f29f81364a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:09.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.199+0000 7f2a0038a640 1 --2- 172.21.15.161:0/2628371484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29f8141b90 0x7f29f80b6ba0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:09.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.199+0000 7f2a0038a640 1 -- 172.21.15.161:0/2628371484 >> 172.21.15.161:0/2628371484 conn(0x7f29f80be150 msgr2=0x7f29f80a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:09.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.199+0000 7f2a0038a640 1 -- 172.21.15.161:0/2628371484 shutdown_connections 2024-02-02T11:49:09.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:09.199+0000 7f2a0038a640 1 -- 172.21.15.161:0/2628371484 wait complete. 2024-02-02T11:49:09.218 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-02T11:49:09.218 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-02T11:49:09.218 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-02-02T11:49:09.218 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-02T11:49:09.218 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-02T11:49:09.218 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-02T11:49:09.218 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-02T11:49:09.218 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-02T11:49:09.218 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-02T11:49:09.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:09.219 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-02-02T11:49:09.228 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-02T11:49:09.228 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-02T11:49:09.229 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-02-02T11:49:09.229 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-02-02T11:49:09.229 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-02-02T11:49:09.229 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-02-02T11:49:09.229 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-02T11:49:09.229 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-02-02T11:49:09.229 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-02-02T11:49:09.229 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-02T11:49:09.229 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-02-02T11:49:09.229 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-02-02T11:49:09.229 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-02T11:49:09.229 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-02-02T11:49:09.229 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-02T11:49:09.229 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-02-02T11:49:09.230 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-02-02T11:49:09.230 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42486sec preferred_lft 42486sec 2024-02-02T11:49:09.230 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2024-02-02T11:49:09.230 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-02-02T11:49:09.230 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-02-02T11:49:09.230 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:6d:e4:25:4d brd ff:ff:ff:ff:ff:ff 2024-02-02T11:49:09.230 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-02-02T11:49:09.230 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-02-02T11:49:09.231 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-02T11:49:09.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:09.231 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-02-02T11:49:09.231 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-02-02T11:49:09.231 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add name ceph-brx type bridge 2024-02-02T11:49:09.231 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip addr flush dev ceph-brx 2024-02-02T11:49:09.231 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set ceph-brx up 2024-02-02T11:49:09.232 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-02T11:49:09.232 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-02-02T11:49:09.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:09.347 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-02T11:49:09.366 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-02-02T11:49:09.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:09.368 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-02-02T11:49:09.450 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-02-02T11:49:09.451 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-02T11:49:09.451 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-02-02T11:49:09.451 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-02T11:49:09.451 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-02-02T11:49:09.451 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-02T11:49:09.451 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-02T11:49:09.451 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-02T11:49:09.451 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-02T11:49:09.451 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-02T11:49:09.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:09.452 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-02-02T11:49:09.452 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-02-02T11:49:09.452 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-02T11:49:09.452 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-02T11:49:09.452 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-02T11:49:09.452 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-02-02T11:49:09.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:09.542 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-02-02T11:49:09.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:09.551 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list-id 2024-02-02T11:49:09.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:09.601 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-02-02T11:49:09.601 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-02-02T11:49:09.601 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-02T11:49:09.601 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-02T11:49:09.601 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-02-02T11:49:09.686 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-02T11:49:09.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:09.686 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-02-02T11:49:09.686 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-02-02T11:49:09.686 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-02T11:49:09.686 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-02T11:49:09.687 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-02T11:49:09.687 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-02T11:49:09.687 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-02T11:49:09.687 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-02-02T11:49:09.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:09.848 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-02-02T11:49:09.848 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-02-02T11:49:09.848 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2024-02-02T11:49:09.848 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set dev brx.0 master ceph-brx 2024-02-02T11:49:09.848 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-02-02T11:49:09.886 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-02T11:49:09.886 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-02T11:49:09.940 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-02T11:49:09.940 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-02T11:49:09.941 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-02T11:49:09.991 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-02T11:49:09.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:09.992 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-02T11:49:10.089 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-02T11:49:10.089 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-02T11:49:10.089 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-02-02T11:49:10.528 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-02T11:49:10.528 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-02T11:49:10.528 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-02-02T11:49:10.528 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.161:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-02-02T11:49:10.528 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-02T11:49:10.544 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-02T11:49:10.544 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-02T11:49:10.544 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-02-02T11:49:10.544 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.161:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-02-02T11:49:10.544 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-02T11:49:10.544 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.161:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-02-02T11:49:10.544 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.161:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-02-02T11:49:10.544 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=6072f293-dbe3-404b-82f1-eb0e17d96787" will pass to kernel 2024-02-02T11:49:10.548 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-02T11:49:10.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:10.548 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-02T11:49:10.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:10.571 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-02T11:49:10.655 INFO:teuthology.orchestra.run.smithi177.stdout:client4668 2024-02-02T11:49:10.655 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T11:49:10.655 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-02T11:49:10.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:10.705 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-02T11:49:10.775 INFO:teuthology.orchestra.run.smithi177.stdout:client4668 2024-02-02T11:49:10.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:10.776 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-02T11:49:10.829 INFO:teuthology.orchestra.run.smithi177.stdout:client4668 2024-02-02T11:49:10.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:10.829 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6072f293-dbe3-404b-82f1-eb0e17d96787.client4668/status') 2024-02-02T11:49:10.891 INFO:teuthology.orchestra.run.smithi177.stdout:instance: client.4668 (3)172.21.15.177:0/187273446 2024-02-02T11:49:10.891 INFO:teuthology.orchestra.run.smithi177.stdout:blocklisted: false 2024-02-02T11:49:10.892 INFO:teuthology.orchestra.run.smithi177.stderr:0+1 records in 2024-02-02T11:49:10.892 INFO:teuthology.orchestra.run.smithi177.stderr:0+1 records out 2024-02-02T11:49:10.892 INFO:teuthology.orchestra.run.smithi177.stderr:70 bytes copied, 7.0513e-05 s, 993 kB/s 2024-02-02T11:49:10.894 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-02-02T11:49:10.936 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:49:11.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f4756b01640 1 Processor -- start 2024-02-02T11:49:11.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f4756b01640 1 -- start start 2024-02-02T11:49:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f4756b01640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47500b9900 0x7f47500b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f4756b01640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47500b3c40 con 0x7f47501429f0 2024-02-02T11:49:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f4756b01640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47500b9d70 con 0x7f4750071160 2024-02-02T11:49:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f4756b01640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47500b5140 con 0x7f47500b9900 2024-02-02T11:49:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f475509e640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f47501429f0 0x7f4750153260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:57610/0 (socket says 172.21.15.161:57610) 2024-02-02T11:49:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f475509e640 1 -- 172.21.15.161:0/813012765 learned_addr learned my addr 172.21.15.161:0/813012765 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f474ffff640 1 --2- 172.21.15.161:0/813012765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47500b9900 0x7f47500b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f474f7fe640 1 -- 172.21.15.161:0/813012765 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239126145 0 0) 0x7f47500b3c40 con 0x7f47501429f0 2024-02-02T11:49:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f474f7fe640 1 -- 172.21.15.161:0/813012765 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4738003530 con 0x7f47501429f0 2024-02-02T11:49:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f474f7fe640 1 -- 172.21.15.161:0/813012765 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1555013747 0 0) 0x7f4738003530 con 0x7f47501429f0 2024-02-02T11:49:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f474f7fe640 1 -- 172.21.15.161:0/813012765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47500b9900 msgr2=0x7f47500b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f474f7fe640 1 --2- 172.21.15.161:0/813012765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47500b9900 0x7f47500b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f474f7fe640 1 -- 172.21.15.161:0/813012765 >> v1:172.21.15.162:6789/0 conn(0x7f4750071160 legacy=0x7f47500b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f474f7fe640 1 -- 172.21.15.161:0/813012765 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47500b9f60 con 0x7f47501429f0 2024-02-02T11:49:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f474f7fe640 1 -- 172.21.15.161:0/813012765 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f4748001a00 con 0x7f47501429f0 2024-02-02T11:49:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f474f7fe640 1 -- 172.21.15.161:0/813012765 >> v1:172.21.15.161:6789/0 conn(0x7f47501429f0 legacy=0x7f4750153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f474f7fe640 1 --2- 172.21.15.161:0/813012765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47380039b0 0x7f4738003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f474f7fe640 1 --2- 172.21.15.161:0/813012765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47380047d0 0x7f4738004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f474f7fe640 1 --2- 172.21.15.161:0/813012765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47500b9900 0x7f4738005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f474f7fe640 1 -- 172.21.15.161:0/813012765 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47500b5140 con 0x7f47380039b0 2024-02-02T11:49:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f474f7fe640 1 -- 172.21.15.161:0/813012765 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473800ba40 con 0x7f47380047d0 2024-02-02T11:49:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f474f7fe640 1 -- 172.21.15.161:0/813012765 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473800bc00 con 0x7f47500b9900 2024-02-02T11:49:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f475489d640 1 --2- 172.21.15.161:0/813012765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47380039b0 0x7f4738003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f475509e640 1 --2- 172.21.15.161:0/813012765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47500b9900 0x7f4738005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f474ffff640 1 --2- 172.21.15.161:0/813012765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47380047d0 0x7f4738004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f475489d640 1 -- 172.21.15.161:0/813012765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47500b9900 msgr2=0x7f4738005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f475489d640 1 --2- 172.21.15.161:0/813012765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47500b9900 0x7f4738005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f475489d640 1 -- 172.21.15.161:0/813012765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47380047d0 msgr2=0x7f4738004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f475489d640 1 --2- 172.21.15.161:0/813012765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47380047d0 0x7f4738004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f475489d640 1 -- 172.21.15.161:0/813012765 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4738003530 con 0x7f47380039b0 2024-02-02T11:49:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f475509e640 1 --2- 172.21.15.161:0/813012765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47500b9900 0x7f4738005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.063+0000 7f474ffff640 1 --2- 172.21.15.161:0/813012765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47380047d0 0x7f4738004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:11.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f475489d640 1 --2- 172.21.15.161:0/813012765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47380039b0 0x7f4738003dd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4744001750 tx=0x7f474401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e13bc754b525ec server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:11.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f474f7fe640 1 -- 172.21.15.161:0/813012765 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47440052d0 con 0x7f47380039b0 2024-02-02T11:49:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f474f7fe640 1 -- 172.21.15.161:0/813012765 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47440a7050 con 0x7f47380039b0 2024-02-02T11:49:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f474f7fe640 1 -- 172.21.15.161:0/813012765 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744003600 con 0x7f47380039b0 2024-02-02T11:49:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f4756b01640 1 -- 172.21.15.161:0/813012765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47380039b0 msgr2=0x7f4738003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f4756b01640 1 --2- 172.21.15.161:0/813012765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47380039b0 0x7f4738003dd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4744001750 tx=0x7f474401c370 comp rx=0 tx=0).stop 2024-02-02T11:49:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f475509e640 1 -- 172.21.15.161:0/813012765 reap_dead start 2024-02-02T11:49:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f4756b01640 1 -- 172.21.15.161:0/813012765 shutdown_connections 2024-02-02T11:49:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f4756b01640 1 -- 172.21.15.161:0/813012765 >> 172.21.15.161:0/813012765 conn(0x7f47500be150 msgr2=0x7f47500be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f4756b01640 1 -- 172.21.15.161:0/813012765 shutdown_connections 2024-02-02T11:49:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f4756b01640 1 -- 172.21.15.161:0/813012765 wait complete. 2024-02-02T11:49:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f4756b01640 1 Processor -- start 2024-02-02T11:49:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f4756b01640 1 -- start start 2024-02-02T11:49:11.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f4756b01640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47380039b0 0x7f4750145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f4756b01640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47501444c0 0x7f475013e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f4756b01640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f475006c580 0x7f475013a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f4756b01640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4750144920 con 0x7f47380039b0 2024-02-02T11:49:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f4756b01640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475013ea40 con 0x7f475006c580 2024-02-02T11:49:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f4756b01640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4750144b40 con 0x7f47501444c0 2024-02-02T11:49:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f475489d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47380039b0 0x7f4750145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f475489d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47380039b0 0x7f4750145e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40060/0 (socket says 172.21.15.161:40060) 2024-02-02T11:49:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.067+0000 7f475489d640 1 -- 172.21.15.161:0/3678355808 learned_addr learned my addr 172.21.15.161:0/3678355808 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f474ffff640 1 --2- 172.21.15.161:0/3678355808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47501444c0 0x7f475013e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f475509e640 1 --2- 172.21.15.161:0/3678355808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f475006c580 0x7f475013a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f475489d640 1 -- 172.21.15.161:0/3678355808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47501444c0 msgr2=0x7f475013e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f475489d640 1 --2- 172.21.15.161:0/3678355808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47501444c0 0x7f475013e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f475489d640 1 -- 172.21.15.161:0/3678355808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f475006c580 msgr2=0x7f475013a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f475489d640 1 --2- 172.21.15.161:0/3678355808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f475006c580 0x7f475013a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f475489d640 1 -- 172.21.15.161:0/3678355808 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475006b710 con 0x7f47380039b0 2024-02-02T11:49:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f475509e640 1 --2- 172.21.15.161:0/3678355808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f475006c580 0x7f475013a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f475489d640 1 --2- 172.21.15.161:0/3678355808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47380039b0 0x7f4750145e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4744005040 tx=0x7f4738005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f474d7fa640 1 -- 172.21.15.161:0/3678355808 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744007180 con 0x7f47380039b0 2024-02-02T11:49:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f474d7fa640 1 -- 172.21.15.161:0/3678355808 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47440072e0 con 0x7f47380039b0 2024-02-02T11:49:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f4756b01640 1 -- 172.21.15.161:0/3678355808 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475006b9f0 con 0x7f47380039b0 2024-02-02T11:49:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f474d7fa640 1 -- 172.21.15.161:0/3678355808 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744007670 con 0x7f47380039b0 2024-02-02T11:49:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f4756b01640 1 -- 172.21.15.161:0/3678355808 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4750143390 con 0x7f47380039b0 2024-02-02T11:49:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f4756b01640 1 -- 172.21.15.161:0/3678355808 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4750143550 con 0x7f47380039b0 2024-02-02T11:49:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f474d7fa640 1 -- 172.21.15.161:0/3678355808 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f47440067e0 con 0x7f47380039b0 2024-02-02T11:49:11.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f474d7fa640 1 --2- 172.21.15.161:0/3678355808 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f473c065a60 0x7f473c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f474d7fa640 1 -- 172.21.15.161:0/3678355808 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f474411d410 con 0x7f47380039b0 2024-02-02T11:49:11.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f474ffff640 1 --2- 172.21.15.161:0/3678355808 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f473c065a60 0x7f473c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.071+0000 7f474ffff640 1 --2- 172.21.15.161:0/3678355808 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f473c065a60 0x7f473c067f20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f47500beab0 tx=0x7f4740008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.075+0000 7f474d7fa640 1 -- 172.21.15.161:0/3678355808 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f47440eae60 con 0x7f47380039b0 2024-02-02T11:49:11.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.231+0000 7f4756b01640 1 -- 172.21.15.161:0/3678355808 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f475004e000 con 0x7f47380039b0 2024-02-02T11:49:11.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.235+0000 7f474d7fa640 1 -- 172.21.15.161:0/3678355808 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f47440ee480 con 0x7f47380039b0 2024-02-02T11:49:11.237 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:11.237 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":20,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:52.816101+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:48:50.155565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-02T11:48:50.795158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:49:11.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.235+0000 7f4756b01640 1 -- 172.21.15.161:0/3678355808 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f473c065a60 msgr2=0x7f473c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:11.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.235+0000 7f4756b01640 1 --2- 172.21.15.161:0/3678355808 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f473c065a60 0x7f473c067f20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f47500beab0 tx=0x7f4740008040 comp rx=0 tx=0).stop 2024-02-02T11:49:11.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.235+0000 7f4756b01640 1 -- 172.21.15.161:0/3678355808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47380039b0 msgr2=0x7f4750145e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:11.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.235+0000 7f4756b01640 1 --2- 172.21.15.161:0/3678355808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47380039b0 0x7f4750145e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4744005040 tx=0x7f4738005800 comp rx=0 tx=0).stop 2024-02-02T11:49:11.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.235+0000 7f4756b01640 1 -- 172.21.15.161:0/3678355808 shutdown_connections 2024-02-02T11:49:11.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.235+0000 7f4756b01640 1 --2- 172.21.15.161:0/3678355808 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f473c065a60 0x7f473c067f20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.235+0000 7f4756b01640 1 --2- 172.21.15.161:0/3678355808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f475006c580 0x7f475013a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.235+0000 7f4756b01640 1 --2- 172.21.15.161:0/3678355808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47501444c0 0x7f475013e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.235+0000 7f4756b01640 1 --2- 172.21.15.161:0/3678355808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47380039b0 0x7f4750145e10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.235+0000 7f4756b01640 1 -- 172.21.15.161:0/3678355808 >> 172.21.15.161:0/3678355808 conn(0x7f47500be150 msgr2=0x7f4750141a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:11.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.235+0000 7f4756b01640 1 -- 172.21.15.161:0/3678355808 shutdown_connections 2024-02-02T11:49:11.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.235+0000 7f4756b01640 1 -- 172.21.15.161:0/3678355808 wait complete. 2024-02-02T11:49:11.256 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-02T11:48:40.330782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-02T11:48:50.155565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-02T11:48:50.795158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-02T11:49:11.257 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-02T11:49:11.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.379+0000 7fdc1c28a640 1 Processor -- start 2024-02-02T11:49:11.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.379+0000 7fdc1c28a640 1 -- start start 2024-02-02T11:49:11.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.379+0000 7fdc1c28a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdc140b8df0 0x7fdc14147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.379+0000 7fdc1c28a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdc140b8530 0x7fdc14152000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.379+0000 7fdc1c28a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1406ec30 con 0x7fdc14070e40 2024-02-02T11:49:11.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.379+0000 7fdc1c28a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc140b30e0 con 0x7fdc140b8df0 2024-02-02T11:49:11.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.379+0000 7fdc1c28a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc140b3770 con 0x7fdc140b8530 2024-02-02T11:49:11.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.379+0000 7fdc1a026640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdc140b8df0 0x7fdc14147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.379+0000 7fdc1a026640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdc140b8df0 0x7fdc14147eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40076/0 (socket says 172.21.15.161:40076) 2024-02-02T11:49:11.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.379+0000 7fdc1a026640 1 -- 172.21.15.161:0/757897040 learned_addr learned my addr 172.21.15.161:0/757897040 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:11.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.379+0000 7fdc1a827640 1 --2- 172.21.15.161:0/757897040 >> v2:172.21.15.162:3300/0 conn(0x7fdc140b8530 0x7fdc14152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.379+0000 7fdc1a026640 1 -- 172.21.15.161:0/757897040 >> v2:172.21.15.162:3300/0 conn(0x7fdc140b8530 msgr2=0x7fdc14152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:11.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.379+0000 7fdc1a026640 1 --2- 172.21.15.161:0/757897040 >> v2:172.21.15.162:3300/0 conn(0x7fdc140b8530 0x7fdc14152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.379+0000 7fdc1a026640 1 -- 172.21.15.161:0/757897040 >> v1:172.21.15.162:6789/0 conn(0x7fdc14070e40 legacy=0x7fdc14141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:11.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.379+0000 7fdc1a026640 1 -- 172.21.15.161:0/757897040 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc14071890 con 0x7fdc140b8df0 2024-02-02T11:49:11.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.379+0000 7fdc1a026640 1 --2- 172.21.15.161:0/757897040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc140b8df0 0x7fdc14147eb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdc140b3490 tx=0x7fdc1001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24856a92d41cbd8 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:11.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.379+0000 7fdc19024640 1 -- 172.21.15.161:0/757897040 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc100aa5f0 con 0x7fdc140b8df0 2024-02-02T11:49:11.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc19024640 1 -- 172.21.15.161:0/757897040 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc100aa750 con 0x7fdc140b8df0 2024-02-02T11:49:11.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc19024640 1 -- 172.21.15.161:0/757897040 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc100aaae0 con 0x7fdc140b8df0 2024-02-02T11:49:11.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1c28a640 1 -- 172.21.15.161:0/757897040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc140b8df0 msgr2=0x7fdc14147eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:11.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1c28a640 1 --2- 172.21.15.161:0/757897040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc140b8df0 0x7fdc14147eb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdc140b3490 tx=0x7fdc1001c490 comp rx=0 tx=0).stop 2024-02-02T11:49:11.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1c28a640 1 -- 172.21.15.161:0/757897040 shutdown_connections 2024-02-02T11:49:11.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1c28a640 1 --2- 172.21.15.161:0/757897040 >> v2:172.21.15.162:3300/0 conn(0x7fdc140b8530 0x7fdc14152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1c28a640 1 --2- 172.21.15.161:0/757897040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc140b8df0 0x7fdc14147eb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1c28a640 1 -- 172.21.15.161:0/757897040 >> 172.21.15.161:0/757897040 conn(0x7fdc1406a120 msgr2=0x7fdc1406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:11.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1c28a640 1 -- 172.21.15.161:0/757897040 shutdown_connections 2024-02-02T11:49:11.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1c28a640 1 -- 172.21.15.161:0/757897040 wait complete. 2024-02-02T11:49:11.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1c28a640 1 Processor -- start 2024-02-02T11:49:11.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1c28a640 1 -- start start 2024-02-02T11:49:11.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1c28a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc140b8530 0x7fdc140b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1c28a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc140b8df0 0x7fdc141e3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1c28a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc141e35a0 0x7fdc14134170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1c28a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140b5b20 con 0x7fdc141e35a0 2024-02-02T11:49:11.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1c28a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc14140a60 con 0x7fdc140b8530 2024-02-02T11:49:11.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1c28a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1413fc50 con 0x7fdc140b8df0 2024-02-02T11:49:11.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1a827640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc141e35a0 0x7fdc14134170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1a827640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc141e35a0 0x7fdc14134170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40092/0 (socket says 172.21.15.161:40092) 2024-02-02T11:49:11.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1a827640 1 -- 172.21.15.161:0/1967069132 learned_addr learned my addr 172.21.15.161:0/1967069132 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:11.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1a026640 1 --2- 172.21.15.161:0/1967069132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc140b8530 0x7fdc140b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc19825640 1 --2- 172.21.15.161:0/1967069132 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc140b8df0 0x7fdc141e3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1a827640 1 -- 172.21.15.161:0/1967069132 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc140b8df0 msgr2=0x7fdc141e3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:11.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1a827640 1 --2- 172.21.15.161:0/1967069132 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc140b8df0 0x7fdc141e3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1a827640 1 -- 172.21.15.161:0/1967069132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc140b8530 msgr2=0x7fdc140b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:11.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1a827640 1 --2- 172.21.15.161:0/1967069132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc140b8530 0x7fdc140b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1a827640 1 -- 172.21.15.161:0/1967069132 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc100094d0 con 0x7fdc141e35a0 2024-02-02T11:49:11.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1a827640 1 --2- 172.21.15.161:0/1967069132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc141e35a0 0x7fdc14134170 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c007e40 tx=0x7fdc0c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:11.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc0affd640 1 -- 172.21.15.161:0/1967069132 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c014620 con 0x7fdc141e35a0 2024-02-02T11:49:11.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc0affd640 1 -- 172.21.15.161:0/1967069132 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0c00ee90 con 0x7fdc141e35a0 2024-02-02T11:49:11.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1c28a640 1 -- 172.21.15.161:0/1967069132 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1413ff30 con 0x7fdc141e35a0 2024-02-02T11:49:11.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc0affd640 1 -- 172.21.15.161:0/1967069132 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c0149e0 con 0x7fdc141e35a0 2024-02-02T11:49:11.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.383+0000 7fdc1c28a640 1 -- 172.21.15.161:0/1967069132 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc14140540 con 0x7fdc141e35a0 2024-02-02T11:49:11.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.387+0000 7fdc1c28a640 1 -- 172.21.15.161:0/1967069132 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc14140730 con 0x7fdc141e35a0 2024-02-02T11:49:11.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.387+0000 7fdc0affd640 1 -- 172.21.15.161:0/1967069132 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdc0c014b40 con 0x7fdc141e35a0 2024-02-02T11:49:11.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.387+0000 7fdc0affd640 1 --2- 172.21.15.161:0/1967069132 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fdbf8065a60 0x7fdbf8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.387+0000 7fdc0affd640 1 -- 172.21.15.161:0/1967069132 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc0c083b60 con 0x7fdc141e35a0 2024-02-02T11:49:11.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.387+0000 7fdc1a026640 1 --2- 172.21.15.161:0/1967069132 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fdbf8065a60 0x7fdbf8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.387+0000 7fdc1a026640 1 --2- 172.21.15.161:0/1967069132 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fdbf8065a60 0x7fdbf8067f20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdc100ae000 tx=0x7fdc100a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:11.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.391+0000 7fdc0affd640 1 -- 172.21.15.161:0/1967069132 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdc0c051520 con 0x7fdc141e35a0 2024-02-02T11:49:11.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.547+0000 7fdc1c28a640 1 -- 172.21.15.161:0/1967069132 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdc1404e000 con 0x7fdc141e35a0 2024-02-02T11:49:11.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.547+0000 7fdc0affd640 1 -- 172.21.15.161:0/1967069132 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc0c054b40 con 0x7fdc141e35a0 2024-02-02T11:49:11.550 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-02-02T11:49:11.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.547+0000 7fdc1c28a640 1 -- 172.21.15.161:0/1967069132 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fdbf8065a60 msgr2=0x7fdbf8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:11.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.547+0000 7fdc1c28a640 1 --2- 172.21.15.161:0/1967069132 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fdbf8065a60 0x7fdbf8067f20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdc100ae000 tx=0x7fdc100a7000 comp rx=0 tx=0).stop 2024-02-02T11:49:11.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.547+0000 7fdc1c28a640 1 -- 172.21.15.161:0/1967069132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc141e35a0 msgr2=0x7fdc14134170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:11.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.547+0000 7fdc1c28a640 1 --2- 172.21.15.161:0/1967069132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc141e35a0 0x7fdc14134170 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c007e40 tx=0x7fdc0c00e4b0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.551+0000 7fdc1c28a640 1 -- 172.21.15.161:0/1967069132 shutdown_connections 2024-02-02T11:49:11.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.551+0000 7fdc1c28a640 1 --2- 172.21.15.161:0/1967069132 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fdbf8065a60 0x7fdbf8067f20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.551+0000 7fdc1c28a640 1 --2- 172.21.15.161:0/1967069132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc141e35a0 0x7fdc14134170 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.551+0000 7fdc1c28a640 1 --2- 172.21.15.161:0/1967069132 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc140b8df0 0x7fdc141e3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.551+0000 7fdc1c28a640 1 --2- 172.21.15.161:0/1967069132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc140b8530 0x7fdc140b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.551+0000 7fdc1c28a640 1 -- 172.21.15.161:0/1967069132 >> 172.21.15.161:0/1967069132 conn(0x7fdc1406a120 msgr2=0x7fdc1406a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:11.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.551+0000 7fdc1c28a640 1 -- 172.21.15.161:0/1967069132 shutdown_connections 2024-02-02T11:49:11.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.551+0000 7fdc1c28a640 1 -- 172.21.15.161:0/1967069132 wait complete. 2024-02-02T11:49:11.571 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-02T11:49:11.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.691+0000 7fea56045640 1 Processor -- start 2024-02-02T11:49:11.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.691+0000 7fea56045640 1 -- start start 2024-02-02T11:49:11.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.691+0000 7fea56045640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fea50070e40 0x7fea50141620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.691+0000 7fea56045640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea500b8530 0x7fea50141b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.691+0000 7fea56045640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5006ec30 con 0x7fea500b8df0 2024-02-02T11:49:11.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.691+0000 7fea56045640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea500b30e0 con 0x7fea50070e40 2024-02-02T11:49:11.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.691+0000 7fea56045640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea500b3770 con 0x7fea500b8530 2024-02-02T11:49:11.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.691+0000 7fea4f7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fea500b8df0 0x7fea50147eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:57626/0 (socket says 172.21.15.161:57626) 2024-02-02T11:49:11.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.691+0000 7fea4f7fe640 1 -- 172.21.15.161:0/1237777456 learned_addr learned my addr 172.21.15.161:0/1237777456 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:11.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea46ffd640 1 --2- 172.21.15.161:0/1237777456 >> v2:172.21.15.162:3300/0 conn(0x7fea50070e40 0x7fea50141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4ffff640 1 --2- 172.21.15.161:0/1237777456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea500b8530 0x7fea50141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4effd640 1 -- 172.21.15.161:0/1237777456 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432230014 0 0) 0x7fea5006ec30 con 0x7fea500b8df0 2024-02-02T11:49:11.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4effd640 1 -- 172.21.15.161:0/1237777456 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea3c003530 con 0x7fea500b8df0 2024-02-02T11:49:11.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4effd640 1 -- 172.21.15.161:0/1237777456 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2616233043 0 0) 0x7fea3c003530 con 0x7fea500b8df0 2024-02-02T11:49:11.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4effd640 1 -- 172.21.15.161:0/1237777456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea500b8530 msgr2=0x7fea50141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:11.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4effd640 1 --2- 172.21.15.161:0/1237777456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea500b8530 0x7fea50141b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4effd640 1 -- 172.21.15.161:0/1237777456 >> v2:172.21.15.162:3300/0 conn(0x7fea50070e40 msgr2=0x7fea50141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:11.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4effd640 1 --2- 172.21.15.161:0/1237777456 >> v2:172.21.15.162:3300/0 conn(0x7fea50070e40 0x7fea50141620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4effd640 1 -- 172.21.15.161:0/1237777456 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea50071890 con 0x7fea500b8df0 2024-02-02T11:49:11.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4effd640 1 -- 172.21.15.161:0/1237777456 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7fea40001680 con 0x7fea500b8df0 2024-02-02T11:49:11.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4effd640 1 -- 172.21.15.161:0/1237777456 >> v1:172.21.15.161:6789/0 conn(0x7fea500b8df0 legacy=0x7fea50147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:11.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4effd640 1 --2- 172.21.15.161:0/1237777456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea3c003980 0x7fea3c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4effd640 1 --2- 172.21.15.161:0/1237777456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea500b8530 0x7fea3c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4effd640 1 --2- 172.21.15.161:0/1237777456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea3c004d10 0x7fea3c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4effd640 1 -- 172.21.15.161:0/1237777456 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea500b30e0 con 0x7fea3c003980 2024-02-02T11:49:11.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4effd640 1 -- 172.21.15.161:0/1237777456 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c00b990 con 0x7fea3c004d10 2024-02-02T11:49:11.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4effd640 1 -- 172.21.15.161:0/1237777456 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c00bad0 con 0x7fea500b8530 2024-02-02T11:49:11.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4f7fe640 1 --2- 172.21.15.161:0/1237777456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea3c003980 0x7fea3c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea46ffd640 1 --2- 172.21.15.161:0/1237777456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea500b8530 0x7fea3c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4ffff640 1 --2- 172.21.15.161:0/1237777456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea3c004d10 0x7fea3c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4f7fe640 1 -- 172.21.15.161:0/1237777456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea500b8530 msgr2=0x7fea3c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:11.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4f7fe640 1 --2- 172.21.15.161:0/1237777456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea500b8530 0x7fea3c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4f7fe640 1 -- 172.21.15.161:0/1237777456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea3c004d10 msgr2=0x7fea3c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:11.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4f7fe640 1 --2- 172.21.15.161:0/1237777456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea3c004d10 0x7fea3c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4f7fe640 1 -- 172.21.15.161:0/1237777456 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c003530 con 0x7fea3c003980 2024-02-02T11:49:11.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4f7fe640 1 --2- 172.21.15.161:0/1237777456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea3c003980 0x7fea3c003da0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fea4000c240 tx=0x7fea4001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c886cbbe713cbebf server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:11.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4effd640 1 -- 172.21.15.161:0/1237777456 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea400058e0 con 0x7fea3c003980 2024-02-02T11:49:11.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4effd640 1 -- 172.21.15.161:0/1237777456 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea40005a40 con 0x7fea3c003980 2024-02-02T11:49:11.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4effd640 1 -- 172.21.15.161:0/1237777456 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40005e30 con 0x7fea3c003980 2024-02-02T11:49:11.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea56045640 1 -- 172.21.15.161:0/1237777456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea3c003980 msgr2=0x7fea3c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:11.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea56045640 1 --2- 172.21.15.161:0/1237777456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea3c003980 0x7fea3c003da0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fea4000c240 tx=0x7fea4001cc60 comp rx=0 tx=0).stop 2024-02-02T11:49:11.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea4ffff640 1 -- 172.21.15.161:0/1237777456 reap_dead start 2024-02-02T11:49:11.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea56045640 1 -- 172.21.15.161:0/1237777456 shutdown_connections 2024-02-02T11:49:11.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.695+0000 7fea56045640 1 -- 172.21.15.161:0/1237777456 >> 172.21.15.161:0/1237777456 conn(0x7fea5006a120 msgr2=0x7fea5006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:11.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea56045640 1 -- 172.21.15.161:0/1237777456 shutdown_connections 2024-02-02T11:49:11.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea56045640 1 -- 172.21.15.161:0/1237777456 wait complete. 2024-02-02T11:49:11.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea56045640 1 Processor -- start 2024-02-02T11:49:11.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea56045640 1 -- start start 2024-02-02T11:49:11.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea56045640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea3c003980 0x7fea500bb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea56045640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea50132740 0x7fea500b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea56045640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea500b20d0 0x7fea500b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea56045640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea50146590 con 0x7fea500b20d0 2024-02-02T11:49:11.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea56045640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea500bb700 con 0x7fea50132740 2024-02-02T11:49:11.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea56045640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea50146f30 con 0x7fea3c003980 2024-02-02T11:49:11.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea4ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea500b20d0 0x7fea500b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea4ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea500b20d0 0x7fea500b5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40114/0 (socket says 172.21.15.161:40114) 2024-02-02T11:49:11.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea4ffff640 1 -- 172.21.15.161:0/4156278339 learned_addr learned my addr 172.21.15.161:0/4156278339 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:11.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea4f7fe640 1 --2- 172.21.15.161:0/4156278339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea3c003980 0x7fea500bb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea46ffd640 1 --2- 172.21.15.161:0/4156278339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea50132740 0x7fea500b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea4ffff640 1 -- 172.21.15.161:0/4156278339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea3c003980 msgr2=0x7fea500bb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:11.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea4ffff640 1 --2- 172.21.15.161:0/4156278339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea3c003980 0x7fea500bb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea4ffff640 1 -- 172.21.15.161:0/4156278339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea50132740 msgr2=0x7fea500b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:11.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea4ffff640 1 --2- 172.21.15.161:0/4156278339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea50132740 0x7fea500b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea4ffff640 1 -- 172.21.15.161:0/4156278339 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea501468e0 con 0x7fea500b20d0 2024-02-02T11:49:11.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea4ffff640 1 --2- 172.21.15.161:0/4156278339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea500b20d0 0x7fea500b5460 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fea500b8930 tx=0x7fea480115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:11.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea4cff9640 1 -- 172.21.15.161:0/4156278339 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4800e070 con 0x7fea500b20d0 2024-02-02T11:49:11.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea4cff9640 1 -- 172.21.15.161:0/4156278339 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea48011e10 con 0x7fea500b20d0 2024-02-02T11:49:11.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea56045640 1 -- 172.21.15.161:0/4156278339 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea50146bc0 con 0x7fea500b20d0 2024-02-02T11:49:11.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea4cff9640 1 -- 172.21.15.161:0/4156278339 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea480039a0 con 0x7fea500b20d0 2024-02-02T11:49:11.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea56045640 1 -- 172.21.15.161:0/4156278339 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea500bba30 con 0x7fea500b20d0 2024-02-02T11:49:11.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.699+0000 7fea56045640 1 -- 172.21.15.161:0/4156278339 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea50146740 con 0x7fea500b20d0 2024-02-02T11:49:11.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.703+0000 7fea4cff9640 1 -- 172.21.15.161:0/4156278339 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fea48003b00 con 0x7fea500b20d0 2024-02-02T11:49:11.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.703+0000 7fea4cff9640 1 --2- 172.21.15.161:0/4156278339 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fea30065a80 0x7fea30067f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:11.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.703+0000 7fea4cff9640 1 -- 172.21.15.161:0/4156278339 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea48083710 con 0x7fea500b20d0 2024-02-02T11:49:11.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.703+0000 7fea4f7fe640 1 --2- 172.21.15.161:0/4156278339 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fea30065a80 0x7fea30067f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:11.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.703+0000 7fea4f7fe640 1 --2- 172.21.15.161:0/4156278339 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fea30065a80 0x7fea30067f40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fea400aa000 tx=0x7fea40001a80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:11.709 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.707+0000 7fea4cff9640 1 -- 172.21.15.161:0/4156278339 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fea50146740 con 0x7fea500b20d0 2024-02-02T11:49:11.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.859+0000 7fea56045640 1 -- 172.21.15.161:0/4156278339 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fea50146740 con 0x7fea500b20d0 2024-02-02T11:49:11.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.859+0000 7fea4cff9640 1 -- 172.21.15.161:0/4156278339 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fea50146740 con 0x7fea500b20d0 2024-02-02T11:49:11.862 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-02-02T11:49:11.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.859+0000 7fea56045640 1 -- 172.21.15.161:0/4156278339 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fea30065a80 msgr2=0x7fea30067f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:11.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.859+0000 7fea56045640 1 --2- 172.21.15.161:0/4156278339 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fea30065a80 0x7fea30067f40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fea400aa000 tx=0x7fea40001a80 comp rx=0 tx=0).stop 2024-02-02T11:49:11.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.859+0000 7fea56045640 1 -- 172.21.15.161:0/4156278339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea500b20d0 msgr2=0x7fea500b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:11.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.859+0000 7fea56045640 1 --2- 172.21.15.161:0/4156278339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea500b20d0 0x7fea500b5460 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fea500b8930 tx=0x7fea480115a0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.859+0000 7fea56045640 1 -- 172.21.15.161:0/4156278339 shutdown_connections 2024-02-02T11:49:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.859+0000 7fea56045640 1 --2- 172.21.15.161:0/4156278339 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fea30065a80 0x7fea30067f40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.859+0000 7fea56045640 1 --2- 172.21.15.161:0/4156278339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea500b20d0 0x7fea500b5460 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.859+0000 7fea56045640 1 --2- 172.21.15.161:0/4156278339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea50132740 0x7fea500b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.859+0000 7fea56045640 1 --2- 172.21.15.161:0/4156278339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea3c003980 0x7fea500bb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.859+0000 7fea56045640 1 -- 172.21.15.161:0/4156278339 >> 172.21.15.161:0/4156278339 conn(0x7fea5006a120 msgr2=0x7fea5013a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.859+0000 7fea56045640 1 -- 172.21.15.161:0/4156278339 shutdown_connections 2024-02-02T11:49:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:11.859+0000 7fea56045640 1 -- 172.21.15.161:0/4156278339 wait complete. 2024-02-02T11:49:11.880 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-02T11:49:12.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc3ff3640 1 Processor -- start 2024-02-02T11:49:12.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc3ff3640 1 -- start start 2024-02-02T11:49:12.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc3ff3640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4cbc14b370 0x7f4cbc1562f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc3ff3640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cbc0b6e80 con 0x7f4cbc144a80 2024-02-02T11:49:12.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc3ff3640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cbc0b7160 con 0x7f4cbc0b8b40 2024-02-02T11:49:12.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc3ff3640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cbc0bc6c0 con 0x7f4cbc14b370 2024-02-02T11:49:12.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc158e640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f4cbc144a80 0x7f4cbc14ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:57640/0 (socket says 172.21.15.161:57640) 2024-02-02T11:49:12.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc158e640 1 -- 172.21.15.161:0/3881275851 learned_addr learned my addr 172.21.15.161:0/3881275851 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:12.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc2590640 1 --2- 172.21.15.161:0/3881275851 >> v2:172.21.15.162:3300/0 conn(0x7f4cbc14b370 0x7f4cbc1562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc0d8d640 1 -- 172.21.15.161:0/3881275851 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603451433 0 0) 0x7f4cbc0b6e80 con 0x7f4cbc144a80 2024-02-02T11:49:12.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc0d8d640 1 -- 172.21.15.161:0/3881275851 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ca8003530 con 0x7f4cbc144a80 2024-02-02T11:49:12.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc0d8d640 1 -- 172.21.15.161:0/3881275851 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2145974908 0 0) 0x7f4cbc0b7160 con 0x7f4cbc0b8b40 2024-02-02T11:49:12.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc0d8d640 1 -- 172.21.15.161:0/3881275851 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cbc0b6e80 con 0x7f4cbc0b8b40 2024-02-02T11:49:12.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc0d8d640 1 -- 172.21.15.161:0/3881275851 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 721496932 0 0) 0x7f4ca8003530 con 0x7f4cbc144a80 2024-02-02T11:49:12.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc0d8d640 1 -- 172.21.15.161:0/3881275851 >> v2:172.21.15.162:3300/0 conn(0x7f4cbc14b370 msgr2=0x7f4cbc1562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:12.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc0d8d640 1 --2- 172.21.15.161:0/3881275851 >> v2:172.21.15.162:3300/0 conn(0x7f4cbc14b370 0x7f4cbc1562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc0d8d640 1 -- 172.21.15.161:0/3881275851 >> v1:172.21.15.162:6789/0 conn(0x7f4cbc0b8b40 legacy=0x7f4cbc0b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc0d8d640 1 -- 172.21.15.161:0/3881275851 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cbc0bc9a0 con 0x7f4cbc144a80 2024-02-02T11:49:12.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc0d8d640 1 -- 172.21.15.161:0/3881275851 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f4cac001680 con 0x7f4cbc144a80 2024-02-02T11:49:12.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc0d8d640 1 -- 172.21.15.161:0/3881275851 >> v1:172.21.15.161:6789/0 conn(0x7f4cbc144a80 legacy=0x7f4cbc14ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc0d8d640 1 --2- 172.21.15.161:0/3881275851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca8003b10 0x7f4ca8003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc0d8d640 1 --2- 172.21.15.161:0/3881275851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ca80047d0 0x7f4ca8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc0d8d640 1 --2- 172.21.15.161:0/3881275851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca8005190 0x7f4ca800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc0d8d640 1 -- 172.21.15.161:0/3881275851 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cbc0bc6c0 con 0x7f4ca80047d0 2024-02-02T11:49:12.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc0d8d640 1 -- 172.21.15.161:0/3881275851 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca800bf80 con 0x7f4ca8005190 2024-02-02T11:49:12.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc0d8d640 1 -- 172.21.15.161:0/3881275851 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca800c140 con 0x7f4ca8003b10 2024-02-02T11:49:12.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc158e640 1 --2- 172.21.15.161:0/3881275851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ca80047d0 0x7f4ca8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc1d8f640 1 --2- 172.21.15.161:0/3881275851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca8003b10 0x7f4ca8003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc2590640 1 --2- 172.21.15.161:0/3881275851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca8005190 0x7f4ca800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc158e640 1 -- 172.21.15.161:0/3881275851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca8003b10 msgr2=0x7f4ca8003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:12.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc158e640 1 --2- 172.21.15.161:0/3881275851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca8003b10 0x7f4ca8003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc158e640 1 -- 172.21.15.161:0/3881275851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca8005190 msgr2=0x7f4ca800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:12.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc158e640 1 --2- 172.21.15.161:0/3881275851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca8005190 0x7f4ca800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc158e640 1 -- 172.21.15.161:0/3881275851 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca8003530 con 0x7f4ca80047d0 2024-02-02T11:49:12.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc1d8f640 1 --2- 172.21.15.161:0/3881275851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca8003b10 0x7f4ca8003f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:12.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc2590640 1 --2- 172.21.15.161:0/3881275851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca8005190 0x7f4ca800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:12.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.003+0000 7f4cc2590640 1 -- 172.21.15.161:0/3881275851 reap_dead start 2024-02-02T11:49:12.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.007+0000 7f4cc158e640 1 --2- 172.21.15.161:0/3881275851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ca80047d0 0x7f4ca8004c50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4cac001ec0 tx=0x7f4cac01f250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb249a00d366db09 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:12.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.007+0000 7f4cc0d8d640 1 -- 172.21.15.161:0/3881275851 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cac0a8c70 con 0x7f4ca80047d0 2024-02-02T11:49:12.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.007+0000 7f4cc0d8d640 1 -- 172.21.15.161:0/3881275851 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cac0a8df0 con 0x7f4ca80047d0 2024-02-02T11:49:12.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.007+0000 7f4cc0d8d640 1 -- 172.21.15.161:0/3881275851 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cac005b20 con 0x7f4ca80047d0 2024-02-02T11:49:12.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.007+0000 7f4cc3ff3640 1 -- 172.21.15.161:0/3881275851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ca80047d0 msgr2=0x7f4ca8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.007+0000 7f4cc3ff3640 1 --2- 172.21.15.161:0/3881275851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ca80047d0 0x7f4ca8004c50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4cac001ec0 tx=0x7f4cac01f250 comp rx=0 tx=0).stop 2024-02-02T11:49:12.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.007+0000 7f4cc3ff3640 1 -- 172.21.15.161:0/3881275851 shutdown_connections 2024-02-02T11:49:12.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.007+0000 7f4cc3ff3640 1 --2- 172.21.15.161:0/3881275851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ca80047d0 0x7f4ca8004c50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.007+0000 7f4cc3ff3640 1 -- 172.21.15.161:0/3881275851 >> 172.21.15.161:0/3881275851 conn(0x7f4cbc0c02f0 msgr2=0x7f4cbc0c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:12.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.007+0000 7f4cc3ff3640 1 -- 172.21.15.161:0/3881275851 shutdown_connections 2024-02-02T11:49:12.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.007+0000 7f4cc3ff3640 1 -- 172.21.15.161:0/3881275851 wait complete. 2024-02-02T11:49:12.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.007+0000 7f4cc3ff3640 1 Processor -- start 2024-02-02T11:49:12.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.007+0000 7f4cc3ff3640 1 -- start start 2024-02-02T11:49:12.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc3ff3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca80047d0 0x7f4cbc1d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc3ff3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cbc1d1870 0x7f4cbc1d1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc3ff3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cbc1486a0 0x7f4cbc148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc3ff3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cbc1d1260 con 0x7f4cbc1486a0 2024-02-02T11:49:12.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc3ff3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cbc148210 con 0x7f4ca80047d0 2024-02-02T11:49:12.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc3ff3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cbc0bfb40 con 0x7f4cbc1d1870 2024-02-02T11:49:12.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc2590640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cbc1486a0 0x7f4cbc148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc2590640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cbc1486a0 0x7f4cbc148b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40134/0 (socket says 172.21.15.161:40134) 2024-02-02T11:49:12.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc2590640 1 -- 172.21.15.161:0/1788792946 learned_addr learned my addr 172.21.15.161:0/1788792946 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:12.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc1d8f640 1 --2- 172.21.15.161:0/1788792946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca80047d0 0x7f4cbc1d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc158e640 1 --2- 172.21.15.161:0/1788792946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cbc1d1870 0x7f4cbc1d1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc2590640 1 -- 172.21.15.161:0/1788792946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cbc1d1870 msgr2=0x7f4cbc1d1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc2590640 1 --2- 172.21.15.161:0/1788792946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cbc1d1870 0x7f4cbc1d1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc2590640 1 -- 172.21.15.161:0/1788792946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca80047d0 msgr2=0x7f4cbc1d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc2590640 1 --2- 172.21.15.161:0/1788792946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca80047d0 0x7f4cbc1d0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc2590640 1 -- 172.21.15.161:0/1788792946 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cbc1d2380 con 0x7f4cbc1486a0 2024-02-02T11:49:12.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc2590640 1 --2- 172.21.15.161:0/1788792946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cbc1486a0 0x7f4cbc148b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc14aa60 tx=0x7f4cb400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:12.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cb27fc640 1 -- 172.21.15.161:0/1788792946 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4009b10 con 0x7f4cbc1486a0 2024-02-02T11:49:12.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cb27fc640 1 -- 172.21.15.161:0/1788792946 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb4016420 con 0x7f4cbc1486a0 2024-02-02T11:49:12.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc3ff3640 1 -- 172.21.15.161:0/1788792946 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cbc149440 con 0x7f4cbc1486a0 2024-02-02T11:49:12.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cb27fc640 1 -- 172.21.15.161:0/1788792946 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4016790 con 0x7f4cbc1486a0 2024-02-02T11:49:12.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc3ff3640 1 -- 172.21.15.161:0/1788792946 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cbc149720 con 0x7f4cbc1486a0 2024-02-02T11:49:12.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc3ff3640 1 -- 172.21.15.161:0/1788792946 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cbc04e000 con 0x7f4cbc1486a0 2024-02-02T11:49:12.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cb27fc640 1 -- 172.21.15.161:0/1788792946 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4cb40168f0 con 0x7f4cbc1486a0 2024-02-02T11:49:12.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cb27fc640 1 --2- 172.21.15.161:0/1788792946 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4ca0065a60 0x7f4ca0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc1d8f640 1 --2- 172.21.15.161:0/1788792946 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4ca0065a60 0x7f4ca0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cb27fc640 1 -- 172.21.15.161:0/1788792946 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cb4083e60 con 0x7f4cbc1486a0 2024-02-02T11:49:12.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.011+0000 7f4cc1d8f640 1 --2- 172.21.15.161:0/1788792946 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4ca0065a60 0x7f4ca0067f20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8000f70 tx=0x7f4cb8007b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:12.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.015+0000 7f4cb27fc640 1 -- 172.21.15.161:0/1788792946 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4cb40518b0 con 0x7f4cbc1486a0 2024-02-02T11:49:12.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.171+0000 7f4cc3ff3640 1 -- 172.21.15.161:0/1788792946 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4cbc148350 con 0x7f4cbc1486a0 2024-02-02T11:49:12.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.171+0000 7f4cb27fc640 1 -- 172.21.15.161:0/1788792946 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4cb4054ed0 con 0x7f4cbc1486a0 2024-02-02T11:49:12.174 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2024-02-02T11:49:12.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.171+0000 7f4cc3ff3640 1 -- 172.21.15.161:0/1788792946 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4ca0065a60 msgr2=0x7f4ca0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.171+0000 7f4cc3ff3640 1 --2- 172.21.15.161:0/1788792946 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4ca0065a60 0x7f4ca0067f20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8000f70 tx=0x7f4cb8007b80 comp rx=0 tx=0).stop 2024-02-02T11:49:12.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.171+0000 7f4cc3ff3640 1 -- 172.21.15.161:0/1788792946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cbc1486a0 msgr2=0x7f4cbc148b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.171+0000 7f4cc3ff3640 1 --2- 172.21.15.161:0/1788792946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cbc1486a0 0x7f4cbc148b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc14aa60 tx=0x7f4cb400f520 comp rx=0 tx=0).stop 2024-02-02T11:49:12.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.171+0000 7f4cc3ff3640 1 -- 172.21.15.161:0/1788792946 shutdown_connections 2024-02-02T11:49:12.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.171+0000 7f4cc3ff3640 1 --2- 172.21.15.161:0/1788792946 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4ca0065a60 0x7f4ca0067f20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.171+0000 7f4cc3ff3640 1 --2- 172.21.15.161:0/1788792946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cbc1486a0 0x7f4cbc148b00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.171+0000 7f4cc3ff3640 1 --2- 172.21.15.161:0/1788792946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cbc1d1870 0x7f4cbc1d1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.171+0000 7f4cc3ff3640 1 --2- 172.21.15.161:0/1788792946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca80047d0 0x7f4cbc1d0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.171+0000 7f4cc3ff3640 1 -- 172.21.15.161:0/1788792946 >> 172.21.15.161:0/1788792946 conn(0x7f4cbc0c02f0 msgr2=0x7f4cbc0b8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:12.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.171+0000 7f4cc3ff3640 1 -- 172.21.15.161:0/1788792946 shutdown_connections 2024-02-02T11:49:12.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.171+0000 7f4cc3ff3640 1 -- 172.21.15.161:0/1788792946 wait complete. 2024-02-02T11:49:12.193 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:49:12.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.307+0000 7f8bd1749640 1 Processor -- start 2024-02-02T11:49:12.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.307+0000 7f8bd1749640 1 -- start start 2024-02-02T11:49:12.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.311+0000 7f8bd1749640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8bcc0bc340 0x7f8bcc1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.311+0000 7f8bd1749640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bcc141b30 0x7f8bcc147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.311+0000 7f8bd1749640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bcc071550 con 0x7f8bcc0b8020 2024-02-02T11:49:12.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.311+0000 7f8bd1749640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bcc071810 con 0x7f8bcc0bc340 2024-02-02T11:49:12.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.311+0000 7f8bd1749640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc071950 con 0x7f8bcc141b30 2024-02-02T11:49:12.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.311+0000 7f8bcaffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8bcc0bc340 0x7f8bcc1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.311+0000 7f8bcaffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8bcc0bc340 0x7f8bcc1415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40136/0 (socket says 172.21.15.161:40136) 2024-02-02T11:49:12.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.311+0000 7f8bcaffd640 1 -- 172.21.15.161:0/609172615 learned_addr learned my addr 172.21.15.161:0/609172615 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:12.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.311+0000 7f8bc3fff640 1 --2- 172.21.15.161:0/609172615 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bcc141b30 0x7f8bcc147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.311+0000 7f8bcaffd640 1 -- 172.21.15.161:0/609172615 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bcc141b30 msgr2=0x7f8bcc147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:12.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.311+0000 7f8bcaffd640 1 --2- 172.21.15.161:0/609172615 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bcc141b30 0x7f8bcc147c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.311+0000 7f8bcaffd640 1 -- 172.21.15.161:0/609172615 >> v1:172.21.15.162:6789/0 conn(0x7f8bcc0b8020 legacy=0x7f8bcc14abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:12.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.311+0000 7f8bcaffd640 1 -- 172.21.15.161:0/609172615 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc0bc720 con 0x7f8bcc0bc340 2024-02-02T11:49:12.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.311+0000 7f8bcaffd640 1 --2- 172.21.15.161:0/609172615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bcc0bc340 0x7f8bcc1415f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc009870 tx=0x7f8bbc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828833eb6df2945d server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:12.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.311+0000 7f8bca7fc640 1 -- 172.21.15.161:0/609172615 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc0ab600 con 0x7f8bcc0bc340 2024-02-02T11:49:12.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.311+0000 7f8bca7fc640 1 -- 172.21.15.161:0/609172615 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bbc0a7050 con 0x7f8bcc0bc340 2024-02-02T11:49:12.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.311+0000 7f8bca7fc640 1 -- 172.21.15.161:0/609172615 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc0ab980 con 0x7f8bcc0bc340 2024-02-02T11:49:12.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bd1749640 1 -- 172.21.15.161:0/609172615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bcc0bc340 msgr2=0x7f8bcc1415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bd1749640 1 --2- 172.21.15.161:0/609172615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bcc0bc340 0x7f8bcc1415f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc009870 tx=0x7f8bbc01c470 comp rx=0 tx=0).stop 2024-02-02T11:49:12.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bd1749640 1 -- 172.21.15.161:0/609172615 shutdown_connections 2024-02-02T11:49:12.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bd1749640 1 --2- 172.21.15.161:0/609172615 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bcc141b30 0x7f8bcc147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bd1749640 1 --2- 172.21.15.161:0/609172615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bcc0bc340 0x7f8bcc1415f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bd1749640 1 -- 172.21.15.161:0/609172615 >> 172.21.15.161:0/609172615 conn(0x7f8bcc069ef0 msgr2=0x7f8bcc06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:12.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bd1749640 1 -- 172.21.15.161:0/609172615 shutdown_connections 2024-02-02T11:49:12.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bd1749640 1 -- 172.21.15.161:0/609172615 wait complete. 2024-02-02T11:49:12.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bd1749640 1 Processor -- start 2024-02-02T11:49:12.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bd1749640 1 -- start start 2024-02-02T11:49:12.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bd1749640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bcc0b8020 0x7f8bcc1e3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bd1749640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bcc0bc340 0x7f8bcc1421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bd1749640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bcc141b30 0x7f8bcc1430b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bd1749640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc1426f0 con 0x7f8bcc141b30 2024-02-02T11:49:12.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bd1749640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc1e31f0 con 0x7f8bcc0b8020 2024-02-02T11:49:12.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bd1749640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc1435f0 con 0x7f8bcc0bc340 2024-02-02T11:49:12.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bcb7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bcc141b30 0x7f8bcc1430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bcb7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bcc141b30 0x7f8bcc1430b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40140/0 (socket says 172.21.15.161:40140) 2024-02-02T11:49:12.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bcb7fe640 1 -- 172.21.15.161:0/1541479639 learned_addr learned my addr 172.21.15.161:0/1541479639 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:12.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bc3fff640 1 --2- 172.21.15.161:0/1541479639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bcc0bc340 0x7f8bcc1421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bcaffd640 1 --2- 172.21.15.161:0/1541479639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bcc0b8020 0x7f8bcc1e3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bcb7fe640 1 -- 172.21.15.161:0/1541479639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bcc0bc340 msgr2=0x7f8bcc1421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bcb7fe640 1 --2- 172.21.15.161:0/1541479639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bcc0bc340 0x7f8bcc1421b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bcb7fe640 1 -- 172.21.15.161:0/1541479639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bcc0b8020 msgr2=0x7f8bcc1e3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bcb7fe640 1 --2- 172.21.15.161:0/1541479639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bcc0b8020 0x7f8bcc1e3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bcb7fe640 1 -- 172.21.15.161:0/1541479639 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc0094d0 con 0x7f8bcc141b30 2024-02-02T11:49:12.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bc3fff640 1 --2- 172.21.15.161:0/1541479639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bcc0bc340 0x7f8bcc1421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:49:12.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bcaffd640 1 --2- 172.21.15.161:0/1541479639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bcc0b8020 0x7f8bcc1e3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:49:12.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bcb7fe640 1 --2- 172.21.15.161:0/1541479639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bcc141b30 0x7f8bcc1430b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400be60 tx=0x7f8bc400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:12.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bc37fe640 1 -- 172.21.15.161:0/1541479639 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4014440 con 0x7f8bcc141b30 2024-02-02T11:49:12.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bc37fe640 1 -- 172.21.15.161:0/1541479639 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc40145a0 con 0x7f8bcc141b30 2024-02-02T11:49:12.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bd1749640 1 -- 172.21.15.161:0/1541479639 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bcc14a2f0 con 0x7f8bcc141b30 2024-02-02T11:49:12.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bc37fe640 1 -- 172.21.15.161:0/1541479639 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4014990 con 0x7f8bcc141b30 2024-02-02T11:49:12.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.315+0000 7f8bd1749640 1 -- 172.21.15.161:0/1541479639 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bcc1e2e80 con 0x7f8bcc141b30 2024-02-02T11:49:12.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.319+0000 7f8bd1749640 1 -- 172.21.15.161:0/1541479639 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bcc1e3360 con 0x7f8bcc141b30 2024-02-02T11:49:12.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.319+0000 7f8bc37fe640 1 -- 172.21.15.161:0/1541479639 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8bc401e440 con 0x7f8bcc141b30 2024-02-02T11:49:12.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.319+0000 7f8bc37fe640 1 --2- 172.21.15.161:0/1541479639 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8bac065a90 0x7f8bac067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.319+0000 7f8bc37fe640 1 -- 172.21.15.161:0/1541479639 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8bc4083400 con 0x7f8bcc141b30 2024-02-02T11:49:12.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.319+0000 7f8bcaffd640 1 --2- 172.21.15.161:0/1541479639 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8bac065a90 0x7f8bac067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.319+0000 7f8bcaffd640 1 --2- 172.21.15.161:0/1541479639 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8bac065a90 0x7f8bac067f50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0ad000 tx=0x7f8bbc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:12.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.323+0000 7f8bc37fe640 1 -- 172.21.15.161:0/1541479639 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8bc4050f30 con 0x7f8bcc141b30 2024-02-02T11:49:12.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.479+0000 7f8bd1749640 1 -- 172.21.15.161:0/1541479639 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8bcc04e000 con 0x7f8bcc141b30 2024-02-02T11:49:12.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.479+0000 7f8bc37fe640 1 -- 172.21.15.161:0/1541479639 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f8bc4054550 con 0x7f8bcc141b30 2024-02-02T11:49:12.484 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:12.484 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":20,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:52.816101+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:48:50.155565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-02T11:48:50.795158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:49:12.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.483+0000 7f8bd1749640 1 -- 172.21.15.161:0/1541479639 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8bac065a90 msgr2=0x7f8bac067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.483+0000 7f8bd1749640 1 --2- 172.21.15.161:0/1541479639 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8bac065a90 0x7f8bac067f50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0ad000 tx=0x7f8bbc008040 comp rx=0 tx=0).stop 2024-02-02T11:49:12.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.483+0000 7f8bd1749640 1 -- 172.21.15.161:0/1541479639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bcc141b30 msgr2=0x7f8bcc1430b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.483+0000 7f8bd1749640 1 --2- 172.21.15.161:0/1541479639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bcc141b30 0x7f8bcc1430b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400be60 tx=0x7f8bc400bf50 comp rx=0 tx=0).stop 2024-02-02T11:49:12.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.483+0000 7f8bd1749640 1 -- 172.21.15.161:0/1541479639 shutdown_connections 2024-02-02T11:49:12.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.483+0000 7f8bd1749640 1 --2- 172.21.15.161:0/1541479639 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8bac065a90 0x7f8bac067f50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.483+0000 7f8bd1749640 1 --2- 172.21.15.161:0/1541479639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bcc141b30 0x7f8bcc1430b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.483+0000 7f8bd1749640 1 --2- 172.21.15.161:0/1541479639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bcc0bc340 0x7f8bcc1421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.483+0000 7f8bd1749640 1 --2- 172.21.15.161:0/1541479639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bcc0b8020 0x7f8bcc1e3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.483+0000 7f8bd1749640 1 -- 172.21.15.161:0/1541479639 >> 172.21.15.161:0/1541479639 conn(0x7f8bcc069ef0 msgr2=0x7f8bcc13f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:12.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.483+0000 7f8bd1749640 1 -- 172.21.15.161:0/1541479639 shutdown_connections 2024-02-02T11:49:12.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.483+0000 7f8bd1749640 1 -- 172.21.15.161:0/1541479639 wait complete. 2024-02-02T11:49:12.503 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-02T11:48:40.330782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-02T11:48:50.155565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-02T11:48:50.795158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-02T11:49:12.504 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-02T11:49:12.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.623+0000 7f8b3bb6c640 1 Processor -- start 2024-02-02T11:49:12.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.623+0000 7f8b3bb6c640 1 -- start start 2024-02-02T11:49:12.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.623+0000 7f8b3bb6c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b340706d0 0x7f8b34070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.623+0000 7f8b3bb6c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8b340b2db0 0x7f8b34144270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.623+0000 7f8b3bb6c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b340b2960 con 0x7f8b341447b0 2024-02-02T11:49:12.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.623+0000 7f8b3bb6c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3406ef70 con 0x7f8b340b2db0 2024-02-02T11:49:12.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.623+0000 7f8b3bb6c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3406ecd0 con 0x7f8b340706d0 2024-02-02T11:49:12.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.623+0000 7f8b3a109640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f8b341447b0 0x7f8b34147280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:58970/0 (socket says 172.21.15.161:58970) 2024-02-02T11:49:12.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.623+0000 7f8b3a109640 1 -- 172.21.15.161:0/67637574 learned_addr learned my addr 172.21.15.161:0/67637574 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:12.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b39908640 1 --2- 172.21.15.161:0/67637574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b340706d0 0x7f8b34070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b38906640 1 -- 172.21.15.161:0/67637574 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355221977 0 0) 0x7f8b340b2960 con 0x7f8b341447b0 2024-02-02T11:49:12.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b39107640 1 --2- 172.21.15.161:0/67637574 >> v2:172.21.15.162:3300/0 conn(0x7f8b340b2db0 0x7f8b34144270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b38906640 1 -- 172.21.15.161:0/67637574 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b20003530 con 0x7f8b341447b0 2024-02-02T11:49:12.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b38906640 1 -- 172.21.15.161:0/67637574 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1615652195 0 0) 0x7f8b20003530 con 0x7f8b341447b0 2024-02-02T11:49:12.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b38906640 1 -- 172.21.15.161:0/67637574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b340706d0 msgr2=0x7f8b34070ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:12.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b38906640 1 --2- 172.21.15.161:0/67637574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b340706d0 0x7f8b34070ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b38906640 1 -- 172.21.15.161:0/67637574 >> v2:172.21.15.162:3300/0 conn(0x7f8b340b2db0 msgr2=0x7f8b34144270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:12.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b38906640 1 --2- 172.21.15.161:0/67637574 >> v2:172.21.15.162:3300/0 conn(0x7f8b340b2db0 0x7f8b34144270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b38906640 1 -- 172.21.15.161:0/67637574 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3406fe50 con 0x7f8b341447b0 2024-02-02T11:49:12.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b38906640 1 -- 172.21.15.161:0/67637574 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f8b2c001a00 con 0x7f8b341447b0 2024-02-02T11:49:12.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b38906640 1 -- 172.21.15.161:0/67637574 >> v1:172.21.15.161:6789/0 conn(0x7f8b341447b0 legacy=0x7f8b34147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b38906640 1 --2- 172.21.15.161:0/67637574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b20003980 0x7f8b20003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b38906640 1 --2- 172.21.15.161:0/67637574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b340706d0 0x7f8b200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b38906640 1 --2- 172.21.15.161:0/67637574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b20004d10 0x7f8b20005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b38906640 1 -- 172.21.15.161:0/67637574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3406ef70 con 0x7f8b20003980 2024-02-02T11:49:12.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b38906640 1 -- 172.21.15.161:0/67637574 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3406ecd0 con 0x7f8b20004d10 2024-02-02T11:49:12.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b38906640 1 -- 172.21.15.161:0/67637574 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2000b990 con 0x7f8b340706d0 2024-02-02T11:49:12.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b39908640 1 --2- 172.21.15.161:0/67637574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b20003980 0x7f8b20003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b39107640 1 --2- 172.21.15.161:0/67637574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b340706d0 0x7f8b200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b39908640 1 -- 172.21.15.161:0/67637574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b340706d0 msgr2=0x7f8b200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:12.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b39908640 1 --2- 172.21.15.161:0/67637574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b340706d0 0x7f8b200047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b39908640 1 -- 172.21.15.161:0/67637574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b20004d10 msgr2=0x7f8b20005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:12.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b3a109640 1 --2- 172.21.15.161:0/67637574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b20004d10 0x7f8b20005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b39908640 1 --2- 172.21.15.161:0/67637574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b20004d10 0x7f8b20005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b39908640 1 -- 172.21.15.161:0/67637574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b20003530 con 0x7f8b20003980 2024-02-02T11:49:12.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b39107640 1 --2- 172.21.15.161:0/67637574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b340706d0 0x7f8b200047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:12.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b39908640 1 --2- 172.21.15.161:0/67637574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b20003980 0x7f8b20003da0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8b30009b10 tx=0x7f8b3001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44734cf549b6eaa1 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:12.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b38906640 1 -- 172.21.15.161:0/67637574 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b300a5640 con 0x7f8b20003980 2024-02-02T11:49:12.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b38906640 1 -- 172.21.15.161:0/67637574 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b300a57a0 con 0x7f8b20003980 2024-02-02T11:49:12.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b38906640 1 -- 172.21.15.161:0/67637574 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b300a5b50 con 0x7f8b20003980 2024-02-02T11:49:12.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b3bb6c640 1 -- 172.21.15.161:0/67637574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b20003980 msgr2=0x7f8b20003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b3bb6c640 1 --2- 172.21.15.161:0/67637574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b20003980 0x7f8b20003da0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8b30009b10 tx=0x7f8b3001ca50 comp rx=0 tx=0).stop 2024-02-02T11:49:12.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b3a109640 1 -- 172.21.15.161:0/67637574 reap_dead start 2024-02-02T11:49:12.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b3bb6c640 1 -- 172.21.15.161:0/67637574 shutdown_connections 2024-02-02T11:49:12.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b3bb6c640 1 -- 172.21.15.161:0/67637574 >> 172.21.15.161:0/67637574 conn(0x7f8b3406a120 msgr2=0x7f8b3406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:12.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b3bb6c640 1 -- 172.21.15.161:0/67637574 shutdown_connections 2024-02-02T11:49:12.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.627+0000 7f8b3bb6c640 1 -- 172.21.15.161:0/67637574 wait complete. 2024-02-02T11:49:12.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b3bb6c640 1 Processor -- start 2024-02-02T11:49:12.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b3bb6c640 1 -- start start 2024-02-02T11:49:12.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b3bb6c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b20003980 0x7f8b34143240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b3bb6c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b3413bc90 0x7f8b3413d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b3bb6c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b3413f8b0 0x7f8b341db9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b3bb6c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3413df10 con 0x7f8b20003980 2024-02-02T11:49:12.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b3bb6c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b34143780 con 0x7f8b3413bc90 2024-02-02T11:49:12.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b3bb6c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3413dc30 con 0x7f8b3413f8b0 2024-02-02T11:49:12.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b39908640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b20003980 0x7f8b34143240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b39908640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b20003980 0x7f8b34143240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40364/0 (socket says 172.21.15.161:40364) 2024-02-02T11:49:12.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b39908640 1 -- 172.21.15.161:0/2962897556 learned_addr learned my addr 172.21.15.161:0/2962897556 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:12.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b39107640 1 --2- 172.21.15.161:0/2962897556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b3413bc90 0x7f8b3413d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b3a109640 1 --2- 172.21.15.161:0/2962897556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b3413f8b0 0x7f8b341db9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b39908640 1 -- 172.21.15.161:0/2962897556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b3413f8b0 msgr2=0x7f8b341db9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b39908640 1 --2- 172.21.15.161:0/2962897556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b3413f8b0 0x7f8b341db9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b39908640 1 -- 172.21.15.161:0/2962897556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b3413bc90 msgr2=0x7f8b3413d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b39908640 1 --2- 172.21.15.161:0/2962897556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b3413bc90 0x7f8b3413d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b39908640 1 -- 172.21.15.161:0/2962897556 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3413b490 con 0x7f8b20003980 2024-02-02T11:49:12.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b3a109640 1 --2- 172.21.15.161:0/2962897556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b3413f8b0 0x7f8b341db9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:12.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b39908640 1 --2- 172.21.15.161:0/2962897556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b20003980 0x7f8b34143240 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8b3001c880 tx=0x7f8b20005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:12.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b2a7fc640 1 -- 172.21.15.161:0/2962897556 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b300be070 con 0x7f8b20003980 2024-02-02T11:49:12.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b2a7fc640 1 -- 172.21.15.161:0/2962897556 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b30004020 con 0x7f8b20003980 2024-02-02T11:49:12.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b3bb6c640 1 -- 172.21.15.161:0/2962897556 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3413b770 con 0x7f8b20003980 2024-02-02T11:49:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b2a7fc640 1 -- 172.21.15.161:0/2962897556 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b300a5640 con 0x7f8b20003980 2024-02-02T11:49:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b3bb6c640 1 -- 172.21.15.161:0/2962897556 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b341dbee0 con 0x7f8b20003980 2024-02-02T11:49:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b3bb6c640 1 -- 172.21.15.161:0/2962897556 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b34067050 con 0x7f8b20003980 2024-02-02T11:49:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.631+0000 7f8b2a7fc640 1 -- 172.21.15.161:0/2962897556 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8b300b4040 con 0x7f8b20003980 2024-02-02T11:49:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.635+0000 7f8b2a7fc640 1 --2- 172.21.15.161:0/2962897556 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8b18065a60 0x7f8b18067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.635+0000 7f8b2a7fc640 1 -- 172.21.15.161:0/2962897556 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b3011d1e0 con 0x7f8b20003980 2024-02-02T11:49:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.635+0000 7f8b39107640 1 --2- 172.21.15.161:0/2962897556 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8b18065a60 0x7f8b18067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.635+0000 7f8b39107640 1 --2- 172.21.15.161:0/2962897556 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8b18065a60 0x7f8b18067f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8b34146fc0 tx=0x7f8b24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:12.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.639+0000 7f8b2a7fc640 1 -- 172.21.15.161:0/2962897556 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8b300ead50 con 0x7f8b20003980 2024-02-02T11:49:12.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.779+0000 7f8b3bb6c640 1 -- 172.21.15.161:0/2962897556 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b3413b2f0 con 0x7f8b20003980 2024-02-02T11:49:12.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.779+0000 7f8b2a7fc640 1 -- 172.21.15.161:0/2962897556 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b3413b2f0 con 0x7f8b20003980 2024-02-02T11:49:12.783 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-02-02T11:49:12.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.779+0000 7f8b3bb6c640 1 -- 172.21.15.161:0/2962897556 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8b18065a60 msgr2=0x7f8b18067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.779+0000 7f8b3bb6c640 1 --2- 172.21.15.161:0/2962897556 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8b18065a60 0x7f8b18067f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8b34146fc0 tx=0x7f8b24008040 comp rx=0 tx=0).stop 2024-02-02T11:49:12.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.779+0000 7f8b3bb6c640 1 -- 172.21.15.161:0/2962897556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b20003980 msgr2=0x7f8b34143240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.779+0000 7f8b3bb6c640 1 --2- 172.21.15.161:0/2962897556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b20003980 0x7f8b34143240 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8b3001c880 tx=0x7f8b20005800 comp rx=0 tx=0).stop 2024-02-02T11:49:12.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.779+0000 7f8b3bb6c640 1 -- 172.21.15.161:0/2962897556 shutdown_connections 2024-02-02T11:49:12.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.783+0000 7f8b3bb6c640 1 --2- 172.21.15.161:0/2962897556 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8b18065a60 0x7f8b18067f20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.783+0000 7f8b3bb6c640 1 --2- 172.21.15.161:0/2962897556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b3413f8b0 0x7f8b341db9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.783+0000 7f8b3bb6c640 1 --2- 172.21.15.161:0/2962897556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b3413bc90 0x7f8b3413d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.783+0000 7f8b3bb6c640 1 --2- 172.21.15.161:0/2962897556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b20003980 0x7f8b34143240 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.783+0000 7f8b3bb6c640 1 -- 172.21.15.161:0/2962897556 >> 172.21.15.161:0/2962897556 conn(0x7f8b3406a120 msgr2=0x7f8b3406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:12.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.783+0000 7f8b3bb6c640 1 -- 172.21.15.161:0/2962897556 shutdown_connections 2024-02-02T11:49:12.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.783+0000 7f8b3bb6c640 1 -- 172.21.15.161:0/2962897556 wait complete. 2024-02-02T11:49:12.800 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-02T11:49:12.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dca31b640 1 Processor -- start 2024-02-02T11:49:12.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dca31b640 1 -- start start 2024-02-02T11:49:12.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dca31b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dc4147bc0 0x7f4dc40709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dca31b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4dc4144100 0x7f4dc41445b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dca31b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc4070ef0 con 0x7f4dc406fc30 2024-02-02T11:49:12.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dca31b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc4071640 con 0x7f4dc4144100 2024-02-02T11:49:12.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dca31b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc406ecc0 con 0x7f4dc4147bc0 2024-02-02T11:49:12.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc3fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f4dc406fc30 0x7f4dc41474b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:58986/0 (socket says 172.21.15.161:58986) 2024-02-02T11:49:12.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc3fff640 1 -- 172.21.15.161:0/2295959491 learned_addr learned my addr 172.21.15.161:0/2295959491 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:12.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc37fe640 1 --2- 172.21.15.161:0/2295959491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dc4147bc0 0x7f4dc40709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc88b8640 1 --2- 172.21.15.161:0/2295959491 >> v2:172.21.15.162:3300/0 conn(0x7f4dc4144100 0x7f4dc41445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc2ffd640 1 -- 172.21.15.161:0/2295959491 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307990715 0 0) 0x7f4db4001120 con 0x7f4dc406fc30 2024-02-02T11:49:12.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc2ffd640 1 -- 172.21.15.161:0/2295959491 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dac003530 con 0x7f4dc406fc30 2024-02-02T11:49:12.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc2ffd640 1 -- 172.21.15.161:0/2295959491 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 570360398 0 0) 0x7f4dac003530 con 0x7f4dc406fc30 2024-02-02T11:49:12.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc2ffd640 1 -- 172.21.15.161:0/2295959491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dc4147bc0 msgr2=0x7f4dc40709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:12.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc2ffd640 1 --2- 172.21.15.161:0/2295959491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dc4147bc0 0x7f4dc40709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc2ffd640 1 -- 172.21.15.161:0/2295959491 >> v2:172.21.15.162:3300/0 conn(0x7f4dc4144100 msgr2=0x7f4dc41445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:12.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc2ffd640 1 --2- 172.21.15.161:0/2295959491 >> v2:172.21.15.162:3300/0 conn(0x7f4dc4144100 0x7f4dc41445b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc2ffd640 1 -- 172.21.15.161:0/2295959491 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc406ef30 con 0x7f4dc406fc30 2024-02-02T11:49:12.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc2ffd640 1 -- 172.21.15.161:0/2295959491 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f4db4001810 con 0x7f4dc406fc30 2024-02-02T11:49:12.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc2ffd640 1 -- 172.21.15.161:0/2295959491 >> v1:172.21.15.161:6789/0 conn(0x7f4dc406fc30 legacy=0x7f4dc41474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc2ffd640 1 --2- 172.21.15.161:0/2295959491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dac003980 0x7f4dac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc2ffd640 1 --2- 172.21.15.161:0/2295959491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dac0047d0 0x7f4dac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc2ffd640 1 --2- 172.21.15.161:0/2295959491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dc4147bc0 0x7f4dac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc2ffd640 1 -- 172.21.15.161:0/2295959491 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc406ecc0 con 0x7f4dac003980 2024-02-02T11:49:12.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc2ffd640 1 -- 172.21.15.161:0/2295959491 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac005960 con 0x7f4dac0047d0 2024-02-02T11:49:12.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc2ffd640 1 -- 172.21.15.161:0/2295959491 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac005b20 con 0x7f4dc4147bc0 2024-02-02T11:49:12.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc3fff640 1 --2- 172.21.15.161:0/2295959491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dac003980 0x7f4dac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc37fe640 1 --2- 172.21.15.161:0/2295959491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dac0047d0 0x7f4dac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc3fff640 1 -- 172.21.15.161:0/2295959491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dc4147bc0 msgr2=0x7f4dac005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:12.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc88b8640 1 --2- 172.21.15.161:0/2295959491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dc4147bc0 0x7f4dac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc3fff640 1 --2- 172.21.15.161:0/2295959491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dc4147bc0 0x7f4dac005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc3fff640 1 -- 172.21.15.161:0/2295959491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dac0047d0 msgr2=0x7f4dac004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:12.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc3fff640 1 --2- 172.21.15.161:0/2295959491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dac0047d0 0x7f4dac004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc3fff640 1 -- 172.21.15.161:0/2295959491 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac003530 con 0x7f4dac003980 2024-02-02T11:49:12.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.915+0000 7f4dc37fe640 1 --2- 172.21.15.161:0/2295959491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dac0047d0 0x7f4dac004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:12.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dc3fff640 1 --2- 172.21.15.161:0/2295959491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dac003980 0x7f4dac003da0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c210 tx=0x7f4db401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4656c9f6c1d45d server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:12.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dc2ffd640 1 -- 172.21.15.161:0/2295959491 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db40058e0 con 0x7f4dac003980 2024-02-02T11:49:12.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dc2ffd640 1 -- 172.21.15.161:0/2295959491 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db4005a40 con 0x7f4dac003980 2024-02-02T11:49:12.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dc2ffd640 1 -- 172.21.15.161:0/2295959491 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4005df0 con 0x7f4dac003980 2024-02-02T11:49:12.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dca31b640 1 -- 172.21.15.161:0/2295959491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dac003980 msgr2=0x7f4dac003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dca31b640 1 --2- 172.21.15.161:0/2295959491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dac003980 0x7f4dac003da0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c210 tx=0x7f4db401cc10 comp rx=0 tx=0).stop 2024-02-02T11:49:12.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dc88b8640 1 -- 172.21.15.161:0/2295959491 reap_dead start 2024-02-02T11:49:12.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dca31b640 1 -- 172.21.15.161:0/2295959491 shutdown_connections 2024-02-02T11:49:12.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dca31b640 1 -- 172.21.15.161:0/2295959491 >> 172.21.15.161:0/2295959491 conn(0x7f4dc406a120 msgr2=0x7f4dc406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:12.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dca31b640 1 -- 172.21.15.161:0/2295959491 shutdown_connections 2024-02-02T11:49:12.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dca31b640 1 -- 172.21.15.161:0/2295959491 wait complete. 2024-02-02T11:49:12.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dca31b640 1 Processor -- start 2024-02-02T11:49:12.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dca31b640 1 -- start start 2024-02-02T11:49:12.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dca31b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dac003980 0x7f4dc40b9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dca31b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dc40bb0e0 0x7f4dc41d5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dca31b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dc40b5640 0x7f4dc41d5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dca31b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40ba510 con 0x7f4dc40bb0e0 2024-02-02T11:49:12.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dca31b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40bc510 con 0x7f4dc40b5640 2024-02-02T11:49:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dca31b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40bc080 con 0x7f4dac003980 2024-02-02T11:49:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dc37fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dc40bb0e0 0x7f4dc41d5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dc37fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dc40bb0e0 0x7f4dc41d5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40386/0 (socket says 172.21.15.161:40386) 2024-02-02T11:49:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.919+0000 7f4dc37fe640 1 -- 172.21.15.161:0/1453811049 learned_addr learned my addr 172.21.15.161:0/1453811049 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.923+0000 7f4dc88b8640 1 --2- 172.21.15.161:0/1453811049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dc40b5640 0x7f4dc41d5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.923+0000 7f4dc3fff640 1 --2- 172.21.15.161:0/1453811049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dac003980 0x7f4dc40b9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.923+0000 7f4dc37fe640 1 -- 172.21.15.161:0/1453811049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dac003980 msgr2=0x7f4dc40b9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.923+0000 7f4dc37fe640 1 --2- 172.21.15.161:0/1453811049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dac003980 0x7f4dc40b9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.923+0000 7f4dc37fe640 1 -- 172.21.15.161:0/1453811049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dc40b5640 msgr2=0x7f4dc41d5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.923+0000 7f4dc37fe640 1 --2- 172.21.15.161:0/1453811049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dc40b5640 0x7f4dc41d5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.923+0000 7f4dc37fe640 1 -- 172.21.15.161:0/1453811049 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc40bb5c0 con 0x7f4dc40bb0e0 2024-02-02T11:49:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.923+0000 7f4dc37fe640 1 --2- 172.21.15.161:0/1453811049 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dc40bb0e0 0x7f4dc41d5780 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4db8010890 tx=0x7f4db8010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.923+0000 7f4dc0ff9640 1 -- 172.21.15.161:0/1453811049 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db800eae0 con 0x7f4dc40bb0e0 2024-02-02T11:49:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.923+0000 7f4dc0ff9640 1 -- 172.21.15.161:0/1453811049 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db800ec40 con 0x7f4dc40bb0e0 2024-02-02T11:49:12.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.923+0000 7f4dca31b640 1 -- 172.21.15.161:0/1453811049 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc40bc890 con 0x7f4dc40bb0e0 2024-02-02T11:49:12.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.923+0000 7f4dc0ff9640 1 -- 172.21.15.161:0/1453811049 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db801c400 con 0x7f4dc40bb0e0 2024-02-02T11:49:12.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.923+0000 7f4dca31b640 1 -- 172.21.15.161:0/1453811049 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc40bbd10 con 0x7f4dc40bb0e0 2024-02-02T11:49:12.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.923+0000 7f4dca31b640 1 -- 172.21.15.161:0/1453811049 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc40bbed0 con 0x7f4dc40bb0e0 2024-02-02T11:49:12.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.923+0000 7f4dc0ff9640 1 -- 172.21.15.161:0/1453811049 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4db801c560 con 0x7f4dc40bb0e0 2024-02-02T11:49:12.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.923+0000 7f4dc0ff9640 1 --2- 172.21.15.161:0/1453811049 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4db0065a60 0x7f4db0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:12.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.923+0000 7f4dc0ff9640 1 -- 172.21.15.161:0/1453811049 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4db8083630 con 0x7f4dc40bb0e0 2024-02-02T11:49:12.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.923+0000 7f4dc3fff640 1 --2- 172.21.15.161:0/1453811049 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4db0065a60 0x7f4db0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:12.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.923+0000 7f4dc3fff640 1 --2- 172.21.15.161:0/1453811049 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4db0065a60 0x7f4db0067f20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4db40aa000 tx=0x7f4db4001ba0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:12.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:12.927+0000 7f4dc0ff9640 1 -- 172.21.15.161:0/1453811049 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4db8050ff0 con 0x7f4dc40bb0e0 2024-02-02T11:49:13.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.075+0000 7f4dca31b640 1 -- 172.21.15.161:0/1453811049 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4dc4067050 con 0x7f4dc40bb0e0 2024-02-02T11:49:13.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.079+0000 7f4dc0ff9640 1 -- 172.21.15.161:0/1453811049 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4db8054610 con 0x7f4dc40bb0e0 2024-02-02T11:49:13.081 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-02-02T11:49:13.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.079+0000 7f4dca31b640 1 -- 172.21.15.161:0/1453811049 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4db0065a60 msgr2=0x7f4db0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:13.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.079+0000 7f4dca31b640 1 --2- 172.21.15.161:0/1453811049 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4db0065a60 0x7f4db0067f20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4db40aa000 tx=0x7f4db4001ba0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.079+0000 7f4dca31b640 1 -- 172.21.15.161:0/1453811049 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dc40bb0e0 msgr2=0x7f4dc41d5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:13.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.079+0000 7f4dca31b640 1 --2- 172.21.15.161:0/1453811049 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dc40bb0e0 0x7f4dc41d5780 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4db8010890 tx=0x7f4db8010d50 comp rx=0 tx=0).stop 2024-02-02T11:49:13.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.079+0000 7f4dca31b640 1 -- 172.21.15.161:0/1453811049 shutdown_connections 2024-02-02T11:49:13.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.079+0000 7f4dca31b640 1 --2- 172.21.15.161:0/1453811049 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4db0065a60 0x7f4db0067f20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.079+0000 7f4dca31b640 1 --2- 172.21.15.161:0/1453811049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dc40b5640 0x7f4dc41d5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.079+0000 7f4dca31b640 1 --2- 172.21.15.161:0/1453811049 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dc40bb0e0 0x7f4dc41d5780 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.079+0000 7f4dca31b640 1 --2- 172.21.15.161:0/1453811049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dac003980 0x7f4dc40b9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.079+0000 7f4dca31b640 1 -- 172.21.15.161:0/1453811049 >> 172.21.15.161:0/1453811049 conn(0x7f4dc406a120 msgr2=0x7f4dc4144f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:13.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.079+0000 7f4dca31b640 1 -- 172.21.15.161:0/1453811049 shutdown_connections 2024-02-02T11:49:13.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.079+0000 7f4dca31b640 1 -- 172.21.15.161:0/1453811049 wait complete. 2024-02-02T11:49:13.100 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-02T11:49:13.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.223+0000 7fbe01aa7640 1 Processor -- start 2024-02-02T11:49:13.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.223+0000 7fbe01aa7640 1 -- start start 2024-02-02T11:49:13.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.223+0000 7fbe01aa7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbdfc0b3320 0x7fbdfc1541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:13.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.223+0000 7fbe01aa7640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdfc148a80 con 0x7fbdfc0b8df0 2024-02-02T11:49:13.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.223+0000 7fbe01aa7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdfc0b3890 con 0x7fbdfc0b8540 2024-02-02T11:49:13.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.223+0000 7fbe01aa7640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdfc0b3b70 con 0x7fbdfc0b3320 2024-02-02T11:49:13.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.223+0000 7fbdfbfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbdfc0b3320 0x7fbdfc1541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:13.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.223+0000 7fbdfbfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbdfc0b3320 0x7fbdfc1541c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40392/0 (socket says 172.21.15.161:40392) 2024-02-02T11:49:13.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.223+0000 7fbdfbfff640 1 -- 172.21.15.161:0/3442761934 learned_addr learned my addr 172.21.15.161:0/3442761934 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:13.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.223+0000 7fbdfb7fe640 1 --1- 172.21.15.161:0/3442761934 >> v1:172.21.15.161:6789/0 conn(0x7fbdfc0b8df0 0x7fbdfc142840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:58998/0 (socket says 172.21.15.161:58998) 2024-02-02T11:49:13.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.223+0000 7fbdfbfff640 1 -- 172.21.15.161:0/3442761934 >> v1:172.21.15.162:6789/0 conn(0x7fbdfc0b8540 legacy=0x7fbdfc148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:13.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.223+0000 7fbdfbfff640 1 -- 172.21.15.161:0/3442761934 >> v1:172.21.15.161:6789/0 conn(0x7fbdfc0b8df0 legacy=0x7fbdfc142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:13.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.223+0000 7fbdfa7fc640 1 -- 172.21.15.161:0/3442761934 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250162834 0 0) 0x7fbdfc148a80 con 0x7fbdfc0b8df0 2024-02-02T11:49:13.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.223+0000 7fbdfbfff640 1 -- 172.21.15.161:0/3442761934 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc0b3e50 con 0x7fbdfc0b3320 2024-02-02T11:49:13.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbdfbfff640 1 --2- 172.21.15.161:0/3442761934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdfc0b3320 0x7fbdfc1541c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009e50 tx=0x7fbdf401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35bc1aa6ca03e3b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:13.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbdfa7fc640 1 -- 172.21.15.161:0/3442761934 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf40a5830 con 0x7fbdfc0b3320 2024-02-02T11:49:13.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbdfa7fc640 1 -- 172.21.15.161:0/3442761934 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf40a5990 con 0x7fbdfc0b3320 2024-02-02T11:49:13.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbdfa7fc640 1 -- 172.21.15.161:0/3442761934 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf40a5d20 con 0x7fbdfc0b3320 2024-02-02T11:49:13.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbe01aa7640 1 -- 172.21.15.161:0/3442761934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdfc0b3320 msgr2=0x7fbdfc1541c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:13.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbe01aa7640 1 --2- 172.21.15.161:0/3442761934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdfc0b3320 0x7fbdfc1541c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009e50 tx=0x7fbdf401c9d0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbe01aa7640 1 -- 172.21.15.161:0/3442761934 shutdown_connections 2024-02-02T11:49:13.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbe01aa7640 1 --2- 172.21.15.161:0/3442761934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdfc0b3320 0x7fbdfc1541c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbe01aa7640 1 -- 172.21.15.161:0/3442761934 >> 172.21.15.161:0/3442761934 conn(0x7fbdfc06a120 msgr2=0x7fbdfc06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:13.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbe01aa7640 1 -- 172.21.15.161:0/3442761934 shutdown_connections 2024-02-02T11:49:13.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbe01aa7640 1 -- 172.21.15.161:0/3442761934 wait complete. 2024-02-02T11:49:13.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbe01aa7640 1 Processor -- start 2024-02-02T11:49:13.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbe01aa7640 1 -- start start 2024-02-02T11:49:13.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbe01aa7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbdfc0b3320 0x7fbdfc137d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:13.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbe01aa7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbdfc0b8540 0x7fbdfc140590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:13.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbe01aa7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdfc0b8df0 0x7fbdfc1414c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:13.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbe01aa7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc070b60 con 0x7fbdfc0b8df0 2024-02-02T11:49:13.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbe01aa7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc1410a0 con 0x7fbdfc0b8540 2024-02-02T11:49:13.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbe01aa7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc06fa00 con 0x7fbdfc0b3320 2024-02-02T11:49:13.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbdfbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdfc0b8df0 0x7fbdfc1414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:13.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbdfbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdfc0b8df0 0x7fbdfc1414c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40398/0 (socket says 172.21.15.161:40398) 2024-02-02T11:49:13.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbdfbfff640 1 -- 172.21.15.161:0/2869087854 learned_addr learned my addr 172.21.15.161:0/2869087854 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:13.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbdfb7fe640 1 --2- 172.21.15.161:0/2869087854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbdfc0b3320 0x7fbdfc137d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:13.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbdfaffd640 1 --2- 172.21.15.161:0/2869087854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbdfc0b8540 0x7fbdfc140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:13.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbdfbfff640 1 -- 172.21.15.161:0/2869087854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbdfc0b3320 msgr2=0x7fbdfc137d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:13.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbdfbfff640 1 --2- 172.21.15.161:0/2869087854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbdfc0b3320 0x7fbdfc137d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbdfbfff640 1 -- 172.21.15.161:0/2869087854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbdfc0b8540 msgr2=0x7fbdfc140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:13.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbdfbfff640 1 --2- 172.21.15.161:0/2869087854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbdfc0b8540 0x7fbdfc140590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbdfbfff640 1 -- 172.21.15.161:0/2869087854 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf4009b30 con 0x7fbdfc0b8df0 2024-02-02T11:49:13.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbdfaffd640 1 --2- 172.21.15.161:0/2869087854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbdfc0b8540 0x7fbdfc140590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:13.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbdfbfff640 1 --2- 172.21.15.161:0/2869087854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdfc0b8df0 0x7fbdfc1414c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40195e0 tx=0x7fbdf4019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:13.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbde3fff640 1 -- 172.21.15.161:0/2869087854 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf40b8880 con 0x7fbdfc0b8df0 2024-02-02T11:49:13.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbde3fff640 1 -- 172.21.15.161:0/2869087854 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf40b89e0 con 0x7fbdfc0b8df0 2024-02-02T11:49:13.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbe01aa7640 1 -- 172.21.15.161:0/2869087854 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdfc06fce0 con 0x7fbdfc0b8df0 2024-02-02T11:49:13.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbde3fff640 1 -- 172.21.15.161:0/2869087854 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf40b8d90 con 0x7fbdfc0b8df0 2024-02-02T11:49:13.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.227+0000 7fbe01aa7640 1 -- 172.21.15.161:0/2869087854 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdfc070640 con 0x7fbdfc0b8df0 2024-02-02T11:49:13.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.231+0000 7fbe01aa7640 1 -- 172.21.15.161:0/2869087854 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdfc1495a0 con 0x7fbdfc0b8df0 2024-02-02T11:49:13.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.231+0000 7fbde3fff640 1 -- 172.21.15.161:0/2869087854 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbdf40b6440 con 0x7fbdfc0b8df0 2024-02-02T11:49:13.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.231+0000 7fbde3fff640 1 --2- 172.21.15.161:0/2869087854 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbde8065a60 0x7fbde8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:13.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.231+0000 7fbdfb7fe640 1 --2- 172.21.15.161:0/2869087854 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbde8065a60 0x7fbde8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:13.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.231+0000 7fbde3fff640 1 -- 172.21.15.161:0/2869087854 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbdf411e8e0 con 0x7fbdfc0b8df0 2024-02-02T11:49:13.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.231+0000 7fbdfb7fe640 1 --2- 172.21.15.161:0/2869087854 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbde8065a60 0x7fbde8067f20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbdec000f70 tx=0x7fbdec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:13.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.235+0000 7fbde3fff640 1 -- 172.21.15.161:0/2869087854 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbdf40ec460 con 0x7fbdfc0b8df0 2024-02-02T11:49:13.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.375+0000 7fbe01aa7640 1 -- 172.21.15.161:0/2869087854 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbdfc04e000 con 0x7fbdfc0b8df0 2024-02-02T11:49:13.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.375+0000 7fbde3fff640 1 -- 172.21.15.161:0/2869087854 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbdf40efa80 con 0x7fbdfc0b8df0 2024-02-02T11:49:13.379 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2024-02-02T11:49:13.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.379+0000 7fbe01aa7640 1 -- 172.21.15.161:0/2869087854 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbde8065a60 msgr2=0x7fbde8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:13.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.379+0000 7fbe01aa7640 1 --2- 172.21.15.161:0/2869087854 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbde8065a60 0x7fbde8067f20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbdec000f70 tx=0x7fbdec009040 comp rx=0 tx=0).stop 2024-02-02T11:49:13.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.379+0000 7fbe01aa7640 1 -- 172.21.15.161:0/2869087854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdfc0b8df0 msgr2=0x7fbdfc1414c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:13.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.379+0000 7fbe01aa7640 1 --2- 172.21.15.161:0/2869087854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdfc0b8df0 0x7fbdfc1414c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40195e0 tx=0x7fbdf4019770 comp rx=0 tx=0).stop 2024-02-02T11:49:13.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.379+0000 7fbe01aa7640 1 -- 172.21.15.161:0/2869087854 shutdown_connections 2024-02-02T11:49:13.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.379+0000 7fbe01aa7640 1 --2- 172.21.15.161:0/2869087854 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbde8065a60 0x7fbde8067f20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.379+0000 7fbe01aa7640 1 --2- 172.21.15.161:0/2869087854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdfc0b8df0 0x7fbdfc1414c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.379+0000 7fbe01aa7640 1 --2- 172.21.15.161:0/2869087854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbdfc0b8540 0x7fbdfc140590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.379+0000 7fbe01aa7640 1 --2- 172.21.15.161:0/2869087854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbdfc0b3320 0x7fbdfc137d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.379+0000 7fbe01aa7640 1 -- 172.21.15.161:0/2869087854 >> 172.21.15.161:0/2869087854 conn(0x7fbdfc06a120 msgr2=0x7fbdfc0b7260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:13.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.379+0000 7fbe01aa7640 1 -- 172.21.15.161:0/2869087854 shutdown_connections 2024-02-02T11:49:13.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.379+0000 7fbe01aa7640 1 -- 172.21.15.161:0/2869087854 wait complete. 2024-02-02T11:49:13.397 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:49:13.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.499+0000 7fba5e1c2640 1 Processor -- start 2024-02-02T11:49:13.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.503+0000 7fba5e1c2640 1 -- start start 2024-02-02T11:49:13.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.503+0000 7fba5e1c2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fba58147920 0x7fba58070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:13.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.503+0000 7fba5e1c2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba580b2c80 con 0x7fba580708d0 2024-02-02T11:49:13.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.503+0000 7fba5e1c2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5806fdb0 con 0x7fba58071a20 2024-02-02T11:49:13.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.503+0000 7fba5e1c2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba58070370 con 0x7fba58147920 2024-02-02T11:49:13.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.503+0000 7fba57fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fba58147920 0x7fba58070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:13.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.503+0000 7fba577fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fba580708d0 0x7fba58147210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59008/0 (socket says 172.21.15.161:59008) 2024-02-02T11:49:13.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.503+0000 7fba577fe640 1 -- 172.21.15.161:0/681836829 learned_addr learned my addr 172.21.15.161:0/681836829 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:13.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.503+0000 7fba57fff640 1 -- 172.21.15.161:0/681836829 >> v1:172.21.15.162:6789/0 conn(0x7fba58071a20 legacy=0x7fba581440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:13.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.503+0000 7fba57fff640 1 -- 172.21.15.161:0/681836829 >> v1:172.21.15.161:6789/0 conn(0x7fba580708d0 legacy=0x7fba58147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:13.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.503+0000 7fba57fff640 1 -- 172.21.15.161:0/681836829 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba580b2ed0 con 0x7fba58147920 2024-02-02T11:49:13.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.503+0000 7fba57fff640 1 --2- 172.21.15.161:0/681836829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba58147920 0x7fba58070cb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fba50009d90 tx=0x7fba5001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601e007b22ee07b server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:13.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.503+0000 7fba56ffd640 1 -- 172.21.15.161:0/681836829 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba500a59c0 con 0x7fba58147920 2024-02-02T11:49:13.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.503+0000 7fba56ffd640 1 -- 172.21.15.161:0/681836829 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba500a5b20 con 0x7fba58147920 2024-02-02T11:49:13.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.503+0000 7fba56ffd640 1 -- 172.21.15.161:0/681836829 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba500ad440 con 0x7fba58147920 2024-02-02T11:49:13.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba5e1c2640 1 -- 172.21.15.161:0/681836829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba58147920 msgr2=0x7fba58070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:13.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba5e1c2640 1 --2- 172.21.15.161:0/681836829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba58147920 0x7fba58070cb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fba50009d90 tx=0x7fba5001c8e0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba5e1c2640 1 -- 172.21.15.161:0/681836829 shutdown_connections 2024-02-02T11:49:13.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba5e1c2640 1 --2- 172.21.15.161:0/681836829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba58147920 0x7fba58070cb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba5e1c2640 1 -- 172.21.15.161:0/681836829 >> 172.21.15.161:0/681836829 conn(0x7fba58069ef0 msgr2=0x7fba5806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:13.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba5e1c2640 1 -- 172.21.15.161:0/681836829 shutdown_connections 2024-02-02T11:49:13.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba5e1c2640 1 -- 172.21.15.161:0/681836829 wait complete. 2024-02-02T11:49:13.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba5e1c2640 1 Processor -- start 2024-02-02T11:49:13.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba5e1c2640 1 -- start start 2024-02-02T11:49:13.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba5e1c2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba580708d0 0x7fba581426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:13.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba5e1c2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba58071a20 0x7fba581e6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:13.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba5e1c2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba58147920 0x7fba581e7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:13.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba5e1c2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba58142c10 con 0x7fba58071a20 2024-02-02T11:49:13.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba5e1c2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5814e1e0 con 0x7fba580708d0 2024-02-02T11:49:13.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba5e1c2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5814eec0 con 0x7fba58147920 2024-02-02T11:49:13.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba4ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba58071a20 0x7fba581e6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:13.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba4ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba58071a20 0x7fba581e6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40430/0 (socket says 172.21.15.161:40430) 2024-02-02T11:49:13.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba4ffff640 1 -- 172.21.15.161:0/2802319173 learned_addr learned my addr 172.21.15.161:0/2802319173 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:13.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba577fe640 1 --2- 172.21.15.161:0/2802319173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba580708d0 0x7fba581426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:13.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba57fff640 1 --2- 172.21.15.161:0/2802319173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba58147920 0x7fba581e7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:13.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba4ffff640 1 -- 172.21.15.161:0/2802319173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba58147920 msgr2=0x7fba581e7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:13.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba4ffff640 1 --2- 172.21.15.161:0/2802319173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba58147920 0x7fba581e7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba4ffff640 1 -- 172.21.15.161:0/2802319173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba580708d0 msgr2=0x7fba581426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:13.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba4ffff640 1 --2- 172.21.15.161:0/2802319173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba580708d0 0x7fba581426d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba4ffff640 1 -- 172.21.15.161:0/2802319173 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba50009a70 con 0x7fba58071a20 2024-02-02T11:49:13.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba4ffff640 1 --2- 172.21.15.161:0/2802319173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba58071a20 0x7fba581e6df0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fba4000c480 tx=0x7fba4000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:13.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba54ff9640 1 -- 172.21.15.161:0/2802319173 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba40012830 con 0x7fba58071a20 2024-02-02T11:49:13.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba54ff9640 1 -- 172.21.15.161:0/2802319173 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba400129b0 con 0x7fba58071a20 2024-02-02T11:49:13.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba5e1c2640 1 -- 172.21.15.161:0/2802319173 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba58146c60 con 0x7fba58071a20 2024-02-02T11:49:13.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba54ff9640 1 -- 172.21.15.161:0/2802319173 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba40012d60 con 0x7fba58071a20 2024-02-02T11:49:13.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba5e1c2640 1 -- 172.21.15.161:0/2802319173 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba5814d8b0 con 0x7fba58071a20 2024-02-02T11:49:13.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.507+0000 7fba5e1c2640 1 -- 172.21.15.161:0/2802319173 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba5814ecb0 con 0x7fba58071a20 2024-02-02T11:49:13.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.511+0000 7fba54ff9640 1 -- 172.21.15.161:0/2802319173 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fba4001c460 con 0x7fba58071a20 2024-02-02T11:49:13.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.511+0000 7fba54ff9640 1 --2- 172.21.15.161:0/2802319173 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fba38065a90 0x7fba38067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:13.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.511+0000 7fba54ff9640 1 -- 172.21.15.161:0/2802319173 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba40082fc0 con 0x7fba58071a20 2024-02-02T11:49:13.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.511+0000 7fba577fe640 1 --2- 172.21.15.161:0/2802319173 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fba38065a90 0x7fba38067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:13.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.511+0000 7fba577fe640 1 --2- 172.21.15.161:0/2802319173 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fba38065a90 0x7fba38067f50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fba48005890 tx=0x7fba48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:13.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.515+0000 7fba54ff9640 1 -- 172.21.15.161:0/2802319173 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fba400b40a0 con 0x7fba58071a20 2024-02-02T11:49:13.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.659+0000 7fba5e1c2640 1 -- 172.21.15.161:0/2802319173 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba5804e000 con 0x7fba58071a20 2024-02-02T11:49:13.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.659+0000 7fba54ff9640 1 -- 172.21.15.161:0/2802319173 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fba5814ecb0 con 0x7fba58071a20 2024-02-02T11:49:13.663 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:13.663 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":20,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:52.816101+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:48:50.155565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-02T11:48:50.795158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:49:13.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.663+0000 7fba5e1c2640 1 -- 172.21.15.161:0/2802319173 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fba38065a90 msgr2=0x7fba38067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:13.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.663+0000 7fba5e1c2640 1 --2- 172.21.15.161:0/2802319173 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fba38065a90 0x7fba38067f50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fba48005890 tx=0x7fba48009040 comp rx=0 tx=0).stop 2024-02-02T11:49:13.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.663+0000 7fba5e1c2640 1 -- 172.21.15.161:0/2802319173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba58071a20 msgr2=0x7fba581e6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:13.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.663+0000 7fba5e1c2640 1 --2- 172.21.15.161:0/2802319173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba58071a20 0x7fba581e6df0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fba4000c480 tx=0x7fba4000c940 comp rx=0 tx=0).stop 2024-02-02T11:49:13.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.663+0000 7fba5e1c2640 1 -- 172.21.15.161:0/2802319173 shutdown_connections 2024-02-02T11:49:13.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.663+0000 7fba5e1c2640 1 --2- 172.21.15.161:0/2802319173 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fba38065a90 0x7fba38067f50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.663+0000 7fba5e1c2640 1 --2- 172.21.15.161:0/2802319173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba58147920 0x7fba581e7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.663+0000 7fba5e1c2640 1 --2- 172.21.15.161:0/2802319173 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba58071a20 0x7fba581e6df0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.663+0000 7fba5e1c2640 1 --2- 172.21.15.161:0/2802319173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba580708d0 0x7fba581426d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.663+0000 7fba5e1c2640 1 -- 172.21.15.161:0/2802319173 >> 172.21.15.161:0/2802319173 conn(0x7fba58069ef0 msgr2=0x7fba580b9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:13.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.663+0000 7fba5e1c2640 1 -- 172.21.15.161:0/2802319173 shutdown_connections 2024-02-02T11:49:13.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.663+0000 7fba5e1c2640 1 -- 172.21.15.161:0/2802319173 wait complete. 2024-02-02T11:49:13.681 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-02T11:48:40.330782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-02T11:48:50.155565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-02T11:48:50.795158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-02T11:49:13.681 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-02T11:49:13.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.791+0000 7f6b1dafa640 1 Processor -- start 2024-02-02T11:49:13.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.791+0000 7f6b1dafa640 1 -- start start 2024-02-02T11:49:13.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.795+0000 7f6b1dafa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6b180b8df0 0x7f6b18142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:13.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.795+0000 7f6b1dafa640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6b180b8540 0x7f6b18148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:13.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.795+0000 7f6b1dafa640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b18142d80 0x7f6b18149450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:13.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.795+0000 7f6b1dafa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b18148a80 con 0x7f6b180b8df0 2024-02-02T11:49:13.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.795+0000 7f6b1dafa640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b180b3890 con 0x7f6b180b8540 2024-02-02T11:49:13.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.795+0000 7f6b1dafa640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b180b3b70 con 0x7f6b18142d80 2024-02-02T11:49:13.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.795+0000 7f6b177fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6b180b8df0 0x7f6b18142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:13.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.795+0000 7f6b177fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6b180b8df0 0x7f6b18142840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40436/0 (socket says 172.21.15.161:40436) 2024-02-02T11:49:13.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.795+0000 7f6b177fe640 1 -- 172.21.15.161:0/1966022622 learned_addr learned my addr 172.21.15.161:0/1966022622 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:13.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.795+0000 7f6b0effd640 1 --2- 172.21.15.161:0/1966022622 >> v2:172.21.15.162:3300/0 conn(0x7f6b180b8540 0x7f6b18148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:13.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.795+0000 7f6b17fff640 1 --2- 172.21.15.161:0/1966022622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b18142d80 0x7f6b18149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:13.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.795+0000 7f6b177fe640 1 -- 172.21.15.161:0/1966022622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b18142d80 msgr2=0x7f6b18149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:13.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.795+0000 7f6b177fe640 1 --2- 172.21.15.161:0/1966022622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b18142d80 0x7f6b18149450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.795+0000 7f6b177fe640 1 -- 172.21.15.161:0/1966022622 >> v2:172.21.15.162:3300/0 conn(0x7f6b180b8540 msgr2=0x7f6b18148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:13.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.795+0000 7f6b177fe640 1 --2- 172.21.15.161:0/1966022622 >> v2:172.21.15.162:3300/0 conn(0x7f6b180b8540 0x7f6b18148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.795+0000 7f6b177fe640 1 -- 172.21.15.161:0/1966022622 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b180b3e50 con 0x7f6b180b8df0 2024-02-02T11:49:13.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.795+0000 7f6b0effd640 1 --2- 172.21.15.161:0/1966022622 >> v2:172.21.15.162:3300/0 conn(0x7f6b180b8540 0x7f6b18148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:13.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b177fe640 1 --2- 172.21.15.161:0/1966022622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b180b8df0 0x7f6b18142840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6b180b4e50 tx=0x7f6b0801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31fa0d38e70cb40a server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:13.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b16ffd640 1 -- 172.21.15.161:0/1966022622 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b18071930 con 0x7f6b180b8df0 2024-02-02T11:49:13.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b16ffd640 1 -- 172.21.15.161:0/1966022622 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b080ac640 con 0x7f6b180b8df0 2024-02-02T11:49:13.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b16ffd640 1 -- 172.21.15.161:0/1966022622 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b080ac9d0 con 0x7f6b180b8df0 2024-02-02T11:49:13.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b1dafa640 1 -- 172.21.15.161:0/1966022622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b180b8df0 msgr2=0x7f6b18142840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:13.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b1dafa640 1 --2- 172.21.15.161:0/1966022622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b180b8df0 0x7f6b18142840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6b180b4e50 tx=0x7f6b0801c500 comp rx=0 tx=0).stop 2024-02-02T11:49:13.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b1dafa640 1 -- 172.21.15.161:0/1966022622 shutdown_connections 2024-02-02T11:49:13.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b1dafa640 1 --2- 172.21.15.161:0/1966022622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b18142d80 0x7f6b18149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b1dafa640 1 --2- 172.21.15.161:0/1966022622 >> v2:172.21.15.162:3300/0 conn(0x7f6b180b8540 0x7f6b18148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b1dafa640 1 --2- 172.21.15.161:0/1966022622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b180b8df0 0x7f6b18142840 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b1dafa640 1 -- 172.21.15.161:0/1966022622 >> 172.21.15.161:0/1966022622 conn(0x7f6b1806a120 msgr2=0x7f6b1806a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:13.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b1dafa640 1 -- 172.21.15.161:0/1966022622 shutdown_connections 2024-02-02T11:49:13.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b1dafa640 1 -- 172.21.15.161:0/1966022622 wait complete. 2024-02-02T11:49:13.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b1dafa640 1 Processor -- start 2024-02-02T11:49:13.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b1dafa640 1 -- start start 2024-02-02T11:49:13.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b1dafa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b180b8540 0x7f6b180b7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:13.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b1dafa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b180b8df0 0x7f6b18132ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:13.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b1dafa640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b18142d80 0x7f6b18132180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:13.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b1dafa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b180b79b0 con 0x7f6b180b8df0 2024-02-02T11:49:13.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b1dafa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b18131cf0 con 0x7f6b180b8540 2024-02-02T11:49:13.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b1dafa640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b181316a0 con 0x7f6b18142d80 2024-02-02T11:49:13.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b0effd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b180b8df0 0x7f6b18132ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:13.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b0effd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b180b8df0 0x7f6b18132ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40452/0 (socket says 172.21.15.161:40452) 2024-02-02T11:49:13.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b0effd640 1 -- 172.21.15.161:0/3065265498 learned_addr learned my addr 172.21.15.161:0/3065265498 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:13.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b177fe640 1 --2- 172.21.15.161:0/3065265498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b180b8540 0x7f6b180b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:13.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b0effd640 1 -- 172.21.15.161:0/3065265498 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b18142d80 msgr2=0x7f6b18132180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:13.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b0effd640 1 --2- 172.21.15.161:0/3065265498 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b18142d80 0x7f6b18132180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b0effd640 1 -- 172.21.15.161:0/3065265498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b180b8540 msgr2=0x7f6b180b7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:13.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b0effd640 1 --2- 172.21.15.161:0/3065265498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b180b8540 0x7f6b180b7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b0effd640 1 -- 172.21.15.161:0/3065265498 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b080094d0 con 0x7f6b180b8df0 2024-02-02T11:49:13.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b0effd640 1 --2- 172.21.15.161:0/3065265498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b180b8df0 0x7f6b18132ea0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000c7c0 tx=0x7f6b0000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:13.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b14ff9640 1 -- 172.21.15.161:0/3065265498 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00007a30 con 0x7f6b180b8df0 2024-02-02T11:49:13.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b14ff9640 1 -- 172.21.15.161:0/3065265498 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b00007b90 con 0x7f6b180b8df0 2024-02-02T11:49:13.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b14ff9640 1 -- 172.21.15.161:0/3065265498 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0000ce70 con 0x7f6b180b8df0 2024-02-02T11:49:13.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b1dafa640 1 -- 172.21.15.161:0/3065265498 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b18131980 con 0x7f6b180b8df0 2024-02-02T11:49:13.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.799+0000 7f6b1dafa640 1 -- 172.21.15.161:0/3065265498 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b18135e70 con 0x7f6b180b8df0 2024-02-02T11:49:13.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.803+0000 7f6b1dafa640 1 -- 172.21.15.161:0/3065265498 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b18131ea0 con 0x7f6b180b8df0 2024-02-02T11:49:13.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.803+0000 7f6b14ff9640 1 -- 172.21.15.161:0/3065265498 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6b000113f0 con 0x7f6b180b8df0 2024-02-02T11:49:13.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.803+0000 7f6b14ff9640 1 --2- 172.21.15.161:0/3065265498 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6af8065a60 0x7f6af8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:13.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.803+0000 7f6b14ff9640 1 -- 172.21.15.161:0/3065265498 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b000831c0 con 0x7f6b180b8df0 2024-02-02T11:49:13.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.803+0000 7f6b177fe640 1 --2- 172.21.15.161:0/3065265498 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6af8065a60 0x7f6af8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:13.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.803+0000 7f6b177fe640 1 --2- 172.21.15.161:0/3065265498 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6af8065a60 0x7f6af8067f20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6b080ae000 tx=0x7f6b08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:13.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.807+0000 7f6b14ff9640 1 -- 172.21.15.161:0/3065265498 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6b18131ea0 con 0x7f6b180b8df0 2024-02-02T11:49:13.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.963+0000 7f6b1dafa640 1 -- 172.21.15.161:0/3065265498 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b18131ea0 con 0x7f6b180b8df0 2024-02-02T11:49:13.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.963+0000 7f6b14ff9640 1 -- 172.21.15.161:0/3065265498 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b18131ea0 con 0x7f6b180b8df0 2024-02-02T11:49:13.966 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-02-02T11:49:13.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.967+0000 7f6b1dafa640 1 -- 172.21.15.161:0/3065265498 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6af8065a60 msgr2=0x7f6af8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:13.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.967+0000 7f6b1dafa640 1 --2- 172.21.15.161:0/3065265498 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6af8065a60 0x7f6af8067f20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6b080ae000 tx=0x7f6b08008040 comp rx=0 tx=0).stop 2024-02-02T11:49:13.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.967+0000 7f6b1dafa640 1 -- 172.21.15.161:0/3065265498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b180b8df0 msgr2=0x7f6b18132ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:13.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.967+0000 7f6b1dafa640 1 --2- 172.21.15.161:0/3065265498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b180b8df0 0x7f6b18132ea0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000c7c0 tx=0x7f6b0000cc80 comp rx=0 tx=0).stop 2024-02-02T11:49:13.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.967+0000 7f6b1dafa640 1 -- 172.21.15.161:0/3065265498 shutdown_connections 2024-02-02T11:49:13.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.967+0000 7f6b1dafa640 1 --2- 172.21.15.161:0/3065265498 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6af8065a60 0x7f6af8067f20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.967+0000 7f6b1dafa640 1 --2- 172.21.15.161:0/3065265498 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b18142d80 0x7f6b18132180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.967+0000 7f6b1dafa640 1 --2- 172.21.15.161:0/3065265498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b180b8df0 0x7f6b18132ea0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.967+0000 7f6b1dafa640 1 --2- 172.21.15.161:0/3065265498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b180b8540 0x7f6b180b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:13.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.967+0000 7f6b1dafa640 1 -- 172.21.15.161:0/3065265498 >> 172.21.15.161:0/3065265498 conn(0x7f6b1806a120 msgr2=0x7f6b18138090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:13.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.967+0000 7f6b1dafa640 1 -- 172.21.15.161:0/3065265498 shutdown_connections 2024-02-02T11:49:13.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:13.967+0000 7f6b1dafa640 1 -- 172.21.15.161:0/3065265498 wait complete. 2024-02-02T11:49:13.986 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-02T11:49:14.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.095+0000 7f6a67eaa640 1 Processor -- start 2024-02-02T11:49:14.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.095+0000 7f6a67eaa640 1 -- start start 2024-02-02T11:49:14.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a67eaa640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a600b8df0 0x7f6a60142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a67eaa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6a600b8540 0x7f6a60148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a67eaa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a60148a80 con 0x7f6a60142d80 2024-02-02T11:49:14.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a67eaa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a600b3890 con 0x7f6a600b8540 2024-02-02T11:49:14.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a67eaa640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600b3b70 con 0x7f6a600b8df0 2024-02-02T11:49:14.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a65445640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6a600b8540 0x7f6a60148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a66447640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6a60142d80 0x7f6a600b5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59018/0 (socket says 172.21.15.161:59018) 2024-02-02T11:49:14.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a66447640 1 -- 172.21.15.161:0/3458076329 learned_addr learned my addr 172.21.15.161:0/3458076329 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:14.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a65c46640 1 --2- 172.21.15.161:0/3458076329 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a600b8df0 0x7f6a60142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a65445640 1 -- 172.21.15.161:0/3458076329 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a600b8df0 msgr2=0x7f6a60142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:14.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a65445640 1 --2- 172.21.15.161:0/3458076329 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a600b8df0 0x7f6a60142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a65445640 1 -- 172.21.15.161:0/3458076329 >> v1:172.21.15.161:6789/0 conn(0x7f6a60142d80 legacy=0x7f6a600b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:14.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a65445640 1 -- 172.21.15.161:0/3458076329 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a600b3e50 con 0x7f6a600b8540 2024-02-02T11:49:14.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a64c44640 1 -- 172.21.15.161:0/3458076329 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826109714 0 0) 0x7f6a60148a80 con 0x7f6a60142d80 2024-02-02T11:49:14.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a65445640 1 --2- 172.21.15.161:0/3458076329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a600b8540 0x7f6a60148f10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0097c0 tx=0x7f6a5c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77b581ba7c0957e server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:14.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a64c44640 1 -- 172.21.15.161:0/3458076329 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c0a6040 con 0x7f6a600b8540 2024-02-02T11:49:14.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a64c44640 1 -- 172.21.15.161:0/3458076329 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c0aa600 con 0x7f6a600b8540 2024-02-02T11:49:14.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a64c44640 1 -- 172.21.15.161:0/3458076329 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a60071930 con 0x7f6a600b8540 2024-02-02T11:49:14.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a67eaa640 1 -- 172.21.15.161:0/3458076329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a600b8540 msgr2=0x7f6a60148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:14.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a67eaa640 1 --2- 172.21.15.161:0/3458076329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a600b8540 0x7f6a60148f10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0097c0 tx=0x7f6a5c01c480 comp rx=0 tx=0).stop 2024-02-02T11:49:14.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.099+0000 7f6a67eaa640 1 -- 172.21.15.161:0/3458076329 shutdown_connections 2024-02-02T11:49:14.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a67eaa640 1 --2- 172.21.15.161:0/3458076329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a600b8540 0x7f6a60148f10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a67eaa640 1 --2- 172.21.15.161:0/3458076329 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a600b8df0 0x7f6a60142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a67eaa640 1 -- 172.21.15.161:0/3458076329 >> 172.21.15.161:0/3458076329 conn(0x7f6a6006a120 msgr2=0x7f6a6006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:14.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a67eaa640 1 -- 172.21.15.161:0/3458076329 shutdown_connections 2024-02-02T11:49:14.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a67eaa640 1 -- 172.21.15.161:0/3458076329 wait complete. 2024-02-02T11:49:14.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a67eaa640 1 Processor -- start 2024-02-02T11:49:14.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a67eaa640 1 -- start start 2024-02-02T11:49:14.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a67eaa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a600b8540 0x7f6a600bc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a67eaa640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a600b8df0 0x7f6a600bb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a67eaa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a60142d80 0x7f6a601394e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a67eaa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a601e4450 con 0x7f6a60142d80 2024-02-02T11:49:14.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a67eaa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6013a0c0 con 0x7f6a600b8540 2024-02-02T11:49:14.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a67eaa640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600bccf0 con 0x7f6a600b8df0 2024-02-02T11:49:14.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a66447640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a60142d80 0x7f6a601394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a66447640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a60142d80 0x7f6a601394e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40468/0 (socket says 172.21.15.161:40468) 2024-02-02T11:49:14.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a66447640 1 -- 172.21.15.161:0/1416002552 learned_addr learned my addr 172.21.15.161:0/1416002552 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:14.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a65c46640 1 --2- 172.21.15.161:0/1416002552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a600b8540 0x7f6a600bc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a66447640 1 -- 172.21.15.161:0/1416002552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a600b8df0 msgr2=0x7f6a600bb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:14.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a65445640 1 --2- 172.21.15.161:0/1416002552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a600b8df0 0x7f6a600bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a66447640 1 --2- 172.21.15.161:0/1416002552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a600b8df0 0x7f6a600bb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a66447640 1 -- 172.21.15.161:0/1416002552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a600b8540 msgr2=0x7f6a600bc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:14.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a66447640 1 --2- 172.21.15.161:0/1416002552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a600b8540 0x7f6a600bc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a66447640 1 -- 172.21.15.161:0/1416002552 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c009420 con 0x7f6a60142d80 2024-02-02T11:49:14.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a65c46640 1 --2- 172.21.15.161:0/1416002552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a600b8540 0x7f6a600bc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:14.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a66447640 1 --2- 172.21.15.161:0/1416002552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a60142d80 0x7f6a601394e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800c780 tx=0x7f6a5800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:14.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a567fc640 1 -- 172.21.15.161:0/1416002552 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5800ce30 con 0x7f6a60142d80 2024-02-02T11:49:14.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a567fc640 1 -- 172.21.15.161:0/1416002552 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5800a640 con 0x7f6a60142d80 2024-02-02T11:49:14.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a67eaa640 1 -- 172.21.15.161:0/1416002552 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a60138560 con 0x7f6a60142d80 2024-02-02T11:49:14.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a567fc640 1 -- 172.21.15.161:0/1416002552 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5800a9f0 con 0x7f6a60142d80 2024-02-02T11:49:14.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a67eaa640 1 -- 172.21.15.161:0/1416002552 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a600bbdd0 con 0x7f6a60142d80 2024-02-02T11:49:14.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a67eaa640 1 -- 172.21.15.161:0/1416002552 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a60148730 con 0x7f6a60142d80 2024-02-02T11:49:14.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.103+0000 7f6a567fc640 1 -- 172.21.15.161:0/1416002552 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6a5800ab50 con 0x7f6a60142d80 2024-02-02T11:49:14.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.107+0000 7f6a567fc640 1 --2- 172.21.15.161:0/1416002552 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6a44065a60 0x7f6a44067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.107+0000 7f6a567fc640 1 -- 172.21.15.161:0/1416002552 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a580828b0 con 0x7f6a60142d80 2024-02-02T11:49:14.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.107+0000 7f6a65c46640 1 --2- 172.21.15.161:0/1416002552 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6a44065a60 0x7f6a44067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.107+0000 7f6a65c46640 1 --2- 172.21.15.161:0/1416002552 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6a44065a60 0x7f6a44067f20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009840 tx=0x7f6a50008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:14.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.111+0000 7f6a567fc640 1 -- 172.21.15.161:0/1416002552 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6a60148730 con 0x7f6a60142d80 2024-02-02T11:49:14.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.259+0000 7f6a67eaa640 1 -- 172.21.15.161:0/1416002552 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a60148730 con 0x7f6a60142d80 2024-02-02T11:49:14.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.259+0000 7f6a567fc640 1 -- 172.21.15.161:0/1416002552 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6a58018020 con 0x7f6a60142d80 2024-02-02T11:49:14.262 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-02-02T11:49:14.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.259+0000 7f6a67eaa640 1 -- 172.21.15.161:0/1416002552 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6a44065a60 msgr2=0x7f6a44067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:14.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.259+0000 7f6a67eaa640 1 --2- 172.21.15.161:0/1416002552 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6a44065a60 0x7f6a44067f20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009840 tx=0x7f6a50008040 comp rx=0 tx=0).stop 2024-02-02T11:49:14.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.259+0000 7f6a67eaa640 1 -- 172.21.15.161:0/1416002552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a60142d80 msgr2=0x7f6a601394e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:14.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.259+0000 7f6a67eaa640 1 --2- 172.21.15.161:0/1416002552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a60142d80 0x7f6a601394e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800c780 tx=0x7f6a5800cc40 comp rx=0 tx=0).stop 2024-02-02T11:49:14.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.259+0000 7f6a67eaa640 1 -- 172.21.15.161:0/1416002552 shutdown_connections 2024-02-02T11:49:14.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.259+0000 7f6a67eaa640 1 --2- 172.21.15.161:0/1416002552 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6a44065a60 0x7f6a44067f20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.259+0000 7f6a67eaa640 1 --2- 172.21.15.161:0/1416002552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a60142d80 0x7f6a601394e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.259+0000 7f6a67eaa640 1 --2- 172.21.15.161:0/1416002552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a600b8df0 0x7f6a600bb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.259+0000 7f6a67eaa640 1 --2- 172.21.15.161:0/1416002552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a600b8540 0x7f6a600bc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.259+0000 7f6a67eaa640 1 -- 172.21.15.161:0/1416002552 >> 172.21.15.161:0/1416002552 conn(0x7f6a6006a120 msgr2=0x7f6a6013a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:14.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.259+0000 7f6a67eaa640 1 -- 172.21.15.161:0/1416002552 shutdown_connections 2024-02-02T11:49:14.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.259+0000 7f6a67eaa640 1 -- 172.21.15.161:0/1416002552 wait complete. 2024-02-02T11:49:14.279 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-02T11:49:14.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.391+0000 7ff85199b640 1 Processor -- start 2024-02-02T11:49:14.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.391+0000 7ff85199b640 1 -- start start 2024-02-02T11:49:14.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.395+0000 7ff85199b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff84c0b8540 0x7ff84c148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.395+0000 7ff85199b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff84c0b3320 0x7ff84c149450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.395+0000 7ff85199b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84c148a80 con 0x7ff84c0b8df0 2024-02-02T11:49:14.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.395+0000 7ff85199b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff84c0b3890 con 0x7ff84c0b8540 2024-02-02T11:49:14.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.395+0000 7ff85199b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff84c0b3b70 con 0x7ff84c0b3320 2024-02-02T11:49:14.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.395+0000 7ff84a7fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff84c0b8540 0x7ff84c148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.395+0000 7ff84a7fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff84c0b8540 0x7ff84c148f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40472/0 (socket says 172.21.15.161:40472) 2024-02-02T11:49:14.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.395+0000 7ff84a7fc640 1 -- 172.21.15.161:0/3850373393 learned_addr learned my addr 172.21.15.161:0/3850373393 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:14.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.395+0000 7ff84b7fe640 1 --2- 172.21.15.161:0/3850373393 >> v2:172.21.15.162:3300/0 conn(0x7ff84c0b3320 0x7ff84c149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.395+0000 7ff84a7fc640 1 -- 172.21.15.161:0/3850373393 >> v2:172.21.15.162:3300/0 conn(0x7ff84c0b3320 msgr2=0x7ff84c149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:14.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.395+0000 7ff84a7fc640 1 --2- 172.21.15.161:0/3850373393 >> v2:172.21.15.162:3300/0 conn(0x7ff84c0b3320 0x7ff84c149450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.395+0000 7ff84a7fc640 1 -- 172.21.15.161:0/3850373393 >> v1:172.21.15.162:6789/0 conn(0x7ff84c0b8df0 legacy=0x7ff84c142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:14.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.395+0000 7ff84a7fc640 1 -- 172.21.15.161:0/3850373393 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c0b3e50 con 0x7ff84c0b8540 2024-02-02T11:49:14.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.395+0000 7ff84a7fc640 1 --2- 172.21.15.161:0/3850373393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff84c0b8540 0x7ff84c148f10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff84c0b9a50 tx=0x7ff84001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637d0917bdcd5596 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:14.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.395+0000 7ff849ffb640 1 -- 172.21.15.161:0/3850373393 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8400ab660 con 0x7ff84c0b8540 2024-02-02T11:49:14.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.395+0000 7ff849ffb640 1 -- 172.21.15.161:0/3850373393 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8400ab7c0 con 0x7ff84c0b8540 2024-02-02T11:49:14.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.395+0000 7ff849ffb640 1 -- 172.21.15.161:0/3850373393 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8400abb50 con 0x7ff84c0b8540 2024-02-02T11:49:14.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff85199b640 1 -- 172.21.15.161:0/3850373393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff84c0b8540 msgr2=0x7ff84c148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:14.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff85199b640 1 --2- 172.21.15.161:0/3850373393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff84c0b8540 0x7ff84c148f10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff84c0b9a50 tx=0x7ff84001c4c0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff85199b640 1 -- 172.21.15.161:0/3850373393 shutdown_connections 2024-02-02T11:49:14.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff85199b640 1 --2- 172.21.15.161:0/3850373393 >> v2:172.21.15.162:3300/0 conn(0x7ff84c0b3320 0x7ff84c149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff85199b640 1 --2- 172.21.15.161:0/3850373393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff84c0b8540 0x7ff84c148f10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff85199b640 1 -- 172.21.15.161:0/3850373393 >> 172.21.15.161:0/3850373393 conn(0x7ff84c06a120 msgr2=0x7ff84c06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:14.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff85199b640 1 -- 172.21.15.161:0/3850373393 shutdown_connections 2024-02-02T11:49:14.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff85199b640 1 -- 172.21.15.161:0/3850373393 wait complete. 2024-02-02T11:49:14.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff85199b640 1 Processor -- start 2024-02-02T11:49:14.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff85199b640 1 -- start start 2024-02-02T11:49:14.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff85199b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff84c0b3320 0x7ff84c140f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff85199b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff84c0b8540 0x7ff84c0bc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff85199b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff84c0b8df0 0x7ff84c0bc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff85199b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c141480 con 0x7ff84c0b8540 2024-02-02T11:49:14.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff85199b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c141700 con 0x7ff84c0b8df0 2024-02-02T11:49:14.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff85199b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c1e1190 con 0x7ff84c0b3320 2024-02-02T11:49:14.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff84a7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff84c0b8540 0x7ff84c0bc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff84a7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff84c0b8540 0x7ff84c0bc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40480/0 (socket says 172.21.15.161:40480) 2024-02-02T11:49:14.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff84a7fc640 1 -- 172.21.15.161:0/4079598395 learned_addr learned my addr 172.21.15.161:0/4079598395 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:14.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff84a7fc640 1 -- 172.21.15.161:0/4079598395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff84c0b3320 msgr2=0x7ff84c140f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:14.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff84a7fc640 1 --2- 172.21.15.161:0/4079598395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff84c0b3320 0x7ff84c140f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff84a7fc640 1 -- 172.21.15.161:0/4079598395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff84c0b8df0 msgr2=0x7ff84c0bc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:14.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff84b7fe640 1 --2- 172.21.15.161:0/4079598395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff84c0b8df0 0x7ff84c0bc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff84a7fc640 1 --2- 172.21.15.161:0/4079598395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff84c0b8df0 0x7ff84c0bc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff84a7fc640 1 -- 172.21.15.161:0/4079598395 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8400094d0 con 0x7ff84c0b8540 2024-02-02T11:49:14.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff84a7fc640 1 --2- 172.21.15.161:0/4079598395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff84c0b8540 0x7ff84c0bc480 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff8400ad040 tx=0x7ff84001ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:14.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff833fff640 1 -- 172.21.15.161:0/4079598395 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8400b4800 con 0x7ff84c0b8540 2024-02-02T11:49:14.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff833fff640 1 -- 172.21.15.161:0/4079598395 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8400b4980 con 0x7ff84c0b8540 2024-02-02T11:49:14.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff85199b640 1 -- 172.21.15.161:0/4079598395 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84c1e1470 con 0x7ff84c0b8540 2024-02-02T11:49:14.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff833fff640 1 -- 172.21.15.161:0/4079598395 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8400b4d30 con 0x7ff84c0b8540 2024-02-02T11:49:14.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.399+0000 7ff85199b640 1 -- 172.21.15.161:0/4079598395 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84c1e0e70 con 0x7ff84c0b8540 2024-02-02T11:49:14.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.403+0000 7ff85199b640 1 -- 172.21.15.161:0/4079598395 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84c1e16b0 con 0x7ff84c0b8540 2024-02-02T11:49:14.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.403+0000 7ff833fff640 1 -- 172.21.15.161:0/4079598395 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff8400a9070 con 0x7ff84c0b8540 2024-02-02T11:49:14.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.403+0000 7ff833fff640 1 --2- 172.21.15.161:0/4079598395 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff838065a90 0x7ff838067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.403+0000 7ff833fff640 1 -- 172.21.15.161:0/4079598395 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff84011dad0 con 0x7ff84c0b8540 2024-02-02T11:49:14.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.403+0000 7ff84affd640 1 --2- 172.21.15.161:0/4079598395 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff838065a90 0x7ff838067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.403+0000 7ff84affd640 1 --2- 172.21.15.161:0/4079598395 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff838065a90 0x7ff838067f50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009670 tx=0x7ff83c006bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:14.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.407+0000 7ff833fff640 1 -- 172.21.15.161:0/4079598395 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff84c1e16b0 con 0x7ff84c0b8540 2024-02-02T11:49:14.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.547+0000 7ff85199b640 1 -- 172.21.15.161:0/4079598395 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff84c1e16b0 con 0x7ff84c0b8540 2024-02-02T11:49:14.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.547+0000 7ff833fff640 1 -- 172.21.15.161:0/4079598395 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff84c1e16b0 con 0x7ff84c0b8540 2024-02-02T11:49:14.552 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2024-02-02T11:49:14.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.551+0000 7ff85199b640 1 -- 172.21.15.161:0/4079598395 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff838065a90 msgr2=0x7ff838067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:14.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.551+0000 7ff85199b640 1 --2- 172.21.15.161:0/4079598395 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff838065a90 0x7ff838067f50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009670 tx=0x7ff83c006bd0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.551+0000 7ff85199b640 1 -- 172.21.15.161:0/4079598395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff84c0b8540 msgr2=0x7ff84c0bc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:14.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.551+0000 7ff85199b640 1 --2- 172.21.15.161:0/4079598395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff84c0b8540 0x7ff84c0bc480 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff8400ad040 tx=0x7ff84001ad00 comp rx=0 tx=0).stop 2024-02-02T11:49:14.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.551+0000 7ff85199b640 1 -- 172.21.15.161:0/4079598395 shutdown_connections 2024-02-02T11:49:14.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.551+0000 7ff85199b640 1 --2- 172.21.15.161:0/4079598395 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff838065a90 0x7ff838067f50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.551+0000 7ff85199b640 1 --2- 172.21.15.161:0/4079598395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff84c0b8df0 0x7ff84c0bc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.551+0000 7ff85199b640 1 --2- 172.21.15.161:0/4079598395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff84c0b8540 0x7ff84c0bc480 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.551+0000 7ff85199b640 1 --2- 172.21.15.161:0/4079598395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff84c0b3320 0x7ff84c140f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.551+0000 7ff85199b640 1 -- 172.21.15.161:0/4079598395 >> 172.21.15.161:0/4079598395 conn(0x7ff84c06a120 msgr2=0x7ff84c142610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:14.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.551+0000 7ff85199b640 1 -- 172.21.15.161:0/4079598395 shutdown_connections 2024-02-02T11:49:14.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.551+0000 7ff85199b640 1 -- 172.21.15.161:0/4079598395 wait complete. 2024-02-02T11:49:14.569 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:49:14.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f3756b68640 1 Processor -- start 2024-02-02T11:49:14.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f3756b68640 1 -- start start 2024-02-02T11:49:14.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f3756b68640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f375006eeb0 0x7f3750156270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f3756b68640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37500707e0 con 0x7f375006f4f0 2024-02-02T11:49:14.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f3756b68640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37500b8750 con 0x7f37500bc340 2024-02-02T11:49:14.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f3756b68640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37500703c0 con 0x7f375006eeb0 2024-02-02T11:49:14.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374ffff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f375006f4f0 0x7f375014ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59032/0 (socket says 172.21.15.161:59032) 2024-02-02T11:49:14.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374ffff640 1 -- 172.21.15.161:0/1815659066 learned_addr learned my addr 172.21.15.161:0/1815659066 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:14.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f3755105640 1 --2- 172.21.15.161:0/1815659066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f375006eeb0 0x7f3750156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374f7fe640 1 -- 172.21.15.161:0/1815659066 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426412242 0 0) 0x7f37500707e0 con 0x7f375006f4f0 2024-02-02T11:49:14.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374f7fe640 1 -- 172.21.15.161:0/1815659066 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3738003530 con 0x7f375006f4f0 2024-02-02T11:49:14.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374f7fe640 1 -- 172.21.15.161:0/1815659066 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3133653592 0 0) 0x7f3738003530 con 0x7f375006f4f0 2024-02-02T11:49:14.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374f7fe640 1 -- 172.21.15.161:0/1815659066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f375006eeb0 msgr2=0x7f3750156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:14.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374f7fe640 1 --2- 172.21.15.161:0/1815659066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f375006eeb0 0x7f3750156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374f7fe640 1 -- 172.21.15.161:0/1815659066 >> v1:172.21.15.162:6789/0 conn(0x7f37500bc340 legacy=0x7f3750144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:14.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374f7fe640 1 -- 172.21.15.161:0/1815659066 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375006fa10 con 0x7f375006f4f0 2024-02-02T11:49:14.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374f7fe640 1 -- 172.21.15.161:0/1815659066 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f3740001680 con 0x7f375006f4f0 2024-02-02T11:49:14.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374f7fe640 1 -- 172.21.15.161:0/1815659066 >> v1:172.21.15.161:6789/0 conn(0x7f375006f4f0 legacy=0x7f375014ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:14.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374f7fe640 1 --2- 172.21.15.161:0/1815659066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37380039b0 0x7f3738003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374f7fe640 1 --2- 172.21.15.161:0/1815659066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37380047d0 0x7f3738004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374f7fe640 1 --2- 172.21.15.161:0/1815659066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f375006eeb0 0x7f3738005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374f7fe640 1 -- 172.21.15.161:0/1815659066 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37500703c0 con 0x7f37380047d0 2024-02-02T11:49:14.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374f7fe640 1 -- 172.21.15.161:0/1815659066 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373800ba40 con 0x7f37380039b0 2024-02-02T11:49:14.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374f7fe640 1 -- 172.21.15.161:0/1815659066 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373800bc00 con 0x7f375006eeb0 2024-02-02T11:49:14.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374ffff640 1 --2- 172.21.15.161:0/1815659066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37380047d0 0x7f3738004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f3755105640 1 --2- 172.21.15.161:0/1815659066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f375006eeb0 0x7f3738005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f3754904640 1 --2- 172.21.15.161:0/1815659066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37380039b0 0x7f3738003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374ffff640 1 -- 172.21.15.161:0/1815659066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f375006eeb0 msgr2=0x7f3738005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:14.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374ffff640 1 --2- 172.21.15.161:0/1815659066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f375006eeb0 0x7f3738005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374ffff640 1 -- 172.21.15.161:0/1815659066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37380039b0 msgr2=0x7f3738003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:14.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374ffff640 1 --2- 172.21.15.161:0/1815659066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37380039b0 0x7f3738003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f374ffff640 1 -- 172.21.15.161:0/1815659066 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3738003530 con 0x7f37380047d0 2024-02-02T11:49:14.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.679+0000 7f3755105640 1 --2- 172.21.15.161:0/1815659066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f375006eeb0 0x7f3738005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:14.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.683+0000 7f374ffff640 1 --2- 172.21.15.161:0/1815659066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37380047d0 0x7f3738004c50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f375014b950 tx=0x7f374001f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd858d9b201557a3 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:14.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.683+0000 7f374f7fe640 1 -- 172.21.15.161:0/1815659066 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740005ae0 con 0x7f37380047d0 2024-02-02T11:49:14.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.683+0000 7f374f7fe640 1 -- 172.21.15.161:0/1815659066 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37400ab070 con 0x7f37380047d0 2024-02-02T11:49:14.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.683+0000 7f374f7fe640 1 -- 172.21.15.161:0/1815659066 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740007070 con 0x7f37380047d0 2024-02-02T11:49:14.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.683+0000 7f3756b68640 1 -- 172.21.15.161:0/1815659066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37380047d0 msgr2=0x7f3738004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:14.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.683+0000 7f3756b68640 1 --2- 172.21.15.161:0/1815659066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37380047d0 0x7f3738004c50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f375014b950 tx=0x7f374001f310 comp rx=0 tx=0).stop 2024-02-02T11:49:14.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.683+0000 7f3755105640 1 -- 172.21.15.161:0/1815659066 reap_dead start 2024-02-02T11:49:14.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.683+0000 7f3756b68640 1 -- 172.21.15.161:0/1815659066 shutdown_connections 2024-02-02T11:49:14.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.683+0000 7f3756b68640 1 -- 172.21.15.161:0/1815659066 >> 172.21.15.161:0/1815659066 conn(0x7f3750069ef0 msgr2=0x7f375006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:14.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.683+0000 7f3756b68640 1 -- 172.21.15.161:0/1815659066 shutdown_connections 2024-02-02T11:49:14.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.683+0000 7f3756b68640 1 -- 172.21.15.161:0/1815659066 wait complete. 2024-02-02T11:49:14.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.683+0000 7f3756b68640 1 Processor -- start 2024-02-02T11:49:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.683+0000 7f3756b68640 1 -- start start 2024-02-02T11:49:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f3756b68640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37380047d0 0x7f375014e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f3756b68640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37500b3590 0x7f375013c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f3756b68640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f375013b120 0x7f375013b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f3756b68640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375014e620 con 0x7f37500b3590 2024-02-02T11:49:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f3756b68640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37501dfbd0 con 0x7f37380047d0 2024-02-02T11:49:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f3756b68640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37500b4bf0 con 0x7f375013b120 2024-02-02T11:49:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f374ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37500b3590 0x7f375013c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f374ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37500b3590 0x7f375013c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40494/0 (socket says 172.21.15.161:40494) 2024-02-02T11:49:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f374ffff640 1 -- 172.21.15.161:0/2635356011 learned_addr learned my addr 172.21.15.161:0/2635356011 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f3755105640 1 --2- 172.21.15.161:0/2635356011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f375013b120 0x7f375013b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f3754904640 1 --2- 172.21.15.161:0/2635356011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37380047d0 0x7f375014e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f374ffff640 1 -- 172.21.15.161:0/2635356011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f375013b120 msgr2=0x7f375013b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f374ffff640 1 --2- 172.21.15.161:0/2635356011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f375013b120 0x7f375013b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f374ffff640 1 -- 172.21.15.161:0/2635356011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37380047d0 msgr2=0x7f375014e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:14.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f374ffff640 1 --2- 172.21.15.161:0/2635356011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37380047d0 0x7f375014e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f374ffff640 1 -- 172.21.15.161:0/2635356011 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37501dfe70 con 0x7f37500b3590 2024-02-02T11:49:14.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f374ffff640 1 --2- 172.21.15.161:0/2635356011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37500b3590 0x7f375013c6a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3740025f80 tx=0x7f3738005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:14.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f374d7fa640 1 -- 172.21.15.161:0/2635356011 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740001640 con 0x7f37500b3590 2024-02-02T11:49:14.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f374d7fa640 1 -- 172.21.15.161:0/2635356011 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3740007070 con 0x7f37500b3590 2024-02-02T11:49:14.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f3756b68640 1 -- 172.21.15.161:0/2635356011 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37501e0150 con 0x7f37500b3590 2024-02-02T11:49:14.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f374d7fa640 1 -- 172.21.15.161:0/2635356011 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37400073e0 con 0x7f37500b3590 2024-02-02T11:49:14.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f3756b68640 1 -- 172.21.15.161:0/2635356011 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37501e0950 con 0x7f37500b3590 2024-02-02T11:49:14.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f3756b68640 1 -- 172.21.15.161:0/2635356011 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375004e000 con 0x7f37500b3590 2024-02-02T11:49:14.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f374d7fa640 1 -- 172.21.15.161:0/2635356011 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3740007540 con 0x7f37500b3590 2024-02-02T11:49:14.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f374d7fa640 1 --2- 172.21.15.161:0/2635356011 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f373c065a60 0x7f373c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f3754904640 1 --2- 172.21.15.161:0/2635356011 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f373c065a60 0x7f373c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f374d7fa640 1 -- 172.21.15.161:0/2635356011 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f374011ff50 con 0x7f37500b3590 2024-02-02T11:49:14.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.687+0000 7f3754904640 1 --2- 172.21.15.161:0/2635356011 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f373c065a60 0x7f373c067f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3744007fd0 tx=0x7f3744009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:14.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.691+0000 7f374d7fa640 1 -- 172.21.15.161:0/2635356011 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f37400ed880 con 0x7f37500b3590 2024-02-02T11:49:14.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.847+0000 7f3756b68640 1 -- 172.21.15.161:0/2635356011 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f375013e2e0 con 0x7f37500b3590 2024-02-02T11:49:14.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.851+0000 7f374d7fa640 1 -- 172.21.15.161:0/2635356011 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f37400c1030 con 0x7f37500b3590 2024-02-02T11:49:14.854 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:14.854 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":20,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:52.816101+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:48:50.155565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-02T11:48:50.795158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:49:14.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.851+0000 7f3756b68640 1 -- 172.21.15.161:0/2635356011 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f373c065a60 msgr2=0x7f373c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:14.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.851+0000 7f3756b68640 1 --2- 172.21.15.161:0/2635356011 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f373c065a60 0x7f373c067f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3744007fd0 tx=0x7f3744009040 comp rx=0 tx=0).stop 2024-02-02T11:49:14.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.851+0000 7f3756b68640 1 -- 172.21.15.161:0/2635356011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37500b3590 msgr2=0x7f375013c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:14.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.851+0000 7f3756b68640 1 --2- 172.21.15.161:0/2635356011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37500b3590 0x7f375013c6a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3740025f80 tx=0x7f3738005800 comp rx=0 tx=0).stop 2024-02-02T11:49:14.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.851+0000 7f3756b68640 1 -- 172.21.15.161:0/2635356011 shutdown_connections 2024-02-02T11:49:14.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.851+0000 7f3756b68640 1 --2- 172.21.15.161:0/2635356011 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f373c065a60 0x7f373c067f20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.851+0000 7f3756b68640 1 --2- 172.21.15.161:0/2635356011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f375013b120 0x7f375013b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.851+0000 7f3756b68640 1 --2- 172.21.15.161:0/2635356011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37500b3590 0x7f375013c6a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.851+0000 7f3756b68640 1 --2- 172.21.15.161:0/2635356011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37380047d0 0x7f375014e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.851+0000 7f3756b68640 1 -- 172.21.15.161:0/2635356011 >> 172.21.15.161:0/2635356011 conn(0x7f3750069ef0 msgr2=0x7f37500bb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:14.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.851+0000 7f3756b68640 1 -- 172.21.15.161:0/2635356011 shutdown_connections 2024-02-02T11:49:14.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.851+0000 7f3756b68640 1 -- 172.21.15.161:0/2635356011 wait complete. 2024-02-02T11:49:14.872 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-02T11:48:40.330782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-02T11:48:50.155565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-02T11:48:50.795158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-02T11:49:14.873 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-02T11:49:14.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.991+0000 7fb9cb65b640 1 Processor -- start 2024-02-02T11:49:14.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.991+0000 7fb9cb65b640 1 -- start start 2024-02-02T11:49:14.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.991+0000 7fb9cb65b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb9c4070e00 0x7fb9c40b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.991+0000 7fb9cb65b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb9c41489a0 0x7fb9c414c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:14.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.991+0000 7fb9cb65b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c40b6af0 con 0x7fb9c40717a0 2024-02-02T11:49:14.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.991+0000 7fb9cb65b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c40b61e0 con 0x7fb9c41489a0 2024-02-02T11:49:14.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.991+0000 7fb9cb65b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c40b7670 con 0x7fb9c4070e00 2024-02-02T11:49:14.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.991+0000 7fb9c9bf8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb9c41489a0 0x7fb9c414c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.991+0000 7fb9c9bf8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb9c41489a0 0x7fb9c414c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40498/0 (socket says 172.21.15.161:40498) 2024-02-02T11:49:14.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.991+0000 7fb9c9bf8640 1 -- 172.21.15.161:0/2017458230 learned_addr learned my addr 172.21.15.161:0/2017458230 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:14.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.991+0000 7fb9c93f7640 1 --2- 172.21.15.161:0/2017458230 >> v2:172.21.15.162:3300/0 conn(0x7fb9c4070e00 0x7fb9c40b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:14.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.991+0000 7fb9c9bf8640 1 -- 172.21.15.161:0/2017458230 >> v2:172.21.15.162:3300/0 conn(0x7fb9c4070e00 msgr2=0x7fb9c40b7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:14.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.991+0000 7fb9c9bf8640 1 --2- 172.21.15.161:0/2017458230 >> v2:172.21.15.162:3300/0 conn(0x7fb9c4070e00 0x7fb9c40b7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.991+0000 7fb9c9bf8640 1 -- 172.21.15.161:0/2017458230 >> v1:172.21.15.162:6789/0 conn(0x7fb9c40717a0 legacy=0x7fb9c414bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:14.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.991+0000 7fb9c9bf8640 1 -- 172.21.15.161:0/2017458230 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c4149870 con 0x7fb9c41489a0 2024-02-02T11:49:14.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9c9bf8640 1 --2- 172.21.15.161:0/2017458230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9c41489a0 0x7fb9c414c680 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9c406f860 tx=0x7fb9bc01f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973571f80ec74055 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:14.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9bbfff640 1 -- 172.21.15.161:0/2017458230 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc0af400 con 0x7fb9c41489a0 2024-02-02T11:49:14.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9bbfff640 1 -- 172.21.15.161:0/2017458230 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9bc0ab050 con 0x7fb9c41489a0 2024-02-02T11:49:14.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9bbfff640 1 -- 172.21.15.161:0/2017458230 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc0af780 con 0x7fb9c41489a0 2024-02-02T11:49:14.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9cb65b640 1 -- 172.21.15.161:0/2017458230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9c41489a0 msgr2=0x7fb9c414c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:14.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9cb65b640 1 --2- 172.21.15.161:0/2017458230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9c41489a0 0x7fb9c414c680 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9c406f860 tx=0x7fb9bc01f180 comp rx=0 tx=0).stop 2024-02-02T11:49:14.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9cb65b640 1 -- 172.21.15.161:0/2017458230 shutdown_connections 2024-02-02T11:49:14.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9cb65b640 1 --2- 172.21.15.161:0/2017458230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9c41489a0 0x7fb9c414c680 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9cb65b640 1 --2- 172.21.15.161:0/2017458230 >> v2:172.21.15.162:3300/0 conn(0x7fb9c4070e00 0x7fb9c40b7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:14.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9cb65b640 1 -- 172.21.15.161:0/2017458230 >> 172.21.15.161:0/2017458230 conn(0x7fb9c40be100 msgr2=0x7fb9c40be510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:14.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9cb65b640 1 -- 172.21.15.161:0/2017458230 shutdown_connections 2024-02-02T11:49:14.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9cb65b640 1 -- 172.21.15.161:0/2017458230 wait complete. 2024-02-02T11:49:15.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9cb65b640 1 Processor -- start 2024-02-02T11:49:15.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9cb65b640 1 -- start start 2024-02-02T11:49:15.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9cb65b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9c4070e00 0x7fb9c414a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9cb65b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9c40717a0 0x7fb9c41454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9cb65b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9c41489a0 0x7fb9c4143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9cb65b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c41459f0 con 0x7fb9c4070e00 2024-02-02T11:49:15.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9cb65b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c41dec60 con 0x7fb9c41489a0 2024-02-02T11:49:15.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9cb65b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c414a770 con 0x7fb9c40717a0 2024-02-02T11:49:15.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9c93f7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9c4070e00 0x7fb9c414a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9c93f7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9c4070e00 0x7fb9c414a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40508/0 (socket says 172.21.15.161:40508) 2024-02-02T11:49:15.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9c93f7640 1 -- 172.21.15.161:0/3398420589 learned_addr learned my addr 172.21.15.161:0/3398420589 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:15.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9c9bf8640 1 --2- 172.21.15.161:0/3398420589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9c41489a0 0x7fb9c4143db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9c8bf6640 1 --2- 172.21.15.161:0/3398420589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9c40717a0 0x7fb9c41454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9c93f7640 1 -- 172.21.15.161:0/3398420589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9c40717a0 msgr2=0x7fb9c41454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:15.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9c93f7640 1 --2- 172.21.15.161:0/3398420589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9c40717a0 0x7fb9c41454b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9c93f7640 1 -- 172.21.15.161:0/3398420589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9c41489a0 msgr2=0x7fb9c4143db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:15.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9c93f7640 1 --2- 172.21.15.161:0/3398420589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9c41489a0 0x7fb9c4143db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9c93f7640 1 -- 172.21.15.161:0/3398420589 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc009b30 con 0x7fb9c4070e00 2024-02-02T11:49:15.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9c9bf8640 1 --2- 172.21.15.161:0/3398420589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9c41489a0 0x7fb9c4143db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:15.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.995+0000 7fb9c93f7640 1 --2- 172.21.15.161:0/3398420589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9c4070e00 0x7fb9c414a0f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000d800 tx=0x7fb9c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:15.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.999+0000 7fb9b9ffb640 1 -- 172.21.15.161:0/3398420589 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0018070 con 0x7fb9c4070e00 2024-02-02T11:49:15.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.999+0000 7fb9b9ffb640 1 -- 172.21.15.161:0/3398420589 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c00059a0 con 0x7fb9c4070e00 2024-02-02T11:49:15.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.999+0000 7fb9cb65b640 1 -- 172.21.15.161:0/3398420589 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c41ddea0 con 0x7fb9c4070e00 2024-02-02T11:49:15.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.999+0000 7fb9b9ffb640 1 -- 172.21.15.161:0/3398420589 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0005b50 con 0x7fb9c4070e00 2024-02-02T11:49:15.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.999+0000 7fb9cb65b640 1 -- 172.21.15.161:0/3398420589 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c41de460 con 0x7fb9c4070e00 2024-02-02T11:49:15.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.999+0000 7fb9cb65b640 1 -- 172.21.15.161:0/3398420589 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c404e000 con 0x7fb9c4070e00 2024-02-02T11:49:15.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.999+0000 7fb9b9ffb640 1 -- 172.21.15.161:0/3398420589 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb9c0005cb0 con 0x7fb9c4070e00 2024-02-02T11:49:15.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.999+0000 7fb9b9ffb640 1 --2- 172.21.15.161:0/3398420589 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb9a8065a60 0x7fb9a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.999+0000 7fb9b9ffb640 1 -- 172.21.15.161:0/3398420589 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9c0083060 con 0x7fb9c4070e00 2024-02-02T11:49:15.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.999+0000 7fb9c8bf6640 1 --2- 172.21.15.161:0/3398420589 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb9a8065a60 0x7fb9a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:14.999+0000 7fb9c8bf6640 1 --2- 172.21.15.161:0/3398420589 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb9a8065a60 0x7fb9a8067f20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4145010 tx=0x7fb9b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:15.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.003+0000 7fb9b9ffb640 1 -- 172.21.15.161:0/3398420589 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb9c0050a20 con 0x7fb9c4070e00 2024-02-02T11:49:15.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.155+0000 7fb9cb65b640 1 -- 172.21.15.161:0/3398420589 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9c40b5c20 con 0x7fb9c4070e00 2024-02-02T11:49:15.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.159+0000 7fb9b9ffb640 1 -- 172.21.15.161:0/3398420589 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb9c0054040 con 0x7fb9c4070e00 2024-02-02T11:49:15.161 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-02-02T11:49:15.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.159+0000 7fb9cb65b640 1 -- 172.21.15.161:0/3398420589 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb9a8065a60 msgr2=0x7fb9a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:15.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.159+0000 7fb9cb65b640 1 --2- 172.21.15.161:0/3398420589 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb9a8065a60 0x7fb9a8067f20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4145010 tx=0x7fb9b4009040 comp rx=0 tx=0).stop 2024-02-02T11:49:15.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.159+0000 7fb9cb65b640 1 -- 172.21.15.161:0/3398420589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9c4070e00 msgr2=0x7fb9c414a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:15.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.159+0000 7fb9cb65b640 1 --2- 172.21.15.161:0/3398420589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9c4070e00 0x7fb9c414a0f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000d800 tx=0x7fb9c000dcc0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.159+0000 7fb9cb65b640 1 -- 172.21.15.161:0/3398420589 shutdown_connections 2024-02-02T11:49:15.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.159+0000 7fb9cb65b640 1 --2- 172.21.15.161:0/3398420589 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb9a8065a60 0x7fb9a8067f20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.159+0000 7fb9cb65b640 1 --2- 172.21.15.161:0/3398420589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9c41489a0 0x7fb9c4143db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.159+0000 7fb9cb65b640 1 --2- 172.21.15.161:0/3398420589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9c40717a0 0x7fb9c41454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.159+0000 7fb9cb65b640 1 --2- 172.21.15.161:0/3398420589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9c4070e00 0x7fb9c414a0f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.159+0000 7fb9cb65b640 1 -- 172.21.15.161:0/3398420589 >> 172.21.15.161:0/3398420589 conn(0x7fb9c40be100 msgr2=0x7fb9c4141ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:15.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.159+0000 7fb9cb65b640 1 -- 172.21.15.161:0/3398420589 shutdown_connections 2024-02-02T11:49:15.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.159+0000 7fb9cb65b640 1 -- 172.21.15.161:0/3398420589 wait complete. 2024-02-02T11:49:15.179 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-02T11:49:15.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71ebb53640 1 Processor -- start 2024-02-02T11:49:15.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71ebb53640 1 -- start start 2024-02-02T11:49:15.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71ebb53640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f71e40afba0 0x7f71e4071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71ebb53640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e406f800 con 0x7f71e4152410 2024-02-02T11:49:15.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71ebb53640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e406b440 con 0x7f71e4071460 2024-02-02T11:49:15.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71ebb53640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e406f520 con 0x7f71e40afba0 2024-02-02T11:49:15.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71ea0f0640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f71e4152410 0x7f71e406ad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59034/0 (socket says 172.21.15.161:59034) 2024-02-02T11:49:15.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71ea0f0640 1 -- 172.21.15.161:0/2859339492 learned_addr learned my addr 172.21.15.161:0/2859339492 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:15.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e98ef640 1 --2- 172.21.15.161:0/2859339492 >> v2:172.21.15.162:3300/0 conn(0x7f71e40afba0 0x7f71e4071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e88ed640 1 -- 172.21.15.161:0/2859339492 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411939912 0 0) 0x7f71e406f800 con 0x7f71e4152410 2024-02-02T11:49:15.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e88ed640 1 -- 172.21.15.161:0/2859339492 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71d0003530 con 0x7f71e4152410 2024-02-02T11:49:15.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e88ed640 1 -- 172.21.15.161:0/2859339492 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2556561753 0 0) 0x7f71d0003530 con 0x7f71e4152410 2024-02-02T11:49:15.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e88ed640 1 -- 172.21.15.161:0/2859339492 >> v2:172.21.15.162:3300/0 conn(0x7f71e40afba0 msgr2=0x7f71e4071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:15.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e88ed640 1 --2- 172.21.15.161:0/2859339492 >> v2:172.21.15.162:3300/0 conn(0x7f71e40afba0 0x7f71e4071dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e88ed640 1 -- 172.21.15.161:0/2859339492 >> v1:172.21.15.162:6789/0 conn(0x7f71e4071460 legacy=0x7f71e4070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:15.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e88ed640 1 -- 172.21.15.161:0/2859339492 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e40b6610 con 0x7f71e4152410 2024-02-02T11:49:15.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e88ed640 1 -- 172.21.15.161:0/2859339492 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f71dc001a00 con 0x7f71e4152410 2024-02-02T11:49:15.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e88ed640 1 -- 172.21.15.161:0/2859339492 >> v1:172.21.15.161:6789/0 conn(0x7f71e4152410 legacy=0x7f71e406ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:15.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e88ed640 1 --2- 172.21.15.161:0/2859339492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71d0003980 0x7f71d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e88ed640 1 --2- 172.21.15.161:0/2859339492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71d00047d0 0x7f71d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e88ed640 1 --2- 172.21.15.161:0/2859339492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71d0005190 0x7f71d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e88ed640 1 -- 172.21.15.161:0/2859339492 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e406f520 con 0x7f71d0003980 2024-02-02T11:49:15.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e88ed640 1 -- 172.21.15.161:0/2859339492 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d000c030 con 0x7f71d00047d0 2024-02-02T11:49:15.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e88ed640 1 -- 172.21.15.161:0/2859339492 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d000c1f0 con 0x7f71d0005190 2024-02-02T11:49:15.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e98ef640 1 --2- 172.21.15.161:0/2859339492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71d0003980 0x7f71d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e90ee640 1 --2- 172.21.15.161:0/2859339492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71d00047d0 0x7f71d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e98ef640 1 -- 172.21.15.161:0/2859339492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71d0005190 msgr2=0x7f71d000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:15.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e98ef640 1 --2- 172.21.15.161:0/2859339492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71d0005190 0x7f71d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e98ef640 1 -- 172.21.15.161:0/2859339492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71d00047d0 msgr2=0x7f71d0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:15.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e98ef640 1 --2- 172.21.15.161:0/2859339492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71d00047d0 0x7f71d0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e98ef640 1 -- 172.21.15.161:0/2859339492 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d0003530 con 0x7f71d0003980 2024-02-02T11:49:15.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71e90ee640 1 --2- 172.21.15.161:0/2859339492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71d00047d0 0x7f71d0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:15.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.299+0000 7f71ea0f0640 1 -- 172.21.15.161:0/2859339492 reap_dead start 2024-02-02T11:49:15.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71e98ef640 1 --2- 172.21.15.161:0/2859339492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71d0003980 0x7f71d0003da0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009ae0 tx=0x7f71e001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2536f6d9e51487 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:15.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71e88ed640 1 -- 172.21.15.161:0/2859339492 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e00a5530 con 0x7f71d0003980 2024-02-02T11:49:15.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71e88ed640 1 -- 172.21.15.161:0/2859339492 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e00a5690 con 0x7f71d0003980 2024-02-02T11:49:15.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71e88ed640 1 -- 172.21.15.161:0/2859339492 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e00a5a40 con 0x7f71d0003980 2024-02-02T11:49:15.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71ebb53640 1 -- 172.21.15.161:0/2859339492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71d0003980 msgr2=0x7f71d0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:15.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71ebb53640 1 --2- 172.21.15.161:0/2859339492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71d0003980 0x7f71d0003da0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009ae0 tx=0x7f71e001ca50 comp rx=0 tx=0).stop 2024-02-02T11:49:15.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71ebb53640 1 -- 172.21.15.161:0/2859339492 shutdown_connections 2024-02-02T11:49:15.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71ebb53640 1 --2- 172.21.15.161:0/2859339492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71d0003980 0x7f71d0003da0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71ebb53640 1 -- 172.21.15.161:0/2859339492 >> 172.21.15.161:0/2859339492 conn(0x7f71e40b9140 msgr2=0x7f71e40b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:15.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71ebb53640 1 -- 172.21.15.161:0/2859339492 shutdown_connections 2024-02-02T11:49:15.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71ebb53640 1 -- 172.21.15.161:0/2859339492 wait complete. 2024-02-02T11:49:15.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71ebb53640 1 Processor -- start 2024-02-02T11:49:15.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71ebb53640 1 -- start start 2024-02-02T11:49:15.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71ebb53640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71d0003980 0x7f71e41e8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71ebb53640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71e414da50 0x7f71e414e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71ebb53640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71e40b0800 0x7f71e414f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71ebb53640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e414ed10 con 0x7f71e40b0800 2024-02-02T11:49:15.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71ebb53640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e4142e00 con 0x7f71d0003980 2024-02-02T11:49:15.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71ebb53640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e414ded0 con 0x7f71e414da50 2024-02-02T11:49:15.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71ea0f0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71e40b0800 0x7f71e414f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71ea0f0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71e40b0800 0x7f71e414f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40512/0 (socket says 172.21.15.161:40512) 2024-02-02T11:49:15.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71ea0f0640 1 -- 172.21.15.161:0/1778987016 learned_addr learned my addr 172.21.15.161:0/1778987016 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:15.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.303+0000 7f71e90ee640 1 --2- 172.21.15.161:0/1778987016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71e414da50 0x7f71e414e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.307+0000 7f71e98ef640 1 --2- 172.21.15.161:0/1778987016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71d0003980 0x7f71e41e8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.307+0000 7f71ea0f0640 1 -- 172.21.15.161:0/1778987016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71e414da50 msgr2=0x7f71e414e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:15.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.307+0000 7f71ea0f0640 1 --2- 172.21.15.161:0/1778987016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71e414da50 0x7f71e414e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.307+0000 7f71ea0f0640 1 -- 172.21.15.161:0/1778987016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71d0003980 msgr2=0x7f71e41e8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:15.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.307+0000 7f71ea0f0640 1 --2- 172.21.15.161:0/1778987016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71d0003980 0x7f71e41e8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.307+0000 7f71ea0f0640 1 -- 172.21.15.161:0/1778987016 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e4151080 con 0x7f71e40b0800 2024-02-02T11:49:15.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.307+0000 7f71ea0f0640 1 --2- 172.21.15.161:0/1778987016 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71e40b0800 0x7f71e414f130 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f71e4065c60 tx=0x7f71dc00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:15.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.307+0000 7f71da7fc640 1 -- 172.21.15.161:0/1778987016 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc00cea0 con 0x7f71e40b0800 2024-02-02T11:49:15.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.307+0000 7f71da7fc640 1 -- 172.21.15.161:0/1778987016 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71dc00a610 con 0x7f71e40b0800 2024-02-02T11:49:15.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.307+0000 7f71ebb53640 1 -- 172.21.15.161:0/1778987016 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e40b0c80 con 0x7f71e40b0800 2024-02-02T11:49:15.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.307+0000 7f71da7fc640 1 -- 172.21.15.161:0/1778987016 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc00a9a0 con 0x7f71e40b0800 2024-02-02T11:49:15.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.307+0000 7f71ebb53640 1 -- 172.21.15.161:0/1778987016 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e41e7ba0 con 0x7f71e40b0800 2024-02-02T11:49:15.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.307+0000 7f71ebb53640 1 -- 172.21.15.161:0/1778987016 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e404e000 con 0x7f71e40b0800 2024-02-02T11:49:15.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.307+0000 7f71da7fc640 1 -- 172.21.15.161:0/1778987016 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f71dc00ab00 con 0x7f71e40b0800 2024-02-02T11:49:15.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.307+0000 7f71da7fc640 1 --2- 172.21.15.161:0/1778987016 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f71c8065a60 0x7f71c8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.307+0000 7f71e98ef640 1 --2- 172.21.15.161:0/1778987016 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f71c8065a60 0x7f71c8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.307+0000 7f71da7fc640 1 -- 172.21.15.161:0/1778987016 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71dc082d70 con 0x7f71e40b0800 2024-02-02T11:49:15.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.307+0000 7f71e98ef640 1 --2- 172.21.15.161:0/1778987016 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f71c8065a60 0x7f71c8067f20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f71e00af000 tx=0x7f71e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:15.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.311+0000 7f71da7fc640 1 -- 172.21.15.161:0/1778987016 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f71dc054130 con 0x7f71e40b0800 2024-02-02T11:49:15.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.451+0000 7f71ebb53640 1 -- 172.21.15.161:0/1778987016 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f71e4071110 con 0x7f71e40b0800 2024-02-02T11:49:15.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.455+0000 7f71da7fc640 1 -- 172.21.15.161:0/1778987016 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f71dc01a020 con 0x7f71e40b0800 2024-02-02T11:49:15.456 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-02-02T11:49:15.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.455+0000 7f71ebb53640 1 -- 172.21.15.161:0/1778987016 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f71c8065a60 msgr2=0x7f71c8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:15.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.455+0000 7f71ebb53640 1 --2- 172.21.15.161:0/1778987016 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f71c8065a60 0x7f71c8067f20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f71e00af000 tx=0x7f71e0008040 comp rx=0 tx=0).stop 2024-02-02T11:49:15.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.455+0000 7f71ebb53640 1 -- 172.21.15.161:0/1778987016 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71e40b0800 msgr2=0x7f71e414f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:15.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.455+0000 7f71ebb53640 1 --2- 172.21.15.161:0/1778987016 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71e40b0800 0x7f71e414f130 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f71e4065c60 tx=0x7f71dc00cc50 comp rx=0 tx=0).stop 2024-02-02T11:49:15.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.455+0000 7f71ebb53640 1 -- 172.21.15.161:0/1778987016 shutdown_connections 2024-02-02T11:49:15.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.455+0000 7f71ebb53640 1 --2- 172.21.15.161:0/1778987016 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f71c8065a60 0x7f71c8067f20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.455+0000 7f71ebb53640 1 --2- 172.21.15.161:0/1778987016 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71e40b0800 0x7f71e414f130 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.455+0000 7f71ebb53640 1 --2- 172.21.15.161:0/1778987016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71e414da50 0x7f71e414e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.455+0000 7f71ebb53640 1 --2- 172.21.15.161:0/1778987016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71d0003980 0x7f71e41e8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.455+0000 7f71ebb53640 1 -- 172.21.15.161:0/1778987016 >> 172.21.15.161:0/1778987016 conn(0x7f71e40b9140 msgr2=0x7f71e40bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:15.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.455+0000 7f71ebb53640 1 -- 172.21.15.161:0/1778987016 shutdown_connections 2024-02-02T11:49:15.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.455+0000 7f71ebb53640 1 -- 172.21.15.161:0/1778987016 wait complete. 2024-02-02T11:49:15.475 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-02T11:49:15.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.595+0000 7f01cd5f2640 1 Processor -- start 2024-02-02T11:49:15.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.595+0000 7f01cd5f2640 1 -- start start 2024-02-02T11:49:15.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.595+0000 7f01cd5f2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01c8147bc0 0x7f01c80709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.595+0000 7f01cd5f2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f01c8144100 0x7f01c81445b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.595+0000 7f01cd5f2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c8070ef0 con 0x7f01c806fc30 2024-02-02T11:49:15.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.595+0000 7f01cd5f2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c8071640 con 0x7f01c8144100 2024-02-02T11:49:15.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.595+0000 7f01cd5f2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c806ecc0 con 0x7f01c8147bc0 2024-02-02T11:49:15.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.595+0000 7f01c77fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f01c8144100 0x7f01c81445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.595+0000 7f01c77fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f01c8144100 0x7f01c81445b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40516/0 (socket says 172.21.15.161:40516) 2024-02-02T11:49:15.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.595+0000 7f01c77fe640 1 -- 172.21.15.161:0/4277405310 learned_addr learned my addr 172.21.15.161:0/4277405310 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:15.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.595+0000 7f01bffff640 1 --2- 172.21.15.161:0/4277405310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01c8147bc0 0x7f01c80709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.595+0000 7f01c77fe640 1 -- 172.21.15.161:0/4277405310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01c8147bc0 msgr2=0x7f01c80709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:15.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.595+0000 7f01c77fe640 1 --2- 172.21.15.161:0/4277405310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01c8147bc0 0x7f01c80709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.595+0000 7f01c77fe640 1 -- 172.21.15.161:0/4277405310 >> v1:172.21.15.162:6789/0 conn(0x7f01c806fc30 legacy=0x7f01c81474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:15.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.595+0000 7f01c77fe640 1 -- 172.21.15.161:0/4277405310 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c806ef30 con 0x7f01c8144100 2024-02-02T11:49:15.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.595+0000 7f01c77fe640 1 --2- 172.21.15.161:0/4277405310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01c8144100 0x7f01c81445b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009e50 tx=0x7f01c001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a3db0b42748fc7 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:15.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01c67fc640 1 -- 172.21.15.161:0/4277405310 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c00a5820 con 0x7f01c8144100 2024-02-02T11:49:15.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01c67fc640 1 -- 172.21.15.161:0/4277405310 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c00a5980 con 0x7f01c8144100 2024-02-02T11:49:15.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01c67fc640 1 -- 172.21.15.161:0/4277405310 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c00a5d10 con 0x7f01c8144100 2024-02-02T11:49:15.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01cd5f2640 1 -- 172.21.15.161:0/4277405310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01c8144100 msgr2=0x7f01c81445b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:15.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01cd5f2640 1 --2- 172.21.15.161:0/4277405310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01c8144100 0x7f01c81445b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009e50 tx=0x7f01c001c9a0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01cd5f2640 1 -- 172.21.15.161:0/4277405310 shutdown_connections 2024-02-02T11:49:15.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01cd5f2640 1 --2- 172.21.15.161:0/4277405310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01c8147bc0 0x7f01c80709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01cd5f2640 1 --2- 172.21.15.161:0/4277405310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01c8144100 0x7f01c81445b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01cd5f2640 1 -- 172.21.15.161:0/4277405310 >> 172.21.15.161:0/4277405310 conn(0x7f01c806a120 msgr2=0x7f01c806a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:15.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01cd5f2640 1 -- 172.21.15.161:0/4277405310 shutdown_connections 2024-02-02T11:49:15.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01cd5f2640 1 -- 172.21.15.161:0/4277405310 wait complete. 2024-02-02T11:49:15.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01cd5f2640 1 Processor -- start 2024-02-02T11:49:15.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01cd5f2640 1 -- start start 2024-02-02T11:49:15.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01cd5f2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01c806fc30 0x7f01c81e2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01cd5f2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01c8144100 0x7f01c8141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01cd5f2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01c8147bc0 0x7f01c8135c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01cd5f2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c81e5b80 con 0x7f01c8144100 2024-02-02T11:49:15.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01cd5f2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c81e35b0 con 0x7f01c806fc30 2024-02-02T11:49:15.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01cd5f2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c8143170 con 0x7f01c8147bc0 2024-02-02T11:49:15.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01bffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01c8144100 0x7f01c8141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01bffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01c8144100 0x7f01c8141210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40520/0 (socket says 172.21.15.161:40520) 2024-02-02T11:49:15.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01bffff640 1 -- 172.21.15.161:0/283593968 learned_addr learned my addr 172.21.15.161:0/283593968 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:15.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01bffff640 1 -- 172.21.15.161:0/283593968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01c8147bc0 msgr2=0x7f01c8135c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:15.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01bffff640 1 --2- 172.21.15.161:0/283593968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01c8147bc0 0x7f01c8135c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01bffff640 1 -- 172.21.15.161:0/283593968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01c806fc30 msgr2=0x7f01c81e2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:15.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01c6ffd640 1 --2- 172.21.15.161:0/283593968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01c806fc30 0x7f01c81e2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01bffff640 1 --2- 172.21.15.161:0/283593968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01c806fc30 0x7f01c81e2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01bffff640 1 -- 172.21.15.161:0/283593968 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c0009b30 con 0x7f01c8144100 2024-02-02T11:49:15.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01bffff640 1 --2- 172.21.15.161:0/283593968 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01c8144100 0x7f01c8141210 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f01b000d5d0 tx=0x7f01b000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:15.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01bf7fe640 1 -- 172.21.15.161:0/283593968 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b0004240 con 0x7f01c8144100 2024-02-02T11:49:15.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01bf7fe640 1 -- 172.21.15.161:0/283593968 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b00043a0 con 0x7f01c8144100 2024-02-02T11:49:15.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01bf7fe640 1 -- 172.21.15.161:0/283593968 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b0003840 con 0x7f01c8144100 2024-02-02T11:49:15.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01cd5f2640 1 -- 172.21.15.161:0/283593968 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c81e5dd0 con 0x7f01c8144100 2024-02-02T11:49:15.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.599+0000 7f01cd5f2640 1 -- 172.21.15.161:0/283593968 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c81e6390 con 0x7f01c8144100 2024-02-02T11:49:15.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.603+0000 7f01cd5f2640 1 -- 172.21.15.161:0/283593968 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c80b2dc0 con 0x7f01c8144100 2024-02-02T11:49:15.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.603+0000 7f01bf7fe640 1 -- 172.21.15.161:0/283593968 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f01b00039a0 con 0x7f01c8144100 2024-02-02T11:49:15.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.603+0000 7f01bf7fe640 1 --2- 172.21.15.161:0/283593968 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f01a8065a60 0x7f01a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.603+0000 7f01bf7fe640 1 -- 172.21.15.161:0/283593968 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01b0083280 con 0x7f01c8144100 2024-02-02T11:49:15.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.603+0000 7f01c6ffd640 1 --2- 172.21.15.161:0/283593968 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f01a8065a60 0x7f01a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.603+0000 7f01c6ffd640 1 --2- 172.21.15.161:0/283593968 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f01a8065a60 0x7f01a8067f20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f01b8003d60 tx=0x7f01b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:15.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.607+0000 7f01bf7fe640 1 -- 172.21.15.161:0/283593968 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f01b0050cd0 con 0x7f01c8144100 2024-02-02T11:49:15.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.759+0000 7f01cd5f2640 1 -- 172.21.15.161:0/283593968 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01c804e000 con 0x7f01c8144100 2024-02-02T11:49:15.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.759+0000 7f01bf7fe640 1 -- 172.21.15.161:0/283593968 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f01b00542f0 con 0x7f01c8144100 2024-02-02T11:49:15.764 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2024-02-02T11:49:15.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.763+0000 7f01cd5f2640 1 -- 172.21.15.161:0/283593968 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f01a8065a60 msgr2=0x7f01a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:15.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.763+0000 7f01cd5f2640 1 --2- 172.21.15.161:0/283593968 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f01a8065a60 0x7f01a8067f20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f01b8003d60 tx=0x7f01b8009040 comp rx=0 tx=0).stop 2024-02-02T11:49:15.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.763+0000 7f01cd5f2640 1 -- 172.21.15.161:0/283593968 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01c8144100 msgr2=0x7f01c8141210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:15.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.763+0000 7f01cd5f2640 1 --2- 172.21.15.161:0/283593968 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01c8144100 0x7f01c8141210 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f01b000d5d0 tx=0x7f01b000da90 comp rx=0 tx=0).stop 2024-02-02T11:49:15.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.763+0000 7f01cd5f2640 1 -- 172.21.15.161:0/283593968 shutdown_connections 2024-02-02T11:49:15.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.763+0000 7f01cd5f2640 1 --2- 172.21.15.161:0/283593968 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f01a8065a60 0x7f01a8067f20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.763+0000 7f01cd5f2640 1 --2- 172.21.15.161:0/283593968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01c8147bc0 0x7f01c8135c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.763+0000 7f01cd5f2640 1 --2- 172.21.15.161:0/283593968 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01c8144100 0x7f01c8141210 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.763+0000 7f01cd5f2640 1 --2- 172.21.15.161:0/283593968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01c806fc30 0x7f01c81e2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.763+0000 7f01cd5f2640 1 -- 172.21.15.161:0/283593968 >> 172.21.15.161:0/283593968 conn(0x7f01c806a120 msgr2=0x7f01c80b75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:15.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.763+0000 7f01cd5f2640 1 -- 172.21.15.161:0/283593968 shutdown_connections 2024-02-02T11:49:15.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.763+0000 7f01cd5f2640 1 -- 172.21.15.161:0/283593968 wait complete. 2024-02-02T11:49:15.791 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-02-02T11:49:15.791 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2024-02-02T11:49:15.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.895+0000 7f2c8a66a640 1 Processor -- start 2024-02-02T11:49:15.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.895+0000 7f2c8a66a640 1 -- start start 2024-02-02T11:49:15.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.895+0000 7f2c8a66a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2c840708d0 0x7f2c84070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.895+0000 7f2c8a66a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c84071a20 0x7f2c84147210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.895+0000 7f2c8a66a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2c8406eca0 0x7f2c84147750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.895+0000 7f2c8a66a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c840b2c80 con 0x7f2c840708d0 2024-02-02T11:49:15.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.895+0000 7f2c8a66a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c8406fdb0 con 0x7f2c8406eca0 2024-02-02T11:49:15.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.895+0000 7f2c8a66a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c84070370 con 0x7f2c84071a20 2024-02-02T11:49:15.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.895+0000 7f2c83fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2c840708d0 0x7f2c84070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.895+0000 7f2c83fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2c840708d0 0x7f2c84070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40526/0 (socket says 172.21.15.161:40526) 2024-02-02T11:49:15.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.895+0000 7f2c83fff640 1 -- 172.21.15.161:0/3306309234 learned_addr learned my addr 172.21.15.161:0/3306309234 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:15.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.895+0000 7f2c88c07640 1 --2- 172.21.15.161:0/3306309234 >> v2:172.21.15.162:3300/0 conn(0x7f2c8406eca0 0x7f2c84147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.895+0000 7f2c837fe640 1 --2- 172.21.15.161:0/3306309234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c84071a20 0x7f2c84147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.895+0000 7f2c83fff640 1 -- 172.21.15.161:0/3306309234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c84071a20 msgr2=0x7f2c84147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:15.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.895+0000 7f2c83fff640 1 --2- 172.21.15.161:0/3306309234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c84071a20 0x7f2c84147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.895+0000 7f2c83fff640 1 -- 172.21.15.161:0/3306309234 >> v2:172.21.15.162:3300/0 conn(0x7f2c8406eca0 msgr2=0x7f2c84147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:15.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.895+0000 7f2c83fff640 1 --2- 172.21.15.161:0/3306309234 >> v2:172.21.15.162:3300/0 conn(0x7f2c8406eca0 0x7f2c84147750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.895+0000 7f2c83fff640 1 -- 172.21.15.161:0/3306309234 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c840b2ed0 con 0x7f2c840708d0 2024-02-02T11:49:15.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.895+0000 7f2c837fe640 1 --2- 172.21.15.161:0/3306309234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c84071a20 0x7f2c84147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:15.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.899+0000 7f2c83fff640 1 --2- 172.21.15.161:0/3306309234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c840708d0 0x7f2c84070cb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2c8406b260 tx=0x7f2c7801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967361508828b8a3 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:15.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.899+0000 7f2c82ffd640 1 -- 172.21.15.161:0/3306309234 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c780aa640 con 0x7f2c840708d0 2024-02-02T11:49:15.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.899+0000 7f2c82ffd640 1 -- 172.21.15.161:0/3306309234 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c780aa7a0 con 0x7f2c840708d0 2024-02-02T11:49:15.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.899+0000 7f2c82ffd640 1 -- 172.21.15.161:0/3306309234 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c780aab30 con 0x7f2c840708d0 2024-02-02T11:49:15.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.899+0000 7f2c8a66a640 1 -- 172.21.15.161:0/3306309234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c840708d0 msgr2=0x7f2c84070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:15.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.899+0000 7f2c8a66a640 1 --2- 172.21.15.161:0/3306309234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c840708d0 0x7f2c84070cb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2c8406b260 tx=0x7f2c7801c500 comp rx=0 tx=0).stop 2024-02-02T11:49:15.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.899+0000 7f2c8a66a640 1 -- 172.21.15.161:0/3306309234 shutdown_connections 2024-02-02T11:49:15.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.899+0000 7f2c8a66a640 1 --2- 172.21.15.161:0/3306309234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c84071a20 0x7f2c84147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.899+0000 7f2c8a66a640 1 --2- 172.21.15.161:0/3306309234 >> v2:172.21.15.162:3300/0 conn(0x7f2c8406eca0 0x7f2c84147750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.899+0000 7f2c8a66a640 1 --2- 172.21.15.161:0/3306309234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c840708d0 0x7f2c84070cb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.899+0000 7f2c8a66a640 1 -- 172.21.15.161:0/3306309234 >> 172.21.15.161:0/3306309234 conn(0x7f2c84069ef0 msgr2=0x7f2c8406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:15.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.899+0000 7f2c8a66a640 1 -- 172.21.15.161:0/3306309234 shutdown_connections 2024-02-02T11:49:15.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.899+0000 7f2c8a66a640 1 -- 172.21.15.161:0/3306309234 wait complete. 2024-02-02T11:49:15.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c8a66a640 1 Processor -- start 2024-02-02T11:49:15.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c8a66a640 1 -- start start 2024-02-02T11:49:15.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c8a66a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c8406eca0 0x7f2c841428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c8a66a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c840708d0 0x7f2c84149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c8a66a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c84071a20 0x7f2c8414a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c8a66a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8414c140 con 0x7f2c84071a20 2024-02-02T11:49:15.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c8a66a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c84142df0 con 0x7f2c840708d0 2024-02-02T11:49:15.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c8a66a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8414b1c0 con 0x7f2c8406eca0 2024-02-02T11:49:15.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c88c07640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c84071a20 0x7f2c8414a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c88c07640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c84071a20 0x7f2c8414a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40528/0 (socket says 172.21.15.161:40528) 2024-02-02T11:49:15.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c88c07640 1 -- 172.21.15.161:0/3744666574 learned_addr learned my addr 172.21.15.161:0/3744666574 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:15.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c83fff640 1 --2- 172.21.15.161:0/3744666574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c8406eca0 0x7f2c841428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c837fe640 1 --2- 172.21.15.161:0/3744666574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c840708d0 0x7f2c84149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c88c07640 1 -- 172.21.15.161:0/3744666574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c8406eca0 msgr2=0x7f2c841428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:15.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c88c07640 1 --2- 172.21.15.161:0/3744666574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c8406eca0 0x7f2c841428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c88c07640 1 -- 172.21.15.161:0/3744666574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c840708d0 msgr2=0x7f2c84149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:15.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c88c07640 1 --2- 172.21.15.161:0/3744666574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c840708d0 0x7f2c84149cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:15.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c88c07640 1 -- 172.21.15.161:0/3744666574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c780094d0 con 0x7f2c84071a20 2024-02-02T11:49:15.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c837fe640 1 --2- 172.21.15.161:0/3744666574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c840708d0 0x7f2c84149cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:15.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c88c07640 1 --2- 172.21.15.161:0/3744666574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c84071a20 0x7f2c8414a230 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c007e40 tx=0x7f2c7c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:15.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c80ff9640 1 -- 172.21.15.161:0/3744666574 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c014620 con 0x7f2c84071a20 2024-02-02T11:49:15.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c80ff9640 1 -- 172.21.15.161:0/3744666574 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7c0147a0 con 0x7f2c84071a20 2024-02-02T11:49:15.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c8a66a640 1 -- 172.21.15.161:0/3744666574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c8414b410 con 0x7f2c84071a20 2024-02-02T11:49:15.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c80ff9640 1 -- 172.21.15.161:0/3744666574 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c014b50 con 0x7f2c84071a20 2024-02-02T11:49:15.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c8a66a640 1 -- 172.21.15.161:0/3744666574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8414b9d0 con 0x7f2c84071a20 2024-02-02T11:49:15.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c8a66a640 1 -- 172.21.15.161:0/3744666574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c8404e000 con 0x7f2c84071a20 2024-02-02T11:49:15.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c80ff9640 1 -- 172.21.15.161:0/3744666574 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2c7c014cb0 con 0x7f2c84071a20 2024-02-02T11:49:15.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c80ff9640 1 --2- 172.21.15.161:0/3744666574 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2c70065a60 0x7f2c70067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:15.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c83fff640 1 --2- 172.21.15.161:0/3744666574 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2c70065a60 0x7f2c70067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:15.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.903+0000 7f2c80ff9640 1 -- 172.21.15.161:0/3744666574 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c7c083a40 con 0x7f2c84071a20 2024-02-02T11:49:15.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.907+0000 7f2c83fff640 1 --2- 172.21.15.161:0/3744666574 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2c70065a60 0x7f2c70067f20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2c780ae000 tx=0x7f2c780a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:15.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:15.907+0000 7f2c80ff9640 1 -- 172.21.15.161:0/3744666574 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2c7c085e60 con 0x7f2c84071a20 2024-02-02T11:49:16.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.119+0000 7f2c8a66a640 1 -- 172.21.15.161:0/3744666574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f2c84149a50 con 0x7f2c84071a20 2024-02-02T11:49:16.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.635+0000 7f2c80ff9640 1 -- 172.21.15.161:0/3744666574 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v46) v1 ==== 166+0+0 (secure 0 0 0) 0x7f2c7c051490 con 0x7f2c84071a20 2024-02-02T11:49:16.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.639+0000 7f2c8a66a640 1 -- 172.21.15.161:0/3744666574 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2c70065a60 msgr2=0x7f2c70067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:16.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.639+0000 7f2c8a66a640 1 --2- 172.21.15.161:0/3744666574 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2c70065a60 0x7f2c70067f20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2c780ae000 tx=0x7f2c780a7000 comp rx=0 tx=0).stop 2024-02-02T11:49:16.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.639+0000 7f2c8a66a640 1 -- 172.21.15.161:0/3744666574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c84071a20 msgr2=0x7f2c8414a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:16.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.639+0000 7f2c8a66a640 1 --2- 172.21.15.161:0/3744666574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c84071a20 0x7f2c8414a230 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c007e40 tx=0x7f2c7c00e4b0 comp rx=0 tx=0).stop 2024-02-02T11:49:16.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.639+0000 7f2c8a66a640 1 -- 172.21.15.161:0/3744666574 shutdown_connections 2024-02-02T11:49:16.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.639+0000 7f2c8a66a640 1 --2- 172.21.15.161:0/3744666574 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2c70065a60 0x7f2c70067f20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:16.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.639+0000 7f2c8a66a640 1 --2- 172.21.15.161:0/3744666574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c84071a20 0x7f2c8414a230 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:16.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.639+0000 7f2c8a66a640 1 --2- 172.21.15.161:0/3744666574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c840708d0 0x7f2c84149cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:16.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.639+0000 7f2c8a66a640 1 --2- 172.21.15.161:0/3744666574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c8406eca0 0x7f2c841428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:16.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.639+0000 7f2c8a66a640 1 -- 172.21.15.161:0/3744666574 >> 172.21.15.161:0/3744666574 conn(0x7f2c84069ef0 msgr2=0x7f2c84072f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:16.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.639+0000 7f2c8a66a640 1 -- 172.21.15.161:0/3744666574 shutdown_connections 2024-02-02T11:49:16.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.639+0000 7f2c8a66a640 1 -- 172.21.15.161:0/3744666574 wait complete. 2024-02-02T11:49:16.668 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-02-02T11:49:16.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.795+0000 7ff0c529e640 1 Processor -- start 2024-02-02T11:49:16.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.795+0000 7ff0c529e640 1 -- start start 2024-02-02T11:49:16.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.795+0000 7ff0c529e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0c0070e40 0x7ff0c0141620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:16.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.795+0000 7ff0c529e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff0c00b8530 0x7ff0c0141b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:16.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.795+0000 7ff0c529e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c006ec30 con 0x7ff0c00b8df0 2024-02-02T11:49:16.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.795+0000 7ff0c529e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c00b30e0 con 0x7ff0c0070e40 2024-02-02T11:49:16.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.795+0000 7ff0c529e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c00b3770 con 0x7ff0c00b8530 2024-02-02T11:49:16.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.795+0000 7ff0b7fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0c0070e40 0x7ff0c0141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:16.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.795+0000 7ff0b7fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0c0070e40 0x7ff0c0141620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40540/0 (socket says 172.21.15.161:40540) 2024-02-02T11:49:16.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.795+0000 7ff0b7fff640 1 -- 172.21.15.161:0/3005643374 learned_addr learned my addr 172.21.15.161:0/3005643374 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:16.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.795+0000 7ff0bf7fe640 1 --2- 172.21.15.161:0/3005643374 >> v2:172.21.15.162:3300/0 conn(0x7ff0c00b8530 0x7ff0c0141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:16.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.795+0000 7ff0b7fff640 1 -- 172.21.15.161:0/3005643374 >> v2:172.21.15.162:3300/0 conn(0x7ff0c00b8530 msgr2=0x7ff0c0141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:16.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.795+0000 7ff0b7fff640 1 --2- 172.21.15.161:0/3005643374 >> v2:172.21.15.162:3300/0 conn(0x7ff0c00b8530 0x7ff0c0141b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:16.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.795+0000 7ff0b7fff640 1 -- 172.21.15.161:0/3005643374 >> v1:172.21.15.162:6789/0 conn(0x7ff0c00b8df0 legacy=0x7ff0c0147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:16.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.795+0000 7ff0b7fff640 1 -- 172.21.15.161:0/3005643374 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c0071890 con 0x7ff0c0070e40 2024-02-02T11:49:16.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.795+0000 7ff0bf7fe640 1 --2- 172.21.15.161:0/3005643374 >> v2:172.21.15.162:3300/0 conn(0x7ff0c00b8530 0x7ff0c0141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:16.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0b7fff640 1 --2- 172.21.15.161:0/3005643374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0c0070e40 0x7ff0c0141620 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff0c00b3490 tx=0x7ff0a801eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e3dfcbef6573ab server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:16.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0be7fc640 1 -- 172.21.15.161:0/3005643374 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a80a7b30 con 0x7ff0c0070e40 2024-02-02T11:49:16.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0be7fc640 1 -- 172.21.15.161:0/3005643374 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a80a7c90 con 0x7ff0c0070e40 2024-02-02T11:49:16.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0be7fc640 1 -- 172.21.15.161:0/3005643374 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a80af440 con 0x7ff0c0070e40 2024-02-02T11:49:16.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0c529e640 1 -- 172.21.15.161:0/3005643374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0c0070e40 msgr2=0x7ff0c0141620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:16.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0c529e640 1 --2- 172.21.15.161:0/3005643374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0c0070e40 0x7ff0c0141620 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff0c00b3490 tx=0x7ff0a801eb60 comp rx=0 tx=0).stop 2024-02-02T11:49:16.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0c529e640 1 -- 172.21.15.161:0/3005643374 shutdown_connections 2024-02-02T11:49:16.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0c529e640 1 --2- 172.21.15.161:0/3005643374 >> v2:172.21.15.162:3300/0 conn(0x7ff0c00b8530 0x7ff0c0141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:16.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0c529e640 1 --2- 172.21.15.161:0/3005643374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0c0070e40 0x7ff0c0141620 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:16.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0c529e640 1 -- 172.21.15.161:0/3005643374 >> 172.21.15.161:0/3005643374 conn(0x7ff0c006a120 msgr2=0x7ff0c006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:16.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0c529e640 1 -- 172.21.15.161:0/3005643374 shutdown_connections 2024-02-02T11:49:16.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0c529e640 1 -- 172.21.15.161:0/3005643374 wait complete. 2024-02-02T11:49:16.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0c529e640 1 Processor -- start 2024-02-02T11:49:16.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0c529e640 1 -- start start 2024-02-02T11:49:16.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0c529e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0c00b8530 0x7ff0c0145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:16.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0c529e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0c00b8df0 0x7ff0c01374d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:16.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0c529e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0c0146f10 0x7ff0c01e64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:16.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0c529e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c01e60c0 con 0x7ff0c0146f10 2024-02-02T11:49:16.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0c529e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c0137a10 con 0x7ff0c00b8530 2024-02-02T11:49:16.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0c529e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c01e5d70 con 0x7ff0c00b8df0 2024-02-02T11:49:16.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0bf7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0c0146f10 0x7ff0c01e64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:16.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0bf7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0c0146f10 0x7ff0c01e64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40546/0 (socket says 172.21.15.161:40546) 2024-02-02T11:49:16.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0bf7fe640 1 -- 172.21.15.161:0/1461484876 learned_addr learned my addr 172.21.15.161:0/1461484876 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:16.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0beffd640 1 --2- 172.21.15.161:0/1461484876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0c00b8530 0x7ff0c0145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:16.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0b7fff640 1 --2- 172.21.15.161:0/1461484876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0c00b8df0 0x7ff0c01374d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:16.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0bf7fe640 1 -- 172.21.15.161:0/1461484876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0c00b8df0 msgr2=0x7ff0c01374d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:16.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0bf7fe640 1 --2- 172.21.15.161:0/1461484876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0c00b8df0 0x7ff0c01374d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:16.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0bf7fe640 1 -- 172.21.15.161:0/1461484876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0c00b8530 msgr2=0x7ff0c0145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:16.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0bf7fe640 1 --2- 172.21.15.161:0/1461484876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0c00b8530 0x7ff0c0145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:16.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0bf7fe640 1 -- 172.21.15.161:0/1461484876 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a800b770 con 0x7ff0c0146f10 2024-02-02T11:49:16.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0bf7fe640 1 --2- 172.21.15.161:0/1461484876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0c0146f10 0x7ff0c01e64e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800cea0 tx=0x7ff0b800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:16.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0b77fe640 1 -- 172.21.15.161:0/1461484876 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8003ba0 con 0x7ff0c0146f10 2024-02-02T11:49:16.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0b77fe640 1 -- 172.21.15.161:0/1461484876 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b8003d20 con 0x7ff0c0146f10 2024-02-02T11:49:16.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0c529e640 1 -- 172.21.15.161:0/1461484876 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c01380d0 con 0x7ff0c0146f10 2024-02-02T11:49:16.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0b77fe640 1 -- 172.21.15.161:0/1461484876 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b800d880 con 0x7ff0c0146f10 2024-02-02T11:49:16.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.799+0000 7ff0c529e640 1 -- 172.21.15.161:0/1461484876 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c0146410 con 0x7ff0c0146f10 2024-02-02T11:49:16.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.803+0000 7ff0c529e640 1 -- 172.21.15.161:0/1461484876 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c01e6200 con 0x7ff0c0146f10 2024-02-02T11:49:16.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.803+0000 7ff0b77fe640 1 -- 172.21.15.161:0/1461484876 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff0b800d9e0 con 0x7ff0c0146f10 2024-02-02T11:49:16.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.803+0000 7ff0b77fe640 1 --2- 172.21.15.161:0/1461484876 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff0a0065a60 0x7ff0a0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:16.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.803+0000 7ff0b77fe640 1 -- 172.21.15.161:0/1461484876 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0b8083a00 con 0x7ff0c0146f10 2024-02-02T11:49:16.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.803+0000 7ff0beffd640 1 --2- 172.21.15.161:0/1461484876 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff0a0065a60 0x7ff0a0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:16.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.803+0000 7ff0beffd640 1 --2- 172.21.15.161:0/1461484876 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff0a0065a60 0x7ff0a0067f20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0004e30 tx=0x7ff0b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:16.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.807+0000 7ff0b77fe640 1 -- 172.21.15.161:0/1461484876 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff0c01e6200 con 0x7ff0c0146f10 2024-02-02T11:49:16.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.963+0000 7ff0c529e640 1 -- 172.21.15.161:0/1461484876 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff0c01e6200 con 0x7ff0c0146f10 2024-02-02T11:49:16.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.967+0000 7ff0b77fe640 1 -- 172.21.15.161:0/1461484876 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff0c01e6200 con 0x7ff0c0146f10 2024-02-02T11:49:16.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.971+0000 7ff0c529e640 1 -- 172.21.15.161:0/1461484876 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff0a0065a60 msgr2=0x7ff0a0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:16.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.971+0000 7ff0c529e640 1 --2- 172.21.15.161:0/1461484876 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff0a0065a60 0x7ff0a0067f20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0004e30 tx=0x7ff0b0009040 comp rx=0 tx=0).stop 2024-02-02T11:49:16.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.971+0000 7ff0c529e640 1 -- 172.21.15.161:0/1461484876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0c0146f10 msgr2=0x7ff0c01e64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:16.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.971+0000 7ff0c529e640 1 --2- 172.21.15.161:0/1461484876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0c0146f10 0x7ff0c01e64e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800cea0 tx=0x7ff0b800cf90 comp rx=0 tx=0).stop 2024-02-02T11:49:16.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.971+0000 7ff0c529e640 1 -- 172.21.15.161:0/1461484876 shutdown_connections 2024-02-02T11:49:16.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.971+0000 7ff0c529e640 1 --2- 172.21.15.161:0/1461484876 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff0a0065a60 0x7ff0a0067f20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:16.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.971+0000 7ff0c529e640 1 --2- 172.21.15.161:0/1461484876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0c0146f10 0x7ff0c01e64e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:16.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.971+0000 7ff0c529e640 1 --2- 172.21.15.161:0/1461484876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0c00b8df0 0x7ff0c01374d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:16.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.971+0000 7ff0c529e640 1 --2- 172.21.15.161:0/1461484876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0c00b8530 0x7ff0c0145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:16.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.971+0000 7ff0c529e640 1 -- 172.21.15.161:0/1461484876 >> 172.21.15.161:0/1461484876 conn(0x7ff0c006a120 msgr2=0x7ff0c01505f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:16.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.971+0000 7ff0c529e640 1 -- 172.21.15.161:0/1461484876 shutdown_connections 2024-02-02T11:49:16.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:16.971+0000 7ff0c529e640 1 -- 172.21.15.161:0/1461484876 wait complete. 2024-02-02T11:49:16.990 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-02-02T11:49:16.990 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-02T11:49:17.034 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-02T11:49:17.081 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-02T11:49:17.140 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-02-02T11:49:17.140 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T11:49:17.140 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-02T11:49:17.150 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T11:49:17.150 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-02T11:49:17.204 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T11:49:17.205 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-02T11:49:17.257 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:49:17.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.379+0000 7fbcac024640 1 Processor -- start 2024-02-02T11:49:17.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.383+0000 7fbcac024640 1 -- start start 2024-02-02T11:49:17.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.383+0000 7fbcac024640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbca4071a20 0x7fbca4070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:17.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.383+0000 7fbcac024640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbca4147920 0x7fbca41440d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:17.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.383+0000 7fbcac024640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca40b2c80 con 0x7fbca40708d0 2024-02-02T11:49:17.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.383+0000 7fbcac024640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca406fdb0 con 0x7fbca4071a20 2024-02-02T11:49:17.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.383+0000 7fbcac024640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca4070370 con 0x7fbca4147920 2024-02-02T11:49:17.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.383+0000 7fbca95bf640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbca4071a20 0x7fbca4070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:17.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.383+0000 7fbcaa5c1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbca4147920 0x7fbca41440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:17.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.383+0000 7fbca9dc0640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fbca40708d0 0x7fbca4147210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.161:34746/0 (socket says 172.21.15.161:34746) 2024-02-02T11:49:17.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.383+0000 7fbca9dc0640 1 -- 172.21.15.161:0/3516104216 learned_addr learned my addr 172.21.15.161:0/3516104216 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:17.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.383+0000 7fbcaa5c1640 1 -- 172.21.15.161:0/3516104216 >> v2:172.21.15.162:3300/0 conn(0x7fbca4071a20 msgr2=0x7fbca4070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:17.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.383+0000 7fbcaa5c1640 1 --2- 172.21.15.161:0/3516104216 >> v2:172.21.15.162:3300/0 conn(0x7fbca4071a20 0x7fbca4070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.383+0000 7fbcaa5c1640 1 -- 172.21.15.161:0/3516104216 >> v1:172.21.15.162:6789/0 conn(0x7fbca40708d0 legacy=0x7fbca4147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:17.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.383+0000 7fbcaa5c1640 1 -- 172.21.15.161:0/3516104216 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca40b2ed0 con 0x7fbca4147920 2024-02-02T11:49:17.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.383+0000 7fbca95bf640 1 --2- 172.21.15.161:0/3516104216 >> v2:172.21.15.162:3300/0 conn(0x7fbca4071a20 0x7fbca4070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-02T11:49:17.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcaa5c1640 1 --2- 172.21.15.161:0/3516104216 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbca4147920 0x7fbca41440d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00aea0 tx=0x7fbc9c01da20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f28ff989ca538ad6 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:17.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbca8dbe640 1 -- 172.21.15.161:0/3516104216 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c00a2d0 con 0x7fbca4147920 2024-02-02T11:49:17.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbca8dbe640 1 -- 172.21.15.161:0/3516104216 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c0a6920 con 0x7fbca4147920 2024-02-02T11:49:17.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbca8dbe640 1 -- 172.21.15.161:0/3516104216 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0a6cb0 con 0x7fbca4147920 2024-02-02T11:49:17.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcac024640 1 -- 172.21.15.161:0/3516104216 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbca4147920 msgr2=0x7fbca41440d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:17.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcac024640 1 --2- 172.21.15.161:0/3516104216 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbca4147920 0x7fbca41440d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00aea0 tx=0x7fbc9c01da20 comp rx=0 tx=0).stop 2024-02-02T11:49:17.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcac024640 1 -- 172.21.15.161:0/3516104216 shutdown_connections 2024-02-02T11:49:17.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcac024640 1 --2- 172.21.15.161:0/3516104216 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbca4147920 0x7fbca41440d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcac024640 1 --2- 172.21.15.161:0/3516104216 >> v2:172.21.15.162:3300/0 conn(0x7fbca4071a20 0x7fbca4070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcac024640 1 -- 172.21.15.161:0/3516104216 >> 172.21.15.161:0/3516104216 conn(0x7fbca4069ef0 msgr2=0x7fbca406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:17.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcac024640 1 -- 172.21.15.161:0/3516104216 shutdown_connections 2024-02-02T11:49:17.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcac024640 1 -- 172.21.15.161:0/3516104216 wait complete. 2024-02-02T11:49:17.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcac024640 1 Processor -- start 2024-02-02T11:49:17.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcac024640 1 -- start start 2024-02-02T11:49:17.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcac024640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbca40708d0 0x7fbca41e3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:17.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcac024640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbca4071a20 0x7fbca4136c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:17.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcac024640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbca4147920 0x7fbca40b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:17.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcac024640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca4141630 con 0x7fbca40708d0 2024-02-02T11:49:17.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcac024640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca41410b0 con 0x7fbca4147920 2024-02-02T11:49:17.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcac024640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca41e36c0 con 0x7fbca4071a20 2024-02-02T11:49:17.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbca9dc0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbca40708d0 0x7fbca41e3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:17.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbca9dc0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbca40708d0 0x7fbca41e3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40562/0 (socket says 172.21.15.161:40562) 2024-02-02T11:49:17.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbca9dc0640 1 -- 172.21.15.161:0/2103617901 learned_addr learned my addr 172.21.15.161:0/2103617901 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:17.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbca95bf640 1 --2- 172.21.15.161:0/2103617901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbca4071a20 0x7fbca4136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:17.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcaa5c1640 1 --2- 172.21.15.161:0/2103617901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbca4147920 0x7fbca40b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:17.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbca9dc0640 1 -- 172.21.15.161:0/2103617901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbca4071a20 msgr2=0x7fbca4136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:17.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbca9dc0640 1 --2- 172.21.15.161:0/2103617901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbca4071a20 0x7fbca4136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbca9dc0640 1 -- 172.21.15.161:0/2103617901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbca4147920 msgr2=0x7fbca40b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:17.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbca9dc0640 1 --2- 172.21.15.161:0/2103617901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbca4147920 0x7fbca40b5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbca9dc0640 1 -- 172.21.15.161:0/2103617901 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc94009420 con 0x7fbca40708d0 2024-02-02T11:49:17.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbca9dc0640 1 --2- 172.21.15.161:0/2103617901 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbca40708d0 0x7fbca41e3180 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbca000c420 tx=0x7fbca000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:17.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbc9a7fc640 1 -- 172.21.15.161:0/2103617901 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0005cf0 con 0x7fbca40708d0 2024-02-02T11:49:17.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbc9a7fc640 1 -- 172.21.15.161:0/2103617901 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca0005e50 con 0x7fbca40708d0 2024-02-02T11:49:17.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcac024640 1 -- 172.21.15.161:0/2103617901 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9c00ab80 con 0x7fbca40708d0 2024-02-02T11:49:17.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbc9a7fc640 1 -- 172.21.15.161:0/2103617901 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca00072f0 con 0x7fbca40708d0 2024-02-02T11:49:17.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.387+0000 7fbcac024640 1 -- 172.21.15.161:0/2103617901 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca4140b10 con 0x7fbca40708d0 2024-02-02T11:49:17.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.391+0000 7fbcac024640 1 -- 172.21.15.161:0/2103617901 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca404e000 con 0x7fbca40708d0 2024-02-02T11:49:17.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.391+0000 7fbc9a7fc640 1 -- 172.21.15.161:0/2103617901 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbca0007450 con 0x7fbca40708d0 2024-02-02T11:49:17.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.391+0000 7fbc9a7fc640 1 --2- 172.21.15.161:0/2103617901 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbc88065a60 0x7fbc88067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:17.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.391+0000 7fbc9a7fc640 1 -- 172.21.15.161:0/2103617901 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbca0082770 con 0x7fbca40708d0 2024-02-02T11:49:17.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.391+0000 7fbca95bf640 1 --2- 172.21.15.161:0/2103617901 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbc88065a60 0x7fbc88067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:17.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.391+0000 7fbca95bf640 1 --2- 172.21.15.161:0/2103617901 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbc88065a60 0x7fbc88067f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbca4144e20 tx=0x7fbc94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:17.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.395+0000 7fbc9a7fc640 1 -- 172.21.15.161:0/2103617901 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbca0050130 con 0x7fbca40708d0 2024-02-02T11:49:17.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.543+0000 7fbcac024640 1 -- 172.21.15.161:0/2103617901 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbca40bbc90 con 0x7fbca40708d0 2024-02-02T11:49:17.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.543+0000 7fbc9a7fc640 1 -- 172.21.15.161:0/2103617901 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fbca0017020 con 0x7fbca40708d0 2024-02-02T11:49:17.548 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:17.548 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":20,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:52.816101+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:48:50.155565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-02T11:48:50.795158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:49:17.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.547+0000 7fbcac024640 1 -- 172.21.15.161:0/2103617901 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbc88065a60 msgr2=0x7fbc88067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:17.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.547+0000 7fbcac024640 1 --2- 172.21.15.161:0/2103617901 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbc88065a60 0x7fbc88067f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbca4144e20 tx=0x7fbc94008040 comp rx=0 tx=0).stop 2024-02-02T11:49:17.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.547+0000 7fbcac024640 1 -- 172.21.15.161:0/2103617901 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbca40708d0 msgr2=0x7fbca41e3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:17.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.547+0000 7fbcac024640 1 --2- 172.21.15.161:0/2103617901 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbca40708d0 0x7fbca41e3180 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbca000c420 tx=0x7fbca000c8e0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.547+0000 7fbcac024640 1 -- 172.21.15.161:0/2103617901 shutdown_connections 2024-02-02T11:49:17.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.547+0000 7fbcac024640 1 --2- 172.21.15.161:0/2103617901 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbc88065a60 0x7fbc88067f20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.547+0000 7fbcac024640 1 --2- 172.21.15.161:0/2103617901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbca4147920 0x7fbca40b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.547+0000 7fbcac024640 1 --2- 172.21.15.161:0/2103617901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbca4071a20 0x7fbca4136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.547+0000 7fbcac024640 1 --2- 172.21.15.161:0/2103617901 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbca40708d0 0x7fbca41e3180 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.547+0000 7fbcac024640 1 -- 172.21.15.161:0/2103617901 >> 172.21.15.161:0/2103617901 conn(0x7fbca4069ef0 msgr2=0x7fbca40b6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:17.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.547+0000 7fbcac024640 1 -- 172.21.15.161:0/2103617901 shutdown_connections 2024-02-02T11:49:17.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.547+0000 7fbcac024640 1 -- 172.21.15.161:0/2103617901 wait complete. 2024-02-02T11:49:17.565 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-02T11:48:40.330782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-02T11:48:50.155565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-02T11:48:50.795158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-02T11:49:17.565 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-02T11:49:17.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5aa1dae640 1 Processor -- start 2024-02-02T11:49:17.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5aa1dae640 1 -- start start 2024-02-02T11:49:17.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5aa1dae640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5a9c0b8b40 0x7f5a9c0b8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:17.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5aa1dae640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5a9c144a80 0x7f5a9c14ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:17.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5aa1dae640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9c0b6e80 con 0x7f5a9c144f10 2024-02-02T11:49:17.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5aa1dae640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9c0b7160 con 0x7f5a9c144a80 2024-02-02T11:49:17.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5aa1dae640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9c0bc6c0 con 0x7f5a9c0b8b40 2024-02-02T11:49:17.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5a9affd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5a9c144a80 0x7f5a9c14ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:17.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5a9bfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f5a9c144f10 0x7f5a9c14dfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59042/0 (socket says 172.21.15.161:59042) 2024-02-02T11:49:17.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5a9affd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5a9c144a80 0x7f5a9c14ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40578/0 (socket says 172.21.15.161:40578) 2024-02-02T11:49:17.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5a9bfff640 1 -- 172.21.15.161:0/2212382429 learned_addr learned my addr 172.21.15.161:0/2212382429 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:17.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5a9b7fe640 1 --2- 172.21.15.161:0/2212382429 >> v2:172.21.15.162:3300/0 conn(0x7f5a9c0b8b40 0x7f5a9c0b8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:17.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5a9affd640 1 -- 172.21.15.161:0/2212382429 >> v2:172.21.15.162:3300/0 conn(0x7f5a9c0b8b40 msgr2=0x7f5a9c0b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:17.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5a9affd640 1 --2- 172.21.15.161:0/2212382429 >> v2:172.21.15.162:3300/0 conn(0x7f5a9c0b8b40 0x7f5a9c0b8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5a9affd640 1 -- 172.21.15.161:0/2212382429 >> v1:172.21.15.161:6789/0 conn(0x7f5a9c144f10 legacy=0x7f5a9c14dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:17.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5a9a7fc640 1 -- 172.21.15.161:0/2212382429 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028104011 0 0) 0x7f5a9c0b6e80 con 0x7f5a9c144f10 2024-02-02T11:49:17.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5a9affd640 1 -- 172.21.15.161:0/2212382429 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c0bc9a0 con 0x7f5a9c144a80 2024-02-02T11:49:17.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5a9b7fe640 1 --2- 172.21.15.161:0/2212382429 >> v2:172.21.15.162:3300/0 conn(0x7f5a9c0b8b40 0x7f5a9c0b8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:17.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5a9affd640 1 --2- 172.21.15.161:0/2212382429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a9c144a80 0x7f5a9c14ac60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0ba8f0 tx=0x7f5a9001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6652a1b1dca4504 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:17.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5a9a7fc640 1 -- 172.21.15.161:0/2212382429 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a900a8950 con 0x7f5a9c144a80 2024-02-02T11:49:17.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5a9a7fc640 1 -- 172.21.15.161:0/2212382429 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a900a8ab0 con 0x7f5a9c144a80 2024-02-02T11:49:17.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.687+0000 7f5a9a7fc640 1 -- 172.21.15.161:0/2212382429 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a900a8e40 con 0x7f5a9c144a80 2024-02-02T11:49:17.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5aa1dae640 1 -- 172.21.15.161:0/2212382429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a9c144a80 msgr2=0x7f5a9c14ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:17.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5aa1dae640 1 --2- 172.21.15.161:0/2212382429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a9c144a80 0x7f5a9c14ac60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0ba8f0 tx=0x7f5a9001ec50 comp rx=0 tx=0).stop 2024-02-02T11:49:17.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5aa1dae640 1 -- 172.21.15.161:0/2212382429 shutdown_connections 2024-02-02T11:49:17.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5aa1dae640 1 --2- 172.21.15.161:0/2212382429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a9c144a80 0x7f5a9c14ac60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5aa1dae640 1 --2- 172.21.15.161:0/2212382429 >> v2:172.21.15.162:3300/0 conn(0x7f5a9c0b8b40 0x7f5a9c0b8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5aa1dae640 1 -- 172.21.15.161:0/2212382429 >> 172.21.15.161:0/2212382429 conn(0x7f5a9c0c02f0 msgr2=0x7f5a9c0c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:17.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5aa1dae640 1 -- 172.21.15.161:0/2212382429 shutdown_connections 2024-02-02T11:49:17.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5aa1dae640 1 -- 172.21.15.161:0/2212382429 wait complete. 2024-02-02T11:49:17.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5aa1dae640 1 Processor -- start 2024-02-02T11:49:17.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5aa1dae640 1 -- start start 2024-02-02T11:49:17.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5aa1dae640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a9c0b8b40 0x7f5a9c1e3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:17.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5aa1dae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a9c144a80 0x7f5a9c0a77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:17.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5aa1dae640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a9c144f10 0x7f5a9c1e0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:17.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5aa1dae640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c1e3650 con 0x7f5a9c144f10 2024-02-02T11:49:17.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5aa1dae640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c0a7d00 con 0x7f5a9c144a80 2024-02-02T11:49:17.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5aa1dae640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c1e3e00 con 0x7f5a9c0b8b40 2024-02-02T11:49:17.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5a9bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a9c144f10 0x7f5a9c1e0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:17.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5a9bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a9c144f10 0x7f5a9c1e0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40594/0 (socket says 172.21.15.161:40594) 2024-02-02T11:49:17.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5a9bfff640 1 -- 172.21.15.161:0/3231320188 learned_addr learned my addr 172.21.15.161:0/3231320188 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:17.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5a9b7fe640 1 --2- 172.21.15.161:0/3231320188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a9c0b8b40 0x7f5a9c1e3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:17.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5a9affd640 1 --2- 172.21.15.161:0/3231320188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a9c144a80 0x7f5a9c0a77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:17.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5a9bfff640 1 -- 172.21.15.161:0/3231320188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a9c0b8b40 msgr2=0x7f5a9c1e3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5a9bfff640 1 --2- 172.21.15.161:0/3231320188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a9c0b8b40 0x7f5a9c1e3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5a9bfff640 1 -- 172.21.15.161:0/3231320188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a9c144a80 msgr2=0x7f5a9c0a77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5a9bfff640 1 --2- 172.21.15.161:0/3231320188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a9c144a80 0x7f5a9c0a77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5a9bfff640 1 -- 172.21.15.161:0/3231320188 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a90009420 con 0x7f5a9c144f10 2024-02-02T11:49:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5a9bfff640 1 --2- 172.21.15.161:0/3231320188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a9c144f10 0x7f5a9c1e0db0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400c7b0 tx=0x7f5a9400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5a83fff640 1 -- 172.21.15.161:0/3231320188 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a94004d70 con 0x7f5a9c144f10 2024-02-02T11:49:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5a83fff640 1 -- 172.21.15.161:0/3231320188 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9400a5e0 con 0x7f5a9c144f10 2024-02-02T11:49:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5a83fff640 1 -- 172.21.15.161:0/3231320188 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9400a990 con 0x7f5a9c144f10 2024-02-02T11:49:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5aa1dae640 1 -- 172.21.15.161:0/3231320188 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9c149eb0 con 0x7f5a9c144f10 2024-02-02T11:49:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.691+0000 7f5aa1dae640 1 -- 172.21.15.161:0/3231320188 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9c1e3b20 con 0x7f5a9c144f10 2024-02-02T11:49:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.695+0000 7f5aa1dae640 1 -- 172.21.15.161:0/3231320188 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9c0a6a10 con 0x7f5a9c144f10 2024-02-02T11:49:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.695+0000 7f5a83fff640 1 -- 172.21.15.161:0/3231320188 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5a9400aaf0 con 0x7f5a9c144f10 2024-02-02T11:49:17.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.695+0000 7f5a83fff640 1 --2- 172.21.15.161:0/3231320188 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f5a88065a60 0x7f5a88067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:17.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.695+0000 7f5a9b7fe640 1 --2- 172.21.15.161:0/3231320188 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f5a88065a60 0x7f5a88067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:17.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.695+0000 7f5a83fff640 1 -- 172.21.15.161:0/3231320188 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a940826a0 con 0x7f5a9c144f10 2024-02-02T11:49:17.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.695+0000 7f5a9b7fe640 1 --2- 172.21.15.161:0/3231320188 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f5a88065a60 0x7f5a88067f20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c006fd0 tx=0x7f5a8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:17.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.699+0000 7f5a83fff640 1 -- 172.21.15.161:0/3231320188 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5a94050050 con 0x7f5a9c144f10 2024-02-02T11:49:17.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.851+0000 7f5aa1dae640 1 -- 172.21.15.161:0/3231320188 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a9c04e000 con 0x7f5a9c144f10 2024-02-02T11:49:17.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.851+0000 7f5a83fff640 1 -- 172.21.15.161:0/3231320188 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a940180a0 con 0x7f5a9c144f10 2024-02-02T11:49:17.856 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-02-02T11:49:17.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.855+0000 7f5aa1dae640 1 -- 172.21.15.161:0/3231320188 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f5a88065a60 msgr2=0x7f5a88067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:17.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.855+0000 7f5aa1dae640 1 --2- 172.21.15.161:0/3231320188 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f5a88065a60 0x7f5a88067f20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c006fd0 tx=0x7f5a8c008040 comp rx=0 tx=0).stop 2024-02-02T11:49:17.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.855+0000 7f5aa1dae640 1 -- 172.21.15.161:0/3231320188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a9c144f10 msgr2=0x7f5a9c1e0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:17.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.855+0000 7f5aa1dae640 1 --2- 172.21.15.161:0/3231320188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a9c144f10 0x7f5a9c1e0db0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400c7b0 tx=0x7f5a9400cc70 comp rx=0 tx=0).stop 2024-02-02T11:49:17.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.855+0000 7f5aa1dae640 1 -- 172.21.15.161:0/3231320188 shutdown_connections 2024-02-02T11:49:17.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.855+0000 7f5aa1dae640 1 --2- 172.21.15.161:0/3231320188 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f5a88065a60 0x7f5a88067f20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.855+0000 7f5aa1dae640 1 --2- 172.21.15.161:0/3231320188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a9c144f10 0x7f5a9c1e0db0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.855+0000 7f5aa1dae640 1 --2- 172.21.15.161:0/3231320188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a9c144a80 0x7f5a9c0a77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.855+0000 7f5aa1dae640 1 --2- 172.21.15.161:0/3231320188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a9c0b8b40 0x7f5a9c1e3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.855+0000 7f5aa1dae640 1 -- 172.21.15.161:0/3231320188 >> 172.21.15.161:0/3231320188 conn(0x7f5a9c0c02f0 msgr2=0x7f5a9c0bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:17.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.855+0000 7f5aa1dae640 1 -- 172.21.15.161:0/3231320188 shutdown_connections 2024-02-02T11:49:17.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.855+0000 7f5aa1dae640 1 -- 172.21.15.161:0/3231320188 wait complete. 2024-02-02T11:49:17.876 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-02T11:49:17.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.991+0000 7f209dbc3640 1 Processor -- start 2024-02-02T11:49:17.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.991+0000 7f209dbc3640 1 -- start start 2024-02-02T11:49:17.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.991+0000 7f209dbc3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20980b8df0 0x7f2098142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:17.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.991+0000 7f209dbc3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f20980b8540 0x7f2098148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:17.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.991+0000 7f209dbc3640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2098148a80 con 0x7f2098142d80 2024-02-02T11:49:17.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.991+0000 7f209dbc3640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20980b3890 con 0x7f20980b8540 2024-02-02T11:49:17.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.991+0000 7f209dbc3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20980b3b70 con 0x7f20980b8df0 2024-02-02T11:49:17.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.991+0000 7f2096ffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f20980b8540 0x7f2098148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:17.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.991+0000 7f2096ffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f20980b8540 0x7f2098148f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40598/0 (socket says 172.21.15.161:40598) 2024-02-02T11:49:17.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.991+0000 7f2096ffd640 1 -- 172.21.15.161:0/2576083233 learned_addr learned my addr 172.21.15.161:0/2576083233 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:17.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.991+0000 7f20977fe640 1 --2- 172.21.15.161:0/2576083233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20980b8df0 0x7f2098142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:17.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.991+0000 7f2096ffd640 1 -- 172.21.15.161:0/2576083233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20980b8df0 msgr2=0x7f2098142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:17.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.991+0000 7f2096ffd640 1 --2- 172.21.15.161:0/2576083233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20980b8df0 0x7f2098142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:17.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.991+0000 7f2096ffd640 1 -- 172.21.15.161:0/2576083233 >> v1:172.21.15.162:6789/0 conn(0x7f2098142d80 legacy=0x7f20980b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:17.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.991+0000 7f2096ffd640 1 -- 172.21.15.161:0/2576083233 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20980b3e50 con 0x7f20980b8540 2024-02-02T11:49:17.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.995+0000 7f2096ffd640 1 --2- 172.21.15.161:0/2576083233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20980b8540 0x7f2098148f10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2080009870 tx=0x7f208001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59074de9f8fca58f server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:17.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.995+0000 7f20967fc640 1 -- 172.21.15.161:0/2576083233 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098071930 con 0x7f20980b8540 2024-02-02T11:49:17.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.995+0000 7f20967fc640 1 -- 172.21.15.161:0/2576083233 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20800a9620 con 0x7f20980b8540 2024-02-02T11:49:17.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.995+0000 7f20967fc640 1 -- 172.21.15.161:0/2576083233 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20800a99b0 con 0x7f20980b8540 2024-02-02T11:49:17.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.995+0000 7f209dbc3640 1 -- 172.21.15.161:0/2576083233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20980b8540 msgr2=0x7f2098148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:17.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.995+0000 7f209dbc3640 1 --2- 172.21.15.161:0/2576083233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20980b8540 0x7f2098148f10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2080009870 tx=0x7f208001c540 comp rx=0 tx=0).stop 2024-02-02T11:49:18.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.995+0000 7f209dbc3640 1 -- 172.21.15.161:0/2576083233 shutdown_connections 2024-02-02T11:49:18.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.995+0000 7f209dbc3640 1 --2- 172.21.15.161:0/2576083233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20980b8540 0x7f2098148f10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.995+0000 7f209dbc3640 1 --2- 172.21.15.161:0/2576083233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20980b8df0 0x7f2098142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.995+0000 7f209dbc3640 1 -- 172.21.15.161:0/2576083233 >> 172.21.15.161:0/2576083233 conn(0x7f209806a120 msgr2=0x7f209806a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:18.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.995+0000 7f209dbc3640 1 -- 172.21.15.161:0/2576083233 shutdown_connections 2024-02-02T11:49:18.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.995+0000 7f209dbc3640 1 -- 172.21.15.161:0/2576083233 wait complete. 2024-02-02T11:49:18.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.995+0000 7f209dbc3640 1 Processor -- start 2024-02-02T11:49:18.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.995+0000 7f209dbc3640 1 -- start start 2024-02-02T11:49:18.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f209dbc3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20980b8540 0x7f2098145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f209dbc3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20980b8df0 0x7f209814b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f209dbc3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2098142d80 0x7f20981e1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f209dbc3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209814b7a0 con 0x7f20980b8540 2024-02-02T11:49:18.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f209dbc3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20981e14c0 con 0x7f20980b8df0 2024-02-02T11:49:18.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f209dbc3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2098139430 con 0x7f2098142d80 2024-02-02T11:49:18.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f20977fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20980b8540 0x7f2098145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f20977fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20980b8540 0x7f2098145090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40604/0 (socket says 172.21.15.161:40604) 2024-02-02T11:49:18.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f20977fe640 1 -- 172.21.15.161:0/440070919 learned_addr learned my addr 172.21.15.161:0/440070919 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:18.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f2096ffd640 1 --2- 172.21.15.161:0/440070919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20980b8df0 0x7f209814b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f2097fff640 1 --2- 172.21.15.161:0/440070919 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2098142d80 0x7f20981e1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f20977fe640 1 -- 172.21.15.161:0/440070919 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2098142d80 msgr2=0x7f20981e1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:18.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f20977fe640 1 --2- 172.21.15.161:0/440070919 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2098142d80 0x7f20981e1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f20977fe640 1 -- 172.21.15.161:0/440070919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20980b8df0 msgr2=0x7f209814b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:18.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f20977fe640 1 --2- 172.21.15.161:0/440070919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20980b8df0 0x7f209814b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f20977fe640 1 -- 172.21.15.161:0/440070919 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20800094d0 con 0x7f20980b8540 2024-02-02T11:49:18.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f2096ffd640 1 --2- 172.21.15.161:0/440070919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20980b8df0 0x7f209814b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:18.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f2097fff640 1 --2- 172.21.15.161:0/440070919 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2098142d80 0x7f20981e1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:18.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f20977fe640 1 --2- 172.21.15.161:0/440070919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20980b8540 0x7f2098145090 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2090007ec0 tx=0x7f209000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:18.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f208ffff640 1 -- 172.21.15.161:0/440070919 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2090014620 con 0x7f20980b8540 2024-02-02T11:49:18.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f208ffff640 1 -- 172.21.15.161:0/440070919 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20900147a0 con 0x7f20980b8540 2024-02-02T11:49:18.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f209dbc3640 1 -- 172.21.15.161:0/440070919 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2098139710 con 0x7f20980b8540 2024-02-02T11:49:18.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f208ffff640 1 -- 172.21.15.161:0/440070919 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2090014b50 con 0x7f20980b8540 2024-02-02T11:49:18.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f209dbc3640 1 -- 172.21.15.161:0/440070919 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2098139cd0 con 0x7f20980b8540 2024-02-02T11:49:18.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f209dbc3640 1 -- 172.21.15.161:0/440070919 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2098144dd0 con 0x7f20980b8540 2024-02-02T11:49:18.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f208ffff640 1 -- 172.21.15.161:0/440070919 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2090014cb0 con 0x7f20980b8540 2024-02-02T11:49:18.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f208ffff640 1 --2- 172.21.15.161:0/440070919 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2078065a60 0x7f2078067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f208ffff640 1 -- 172.21.15.161:0/440070919 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2090083b60 con 0x7f20980b8540 2024-02-02T11:49:18.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f2096ffd640 1 --2- 172.21.15.161:0/440070919 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2078065a60 0x7f2078067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:17.999+0000 7f2096ffd640 1 --2- 172.21.15.161:0/440070919 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2078065a60 0x7f2078067f20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f20800ae000 tx=0x7f20800b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:18.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.003+0000 7f208ffff640 1 -- 172.21.15.161:0/440070919 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2098144dd0 con 0x7f20980b8540 2024-02-02T11:49:18.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.147+0000 7f209dbc3640 1 -- 172.21.15.161:0/440070919 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2098144dd0 con 0x7f20980b8540 2024-02-02T11:49:18.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.147+0000 7f208ffff640 1 -- 172.21.15.161:0/440070919 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2098144dd0 con 0x7f20980b8540 2024-02-02T11:49:18.152 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-02-02T11:49:18.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.151+0000 7f209dbc3640 1 -- 172.21.15.161:0/440070919 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2078065a60 msgr2=0x7f2078067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:18.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.151+0000 7f209dbc3640 1 --2- 172.21.15.161:0/440070919 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2078065a60 0x7f2078067f20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f20800ae000 tx=0x7f20800b3040 comp rx=0 tx=0).stop 2024-02-02T11:49:18.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.151+0000 7f209dbc3640 1 -- 172.21.15.161:0/440070919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20980b8540 msgr2=0x7f2098145090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:18.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.151+0000 7f209dbc3640 1 --2- 172.21.15.161:0/440070919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20980b8540 0x7f2098145090 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2090007ec0 tx=0x7f209000e4b0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.151+0000 7f209dbc3640 1 -- 172.21.15.161:0/440070919 shutdown_connections 2024-02-02T11:49:18.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.151+0000 7f209dbc3640 1 --2- 172.21.15.161:0/440070919 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2078065a60 0x7f2078067f20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.151+0000 7f209dbc3640 1 --2- 172.21.15.161:0/440070919 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2098142d80 0x7f20981e1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.151+0000 7f209dbc3640 1 --2- 172.21.15.161:0/440070919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20980b8df0 0x7f209814b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.151+0000 7f209dbc3640 1 --2- 172.21.15.161:0/440070919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20980b8540 0x7f2098145090 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.151+0000 7f209dbc3640 1 -- 172.21.15.161:0/440070919 >> 172.21.15.161:0/440070919 conn(0x7f209806a120 msgr2=0x7f20980b6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:18.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.151+0000 7f209dbc3640 1 -- 172.21.15.161:0/440070919 shutdown_connections 2024-02-02T11:49:18.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.151+0000 7f209dbc3640 1 -- 172.21.15.161:0/440070919 wait complete. 2024-02-02T11:49:18.170 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-02T11:49:18.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.279+0000 7f9c919e1640 1 Processor -- start 2024-02-02T11:49:18.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.279+0000 7f9c919e1640 1 -- start start 2024-02-02T11:49:18.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.279+0000 7f9c919e1640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9c8c0b8df0 0x7f9c8c147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.279+0000 7f9c919e1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c8c070e40 0x7f9c8c141620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.279+0000 7f9c919e1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8c06ec30 con 0x7f9c8c0b8530 2024-02-02T11:49:18.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.279+0000 7f9c919e1640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8c0b30e0 con 0x7f9c8c0b8df0 2024-02-02T11:49:18.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.279+0000 7f9c919e1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0b3770 con 0x7f9c8c070e40 2024-02-02T11:49:18.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.279+0000 7f9c8affd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9c8c0b8df0 0x7f9c8c147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.279+0000 7f9c8affd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9c8c0b8df0 0x7f9c8c147eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40608/0 (socket says 172.21.15.161:40608) 2024-02-02T11:49:18.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.279+0000 7f9c8affd640 1 -- 172.21.15.161:0/29510533 learned_addr learned my addr 172.21.15.161:0/29510533 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:18.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.279+0000 7f9c827fc640 1 --2- 172.21.15.161:0/29510533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c8c070e40 0x7f9c8c141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.279+0000 7f9c8affd640 1 -- 172.21.15.161:0/29510533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c8c070e40 msgr2=0x7f9c8c141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:18.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.279+0000 7f9c8affd640 1 --2- 172.21.15.161:0/29510533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c8c070e40 0x7f9c8c141620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.279+0000 7f9c8affd640 1 -- 172.21.15.161:0/29510533 >> v1:172.21.15.162:6789/0 conn(0x7f9c8c0b8530 legacy=0x7f9c8c14acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:18.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.279+0000 7f9c8affd640 1 -- 172.21.15.161:0/29510533 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c071890 con 0x7f9c8c0b8df0 2024-02-02T11:49:18.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.279+0000 7f9c8affd640 1 --2- 172.21.15.161:0/29510533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8c0b8df0 0x7f9c8c147eb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009870 tx=0x7f9c7401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10be268c24b11b4b server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:18.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.279+0000 7f9c8a7fc640 1 -- 172.21.15.161:0/29510533 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c740ac410 con 0x7f9c8c0b8df0 2024-02-02T11:49:18.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.279+0000 7f9c8a7fc640 1 -- 172.21.15.161:0/29510533 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c740ac570 con 0x7f9c8c0b8df0 2024-02-02T11:49:18.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.279+0000 7f9c8a7fc640 1 -- 172.21.15.161:0/29510533 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c740ac900 con 0x7f9c8c0b8df0 2024-02-02T11:49:18.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c919e1640 1 -- 172.21.15.161:0/29510533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8c0b8df0 msgr2=0x7f9c8c147eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:18.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c919e1640 1 --2- 172.21.15.161:0/29510533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8c0b8df0 0x7f9c8c147eb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009870 tx=0x7f9c7401c500 comp rx=0 tx=0).stop 2024-02-02T11:49:18.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c919e1640 1 -- 172.21.15.161:0/29510533 shutdown_connections 2024-02-02T11:49:18.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c919e1640 1 --2- 172.21.15.161:0/29510533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c8c070e40 0x7f9c8c141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c919e1640 1 --2- 172.21.15.161:0/29510533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8c0b8df0 0x7f9c8c147eb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c919e1640 1 -- 172.21.15.161:0/29510533 >> 172.21.15.161:0/29510533 conn(0x7f9c8c06a120 msgr2=0x7f9c8c06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:18.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c919e1640 1 -- 172.21.15.161:0/29510533 shutdown_connections 2024-02-02T11:49:18.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c919e1640 1 -- 172.21.15.161:0/29510533 wait complete. 2024-02-02T11:49:18.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c919e1640 1 Processor -- start 2024-02-02T11:49:18.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c919e1640 1 -- start start 2024-02-02T11:49:18.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c919e1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8c0b8530 0x7f9c8c145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c919e1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c8c0b8df0 0x7f9c8c138590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c919e1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c8c139840 0x7f9c8c0b6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c919e1640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c13d530 con 0x7f9c8c0b8530 2024-02-02T11:49:18.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c919e1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c147400 con 0x7f9c8c0b8df0 2024-02-02T11:49:18.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c919e1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c139cf0 con 0x7f9c8c139840 2024-02-02T11:49:18.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c8affd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8c0b8530 0x7f9c8c145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c8affd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8c0b8530 0x7f9c8c145b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40610/0 (socket says 172.21.15.161:40610) 2024-02-02T11:49:18.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c8affd640 1 -- 172.21.15.161:0/2638878957 learned_addr learned my addr 172.21.15.161:0/2638878957 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:18.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c827fc640 1 --2- 172.21.15.161:0/2638878957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c8c0b8df0 0x7f9c8c138590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c8b7fe640 1 --2- 172.21.15.161:0/2638878957 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c8c139840 0x7f9c8c0b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c8affd640 1 -- 172.21.15.161:0/2638878957 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c8c139840 msgr2=0x7f9c8c0b6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:18.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c8affd640 1 --2- 172.21.15.161:0/2638878957 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c8c139840 0x7f9c8c0b6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c8affd640 1 -- 172.21.15.161:0/2638878957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c8c0b8df0 msgr2=0x7f9c8c138590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:18.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c8affd640 1 --2- 172.21.15.161:0/2638878957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c8c0b8df0 0x7f9c8c138590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c8affd640 1 -- 172.21.15.161:0/2638878957 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c740094d0 con 0x7f9c8c0b8530 2024-02-02T11:49:18.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c8affd640 1 --2- 172.21.15.161:0/2638878957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8c0b8530 0x7f9c8c145b10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9c7401abb0 tx=0x7f9c740192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:18.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c88ff9640 1 -- 172.21.15.161:0/2638878957 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c740ac410 con 0x7f9c8c0b8530 2024-02-02T11:49:18.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c88ff9640 1 -- 172.21.15.161:0/2638878957 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c740b5650 con 0x7f9c8c0b8530 2024-02-02T11:49:18.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c919e1640 1 -- 172.21.15.161:0/2638878957 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8c13d270 con 0x7f9c8c0b8530 2024-02-02T11:49:18.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c88ff9640 1 -- 172.21.15.161:0/2638878957 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c740b5a00 con 0x7f9c8c0b8530 2024-02-02T11:49:18.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c919e1640 1 -- 172.21.15.161:0/2638878957 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8c152b80 con 0x7f9c8c0b8530 2024-02-02T11:49:18.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.283+0000 7f9c919e1640 1 -- 172.21.15.161:0/2638878957 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8c1529e0 con 0x7f9c8c0b8530 2024-02-02T11:49:18.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.287+0000 7f9c88ff9640 1 -- 172.21.15.161:0/2638878957 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9c740b3070 con 0x7f9c8c0b8530 2024-02-02T11:49:18.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.287+0000 7f9c88ff9640 1 --2- 172.21.15.161:0/2638878957 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9c6c065a90 0x7f9c6c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.287+0000 7f9c88ff9640 1 -- 172.21.15.161:0/2638878957 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c7411d0a0 con 0x7f9c8c0b8530 2024-02-02T11:49:18.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.287+0000 7f9c827fc640 1 --2- 172.21.15.161:0/2638878957 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9c6c065a90 0x7f9c6c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.287+0000 7f9c827fc640 1 --2- 172.21.15.161:0/2638878957 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9c6c065a90 0x7f9c6c067f50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c06a970 tx=0x7f9c7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:18.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.291+0000 7f9c88ff9640 1 -- 172.21.15.161:0/2638878957 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9c8c1529e0 con 0x7f9c8c0b8530 2024-02-02T11:49:18.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.431+0000 7f9c919e1640 1 -- 172.21.15.161:0/2638878957 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c8c1529e0 con 0x7f9c8c0b8530 2024-02-02T11:49:18.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.431+0000 7f9c88ff9640 1 -- 172.21.15.161:0/2638878957 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c8c1529e0 con 0x7f9c8c0b8530 2024-02-02T11:49:18.436 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2024-02-02T11:49:18.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.435+0000 7f9c919e1640 1 -- 172.21.15.161:0/2638878957 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9c6c065a90 msgr2=0x7f9c6c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:18.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.435+0000 7f9c919e1640 1 --2- 172.21.15.161:0/2638878957 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9c6c065a90 0x7f9c6c067f50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c06a970 tx=0x7f9c7c008040 comp rx=0 tx=0).stop 2024-02-02T11:49:18.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.435+0000 7f9c919e1640 1 -- 172.21.15.161:0/2638878957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8c0b8530 msgr2=0x7f9c8c145b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:18.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.435+0000 7f9c919e1640 1 --2- 172.21.15.161:0/2638878957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8c0b8530 0x7f9c8c145b10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9c7401abb0 tx=0x7f9c740192a0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.435+0000 7f9c919e1640 1 -- 172.21.15.161:0/2638878957 shutdown_connections 2024-02-02T11:49:18.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.435+0000 7f9c919e1640 1 --2- 172.21.15.161:0/2638878957 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9c6c065a90 0x7f9c6c067f50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.435+0000 7f9c919e1640 1 --2- 172.21.15.161:0/2638878957 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c8c139840 0x7f9c8c0b6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.435+0000 7f9c919e1640 1 --2- 172.21.15.161:0/2638878957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c8c0b8df0 0x7f9c8c138590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.435+0000 7f9c919e1640 1 --2- 172.21.15.161:0/2638878957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8c0b8530 0x7f9c8c145b10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.435+0000 7f9c919e1640 1 -- 172.21.15.161:0/2638878957 >> 172.21.15.161:0/2638878957 conn(0x7f9c8c06a120 msgr2=0x7f9c8c06edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:18.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.435+0000 7f9c919e1640 1 -- 172.21.15.161:0/2638878957 shutdown_connections 2024-02-02T11:49:18.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.435+0000 7f9c919e1640 1 -- 172.21.15.161:0/2638878957 wait complete. 2024-02-02T11:49:18.454 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-02T11:49:18.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1cf06640 1 Processor -- start 2024-02-02T11:49:18.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1cf06640 1 -- start start 2024-02-02T11:49:18.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1cf06640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3b180bc340 0x7f3b18142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1cf06640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b18142d50 0x7f3b18148d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1cf06640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b18071770 con 0x7f3b181492a0 2024-02-02T11:49:18.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1cf06640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b181496d0 con 0x7f3b180bc340 2024-02-02T11:49:18.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1cf06640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b180b37e0 con 0x7f3b18142d50 2024-02-02T11:49:18.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b16d9d640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f3b181492a0 0x7f3b180b53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59052/0 (socket says 172.21.15.161:59052) 2024-02-02T11:49:18.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b16d9d640 1 -- 172.21.15.161:0/422152730 learned_addr learned my addr 172.21.15.161:0/422152730 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:18.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b15d9b640 1 --2- 172.21.15.161:0/422152730 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b18142d50 0x7f3b18148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1559a640 1 -- 172.21.15.161:0/422152730 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143366241 0 0) 0x7f3b18071770 con 0x7f3b181492a0 2024-02-02T11:49:18.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1659c640 1 --2- 172.21.15.161:0/422152730 >> v2:172.21.15.162:3300/0 conn(0x7f3b180bc340 0x7f3b18142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1559a640 1 -- 172.21.15.161:0/422152730 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b00003530 con 0x7f3b181492a0 2024-02-02T11:49:18.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1559a640 1 -- 172.21.15.161:0/422152730 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2208510218 0 0) 0x7f3b00003530 con 0x7f3b181492a0 2024-02-02T11:49:18.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1559a640 1 -- 172.21.15.161:0/422152730 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b18142d50 msgr2=0x7f3b18148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:18.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1559a640 1 --2- 172.21.15.161:0/422152730 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b18142d50 0x7f3b18148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1559a640 1 -- 172.21.15.161:0/422152730 >> v2:172.21.15.162:3300/0 conn(0x7f3b180bc340 msgr2=0x7f3b18142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:18.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1559a640 1 --2- 172.21.15.161:0/422152730 >> v2:172.21.15.162:3300/0 conn(0x7f3b180bc340 0x7f3b18142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1559a640 1 -- 172.21.15.161:0/422152730 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b180b3ac0 con 0x7f3b181492a0 2024-02-02T11:49:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1559a640 1 -- 172.21.15.161:0/422152730 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f3b10001a00 con 0x7f3b181492a0 2024-02-02T11:49:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1559a640 1 -- 172.21.15.161:0/422152730 >> v1:172.21.15.161:6789/0 conn(0x7f3b181492a0 legacy=0x7f3b180b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1559a640 1 --2- 172.21.15.161:0/422152730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b00003980 0x7f3b00003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1559a640 1 --2- 172.21.15.161:0/422152730 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b000047d0 0x7f3b00004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1559a640 1 --2- 172.21.15.161:0/422152730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b00005150 0x7f3b0000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1559a640 1 -- 172.21.15.161:0/422152730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b181496d0 con 0x7f3b00005150 2024-02-02T11:49:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1559a640 1 -- 172.21.15.161:0/422152730 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b180b37e0 con 0x7f3b00003980 2024-02-02T11:49:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1559a640 1 -- 172.21.15.161:0/422152730 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0000bed0 con 0x7f3b000047d0 2024-02-02T11:49:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b16d9d640 1 --2- 172.21.15.161:0/422152730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b00005150 0x7f3b0000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b1659c640 1 --2- 172.21.15.161:0/422152730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b00003980 0x7f3b00003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b15d9b640 1 --2- 172.21.15.161:0/422152730 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b000047d0 0x7f3b00004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b16d9d640 1 -- 172.21.15.161:0/422152730 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b000047d0 msgr2=0x7f3b00004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b16d9d640 1 --2- 172.21.15.161:0/422152730 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b000047d0 0x7f3b00004c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b16d9d640 1 -- 172.21.15.161:0/422152730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b00003980 msgr2=0x7f3b00003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b16d9d640 1 --2- 172.21.15.161:0/422152730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b00003980 0x7f3b00003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.559+0000 7f3b16d9d640 1 -- 172.21.15.161:0/422152730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b00003530 con 0x7f3b00005150 2024-02-02T11:49:18.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b16d9d640 1 --2- 172.21.15.161:0/422152730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b00005150 0x7f3b0000b990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000a830 tx=0x7f3b1001d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad4a4c031c89beb server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:18.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b1559a640 1 -- 172.21.15.161:0/422152730 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b100ad630 con 0x7f3b00005150 2024-02-02T11:49:18.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b1559a640 1 -- 172.21.15.161:0/422152730 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b100a8070 con 0x7f3b00005150 2024-02-02T11:49:18.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b1559a640 1 -- 172.21.15.161:0/422152730 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b100ad9d0 con 0x7f3b00005150 2024-02-02T11:49:18.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b1cf06640 1 -- 172.21.15.161:0/422152730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b00005150 msgr2=0x7f3b0000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:18.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b1cf06640 1 --2- 172.21.15.161:0/422152730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b00005150 0x7f3b0000b990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000a830 tx=0x7f3b1001d340 comp rx=0 tx=0).stop 2024-02-02T11:49:18.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b16d9d640 1 -- 172.21.15.161:0/422152730 reap_dead start 2024-02-02T11:49:18.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b1cf06640 1 -- 172.21.15.161:0/422152730 shutdown_connections 2024-02-02T11:49:18.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b1cf06640 1 -- 172.21.15.161:0/422152730 >> 172.21.15.161:0/422152730 conn(0x7f3b18069ef0 msgr2=0x7f3b1806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:18.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b1cf06640 1 -- 172.21.15.161:0/422152730 shutdown_connections 2024-02-02T11:49:18.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b1cf06640 1 -- 172.21.15.161:0/422152730 wait complete. 2024-02-02T11:49:18.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b1cf06640 1 Processor -- start 2024-02-02T11:49:18.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b1cf06640 1 -- start start 2024-02-02T11:49:18.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b1cf06640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b00005150 0x7f3b181e2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b1cf06640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b181467f0 0x7f3b18148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b1cf06640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b181d4b90 0x7f3b1813e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b1cf06640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b181d3590 con 0x7f3b181d4b90 2024-02-02T11:49:18.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b1cf06640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b181e33d0 con 0x7f3b00005150 2024-02-02T11:49:18.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b1cf06640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b181d3280 con 0x7f3b181467f0 2024-02-02T11:49:18.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b16d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b181d4b90 0x7f3b1813e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b16d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b181d4b90 0x7f3b1813e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40628/0 (socket says 172.21.15.161:40628) 2024-02-02T11:49:18.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b16d9d640 1 -- 172.21.15.161:0/1422860168 learned_addr learned my addr 172.21.15.161:0/1422860168 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:18.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b1659c640 1 --2- 172.21.15.161:0/1422860168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b00005150 0x7f3b181e2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b15d9b640 1 --2- 172.21.15.161:0/1422860168 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b181467f0 0x7f3b18148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b16d9d640 1 -- 172.21.15.161:0/1422860168 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b181467f0 msgr2=0x7f3b18148010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:18.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b16d9d640 1 --2- 172.21.15.161:0/1422860168 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b181467f0 0x7f3b18148010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b16d9d640 1 -- 172.21.15.161:0/1422860168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b00005150 msgr2=0x7f3b181e2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:18.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b16d9d640 1 --2- 172.21.15.161:0/1422860168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b00005150 0x7f3b181e2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b16d9d640 1 -- 172.21.15.161:0/1422860168 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b181d4940 con 0x7f3b181d4b90 2024-02-02T11:49:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.563+0000 7f3b15d9b640 1 --2- 172.21.15.161:0/1422860168 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b181467f0 0x7f3b18148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.567+0000 7f3b16d9d640 1 --2- 172.21.15.161:0/1422860168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b181d4b90 0x7f3b1813e0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3b1001d170 tx=0x7f3b00005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.567+0000 7f3b06ffd640 1 -- 172.21.15.161:0/1422860168 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b100019c0 con 0x7f3b181d4b90 2024-02-02T11:49:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.567+0000 7f3b06ffd640 1 -- 172.21.15.161:0/1422860168 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b100ad430 con 0x7f3b181d4b90 2024-02-02T11:49:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.567+0000 7f3b1cf06640 1 -- 172.21.15.161:0/1422860168 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b181d39b0 con 0x7f3b181d4b90 2024-02-02T11:49:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.567+0000 7f3b06ffd640 1 -- 172.21.15.161:0/1422860168 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b100ad7a0 con 0x7f3b181d4b90 2024-02-02T11:49:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.567+0000 7f3b1cf06640 1 -- 172.21.15.161:0/1422860168 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b18148550 con 0x7f3b181d4b90 2024-02-02T11:49:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.567+0000 7f3b1cf06640 1 -- 172.21.15.161:0/1422860168 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b180b35b0 con 0x7f3b181d4b90 2024-02-02T11:49:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.567+0000 7f3b06ffd640 1 -- 172.21.15.161:0/1422860168 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3b100aa030 con 0x7f3b181d4b90 2024-02-02T11:49:18.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.567+0000 7f3b06ffd640 1 --2- 172.21.15.161:0/1422860168 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3af8065a90 0x7f3af8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.567+0000 7f3b1659c640 1 --2- 172.21.15.161:0/1422860168 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3af8065a90 0x7f3af8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.567+0000 7f3b06ffd640 1 -- 172.21.15.161:0/1422860168 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b1011db60 con 0x7f3b181d4b90 2024-02-02T11:49:18.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.567+0000 7f3b1659c640 1 --2- 172.21.15.161:0/1422860168 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3af8065a90 0x7f3af8067f50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800da30 tx=0x7f3b08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:18.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.571+0000 7f3b06ffd640 1 -- 172.21.15.161:0/1422860168 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3b100eefb0 con 0x7f3b181d4b90 2024-02-02T11:49:18.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.739+0000 7f3b1cf06640 1 -- 172.21.15.161:0/1422860168 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3b180b35b0 con 0x7f3b181d4b90 2024-02-02T11:49:18.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.739+0000 7f3b06ffd640 1 -- 172.21.15.161:0/1422860168 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3b100eeb40 con 0x7f3b181d4b90 2024-02-02T11:49:18.742 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2024-02-02T11:49:18.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.739+0000 7f3b1cf06640 1 -- 172.21.15.161:0/1422860168 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3af8065a90 msgr2=0x7f3af8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:18.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.739+0000 7f3b1cf06640 1 --2- 172.21.15.161:0/1422860168 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3af8065a90 0x7f3af8067f50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800da30 tx=0x7f3b08008040 comp rx=0 tx=0).stop 2024-02-02T11:49:18.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.739+0000 7f3b1cf06640 1 -- 172.21.15.161:0/1422860168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b181d4b90 msgr2=0x7f3b1813e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:18.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.739+0000 7f3b1cf06640 1 --2- 172.21.15.161:0/1422860168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b181d4b90 0x7f3b1813e0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3b1001d170 tx=0x7f3b00005800 comp rx=0 tx=0).stop 2024-02-02T11:49:18.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.739+0000 7f3b1cf06640 1 -- 172.21.15.161:0/1422860168 shutdown_connections 2024-02-02T11:49:18.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.739+0000 7f3b1cf06640 1 --2- 172.21.15.161:0/1422860168 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3af8065a90 0x7f3af8067f50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.739+0000 7f3b1cf06640 1 --2- 172.21.15.161:0/1422860168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b181d4b90 0x7f3b1813e0a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.739+0000 7f3b1cf06640 1 --2- 172.21.15.161:0/1422860168 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b181467f0 0x7f3b18148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.739+0000 7f3b1cf06640 1 --2- 172.21.15.161:0/1422860168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b00005150 0x7f3b181e2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.739+0000 7f3b1cf06640 1 -- 172.21.15.161:0/1422860168 >> 172.21.15.161:0/1422860168 conn(0x7f3b18069ef0 msgr2=0x7f3b180b6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:18.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.739+0000 7f3b1cf06640 1 -- 172.21.15.161:0/1422860168 shutdown_connections 2024-02-02T11:49:18.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.739+0000 7f3b1cf06640 1 -- 172.21.15.161:0/1422860168 wait complete. 2024-02-02T11:49:18.759 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-02T11:49:18.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:18.760 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-02-02T11:49:18.800 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-02-02T11:49:18.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:18.800 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-02T11:49:18.861 INFO:tasks.cephfs.cephfs_test_case:[] 2024-02-02T11:49:18.861 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-02T11:49:18.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.979+0000 7f100f3a5640 1 Processor -- start 2024-02-02T11:49:18.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.979+0000 7f100f3a5640 1 -- start start 2024-02-02T11:49:18.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.979+0000 7f100f3a5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f10080b9900 0x7f10080b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.979+0000 7f100f3a5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10081429f0 0x7f1008153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.979+0000 7f100f3a5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10080b3c40 con 0x7f1008071160 2024-02-02T11:49:18.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.979+0000 7f100f3a5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10080b5140 con 0x7f10080b9900 2024-02-02T11:49:18.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.979+0000 7f100f3a5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10080b9d50 con 0x7f10081429f0 2024-02-02T11:49:18.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.979+0000 7f100c940640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f10080b9900 0x7f10080b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.979+0000 7f100c940640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f10080b9900 0x7f10080b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40636/0 (socket says 172.21.15.161:40636) 2024-02-02T11:49:18.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.979+0000 7f100c940640 1 -- 172.21.15.161:0/3954465320 learned_addr learned my addr 172.21.15.161:0/3954465320 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:18.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.979+0000 7f100d141640 1 --1- 172.21.15.161:0/3954465320 >> v1:172.21.15.161:6789/0 conn(0x7f1008071160 0x7f10080b8ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59054/0 (socket says 172.21.15.161:59054) 2024-02-02T11:49:18.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.979+0000 7f100c940640 1 -- 172.21.15.161:0/3954465320 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10081429f0 msgr2=0x7f1008153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:18.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.979+0000 7f100c940640 1 --2- 172.21.15.161:0/3954465320 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10081429f0 0x7f1008153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.979+0000 7f100c940640 1 -- 172.21.15.161:0/3954465320 >> v1:172.21.15.161:6789/0 conn(0x7f1008071160 legacy=0x7f10080b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:18.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.979+0000 7f100c940640 1 -- 172.21.15.161:0/3954465320 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10080b9f60 con 0x7f10080b9900 2024-02-02T11:49:18.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.979+0000 7f0ffffff640 1 -- 172.21.15.161:0/3954465320 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223937475 0 0) 0x7f10080b3c40 con 0x7f1008071160 2024-02-02T11:49:18.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.979+0000 7f100c940640 1 --2- 172.21.15.161:0/3954465320 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10080b9900 0x7f10080b42d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009870 tx=0x7f0ff801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c262a5acadec95 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:18.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f0ffffff640 1 -- 172.21.15.161:0/3954465320 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff80a9400 con 0x7f10080b9900 2024-02-02T11:49:18.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f0ffffff640 1 -- 172.21.15.161:0/3954465320 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff80a9560 con 0x7f10080b9900 2024-02-02T11:49:18.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f0ffffff640 1 -- 172.21.15.161:0/3954465320 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff80a98f0 con 0x7f10080b9900 2024-02-02T11:49:18.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100f3a5640 1 -- 172.21.15.161:0/3954465320 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10080b9900 msgr2=0x7f10080b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:18.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100f3a5640 1 --2- 172.21.15.161:0/3954465320 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10080b9900 0x7f10080b42d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009870 tx=0x7f0ff801c540 comp rx=0 tx=0).stop 2024-02-02T11:49:18.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100f3a5640 1 -- 172.21.15.161:0/3954465320 shutdown_connections 2024-02-02T11:49:18.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100f3a5640 1 --2- 172.21.15.161:0/3954465320 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10081429f0 0x7f1008153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100f3a5640 1 --2- 172.21.15.161:0/3954465320 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10080b9900 0x7f10080b42d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100f3a5640 1 -- 172.21.15.161:0/3954465320 >> 172.21.15.161:0/3954465320 conn(0x7f10080be150 msgr2=0x7f10080be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:18.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100f3a5640 1 -- 172.21.15.161:0/3954465320 shutdown_connections 2024-02-02T11:49:18.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100f3a5640 1 -- 172.21.15.161:0/3954465320 wait complete. 2024-02-02T11:49:18.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100f3a5640 1 Processor -- start 2024-02-02T11:49:18.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100f3a5640 1 -- start start 2024-02-02T11:49:18.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100f3a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1008071160 0x7f1008149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100f3a5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10080b9900 0x7f10081378a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100f3a5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10081429f0 0x7f10081e6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100f3a5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100806cef0 con 0x7f10080b9900 2024-02-02T11:49:18.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100f3a5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1008137de0 con 0x7f1008071160 2024-02-02T11:49:18.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100f3a5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1008147970 con 0x7f10081429f0 2024-02-02T11:49:18.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100c940640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10080b9900 0x7f10081378a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100c940640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10080b9900 0x7f10081378a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40650/0 (socket says 172.21.15.161:40650) 2024-02-02T11:49:18.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100c940640 1 -- 172.21.15.161:0/2015301563 learned_addr learned my addr 172.21.15.161:0/2015301563 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:18.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100d942640 1 --2- 172.21.15.161:0/2015301563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10081429f0 0x7f10081e6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100d141640 1 --2- 172.21.15.161:0/2015301563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1008071160 0x7f1008149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100c940640 1 -- 172.21.15.161:0/2015301563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10081429f0 msgr2=0x7f10081e6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:18.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100c940640 1 --2- 172.21.15.161:0/2015301563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10081429f0 0x7f10081e6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100c940640 1 -- 172.21.15.161:0/2015301563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1008071160 msgr2=0x7f1008149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:18.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100c940640 1 --2- 172.21.15.161:0/2015301563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1008071160 0x7f1008149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:18.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100c940640 1 -- 172.21.15.161:0/2015301563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80094d0 con 0x7f10080b9900 2024-02-02T11:49:18.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100d141640 1 --2- 172.21.15.161:0/2015301563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1008071160 0x7f1008149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:18.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100c940640 1 --2- 172.21.15.161:0/2015301563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10080b9900 0x7f10081378a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0ff801abf0 tx=0x7f0ff801ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:18.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f0ffdffb640 1 -- 172.21.15.161:0/2015301563 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff80b1800 con 0x7f10080b9900 2024-02-02T11:49:18.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f0ffdffb640 1 -- 172.21.15.161:0/2015301563 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff80b1980 con 0x7f10080b9900 2024-02-02T11:49:18.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f100f3a5640 1 -- 172.21.15.161:0/2015301563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1008148cb0 con 0x7f10080b9900 2024-02-02T11:49:18.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.983+0000 7f0ffdffb640 1 -- 172.21.15.161:0/2015301563 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff80b1d30 con 0x7f10080b9900 2024-02-02T11:49:18.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.987+0000 7f100f3a5640 1 -- 172.21.15.161:0/2015301563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100806cc10 con 0x7f10080b9900 2024-02-02T11:49:18.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.987+0000 7f100f3a5640 1 -- 172.21.15.161:0/2015301563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f100804e000 con 0x7f10080b9900 2024-02-02T11:49:18.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.987+0000 7f0ffdffb640 1 -- 172.21.15.161:0/2015301563 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0ff80bc450 con 0x7f10080b9900 2024-02-02T11:49:18.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.987+0000 7f0ffdffb640 1 --2- 172.21.15.161:0/2015301563 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0fec065a60 0x7f0fec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:18.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.987+0000 7f0ffdffb640 1 -- 172.21.15.161:0/2015301563 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ff811dcf0 con 0x7f10080b9900 2024-02-02T11:49:18.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.987+0000 7f100d141640 1 --2- 172.21.15.161:0/2015301563 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0fec065a60 0x7f0fec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:18.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.987+0000 7f100d141640 1 --2- 172.21.15.161:0/2015301563 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0fec065a60 0x7f0fec067f20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1004007fd0 tx=0x7f1004009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:18.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:18.991+0000 7f0ffdffb640 1 -- 172.21.15.161:0/2015301563 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0ff8122070 con 0x7f10080b9900 2024-02-02T11:49:19.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.163+0000 7f100f3a5640 1 -- 172.21.15.161:0/2015301563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1008147740 con 0x7f10080b9900 2024-02-02T11:49:19.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.163+0000 7f0ffdffb640 1 -- 172.21.15.161:0/2015301563 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3953 (secure 0 0 0) 0x7f0ff80a6020 con 0x7f10080b9900 2024-02-02T11:49:19.166 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:19.166 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3677988163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3677988163},{"type":"v1","addr":"172.21.15.162:6833","nonce":3677988163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/456037269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":456037269},{"type":"v1","addr":"172.21.15.161:6835","nonce":456037269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-02T11:48:51.812809+0000","modified":"2024-02-02T11:48:54.494091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/2509813318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":2509813318},{"type":"v1","addr":"172.21.15.161:6837","nonce":2509813318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-02T11:49:19.166 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 7 2024-02-02T11:49:19.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.163+0000 7f100f3a5640 1 -- 172.21.15.161:0/2015301563 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0fec065a60 msgr2=0x7f0fec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:19.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.163+0000 7f100f3a5640 1 --2- 172.21.15.161:0/2015301563 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0fec065a60 0x7f0fec067f20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1004007fd0 tx=0x7f1004009040 comp rx=0 tx=0).stop 2024-02-02T11:49:19.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.163+0000 7f100f3a5640 1 -- 172.21.15.161:0/2015301563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10080b9900 msgr2=0x7f10081378a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:19.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.163+0000 7f100f3a5640 1 --2- 172.21.15.161:0/2015301563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10080b9900 0x7f10081378a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0ff801abf0 tx=0x7f0ff801ad80 comp rx=0 tx=0).stop 2024-02-02T11:49:19.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.163+0000 7f100f3a5640 1 -- 172.21.15.161:0/2015301563 shutdown_connections 2024-02-02T11:49:19.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.163+0000 7f100f3a5640 1 --2- 172.21.15.161:0/2015301563 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0fec065a60 0x7f0fec067f20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.163+0000 7f100f3a5640 1 --2- 172.21.15.161:0/2015301563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10081429f0 0x7f10081e6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.163+0000 7f100f3a5640 1 --2- 172.21.15.161:0/2015301563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10080b9900 0x7f10081378a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.163+0000 7f100f3a5640 1 --2- 172.21.15.161:0/2015301563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1008071160 0x7f1008149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.163+0000 7f100f3a5640 1 -- 172.21.15.161:0/2015301563 >> 172.21.15.161:0/2015301563 conn(0x7f10080be150 msgr2=0x7f10080a17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:19.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.163+0000 7f100f3a5640 1 -- 172.21.15.161:0/2015301563 shutdown_connections 2024-02-02T11:49:19.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.163+0000 7f100f3a5640 1 -- 172.21.15.161:0/2015301563 wait complete. 2024-02-02T11:49:19.183 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:49:19.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.291+0000 7fee228b3640 1 Processor -- start 2024-02-02T11:49:19.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.291+0000 7fee228b3640 1 -- start start 2024-02-02T11:49:19.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.291+0000 7fee228b3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee1c0bc340 0x7fee1c1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.291+0000 7fee228b3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fee1c141b30 0x7fee1c147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.291+0000 7fee228b3640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fee1c0b8020 0x7fee1c1481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.291+0000 7fee228b3640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1c071550 con 0x7fee1c141b30 2024-02-02T11:49:19.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.291+0000 7fee228b3640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1c071810 con 0x7fee1c0b8020 2024-02-02T11:49:19.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.291+0000 7fee228b3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0bc720 con 0x7fee1c0bc340 2024-02-02T11:49:19.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee1b7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fee1c141b30 0x7fee1c147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee1b7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fee1c141b30 0x7fee1c147c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40660/0 (socket says 172.21.15.161:40660) 2024-02-02T11:49:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee1b7fe640 1 -- 172.21.15.161:0/2905091087 learned_addr learned my addr 172.21.15.161:0/2905091087 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee1b7fe640 1 -- 172.21.15.161:0/2905091087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee1c0bc340 msgr2=0x7fee1c1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee1bfff640 1 --2- 172.21.15.161:0/2905091087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee1c0bc340 0x7fee1c1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee20e50640 1 --2- 172.21.15.161:0/2905091087 >> v2:172.21.15.162:3300/0 conn(0x7fee1c0b8020 0x7fee1c1481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee1b7fe640 1 --2- 172.21.15.161:0/2905091087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee1c0bc340 0x7fee1c1415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee1b7fe640 1 -- 172.21.15.161:0/2905091087 >> v2:172.21.15.162:3300/0 conn(0x7fee1c0b8020 msgr2=0x7fee1c1481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee1b7fe640 1 --2- 172.21.15.161:0/2905091087 >> v2:172.21.15.162:3300/0 conn(0x7fee1c0b8020 0x7fee1c1481a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee1b7fe640 1 -- 172.21.15.161:0/2905091087 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c0b2d90 con 0x7fee1c141b30 2024-02-02T11:49:19.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee1b7fe640 1 --2- 172.21.15.161:0/2905091087 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee1c141b30 0x7fee1c147c60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0b4090 tx=0x7fee1001eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6941b7e70e46620 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:19.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee1affd640 1 -- 172.21.15.161:0/2905091087 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee100a79d0 con 0x7fee1c141b30 2024-02-02T11:49:19.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee1affd640 1 -- 172.21.15.161:0/2905091087 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee100a7b30 con 0x7fee1c141b30 2024-02-02T11:49:19.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee1affd640 1 -- 172.21.15.161:0/2905091087 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee100af440 con 0x7fee1c141b30 2024-02-02T11:49:19.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee228b3640 1 -- 172.21.15.161:0/2905091087 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee1c141b30 msgr2=0x7fee1c147c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:19.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee228b3640 1 --2- 172.21.15.161:0/2905091087 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee1c141b30 0x7fee1c147c60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0b4090 tx=0x7fee1001eb40 comp rx=0 tx=0).stop 2024-02-02T11:49:19.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee228b3640 1 -- 172.21.15.161:0/2905091087 shutdown_connections 2024-02-02T11:49:19.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee228b3640 1 --2- 172.21.15.161:0/2905091087 >> v2:172.21.15.162:3300/0 conn(0x7fee1c0b8020 0x7fee1c1481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee228b3640 1 --2- 172.21.15.161:0/2905091087 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee1c141b30 0x7fee1c147c60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee228b3640 1 --2- 172.21.15.161:0/2905091087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee1c0bc340 0x7fee1c1415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee228b3640 1 -- 172.21.15.161:0/2905091087 >> 172.21.15.161:0/2905091087 conn(0x7fee1c069ef0 msgr2=0x7fee1c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:19.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee228b3640 1 -- 172.21.15.161:0/2905091087 shutdown_connections 2024-02-02T11:49:19.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.295+0000 7fee228b3640 1 -- 172.21.15.161:0/2905091087 wait complete. 2024-02-02T11:49:19.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee228b3640 1 Processor -- start 2024-02-02T11:49:19.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee228b3640 1 -- start start 2024-02-02T11:49:19.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee228b3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee1c0b8020 0x7fee1c0bb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee228b3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee1c0bc340 0x7fee1c130bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee228b3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee1c141b30 0x7fee1c1de640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee228b3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0b4900 con 0x7fee1c0bc340 2024-02-02T11:49:19.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee228b3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0bb5d0 con 0x7fee1c0b8020 2024-02-02T11:49:19.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee228b3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c139a60 con 0x7fee1c141b30 2024-02-02T11:49:19.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee1b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee1c0bc340 0x7fee1c130bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee1b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee1c0bc340 0x7fee1c130bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40664/0 (socket says 172.21.15.161:40664) 2024-02-02T11:49:19.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee1b7fe640 1 -- 172.21.15.161:0/1666732963 learned_addr learned my addr 172.21.15.161:0/1666732963 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:19.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee20e50640 1 --2- 172.21.15.161:0/1666732963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee1c141b30 0x7fee1c1de640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee1b7fe640 1 -- 172.21.15.161:0/1666732963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee1c141b30 msgr2=0x7fee1c1de640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:19.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee1b7fe640 1 --2- 172.21.15.161:0/1666732963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee1c141b30 0x7fee1c1de640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee1b7fe640 1 -- 172.21.15.161:0/1666732963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee1c0b8020 msgr2=0x7fee1c0bb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:19.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee1bfff640 1 --2- 172.21.15.161:0/1666732963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee1c0b8020 0x7fee1c0bb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee1b7fe640 1 --2- 172.21.15.161:0/1666732963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee1c0b8020 0x7fee1c0bb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee1b7fe640 1 -- 172.21.15.161:0/1666732963 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1000b770 con 0x7fee1c0bc340 2024-02-02T11:49:19.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee1b7fe640 1 --2- 172.21.15.161:0/1666732963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee1c0bc340 0x7fee1c130bc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fee1001f3e0 tx=0x7fee1001b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:19.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee18ff9640 1 -- 172.21.15.161:0/1666732963 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee100b8600 con 0x7fee1c0bc340 2024-02-02T11:49:19.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee18ff9640 1 -- 172.21.15.161:0/1666732963 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee100b8760 con 0x7fee1c0bc340 2024-02-02T11:49:19.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee228b3640 1 -- 172.21.15.161:0/1666732963 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1c0b56a0 con 0x7fee1c0bc340 2024-02-02T11:49:19.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee18ff9640 1 -- 172.21.15.161:0/1666732963 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee100b8b10 con 0x7fee1c0bc340 2024-02-02T11:49:19.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee228b3640 1 -- 172.21.15.161:0/1666732963 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1c0b6200 con 0x7fee1c0bc340 2024-02-02T11:49:19.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee228b3640 1 -- 172.21.15.161:0/1666732963 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1c04e000 con 0x7fee1c0bc340 2024-02-02T11:49:19.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee18ff9640 1 -- 172.21.15.161:0/1666732963 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fee100b6040 con 0x7fee1c0bc340 2024-02-02T11:49:19.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee18ff9640 1 --2- 172.21.15.161:0/1666732963 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fee08065a60 0x7fee08067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee18ff9640 1 -- 172.21.15.161:0/1666732963 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee101204d0 con 0x7fee1c0bc340 2024-02-02T11:49:19.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.299+0000 7fee1bfff640 1 --2- 172.21.15.161:0/1666732963 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fee08065a60 0x7fee08067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.303+0000 7fee1bfff640 1 --2- 172.21.15.161:0/1666732963 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fee08065a60 0x7fee08067f20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fee14008ef0 tx=0x7fee14008440 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:19.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.303+0000 7fee18ff9640 1 -- 172.21.15.161:0/1666732963 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fee100edf20 con 0x7fee1c0bc340 2024-02-02T11:49:19.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.447+0000 7fee228b3640 1 -- 172.21.15.161:0/1666732963 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee1c14b9c0 con 0x7fee1c0bc340 2024-02-02T11:49:19.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.447+0000 7fee18ff9640 1 -- 172.21.15.161:0/1666732963 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fee100f1540 con 0x7fee1c0bc340 2024-02-02T11:49:19.452 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:19.452 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":20,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:52.816101+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:48:50.155565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-02T11:48:50.795158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:49:19.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.451+0000 7fee228b3640 1 -- 172.21.15.161:0/1666732963 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fee08065a60 msgr2=0x7fee08067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:19.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.451+0000 7fee228b3640 1 --2- 172.21.15.161:0/1666732963 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fee08065a60 0x7fee08067f20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fee14008ef0 tx=0x7fee14008440 comp rx=0 tx=0).stop 2024-02-02T11:49:19.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.451+0000 7fee228b3640 1 -- 172.21.15.161:0/1666732963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee1c0bc340 msgr2=0x7fee1c130bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:19.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.451+0000 7fee228b3640 1 --2- 172.21.15.161:0/1666732963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee1c0bc340 0x7fee1c130bc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fee1001f3e0 tx=0x7fee1001b8e0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.451+0000 7fee228b3640 1 -- 172.21.15.161:0/1666732963 shutdown_connections 2024-02-02T11:49:19.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.451+0000 7fee228b3640 1 --2- 172.21.15.161:0/1666732963 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fee08065a60 0x7fee08067f20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.451+0000 7fee228b3640 1 --2- 172.21.15.161:0/1666732963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee1c141b30 0x7fee1c1de640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.451+0000 7fee228b3640 1 --2- 172.21.15.161:0/1666732963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee1c0bc340 0x7fee1c130bc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.451+0000 7fee228b3640 1 --2- 172.21.15.161:0/1666732963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee1c0b8020 0x7fee1c0bb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.451+0000 7fee228b3640 1 -- 172.21.15.161:0/1666732963 >> 172.21.15.161:0/1666732963 conn(0x7fee1c069ef0 msgr2=0x7fee1c147c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:19.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.451+0000 7fee228b3640 1 -- 172.21.15.161:0/1666732963 shutdown_connections 2024-02-02T11:49:19.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.451+0000 7fee228b3640 1 -- 172.21.15.161:0/1666732963 wait complete. 2024-02-02T11:49:19.469 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-02T11:48:40.330782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-02T11:48:50.155565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-02T11:48:50.795158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-02T11:49:19.469 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-02T11:49:19.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.587+0000 7fc22d91d640 1 Processor -- start 2024-02-02T11:49:19.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.591+0000 7fc22d91d640 1 -- start start 2024-02-02T11:49:19.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.591+0000 7fc22d91d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc2280b8df0 0x7fc228147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.591+0000 7fc22d91d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc228070e40 0x7fc228141620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.591+0000 7fc22d91d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22806ec30 con 0x7fc2280b8530 2024-02-02T11:49:19.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.591+0000 7fc22d91d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2280b30e0 con 0x7fc2280b8df0 2024-02-02T11:49:19.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.591+0000 7fc22d91d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280b3770 con 0x7fc228070e40 2024-02-02T11:49:19.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.591+0000 7fc226ffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc2280b8df0 0x7fc228147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.591+0000 7fc226ffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc2280b8df0 0x7fc228147eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40672/0 (socket says 172.21.15.161:40672) 2024-02-02T11:49:19.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.591+0000 7fc226ffd640 1 -- 172.21.15.161:0/1469040312 learned_addr learned my addr 172.21.15.161:0/1469040312 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:19.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.591+0000 7fc21e7fc640 1 --2- 172.21.15.161:0/1469040312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc228070e40 0x7fc228141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.591+0000 7fc226ffd640 1 -- 172.21.15.161:0/1469040312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc228070e40 msgr2=0x7fc228141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:19.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.591+0000 7fc226ffd640 1 --2- 172.21.15.161:0/1469040312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc228070e40 0x7fc228141620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.591+0000 7fc226ffd640 1 -- 172.21.15.161:0/1469040312 >> v1:172.21.15.162:6789/0 conn(0x7fc2280b8530 legacy=0x7fc22814acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:19.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.591+0000 7fc226ffd640 1 -- 172.21.15.161:0/1469040312 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc228071890 con 0x7fc2280b8df0 2024-02-02T11:49:19.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.591+0000 7fc21e7fc640 1 --2- 172.21.15.161:0/1469040312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc228070e40 0x7fc228141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:19.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.591+0000 7fc226ffd640 1 --2- 172.21.15.161:0/1469040312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2280b8df0 0x7fc228147eb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc218009870 tx=0x7fc21801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c634153ef1f0bd02 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:19.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.591+0000 7fc2267fc640 1 -- 172.21.15.161:0/1469040312 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2180ac410 con 0x7fc2280b8df0 2024-02-02T11:49:19.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.591+0000 7fc2267fc640 1 -- 172.21.15.161:0/1469040312 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2180ac570 con 0x7fc2280b8df0 2024-02-02T11:49:19.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.591+0000 7fc2267fc640 1 -- 172.21.15.161:0/1469040312 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2180ac900 con 0x7fc2280b8df0 2024-02-02T11:49:19.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc22d91d640 1 -- 172.21.15.161:0/1469040312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2280b8df0 msgr2=0x7fc228147eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:19.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc22d91d640 1 --2- 172.21.15.161:0/1469040312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2280b8df0 0x7fc228147eb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc218009870 tx=0x7fc21801c500 comp rx=0 tx=0).stop 2024-02-02T11:49:19.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc22d91d640 1 -- 172.21.15.161:0/1469040312 shutdown_connections 2024-02-02T11:49:19.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc22d91d640 1 --2- 172.21.15.161:0/1469040312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc228070e40 0x7fc228141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc22d91d640 1 --2- 172.21.15.161:0/1469040312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2280b8df0 0x7fc228147eb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc22d91d640 1 -- 172.21.15.161:0/1469040312 >> 172.21.15.161:0/1469040312 conn(0x7fc22806a120 msgr2=0x7fc22806a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:19.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc22d91d640 1 -- 172.21.15.161:0/1469040312 shutdown_connections 2024-02-02T11:49:19.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc22d91d640 1 -- 172.21.15.161:0/1469040312 wait complete. 2024-02-02T11:49:19.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc22d91d640 1 Processor -- start 2024-02-02T11:49:19.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc22d91d640 1 -- start start 2024-02-02T11:49:19.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc22d91d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2280b8530 0x7fc2281330c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc22d91d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2280b8df0 0x7fc228130260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc22d91d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc228147160 0x7fc2281307a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc22d91d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc228133600 con 0x7fc228147160 2024-02-02T11:49:19.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc22d91d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc228145ec0 con 0x7fc2280b8df0 2024-02-02T11:49:19.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc22d91d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc228145900 con 0x7fc2280b8530 2024-02-02T11:49:19.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc2277fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc228147160 0x7fc2281307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc2277fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc228147160 0x7fc2281307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40678/0 (socket says 172.21.15.161:40678) 2024-02-02T11:49:19.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc2277fe640 1 -- 172.21.15.161:0/3720773565 learned_addr learned my addr 172.21.15.161:0/3720773565 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:19.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc226ffd640 1 --2- 172.21.15.161:0/3720773565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2280b8530 0x7fc2281330c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc21e7fc640 1 --2- 172.21.15.161:0/3720773565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2280b8df0 0x7fc228130260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc2277fe640 1 -- 172.21.15.161:0/3720773565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2280b8530 msgr2=0x7fc2281330c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:19.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc2277fe640 1 --2- 172.21.15.161:0/3720773565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2280b8530 0x7fc2281330c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc2277fe640 1 -- 172.21.15.161:0/3720773565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2280b8df0 msgr2=0x7fc228130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:19.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc2277fe640 1 --2- 172.21.15.161:0/3720773565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2280b8df0 0x7fc228130260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc2277fe640 1 -- 172.21.15.161:0/3720773565 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2180094d0 con 0x7fc228147160 2024-02-02T11:49:19.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc21e7fc640 1 --2- 172.21.15.161:0/3720773565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2280b8df0 0x7fc228130260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:19.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc2277fe640 1 --2- 172.21.15.161:0/3720773565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc228147160 0x7fc2281307a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc22000c780 tx=0x7fc22000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:19.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc224ff9640 1 -- 172.21.15.161:0/3720773565 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22000a9f0 con 0x7fc228147160 2024-02-02T11:49:19.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc224ff9640 1 -- 172.21.15.161:0/3720773565 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22000ce90 con 0x7fc228147160 2024-02-02T11:49:19.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc22d91d640 1 -- 172.21.15.161:0/3720773565 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc228145be0 con 0x7fc228147160 2024-02-02T11:49:19.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc224ff9640 1 -- 172.21.15.161:0/3720773565 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22000add0 con 0x7fc228147160 2024-02-02T11:49:19.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc22d91d640 1 -- 172.21.15.161:0/3720773565 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2281466a0 con 0x7fc228147160 2024-02-02T11:49:19.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.595+0000 7fc22d91d640 1 -- 172.21.15.161:0/3720773565 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2281468c0 con 0x7fc228147160 2024-02-02T11:49:19.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.599+0000 7fc224ff9640 1 -- 172.21.15.161:0/3720773565 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc220012420 con 0x7fc228147160 2024-02-02T11:49:19.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.599+0000 7fc224ff9640 1 --2- 172.21.15.161:0/3720773565 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc208065a60 0x7fc208067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.599+0000 7fc224ff9640 1 -- 172.21.15.161:0/3720773565 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc220083d10 con 0x7fc228147160 2024-02-02T11:49:19.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.599+0000 7fc226ffd640 1 --2- 172.21.15.161:0/3720773565 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc208065a60 0x7fc208067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.599+0000 7fc226ffd640 1 --2- 172.21.15.161:0/3720773565 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc208065a60 0x7fc208067f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc2180ae000 tx=0x7fc218008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:19.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.603+0000 7fc224ff9640 1 -- 172.21.15.161:0/3720773565 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc2200516b0 con 0x7fc228147160 2024-02-02T11:49:19.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.751+0000 7fc22d91d640 1 -- 172.21.15.161:0/3720773565 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc22804e000 con 0x7fc228147160 2024-02-02T11:49:19.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.751+0000 7fc224ff9640 1 -- 172.21.15.161:0/3720773565 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc220016020 con 0x7fc228147160 2024-02-02T11:49:19.753 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-02-02T11:49:19.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.751+0000 7fc22d91d640 1 -- 172.21.15.161:0/3720773565 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc208065a60 msgr2=0x7fc208067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:19.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.751+0000 7fc22d91d640 1 --2- 172.21.15.161:0/3720773565 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc208065a60 0x7fc208067f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc2180ae000 tx=0x7fc218008040 comp rx=0 tx=0).stop 2024-02-02T11:49:19.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.751+0000 7fc22d91d640 1 -- 172.21.15.161:0/3720773565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc228147160 msgr2=0x7fc2281307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:19.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.751+0000 7fc22d91d640 1 --2- 172.21.15.161:0/3720773565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc228147160 0x7fc2281307a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc22000c780 tx=0x7fc22000cc40 comp rx=0 tx=0).stop 2024-02-02T11:49:19.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.751+0000 7fc22d91d640 1 -- 172.21.15.161:0/3720773565 shutdown_connections 2024-02-02T11:49:19.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.751+0000 7fc22d91d640 1 --2- 172.21.15.161:0/3720773565 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc208065a60 0x7fc208067f20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.751+0000 7fc22d91d640 1 --2- 172.21.15.161:0/3720773565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc228147160 0x7fc2281307a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.751+0000 7fc22d91d640 1 --2- 172.21.15.161:0/3720773565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2280b8df0 0x7fc228130260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.751+0000 7fc22d91d640 1 --2- 172.21.15.161:0/3720773565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2280b8530 0x7fc2281330c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.751+0000 7fc22d91d640 1 -- 172.21.15.161:0/3720773565 >> 172.21.15.161:0/3720773565 conn(0x7fc22806a120 msgr2=0x7fc22806f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:19.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.751+0000 7fc22d91d640 1 -- 172.21.15.161:0/3720773565 shutdown_connections 2024-02-02T11:49:19.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.751+0000 7fc22d91d640 1 -- 172.21.15.161:0/3720773565 wait complete. 2024-02-02T11:49:19.771 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-02T11:49:19.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.879+0000 7f3c0c039640 1 Processor -- start 2024-02-02T11:49:19.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.879+0000 7f3c0c039640 1 -- start start 2024-02-02T11:49:19.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.879+0000 7f3c0c039640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3c040b8df0 0x7f3c04142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.879+0000 7f3c0c039640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c04142d80 0x7f3c041531b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.879+0000 7f3c0c039640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c04148a80 con 0x7f3c040b8540 2024-02-02T11:49:19.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.879+0000 7f3c0c039640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c040b3890 con 0x7f3c040b8df0 2024-02-02T11:49:19.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.879+0000 7f3c0c039640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c040b3b70 con 0x7f3c04142d80 2024-02-02T11:49:19.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.879+0000 7f3c095d4640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f3c040b8540 0x7f3c04148f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59056/0 (socket says 172.21.15.161:59056) 2024-02-02T11:49:19.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.879+0000 7f3c095d4640 1 -- 172.21.15.161:0/831803758 learned_addr learned my addr 172.21.15.161:0/831803758 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:19.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.879+0000 7f3c0a5d6640 1 --2- 172.21.15.161:0/831803758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c04142d80 0x7f3c041531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.879+0000 7f3c09dd5640 1 --2- 172.21.15.161:0/831803758 >> v2:172.21.15.162:3300/0 conn(0x7f3c040b8df0 0x7f3c04142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.879+0000 7f3c08dd3640 1 -- 172.21.15.161:0/831803758 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4178564364 0 0) 0x7f3c04148a80 con 0x7f3c040b8540 2024-02-02T11:49:19.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.879+0000 7f3c08dd3640 1 -- 172.21.15.161:0/831803758 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bec003530 con 0x7f3c040b8540 2024-02-02T11:49:19.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c08dd3640 1 -- 172.21.15.161:0/831803758 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 381068691 0 0) 0x7f3bec003530 con 0x7f3c040b8540 2024-02-02T11:49:19.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c08dd3640 1 -- 172.21.15.161:0/831803758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c04142d80 msgr2=0x7f3c041531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:19.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c08dd3640 1 --2- 172.21.15.161:0/831803758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c04142d80 0x7f3c041531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c08dd3640 1 -- 172.21.15.161:0/831803758 >> v2:172.21.15.162:3300/0 conn(0x7f3c040b8df0 msgr2=0x7f3c04142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:19.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c08dd3640 1 --2- 172.21.15.161:0/831803758 >> v2:172.21.15.162:3300/0 conn(0x7f3c040b8df0 0x7f3c04142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c08dd3640 1 -- 172.21.15.161:0/831803758 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c040b3e50 con 0x7f3c040b8540 2024-02-02T11:49:19.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c08dd3640 1 -- 172.21.15.161:0/831803758 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f3bf8001680 con 0x7f3c040b8540 2024-02-02T11:49:19.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c08dd3640 1 -- 172.21.15.161:0/831803758 >> v1:172.21.15.161:6789/0 conn(0x7f3c040b8540 legacy=0x7f3c04148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:19.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c08dd3640 1 --2- 172.21.15.161:0/831803758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c04142d80 0x7f3bec003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c08dd3640 1 --2- 172.21.15.161:0/831803758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bec003f00 0x7f3bec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c08dd3640 1 --2- 172.21.15.161:0/831803758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bec004d10 0x7f3bec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c08dd3640 1 -- 172.21.15.161:0/831803758 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c040b3890 con 0x7f3bec003f00 2024-02-02T11:49:19.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c08dd3640 1 -- 172.21.15.161:0/831803758 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c040b3b70 con 0x7f3bec004d10 2024-02-02T11:49:19.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c08dd3640 1 -- 172.21.15.161:0/831803758 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec00b990 con 0x7f3c04142d80 2024-02-02T11:49:19.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c095d4640 1 --2- 172.21.15.161:0/831803758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bec003f00 0x7f3bec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c09dd5640 1 --2- 172.21.15.161:0/831803758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c04142d80 0x7f3bec003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c0a5d6640 1 --2- 172.21.15.161:0/831803758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bec004d10 0x7f3bec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c095d4640 1 -- 172.21.15.161:0/831803758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c04142d80 msgr2=0x7f3bec003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:19.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c095d4640 1 --2- 172.21.15.161:0/831803758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c04142d80 0x7f3bec003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c095d4640 1 -- 172.21.15.161:0/831803758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bec004d10 msgr2=0x7f3bec005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:19.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c095d4640 1 --2- 172.21.15.161:0/831803758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bec004d10 0x7f3bec005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c095d4640 1 -- 172.21.15.161:0/831803758 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec003530 con 0x7f3bec003f00 2024-02-02T11:49:19.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c095d4640 1 --2- 172.21.15.161:0/831803758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bec003f00 0x7f3bec0047d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800c210 tx=0x7f3bf801f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9bafa89be438389 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:19.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c08dd3640 1 -- 172.21.15.161:0/831803758 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8005ae0 con 0x7f3bec003f00 2024-02-02T11:49:19.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c08dd3640 1 -- 172.21.15.161:0/831803758 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf80ab070 con 0x7f3bec003f00 2024-02-02T11:49:19.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c08dd3640 1 -- 172.21.15.161:0/831803758 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8005e80 con 0x7f3bec003f00 2024-02-02T11:49:19.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c0c039640 1 -- 172.21.15.161:0/831803758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bec003f00 msgr2=0x7f3bec0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:19.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c0c039640 1 --2- 172.21.15.161:0/831803758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bec003f00 0x7f3bec0047d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800c210 tx=0x7f3bf801f330 comp rx=0 tx=0).stop 2024-02-02T11:49:19.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c0a5d6640 1 -- 172.21.15.161:0/831803758 reap_dead start 2024-02-02T11:49:19.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c0c039640 1 -- 172.21.15.161:0/831803758 shutdown_connections 2024-02-02T11:49:19.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c0c039640 1 -- 172.21.15.161:0/831803758 >> 172.21.15.161:0/831803758 conn(0x7f3c0406a120 msgr2=0x7f3c0406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:19.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c0c039640 1 -- 172.21.15.161:0/831803758 shutdown_connections 2024-02-02T11:49:19.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.883+0000 7f3c0c039640 1 -- 172.21.15.161:0/831803758 wait complete. 2024-02-02T11:49:19.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c0c039640 1 Processor -- start 2024-02-02T11:49:19.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c0c039640 1 -- start start 2024-02-02T11:49:19.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c0c039640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bec003f00 0x7f3c0413ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c0c039640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c0413f110 0x7f3c04147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c0c039640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c040bc790 0x7f3c04148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c0c039640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c040bcd20 con 0x7f3bec003f00 2024-02-02T11:49:19.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c0c039640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c040ba820 con 0x7f3c0413f110 2024-02-02T11:49:19.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c0c039640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c040bab00 con 0x7f3c040bc790 2024-02-02T11:49:19.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c09dd5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bec003f00 0x7f3c0413ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c09dd5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bec003f00 0x7f3c0413ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40692/0 (socket says 172.21.15.161:40692) 2024-02-02T11:49:19.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c09dd5640 1 -- 172.21.15.161:0/2646880147 learned_addr learned my addr 172.21.15.161:0/2646880147 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:19.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c0a5d6640 1 --2- 172.21.15.161:0/2646880147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c040bc790 0x7f3c04148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c09dd5640 1 -- 172.21.15.161:0/2646880147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c040bc790 msgr2=0x7f3c04148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:19.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c09dd5640 1 --2- 172.21.15.161:0/2646880147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c040bc790 0x7f3c04148060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c09dd5640 1 -- 172.21.15.161:0/2646880147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c0413f110 msgr2=0x7f3c04147b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:19.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c09dd5640 1 --2- 172.21.15.161:0/2646880147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c0413f110 0x7f3c04147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:19.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c09dd5640 1 -- 172.21.15.161:0/2646880147 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0413f7d0 con 0x7f3bec003f00 2024-02-02T11:49:19.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c09dd5640 1 --2- 172.21.15.161:0/2646880147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bec003f00 0x7f3c0413ebd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc00f3d0 tx=0x7f3bfc00f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:19.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c027fc640 1 -- 172.21.15.161:0/2646880147 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc016620 con 0x7f3bec003f00 2024-02-02T11:49:19.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c027fc640 1 -- 172.21.15.161:0/2646880147 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bfc016780 con 0x7f3bec003f00 2024-02-02T11:49:19.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c0c039640 1 -- 172.21.15.161:0/2646880147 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c040b9e90 con 0x7f3bec003f00 2024-02-02T11:49:19.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c027fc640 1 -- 172.21.15.161:0/2646880147 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc016b30 con 0x7f3bec003f00 2024-02-02T11:49:19.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c0c039640 1 -- 172.21.15.161:0/2646880147 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c041468b0 con 0x7f3bec003f00 2024-02-02T11:49:19.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c0c039640 1 -- 172.21.15.161:0/2646880147 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0404e000 con 0x7f3bec003f00 2024-02-02T11:49:19.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c027fc640 1 -- 172.21.15.161:0/2646880147 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3bfc016c90 con 0x7f3bec003f00 2024-02-02T11:49:19.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c027fc640 1 --2- 172.21.15.161:0/2646880147 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3bf0065a90 0x7f3bf0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:19.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c027fc640 1 -- 172.21.15.161:0/2646880147 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bfc084180 con 0x7f3bec003f00 2024-02-02T11:49:19.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.887+0000 7f3c095d4640 1 --2- 172.21.15.161:0/2646880147 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3bf0065a90 0x7f3bf0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:19.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.891+0000 7f3c095d4640 1 --2- 172.21.15.161:0/2646880147 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3bf0065a90 0x7f3bf0067f50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80ae000 tx=0x7f3c040b4530 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:19.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:19.891+0000 7f3c027fc640 1 -- 172.21.15.161:0/2646880147 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3bfc051b40 con 0x7f3bec003f00 2024-02-02T11:49:20.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.047+0000 7f3c0c039640 1 -- 172.21.15.161:0/2646880147 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3c0406aeb0 con 0x7f3bec003f00 2024-02-02T11:49:20.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.047+0000 7f3c027fc640 1 -- 172.21.15.161:0/2646880147 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3bfc055160 con 0x7f3bec003f00 2024-02-02T11:49:20.050 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-02-02T11:49:20.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.047+0000 7f3c0c039640 1 -- 172.21.15.161:0/2646880147 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3bf0065a90 msgr2=0x7f3bf0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:20.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.047+0000 7f3c0c039640 1 --2- 172.21.15.161:0/2646880147 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3bf0065a90 0x7f3bf0067f50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80ae000 tx=0x7f3c040b4530 comp rx=0 tx=0).stop 2024-02-02T11:49:20.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.047+0000 7f3c0c039640 1 -- 172.21.15.161:0/2646880147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bec003f00 msgr2=0x7f3c0413ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:20.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.047+0000 7f3c0c039640 1 --2- 172.21.15.161:0/2646880147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bec003f00 0x7f3c0413ebd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc00f3d0 tx=0x7f3bfc00f890 comp rx=0 tx=0).stop 2024-02-02T11:49:20.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.047+0000 7f3c0c039640 1 -- 172.21.15.161:0/2646880147 shutdown_connections 2024-02-02T11:49:20.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.047+0000 7f3c0c039640 1 --2- 172.21.15.161:0/2646880147 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3bf0065a90 0x7f3bf0067f50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.047+0000 7f3c0c039640 1 --2- 172.21.15.161:0/2646880147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c040bc790 0x7f3c04148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.047+0000 7f3c0c039640 1 --2- 172.21.15.161:0/2646880147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c0413f110 0x7f3c04147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.047+0000 7f3c0c039640 1 --2- 172.21.15.161:0/2646880147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bec003f00 0x7f3c0413ebd0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.047+0000 7f3c0c039640 1 -- 172.21.15.161:0/2646880147 >> 172.21.15.161:0/2646880147 conn(0x7f3c0406a120 msgr2=0x7f3c041419f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:20.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.047+0000 7f3c0c039640 1 -- 172.21.15.161:0/2646880147 shutdown_connections 2024-02-02T11:49:20.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.047+0000 7f3c0c039640 1 -- 172.21.15.161:0/2646880147 wait complete. 2024-02-02T11:49:20.069 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-02T11:49:20.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.187+0000 7f3bdcb86640 1 Processor -- start 2024-02-02T11:49:20.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.187+0000 7f3bdcb86640 1 -- start start 2024-02-02T11:49:20.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bdcb86640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bd80b8df0 0x7f3bd8142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bdcb86640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd8148a80 con 0x7f3bd80b8540 2024-02-02T11:49:20.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bdcb86640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd80b3890 con 0x7f3bd8142d80 2024-02-02T11:49:20.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bdcb86640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd80b3b70 con 0x7f3bd80b8df0 2024-02-02T11:49:20.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd5d9b640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f3bd80b8540 0x7f3bd8148f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59070/0 (socket says 172.21.15.161:59070) 2024-02-02T11:49:20.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd5d9b640 1 -- 172.21.15.161:0/967970938 learned_addr learned my addr 172.21.15.161:0/967970938 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:20.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd659c640 1 --2- 172.21.15.161:0/967970938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bd80b8df0 0x7f3bd8142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:20.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd559a640 1 -- 172.21.15.161:0/967970938 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667342744 0 0) 0x7f3bd8148a80 con 0x7f3bd80b8540 2024-02-02T11:49:20.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd559a640 1 -- 172.21.15.161:0/967970938 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bc4003530 con 0x7f3bd80b8540 2024-02-02T11:49:20.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd559a640 1 -- 172.21.15.161:0/967970938 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2762227139 0 0) 0x7f3bc4003530 con 0x7f3bd80b8540 2024-02-02T11:49:20.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd559a640 1 -- 172.21.15.161:0/967970938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bd80b8df0 msgr2=0x7f3bd8142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:20.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd559a640 1 --2- 172.21.15.161:0/967970938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bd80b8df0 0x7f3bd8142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd559a640 1 -- 172.21.15.161:0/967970938 >> v1:172.21.15.162:6789/0 conn(0x7f3bd8142d80 legacy=0x7f3bd81531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:20.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd559a640 1 -- 172.21.15.161:0/967970938 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd80b3e50 con 0x7f3bd80b8540 2024-02-02T11:49:20.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd559a640 1 -- 172.21.15.161:0/967970938 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f3bc8001680 con 0x7f3bd80b8540 2024-02-02T11:49:20.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd559a640 1 -- 172.21.15.161:0/967970938 >> v1:172.21.15.161:6789/0 conn(0x7f3bd80b8540 legacy=0x7f3bd8148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:20.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd559a640 1 --2- 172.21.15.161:0/967970938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bc40039b0 0x7f3bc4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd559a640 1 --2- 172.21.15.161:0/967970938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc40047d0 0x7f3bc4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd559a640 1 --2- 172.21.15.161:0/967970938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bd80b8df0 0x7f3bc4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd559a640 1 -- 172.21.15.161:0/967970938 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd80b3b70 con 0x7f3bc40047d0 2024-02-02T11:49:20.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd559a640 1 -- 172.21.15.161:0/967970938 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc400ba40 con 0x7f3bc40039b0 2024-02-02T11:49:20.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd559a640 1 -- 172.21.15.161:0/967970938 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc400bc00 con 0x7f3bd80b8df0 2024-02-02T11:49:20.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd5d9b640 1 --2- 172.21.15.161:0/967970938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc40047d0 0x7f3bc4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:20.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd659c640 1 --2- 172.21.15.161:0/967970938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bc40039b0 0x7f3bc4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:20.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd6d9d640 1 --2- 172.21.15.161:0/967970938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bd80b8df0 0x7f3bc4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:20.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd5d9b640 1 -- 172.21.15.161:0/967970938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bd80b8df0 msgr2=0x7f3bc4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:20.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd5d9b640 1 --2- 172.21.15.161:0/967970938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bd80b8df0 0x7f3bc4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd5d9b640 1 -- 172.21.15.161:0/967970938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bc40039b0 msgr2=0x7f3bc4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:20.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd5d9b640 1 --2- 172.21.15.161:0/967970938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bc40039b0 0x7f3bc4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.191+0000 7f3bd5d9b640 1 -- 172.21.15.161:0/967970938 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc4003530 con 0x7f3bc40047d0 2024-02-02T11:49:20.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bd5d9b640 1 --2- 172.21.15.161:0/967970938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc40047d0 0x7f3bc4004c50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3bc800c190 tx=0x7f3bc801f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251ed53d02088402 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:20.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bd559a640 1 -- 172.21.15.161:0/967970938 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8005ae0 con 0x7f3bc40047d0 2024-02-02T11:49:20.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bd559a640 1 -- 172.21.15.161:0/967970938 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc80ab070 con 0x7f3bc40047d0 2024-02-02T11:49:20.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bd559a640 1 -- 172.21.15.161:0/967970938 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8007070 con 0x7f3bc40047d0 2024-02-02T11:49:20.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bdcb86640 1 -- 172.21.15.161:0/967970938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc40047d0 msgr2=0x7f3bc4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:20.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bdcb86640 1 --2- 172.21.15.161:0/967970938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc40047d0 0x7f3bc4004c50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3bc800c190 tx=0x7f3bc801f330 comp rx=0 tx=0).stop 2024-02-02T11:49:20.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bd6d9d640 1 -- 172.21.15.161:0/967970938 reap_dead start 2024-02-02T11:49:20.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bdcb86640 1 -- 172.21.15.161:0/967970938 shutdown_connections 2024-02-02T11:49:20.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bdcb86640 1 -- 172.21.15.161:0/967970938 >> 172.21.15.161:0/967970938 conn(0x7f3bd806a120 msgr2=0x7f3bd806a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:20.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bdcb86640 1 -- 172.21.15.161:0/967970938 shutdown_connections 2024-02-02T11:49:20.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bdcb86640 1 -- 172.21.15.161:0/967970938 wait complete. 2024-02-02T11:49:20.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bdcb86640 1 Processor -- start 2024-02-02T11:49:20.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bdcb86640 1 -- start start 2024-02-02T11:49:20.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bdcb86640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc40047d0 0x7f3bd813a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bdcb86640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bd81e3e40 0x7f3bd80baf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bdcb86640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bd8137660 0x7f3bd8137ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bdcb86640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd813a9f0 con 0x7f3bc40047d0 2024-02-02T11:49:20.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bdcb86640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd80ba900 con 0x7f3bd8137660 2024-02-02T11:49:20.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bdcb86640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd8070c80 con 0x7f3bd81e3e40 2024-02-02T11:49:20.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bd659c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc40047d0 0x7f3bd813a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:20.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bd659c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc40047d0 0x7f3bd813a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40712/0 (socket says 172.21.15.161:40712) 2024-02-02T11:49:20.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bd659c640 1 -- 172.21.15.161:0/1990428110 learned_addr learned my addr 172.21.15.161:0/1990428110 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:20.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bd6d9d640 1 --2- 172.21.15.161:0/1990428110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bd8137660 0x7f3bd8137ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:20.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bd5d9b640 1 --2- 172.21.15.161:0/1990428110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bd81e3e40 0x7f3bd80baf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:20.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bd659c640 1 -- 172.21.15.161:0/1990428110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bd81e3e40 msgr2=0x7f3bd80baf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:20.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bd659c640 1 --2- 172.21.15.161:0/1990428110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bd81e3e40 0x7f3bd80baf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bd659c640 1 -- 172.21.15.161:0/1990428110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bd8137660 msgr2=0x7f3bd8137ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:20.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bd659c640 1 --2- 172.21.15.161:0/1990428110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bd8137660 0x7f3bd8137ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bd659c640 1 -- 172.21.15.161:0/1990428110 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd80709a0 con 0x7f3bc40047d0 2024-02-02T11:49:20.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bd5d9b640 1 --2- 172.21.15.161:0/1990428110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bd81e3e40 0x7f3bd80baf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:20.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bd659c640 1 --2- 172.21.15.161:0/1990428110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc40047d0 0x7f3bd813a4b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00115e0 tx=0x7f3bc0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:20.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bceffd640 1 -- 172.21.15.161:0/1990428110 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0015870 con 0x7f3bc40047d0 2024-02-02T11:49:20.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bceffd640 1 -- 172.21.15.161:0/1990428110 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc00159d0 con 0x7f3bc40047d0 2024-02-02T11:49:20.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bdcb86640 1 -- 172.21.15.161:0/1990428110 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd81e3360 con 0x7f3bc40047d0 2024-02-02T11:49:20.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bceffd640 1 -- 172.21.15.161:0/1990428110 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0015d40 con 0x7f3bc40047d0 2024-02-02T11:49:20.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.195+0000 7f3bdcb86640 1 -- 172.21.15.161:0/1990428110 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd81e3920 con 0x7f3bc40047d0 2024-02-02T11:49:20.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.199+0000 7f3bdcb86640 1 -- 172.21.15.161:0/1990428110 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd8067050 con 0x7f3bc40047d0 2024-02-02T11:49:20.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.199+0000 7f3bceffd640 1 -- 172.21.15.161:0/1990428110 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3bc000f480 con 0x7f3bc40047d0 2024-02-02T11:49:20.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.199+0000 7f3bceffd640 1 --2- 172.21.15.161:0/1990428110 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3bb8065a60 0x7f3bb8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.199+0000 7f3bd5d9b640 1 --2- 172.21.15.161:0/1990428110 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3bb8065a60 0x7f3bb8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:20.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.199+0000 7f3bceffd640 1 -- 172.21.15.161:0/1990428110 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bc00835a0 con 0x7f3bc40047d0 2024-02-02T11:49:20.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.199+0000 7f3bd5d9b640 1 --2- 172.21.15.161:0/1990428110 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3bb8065a60 0x7f3bb8067f20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80af000 tx=0x7f3bc80aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:20.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.203+0000 7f3bceffd640 1 -- 172.21.15.161:0/1990428110 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3bc0050ff0 con 0x7f3bc40047d0 2024-02-02T11:49:20.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.355+0000 7f3bdcb86640 1 -- 172.21.15.161:0/1990428110 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3bd804e000 con 0x7f3bc40047d0 2024-02-02T11:49:20.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.355+0000 7f3bceffd640 1 -- 172.21.15.161:0/1990428110 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3bc0054610 con 0x7f3bc40047d0 2024-02-02T11:49:20.359 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2024-02-02T11:49:20.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.359+0000 7f3bdcb86640 1 -- 172.21.15.161:0/1990428110 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3bb8065a60 msgr2=0x7f3bb8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:20.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.359+0000 7f3bdcb86640 1 --2- 172.21.15.161:0/1990428110 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3bb8065a60 0x7f3bb8067f20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80af000 tx=0x7f3bc80aa000 comp rx=0 tx=0).stop 2024-02-02T11:49:20.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.359+0000 7f3bdcb86640 1 -- 172.21.15.161:0/1990428110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc40047d0 msgr2=0x7f3bd813a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:20.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.359+0000 7f3bdcb86640 1 --2- 172.21.15.161:0/1990428110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc40047d0 0x7f3bd813a4b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3bc00115e0 tx=0x7f3bc0011aa0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.359+0000 7f3bdcb86640 1 -- 172.21.15.161:0/1990428110 shutdown_connections 2024-02-02T11:49:20.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.359+0000 7f3bdcb86640 1 --2- 172.21.15.161:0/1990428110 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3bb8065a60 0x7f3bb8067f20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.359+0000 7f3bdcb86640 1 --2- 172.21.15.161:0/1990428110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bd8137660 0x7f3bd8137ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.359+0000 7f3bdcb86640 1 --2- 172.21.15.161:0/1990428110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bd81e3e40 0x7f3bd80baf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.359+0000 7f3bdcb86640 1 --2- 172.21.15.161:0/1990428110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc40047d0 0x7f3bd813a4b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.359+0000 7f3bdcb86640 1 -- 172.21.15.161:0/1990428110 >> 172.21.15.161:0/1990428110 conn(0x7f3bd806a120 msgr2=0x7f3bd8140460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:20.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.359+0000 7f3bdcb86640 1 -- 172.21.15.161:0/1990428110 shutdown_connections 2024-02-02T11:49:20.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.359+0000 7f3bdcb86640 1 -- 172.21.15.161:0/1990428110 wait complete. 2024-02-02T11:49:20.377 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-02T11:49:20.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.479+0000 7f60c7ab9640 1 Processor -- start 2024-02-02T11:49:20.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.479+0000 7f60c7ab9640 1 -- start start 2024-02-02T11:49:20.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.479+0000 7f60c7ab9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f60c00b6880 0x7f60c00ba1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.479+0000 7f60c7ab9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60c00b7b60 0x7f60c01425f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.479+0000 7f60c7ab9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c00b7f80 con 0x7f60c0142b30 2024-02-02T11:49:20.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.479+0000 7f60c7ab9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c00b9b90 con 0x7f60c00b6880 2024-02-02T11:49:20.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.479+0000 7f60c7ab9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c014cbd0 con 0x7f60c00b7b60 2024-02-02T11:49:20.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.479+0000 7f60c5855640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f60c00b6880 0x7f60c00ba1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:20.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.479+0000 7f60c5855640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f60c00b6880 0x7f60c00ba1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40722/0 (socket says 172.21.15.161:40722) 2024-02-02T11:49:20.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.479+0000 7f60c5855640 1 -- 172.21.15.161:0/3328795216 learned_addr learned my addr 172.21.15.161:0/3328795216 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:20.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.479+0000 7f60c5855640 1 -- 172.21.15.161:0/3328795216 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60c00b7b60 msgr2=0x7f60c01425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:20.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.479+0000 7f60c5855640 1 --2- 172.21.15.161:0/3328795216 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60c00b7b60 0x7f60c01425f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.479+0000 7f60c5855640 1 -- 172.21.15.161:0/3328795216 >> v1:172.21.15.162:6789/0 conn(0x7f60c0142b30 legacy=0x7f60c0148760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:20.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.479+0000 7f60c5855640 1 -- 172.21.15.161:0/3328795216 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c014c740 con 0x7f60c00b6880 2024-02-02T11:49:20.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c5855640 1 --2- 172.21.15.161:0/3328795216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60c00b6880 0x7f60c00ba1d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0098a0 tx=0x7f60bc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556e44f59f2aedb1 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:20.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c4853640 1 -- 172.21.15.161:0/3328795216 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0ac640 con 0x7f60c00b6880 2024-02-02T11:49:20.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c4853640 1 -- 172.21.15.161:0/3328795216 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc0ac7a0 con 0x7f60c00b6880 2024-02-02T11:49:20.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c4853640 1 -- 172.21.15.161:0/3328795216 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0acb30 con 0x7f60c00b6880 2024-02-02T11:49:20.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c7ab9640 1 -- 172.21.15.161:0/3328795216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60c00b6880 msgr2=0x7f60c00ba1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:20.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c7ab9640 1 --2- 172.21.15.161:0/3328795216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60c00b6880 0x7f60c00ba1d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0098a0 tx=0x7f60bc01c420 comp rx=0 tx=0).stop 2024-02-02T11:49:20.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c7ab9640 1 -- 172.21.15.161:0/3328795216 shutdown_connections 2024-02-02T11:49:20.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c7ab9640 1 --2- 172.21.15.161:0/3328795216 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60c00b7b60 0x7f60c01425f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c7ab9640 1 --2- 172.21.15.161:0/3328795216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60c00b6880 0x7f60c00ba1d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c7ab9640 1 -- 172.21.15.161:0/3328795216 >> 172.21.15.161:0/3328795216 conn(0x7f60c006ae30 msgr2=0x7f60c006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:20.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c7ab9640 1 -- 172.21.15.161:0/3328795216 shutdown_connections 2024-02-02T11:49:20.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c7ab9640 1 -- 172.21.15.161:0/3328795216 wait complete. 2024-02-02T11:49:20.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c7ab9640 1 Processor -- start 2024-02-02T11:49:20.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c7ab9640 1 -- start start 2024-02-02T11:49:20.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c7ab9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60c00b6880 0x7f60c013fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c7ab9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60c00b7b60 0x7f60c0139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c7ab9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60c0142b30 0x7f60c01e3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c7ab9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c01403e0 con 0x7f60c00b6880 2024-02-02T11:49:20.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c7ab9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c0138540 con 0x7f60c0142b30 2024-02-02T11:49:20.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c7ab9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c0139e80 con 0x7f60c00b7b60 2024-02-02T11:49:20.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c5855640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60c00b6880 0x7f60c013fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:20.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c5855640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60c00b6880 0x7f60c013fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40738/0 (socket says 172.21.15.161:40738) 2024-02-02T11:49:20.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c5855640 1 -- 172.21.15.161:0/2996398284 learned_addr learned my addr 172.21.15.161:0/2996398284 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:20.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c5855640 1 -- 172.21.15.161:0/2996398284 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60c00b7b60 msgr2=0x7f60c0139940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:20.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.483+0000 7f60c5855640 1 --2- 172.21.15.161:0/2996398284 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60c00b7b60 0x7f60c0139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.487+0000 7f60c5855640 1 -- 172.21.15.161:0/2996398284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60c0142b30 msgr2=0x7f60c01e3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:20.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.487+0000 7f60c5855640 1 --2- 172.21.15.161:0/2996398284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60c0142b30 0x7f60c01e3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.487+0000 7f60c5855640 1 -- 172.21.15.161:0/2996398284 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc0094d0 con 0x7f60c00b6880 2024-02-02T11:49:20.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.487+0000 7f60c5855640 1 --2- 172.21.15.161:0/2996398284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60c00b6880 0x7f60c013fea0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f60bc01aad0 tx=0x7f60bc01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:20.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.487+0000 7f60b67fc640 1 -- 172.21.15.161:0/2996398284 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0b7830 con 0x7f60c00b6880 2024-02-02T11:49:20.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.487+0000 7f60b67fc640 1 -- 172.21.15.161:0/2996398284 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc0b7990 con 0x7f60c00b6880 2024-02-02T11:49:20.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.487+0000 7f60c7ab9640 1 -- 172.21.15.161:0/2996398284 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c013af40 con 0x7f60c00b6880 2024-02-02T11:49:20.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.487+0000 7f60b67fc640 1 -- 172.21.15.161:0/2996398284 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0b7d40 con 0x7f60c00b6880 2024-02-02T11:49:20.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.487+0000 7f60c7ab9640 1 -- 172.21.15.161:0/2996398284 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c0138a70 con 0x7f60c00b6880 2024-02-02T11:49:20.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.487+0000 7f60c7ab9640 1 -- 172.21.15.161:0/2996398284 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c0138c60 con 0x7f60c00b6880 2024-02-02T11:49:20.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.487+0000 7f60b67fc640 1 -- 172.21.15.161:0/2996398284 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f60bc0b3040 con 0x7f60c00b6880 2024-02-02T11:49:20.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.487+0000 7f60b67fc640 1 --2- 172.21.15.161:0/2996398284 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f60a4065a60 0x7f60a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.487+0000 7f60b67fc640 1 -- 172.21.15.161:0/2996398284 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60bc11d7c0 con 0x7f60c00b6880 2024-02-02T11:49:20.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.487+0000 7f60c5054640 1 --2- 172.21.15.161:0/2996398284 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f60a4065a60 0x7f60a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:20.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.487+0000 7f60c5054640 1 --2- 172.21.15.161:0/2996398284 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f60a4065a60 0x7f60a4067f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f60c01407d0 tx=0x7f60b0006ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:20.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.491+0000 7f60b67fc640 1 -- 172.21.15.161:0/2996398284 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f60bc0eb230 con 0x7f60c00b6880 2024-02-02T11:49:20.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.663+0000 7f60c7ab9640 1 -- 172.21.15.161:0/2996398284 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60c004e000 con 0x7f60c00b6880 2024-02-02T11:49:20.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.663+0000 7f60b67fc640 1 -- 172.21.15.161:0/2996398284 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3953 (secure 0 0 0) 0x7f60bc0ee850 con 0x7f60c00b6880 2024-02-02T11:49:20.668 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:20.668 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3677988163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3677988163},{"type":"v1","addr":"172.21.15.162:6833","nonce":3677988163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/456037269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":456037269},{"type":"v1","addr":"172.21.15.161:6835","nonce":456037269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-02T11:48:51.812809+0000","modified":"2024-02-02T11:48:54.494091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/2509813318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":2509813318},{"type":"v1","addr":"172.21.15.161:6837","nonce":2509813318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-02T11:49:20.668 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 7 2024-02-02T11:49:20.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.667+0000 7f60c7ab9640 1 -- 172.21.15.161:0/2996398284 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f60a4065a60 msgr2=0x7f60a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:20.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.667+0000 7f60c7ab9640 1 --2- 172.21.15.161:0/2996398284 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f60a4065a60 0x7f60a4067f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f60c01407d0 tx=0x7f60b0006ca0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.667+0000 7f60c7ab9640 1 -- 172.21.15.161:0/2996398284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60c00b6880 msgr2=0x7f60c013fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:20.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.667+0000 7f60c7ab9640 1 --2- 172.21.15.161:0/2996398284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60c00b6880 0x7f60c013fea0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f60bc01aad0 tx=0x7f60bc01ac60 comp rx=0 tx=0).stop 2024-02-02T11:49:20.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.667+0000 7f60c7ab9640 1 -- 172.21.15.161:0/2996398284 shutdown_connections 2024-02-02T11:49:20.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.667+0000 7f60c7ab9640 1 --2- 172.21.15.161:0/2996398284 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f60a4065a60 0x7f60a4067f20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.667+0000 7f60c7ab9640 1 --2- 172.21.15.161:0/2996398284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60c0142b30 0x7f60c01e3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.667+0000 7f60c7ab9640 1 --2- 172.21.15.161:0/2996398284 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60c00b7b60 0x7f60c0139940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.667+0000 7f60c7ab9640 1 --2- 172.21.15.161:0/2996398284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60c00b6880 0x7f60c013fea0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.667+0000 7f60c7ab9640 1 -- 172.21.15.161:0/2996398284 >> 172.21.15.161:0/2996398284 conn(0x7f60c006ae30 msgr2=0x7f60c0149ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:20.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.667+0000 7f60c7ab9640 1 -- 172.21.15.161:0/2996398284 shutdown_connections 2024-02-02T11:49:20.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.667+0000 7f60c7ab9640 1 -- 172.21.15.161:0/2996398284 wait complete. 2024-02-02T11:49:20.685 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:49:20.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.787+0000 7ff06f43b640 1 Processor -- start 2024-02-02T11:49:20.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.787+0000 7ff06f43b640 1 -- start start 2024-02-02T11:49:20.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.787+0000 7ff06f43b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0680bc340 0x7ff0681415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.787+0000 7ff06f43b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff068141b30 0x7ff068147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.787+0000 7ff06f43b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff068071550 con 0x7ff0680b8020 2024-02-02T11:49:20.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.787+0000 7ff06f43b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff068071810 con 0x7ff0680bc340 2024-02-02T11:49:20.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.787+0000 7ff06f43b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff068071950 con 0x7ff068141b30 2024-02-02T11:49:20.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.787+0000 7ff06d1d7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0680bc340 0x7ff0681415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:20.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.787+0000 7ff06d1d7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0680bc340 0x7ff0681415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40754/0 (socket says 172.21.15.161:40754) 2024-02-02T11:49:20.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.787+0000 7ff06d1d7640 1 -- 172.21.15.161:0/101233313 learned_addr learned my addr 172.21.15.161:0/101233313 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:20.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.787+0000 7ff06c9d6640 1 --2- 172.21.15.161:0/101233313 >> v2:172.21.15.162:3300/0 conn(0x7ff068141b30 0x7ff068147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:20.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.787+0000 7ff06d1d7640 1 -- 172.21.15.161:0/101233313 >> v2:172.21.15.162:3300/0 conn(0x7ff068141b30 msgr2=0x7ff068147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:20.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.787+0000 7ff06d1d7640 1 --2- 172.21.15.161:0/101233313 >> v2:172.21.15.162:3300/0 conn(0x7ff068141b30 0x7ff068147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.787+0000 7ff06d1d7640 1 -- 172.21.15.161:0/101233313 >> v1:172.21.15.162:6789/0 conn(0x7ff0680b8020 legacy=0x7ff06814abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:20.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.787+0000 7ff06d1d7640 1 -- 172.21.15.161:0/101233313 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0680bc720 con 0x7ff0680bc340 2024-02-02T11:49:20.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.787+0000 7ff06c9d6640 1 --2- 172.21.15.161:0/101233313 >> v2:172.21.15.162:3300/0 conn(0x7ff068141b30 0x7ff068147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:20.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.791+0000 7ff06d1d7640 1 --2- 172.21.15.161:0/101233313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0680bc340 0x7ff0681415f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff06806b260 tx=0x7ff05c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe1aa5b496be574 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:20.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.791+0000 7ff05bfff640 1 -- 172.21.15.161:0/101233313 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c0ab600 con 0x7ff0680bc340 2024-02-02T11:49:20.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.791+0000 7ff05bfff640 1 -- 172.21.15.161:0/101233313 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05c0a7050 con 0x7ff0680bc340 2024-02-02T11:49:20.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.791+0000 7ff05bfff640 1 -- 172.21.15.161:0/101233313 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c0ab980 con 0x7ff0680bc340 2024-02-02T11:49:20.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.791+0000 7ff06f43b640 1 -- 172.21.15.161:0/101233313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0680bc340 msgr2=0x7ff0681415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:20.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.791+0000 7ff06f43b640 1 --2- 172.21.15.161:0/101233313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0680bc340 0x7ff0681415f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff06806b260 tx=0x7ff05c01c430 comp rx=0 tx=0).stop 2024-02-02T11:49:20.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.791+0000 7ff06f43b640 1 -- 172.21.15.161:0/101233313 shutdown_connections 2024-02-02T11:49:20.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.791+0000 7ff06f43b640 1 --2- 172.21.15.161:0/101233313 >> v2:172.21.15.162:3300/0 conn(0x7ff068141b30 0x7ff068147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.791+0000 7ff06f43b640 1 --2- 172.21.15.161:0/101233313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0680bc340 0x7ff0681415f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.791+0000 7ff06f43b640 1 -- 172.21.15.161:0/101233313 >> 172.21.15.161:0/101233313 conn(0x7ff068069ef0 msgr2=0x7ff06806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:20.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.791+0000 7ff06f43b640 1 -- 172.21.15.161:0/101233313 shutdown_connections 2024-02-02T11:49:20.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.791+0000 7ff06f43b640 1 -- 172.21.15.161:0/101233313 wait complete. 2024-02-02T11:49:20.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.791+0000 7ff06f43b640 1 Processor -- start 2024-02-02T11:49:20.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.791+0000 7ff06f43b640 1 -- start start 2024-02-02T11:49:20.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06f43b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0680b8020 0x7ff0681426e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06f43b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0680bc340 0x7ff0681e4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06f43b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff068141b30 0x7ff0681e4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06f43b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff068142c20 con 0x7ff0680b8020 2024-02-02T11:49:20.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06f43b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0680bafe0 con 0x7ff068141b30 2024-02-02T11:49:20.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06f43b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0681440d0 con 0x7ff0680bc340 2024-02-02T11:49:20.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06d1d7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0680b8020 0x7ff0681426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:20.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06d1d7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0680b8020 0x7ff0681426e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40758/0 (socket says 172.21.15.161:40758) 2024-02-02T11:49:20.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06d1d7640 1 -- 172.21.15.161:0/1234856788 learned_addr learned my addr 172.21.15.161:0/1234856788 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:20.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06c9d6640 1 --2- 172.21.15.161:0/1234856788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0680bc340 0x7ff0681e4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:20.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06d1d7640 1 -- 172.21.15.161:0/1234856788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0680bc340 msgr2=0x7ff0681e4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:20.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06d1d7640 1 --2- 172.21.15.161:0/1234856788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0680bc340 0x7ff0681e4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06d9d8640 1 --2- 172.21.15.161:0/1234856788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff068141b30 0x7ff0681e4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:20.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06d1d7640 1 -- 172.21.15.161:0/1234856788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff068141b30 msgr2=0x7ff0681e4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:20.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06d1d7640 1 --2- 172.21.15.161:0/1234856788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff068141b30 0x7ff0681e4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06d1d7640 1 -- 172.21.15.161:0/1234856788 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c0094d0 con 0x7ff0680b8020 2024-02-02T11:49:20.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06d1d7640 1 --2- 172.21.15.161:0/1234856788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0680b8020 0x7ff0681426e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff05c01aae0 tx=0x7ff05c0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:20.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff059ffb640 1 -- 172.21.15.161:0/1234856788 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c0b5810 con 0x7ff0680b8020 2024-02-02T11:49:20.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff059ffb640 1 -- 172.21.15.161:0/1234856788 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0681485b0 con 0x7ff0680b8020 2024-02-02T11:49:20.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06f43b640 1 -- 172.21.15.161:0/1234856788 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff068142e80 con 0x7ff0680b8020 2024-02-02T11:49:20.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff059ffb640 1 -- 172.21.15.161:0/1234856788 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c0b5bd0 con 0x7ff0680b8020 2024-02-02T11:49:20.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06f43b640 1 -- 172.21.15.161:0/1234856788 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0680bb560 con 0x7ff0680b8020 2024-02-02T11:49:20.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06f43b640 1 -- 172.21.15.161:0/1234856788 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06804e000 con 0x7ff0680b8020 2024-02-02T11:49:20.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff059ffb640 1 -- 172.21.15.161:0/1234856788 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff05c0b5d30 con 0x7ff0680b8020 2024-02-02T11:49:20.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff059ffb640 1 --2- 172.21.15.161:0/1234856788 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff04c065a60 0x7ff04c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:20.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff059ffb640 1 -- 172.21.15.161:0/1234856788 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff05c11d7c0 con 0x7ff0680b8020 2024-02-02T11:49:20.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06c9d6640 1 --2- 172.21.15.161:0/1234856788 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff04c065a60 0x7ff04c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:20.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.795+0000 7ff06c9d6640 1 --2- 172.21.15.161:0/1234856788 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff04c065a60 0x7ff04c067f20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff064006fd0 tx=0x7ff064008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:20.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.799+0000 7ff059ffb640 1 -- 172.21.15.161:0/1234856788 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff05c0eb330 con 0x7ff0680b8020 2024-02-02T11:49:20.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.955+0000 7ff06f43b640 1 -- 172.21.15.161:0/1234856788 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0680b77d0 con 0x7ff0680b8020 2024-02-02T11:49:20.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.955+0000 7ff059ffb640 1 -- 172.21.15.161:0/1234856788 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7ff05c0ee950 con 0x7ff0680b8020 2024-02-02T11:49:20.959 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:20.959 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":20,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:52.816101+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:48:50.155565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-02T11:48:50.795158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:49:20.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.959+0000 7ff06f43b640 1 -- 172.21.15.161:0/1234856788 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff04c065a60 msgr2=0x7ff04c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:20.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.959+0000 7ff06f43b640 1 --2- 172.21.15.161:0/1234856788 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff04c065a60 0x7ff04c067f20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff064006fd0 tx=0x7ff064008040 comp rx=0 tx=0).stop 2024-02-02T11:49:20.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.959+0000 7ff06f43b640 1 -- 172.21.15.161:0/1234856788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0680b8020 msgr2=0x7ff0681426e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:20.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.959+0000 7ff06f43b640 1 --2- 172.21.15.161:0/1234856788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0680b8020 0x7ff0681426e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff05c01aae0 tx=0x7ff05c0191d0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.959+0000 7ff06f43b640 1 -- 172.21.15.161:0/1234856788 shutdown_connections 2024-02-02T11:49:20.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.959+0000 7ff06f43b640 1 --2- 172.21.15.161:0/1234856788 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff04c065a60 0x7ff04c067f20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.959+0000 7ff06f43b640 1 --2- 172.21.15.161:0/1234856788 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff068141b30 0x7ff0681e4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.959+0000 7ff06f43b640 1 --2- 172.21.15.161:0/1234856788 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0680bc340 0x7ff0681e4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.959+0000 7ff06f43b640 1 --2- 172.21.15.161:0/1234856788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0680b8020 0x7ff0681426e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:20.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.959+0000 7ff06f43b640 1 -- 172.21.15.161:0/1234856788 >> 172.21.15.161:0/1234856788 conn(0x7ff068069ef0 msgr2=0x7ff06813fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:20.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.959+0000 7ff06f43b640 1 -- 172.21.15.161:0/1234856788 shutdown_connections 2024-02-02T11:49:20.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:20.959+0000 7ff06f43b640 1 -- 172.21.15.161:0/1234856788 wait complete. 2024-02-02T11:49:20.977 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-02T11:49:20.977 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-02T11:49:21.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.095+0000 7f237c1ca640 1 Processor -- start 2024-02-02T11:49:21.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.095+0000 7f237c1ca640 1 -- start start 2024-02-02T11:49:21.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.095+0000 7f237c1ca640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f23740708d0 0x7f2374070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.095+0000 7f237c1ca640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2374071a20 0x7f2374147210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.095+0000 7f237c1ca640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23740b2c80 con 0x7f237406eca0 2024-02-02T11:49:21.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.095+0000 7f237c1ca640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237406fdb0 con 0x7f23740708d0 2024-02-02T11:49:21.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.095+0000 7f237c1ca640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2374070370 con 0x7f2374071a20 2024-02-02T11:49:21.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.095+0000 7f2379f66640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f23740708d0 0x7f2374070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.095+0000 7f2379f66640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f23740708d0 0x7f2374070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40774/0 (socket says 172.21.15.161:40774) 2024-02-02T11:49:21.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.095+0000 7f2379f66640 1 -- 172.21.15.161:0/3997061527 learned_addr learned my addr 172.21.15.161:0/3997061527 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:21.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.095+0000 7f2379765640 1 --2- 172.21.15.161:0/3997061527 >> v2:172.21.15.162:3300/0 conn(0x7f2374071a20 0x7f2374147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.095+0000 7f2379f66640 1 -- 172.21.15.161:0/3997061527 >> v2:172.21.15.162:3300/0 conn(0x7f2374071a20 msgr2=0x7f2374147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:21.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.095+0000 7f2379f66640 1 --2- 172.21.15.161:0/3997061527 >> v2:172.21.15.162:3300/0 conn(0x7f2374071a20 0x7f2374147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.095+0000 7f2379f66640 1 -- 172.21.15.161:0/3997061527 >> v1:172.21.15.162:6789/0 conn(0x7f237406eca0 legacy=0x7f23741440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:21.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.095+0000 7f2379f66640 1 -- 172.21.15.161:0/3997061527 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23740b2ed0 con 0x7f23740708d0 2024-02-02T11:49:21.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f2379f66640 1 --2- 172.21.15.161:0/3997061527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23740708d0 0x7f2374070cb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f237406d230 tx=0x7f237001e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6e293f2af4d251 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:21.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f2378f64640 1 -- 172.21.15.161:0/3997061527 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370004230 con 0x7f23740708d0 2024-02-02T11:49:21.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f2378f64640 1 -- 172.21.15.161:0/3997061527 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23700ab070 con 0x7f23740708d0 2024-02-02T11:49:21.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f2378f64640 1 -- 172.21.15.161:0/3997061527 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23700a7760 con 0x7f23740708d0 2024-02-02T11:49:21.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f237c1ca640 1 -- 172.21.15.161:0/3997061527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23740708d0 msgr2=0x7f2374070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:21.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f237c1ca640 1 --2- 172.21.15.161:0/3997061527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23740708d0 0x7f2374070cb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f237406d230 tx=0x7f237001e980 comp rx=0 tx=0).stop 2024-02-02T11:49:21.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f237c1ca640 1 -- 172.21.15.161:0/3997061527 shutdown_connections 2024-02-02T11:49:21.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f237c1ca640 1 --2- 172.21.15.161:0/3997061527 >> v2:172.21.15.162:3300/0 conn(0x7f2374071a20 0x7f2374147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f237c1ca640 1 --2- 172.21.15.161:0/3997061527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23740708d0 0x7f2374070cb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f237c1ca640 1 -- 172.21.15.161:0/3997061527 >> 172.21.15.161:0/3997061527 conn(0x7f2374069ef0 msgr2=0x7f237406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:21.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f237c1ca640 1 -- 172.21.15.161:0/3997061527 shutdown_connections 2024-02-02T11:49:21.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f237c1ca640 1 -- 172.21.15.161:0/3997061527 wait complete. 2024-02-02T11:49:21.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f237c1ca640 1 Processor -- start 2024-02-02T11:49:21.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f237c1ca640 1 -- start start 2024-02-02T11:49:21.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f237c1ca640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f237406eca0 0x7f237413d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f237c1ca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23740708d0 0x7f23741df080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f237c1ca640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2374071a20 0x7f2374142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f237c1ca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23741e2580 con 0x7f23740708d0 2024-02-02T11:49:21.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f237c1ca640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237413d5e0 con 0x7f237406eca0 2024-02-02T11:49:21.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f237c1ca640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23741e27d0 con 0x7f2374071a20 2024-02-02T11:49:21.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f2379765640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23740708d0 0x7f23741df080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f2379765640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23740708d0 0x7f23741df080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40788/0 (socket says 172.21.15.161:40788) 2024-02-02T11:49:21.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f2379765640 1 -- 172.21.15.161:0/3453425734 learned_addr learned my addr 172.21.15.161:0/3453425734 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:21.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f2379f66640 1 --2- 172.21.15.161:0/3453425734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f237406eca0 0x7f237413d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f2379765640 1 -- 172.21.15.161:0/3453425734 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2374071a20 msgr2=0x7f2374142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:21.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.099+0000 7f237a767640 1 --2- 172.21.15.161:0/3453425734 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2374071a20 0x7f2374142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.103+0000 7f2379765640 1 --2- 172.21.15.161:0/3453425734 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2374071a20 0x7f2374142810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.103+0000 7f2379765640 1 -- 172.21.15.161:0/3453425734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f237406eca0 msgr2=0x7f237413d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:21.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.103+0000 7f2379765640 1 --2- 172.21.15.161:0/3453425734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f237406eca0 0x7f237413d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.103+0000 7f2379765640 1 -- 172.21.15.161:0/3453425734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237000b780 con 0x7f23740708d0 2024-02-02T11:49:21.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.103+0000 7f2379765640 1 --2- 172.21.15.161:0/3453425734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23740708d0 0x7f23741df080 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f236400d620 tx=0x7f236400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:21.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.103+0000 7f236a7fc640 1 -- 172.21.15.161:0/3453425734 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236400b620 con 0x7f23740708d0 2024-02-02T11:49:21.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.103+0000 7f236a7fc640 1 -- 172.21.15.161:0/3453425734 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236400b780 con 0x7f23740708d0 2024-02-02T11:49:21.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.103+0000 7f237c1ca640 1 -- 172.21.15.161:0/3453425734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23741e2ab0 con 0x7f23740708d0 2024-02-02T11:49:21.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.103+0000 7f236a7fc640 1 -- 172.21.15.161:0/3453425734 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236400bb10 con 0x7f23740708d0 2024-02-02T11:49:21.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.103+0000 7f237c1ca640 1 -- 172.21.15.161:0/3453425734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23741df5c0 con 0x7f23740708d0 2024-02-02T11:49:21.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.103+0000 7f237c1ca640 1 -- 172.21.15.161:0/3453425734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f237404e000 con 0x7f23740708d0 2024-02-02T11:49:21.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.103+0000 7f236a7fc640 1 -- 172.21.15.161:0/3453425734 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f236400bc70 con 0x7f23740708d0 2024-02-02T11:49:21.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.103+0000 7f236a7fc640 1 --2- 172.21.15.161:0/3453425734 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2358065a60 0x7f2358067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.103+0000 7f2379f66640 1 --2- 172.21.15.161:0/3453425734 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2358065a60 0x7f2358067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.103+0000 7f236a7fc640 1 -- 172.21.15.161:0/3453425734 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2364083680 con 0x7f23740708d0 2024-02-02T11:49:21.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.103+0000 7f2379f66640 1 --2- 172.21.15.161:0/3453425734 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2358065a60 0x7f2358067f20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f23700b1000 tx=0x7f23700a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:21.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.107+0000 7f236a7fc640 1 -- 172.21.15.161:0/3453425734 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2364051040 con 0x7f23740708d0 2024-02-02T11:49:21.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.279+0000 7f237c1ca640 1 -- 172.21.15.161:0/3453425734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f237406fa90 con 0x7f23740708d0 2024-02-02T11:49:21.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.279+0000 7f236a7fc640 1 -- 172.21.15.161:0/3453425734 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3953 (secure 0 0 0) 0x7f2364007380 con 0x7f23740708d0 2024-02-02T11:49:21.284 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:21.284 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3677988163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3677988163},{"type":"v1","addr":"172.21.15.162:6833","nonce":3677988163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/456037269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":456037269},{"type":"v1","addr":"172.21.15.161:6835","nonce":456037269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-02T11:48:51.812809+0000","modified":"2024-02-02T11:48:54.494091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/2509813318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":2509813318},{"type":"v1","addr":"172.21.15.161:6837","nonce":2509813318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-02T11:49:21.285 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 7 2024-02-02T11:49:21.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.283+0000 7f237c1ca640 1 -- 172.21.15.161:0/3453425734 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2358065a60 msgr2=0x7f2358067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:21.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.283+0000 7f237c1ca640 1 --2- 172.21.15.161:0/3453425734 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2358065a60 0x7f2358067f20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f23700b1000 tx=0x7f23700a9070 comp rx=0 tx=0).stop 2024-02-02T11:49:21.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.283+0000 7f237c1ca640 1 -- 172.21.15.161:0/3453425734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23740708d0 msgr2=0x7f23741df080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:21.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.283+0000 7f237c1ca640 1 --2- 172.21.15.161:0/3453425734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23740708d0 0x7f23741df080 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f236400d620 tx=0x7f236400dae0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.283+0000 7f237c1ca640 1 -- 172.21.15.161:0/3453425734 shutdown_connections 2024-02-02T11:49:21.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.283+0000 7f237c1ca640 1 --2- 172.21.15.161:0/3453425734 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2358065a60 0x7f2358067f20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.283+0000 7f237c1ca640 1 --2- 172.21.15.161:0/3453425734 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2374071a20 0x7f2374142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.283+0000 7f237c1ca640 1 --2- 172.21.15.161:0/3453425734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23740708d0 0x7f23741df080 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.283+0000 7f237c1ca640 1 --2- 172.21.15.161:0/3453425734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f237406eca0 0x7f237413d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.283+0000 7f237c1ca640 1 -- 172.21.15.161:0/3453425734 >> 172.21.15.161:0/3453425734 conn(0x7f2374069ef0 msgr2=0x7f2374143ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:21.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.283+0000 7f237c1ca640 1 -- 172.21.15.161:0/3453425734 shutdown_connections 2024-02-02T11:49:21.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.283+0000 7f237c1ca640 1 -- 172.21.15.161:0/3453425734 wait complete. 2024-02-02T11:49:21.301 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-02T11:49:21.357 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:49:21.359 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:49:21.361 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:49:21.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.411+0000 7f7d53796640 1 Processor -- start 2024-02-02T11:49:21.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.411+0000 7f7d53796640 1 -- start start 2024-02-02T11:49:21.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d53796640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7d4c0b8ce0 0x7f7d4c0717c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d53796640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c071350 con 0x7f7d4c06aaa0 2024-02-02T11:49:21.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d53796640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c06fe30 con 0x7f7d4c0b8820 2024-02-02T11:49:21.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d53796640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c06f590 con 0x7f7d4c0b8ce0 2024-02-02T11:49:21.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d51532640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7d4c06aaa0 0x7f7d4c1426c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59072/0 (socket says 172.21.15.161:59072) 2024-02-02T11:49:21.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d51532640 1 -- 172.21.15.161:0/1696211700 learned_addr learned my addr 172.21.15.161:0/1696211700 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:21.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d43fff640 1 -- 172.21.15.161:0/1696211700 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382423871 0 0) 0x7f7d4c071350 con 0x7f7d4c06aaa0 2024-02-02T11:49:21.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d50d31640 1 --2- 172.21.15.161:0/1696211700 >> v2:172.21.15.162:3300/0 conn(0x7f7d4c0b8ce0 0x7f7d4c0717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d43fff640 1 -- 172.21.15.161:0/1696211700 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d38003530 con 0x7f7d4c06aaa0 2024-02-02T11:49:21.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d43fff640 1 -- 172.21.15.161:0/1696211700 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3761292919 0 0) 0x7f7d38003530 con 0x7f7d4c06aaa0 2024-02-02T11:49:21.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d43fff640 1 -- 172.21.15.161:0/1696211700 >> v2:172.21.15.162:3300/0 conn(0x7f7d4c0b8ce0 msgr2=0x7f7d4c0717c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:21.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d43fff640 1 --2- 172.21.15.161:0/1696211700 >> v2:172.21.15.162:3300/0 conn(0x7f7d4c0b8ce0 0x7f7d4c0717c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d43fff640 1 -- 172.21.15.161:0/1696211700 >> v1:172.21.15.162:6789/0 conn(0x7f7d4c0b8820 legacy=0x7f7d4c153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:21.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d43fff640 1 -- 172.21.15.161:0/1696211700 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c06f870 con 0x7f7d4c06aaa0 2024-02-02T11:49:21.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d43fff640 1 -- 172.21.15.161:0/1696211700 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f7d48001680 con 0x7f7d4c06aaa0 2024-02-02T11:49:21.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d43fff640 1 -- 172.21.15.161:0/1696211700 >> v1:172.21.15.161:6789/0 conn(0x7f7d4c06aaa0 legacy=0x7f7d4c1426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:21.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d43fff640 1 --2- 172.21.15.161:0/1696211700 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d38003980 0x7f7d38003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d43fff640 1 --2- 172.21.15.161:0/1696211700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d380047d0 0x7f7d38004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d43fff640 1 --2- 172.21.15.161:0/1696211700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d38005190 0x7f7d3800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d43fff640 1 -- 172.21.15.161:0/1696211700 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c06f590 con 0x7f7d38003980 2024-02-02T11:49:21.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d43fff640 1 -- 172.21.15.161:0/1696211700 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3800c040 con 0x7f7d380047d0 2024-02-02T11:49:21.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d43fff640 1 -- 172.21.15.161:0/1696211700 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3800c200 con 0x7f7d38005190 2024-02-02T11:49:21.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d51532640 1 --2- 172.21.15.161:0/1696211700 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d38003980 0x7f7d38003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d50d31640 1 --2- 172.21.15.161:0/1696211700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d380047d0 0x7f7d38004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d51532640 1 -- 172.21.15.161:0/1696211700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d38005190 msgr2=0x7f7d3800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:21.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d51532640 1 --2- 172.21.15.161:0/1696211700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d38005190 0x7f7d3800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d51532640 1 -- 172.21.15.161:0/1696211700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d380047d0 msgr2=0x7f7d38004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:21.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d51532640 1 --2- 172.21.15.161:0/1696211700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d380047d0 0x7f7d38004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d51532640 1 -- 172.21.15.161:0/1696211700 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d38003530 con 0x7f7d38003980 2024-02-02T11:49:21.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d51d33640 1 -- 172.21.15.161:0/1696211700 reap_dead start 2024-02-02T11:49:21.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d50d31640 1 --2- 172.21.15.161:0/1696211700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d380047d0 0x7f7d38004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:49:21.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d51532640 1 --2- 172.21.15.161:0/1696211700 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d38003980 0x7f7d38003da0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800c240 tx=0x7f7d4801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253bbe2155908207 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:21.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d43fff640 1 -- 172.21.15.161:0/1696211700 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48005ae0 con 0x7f7d38003980 2024-02-02T11:49:21.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d43fff640 1 -- 172.21.15.161:0/1696211700 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d480ab070 con 0x7f7d38003980 2024-02-02T11:49:21.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.415+0000 7f7d43fff640 1 -- 172.21.15.161:0/1696211700 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48005ea0 con 0x7f7d38003980 2024-02-02T11:49:21.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d53796640 1 -- 172.21.15.161:0/1696211700 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d38003980 msgr2=0x7f7d38003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:21.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d53796640 1 --2- 172.21.15.161:0/1696211700 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d38003980 0x7f7d38003da0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800c240 tx=0x7f7d4801f3b0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d53796640 1 -- 172.21.15.161:0/1696211700 shutdown_connections 2024-02-02T11:49:21.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d53796640 1 --2- 172.21.15.161:0/1696211700 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d38003980 0x7f7d38003da0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d53796640 1 -- 172.21.15.161:0/1696211700 >> 172.21.15.161:0/1696211700 conn(0x7f7d4c069d20 msgr2=0x7f7d4c06a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:21.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d53796640 1 -- 172.21.15.161:0/1696211700 shutdown_connections 2024-02-02T11:49:21.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d53796640 1 -- 172.21.15.161:0/1696211700 wait complete. 2024-02-02T11:49:21.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d53796640 1 Processor -- start 2024-02-02T11:49:21.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d53796640 1 -- start start 2024-02-02T11:49:21.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d53796640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d38003980 0x7f7d4c13dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d53796640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d4c144510 0x7f7d4c144970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d53796640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d4c1e16d0 0x7f7d4c1e1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d53796640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c136160 con 0x7f7d4c1e16d0 2024-02-02T11:49:21.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d53796640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c135a40 con 0x7f7d4c144510 2024-02-02T11:49:21.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d53796640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c13e120 con 0x7f7d38003980 2024-02-02T11:49:21.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d51d33640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d4c1e16d0 0x7f7d4c1e1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d51d33640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d4c1e16d0 0x7f7d4c1e1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40802/0 (socket says 172.21.15.161:40802) 2024-02-02T11:49:21.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d51d33640 1 -- 172.21.15.161:0/1145536119 learned_addr learned my addr 172.21.15.161:0/1145536119 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:21.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d50d31640 1 --2- 172.21.15.161:0/1145536119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d4c144510 0x7f7d4c144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d51532640 1 --2- 172.21.15.161:0/1145536119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d38003980 0x7f7d4c13dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d51d33640 1 -- 172.21.15.161:0/1145536119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d38003980 msgr2=0x7f7d4c13dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:21.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d51d33640 1 --2- 172.21.15.161:0/1145536119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d38003980 0x7f7d4c13dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d51d33640 1 -- 172.21.15.161:0/1145536119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d4c144510 msgr2=0x7f7d4c144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:21.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d51d33640 1 --2- 172.21.15.161:0/1145536119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d4c144510 0x7f7d4c144970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d51d33640 1 -- 172.21.15.161:0/1145536119 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c145be0 con 0x7f7d4c1e16d0 2024-02-02T11:49:21.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d51d33640 1 --2- 172.21.15.161:0/1145536119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d4c1e16d0 0x7f7d4c1e1b50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c149940 tx=0x7f7d4400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:21.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d41ffb640 1 -- 172.21.15.161:0/1145536119 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44005d50 con 0x7f7d4c1e16d0 2024-02-02T11:49:21.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d41ffb640 1 -- 172.21.15.161:0/1145536119 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4400ced0 con 0x7f7d4c1e16d0 2024-02-02T11:49:21.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d53796640 1 -- 172.21.15.161:0/1145536119 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c145ec0 con 0x7f7d4c1e16d0 2024-02-02T11:49:21.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d41ffb640 1 -- 172.21.15.161:0/1145536119 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400a850 con 0x7f7d4c1e16d0 2024-02-02T11:49:21.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d53796640 1 -- 172.21.15.161:0/1145536119 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c136ef0 con 0x7f7d4c1e16d0 2024-02-02T11:49:21.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d53796640 1 -- 172.21.15.161:0/1145536119 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c04e000 con 0x7f7d4c1e16d0 2024-02-02T11:49:21.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.419+0000 7f7d41ffb640 1 -- 172.21.15.161:0/1145536119 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7d4400a9b0 con 0x7f7d4c1e16d0 2024-02-02T11:49:21.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.423+0000 7f7d41ffb640 1 --2- 172.21.15.161:0/1145536119 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7d30065a90 0x7f7d30067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.423+0000 7f7d41ffb640 1 -- 172.21.15.161:0/1145536119 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d440825a0 con 0x7f7d4c1e16d0 2024-02-02T11:49:21.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.423+0000 7f7d51532640 1 --2- 172.21.15.161:0/1145536119 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7d30065a90 0x7f7d30067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.423+0000 7f7d51532640 1 --2- 172.21.15.161:0/1145536119 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7d30065a90 0x7f7d30067f50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7d480af000 tx=0x7f7d480aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:21.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.427+0000 7f7d41ffb640 1 -- 172.21.15.161:0/1145536119 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7d4404ffb0 con 0x7f7d4c1e16d0 2024-02-02T11:49:21.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.599+0000 7f7d53796640 1 -- 172.21.15.161:0/1145536119 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d4c146200 con 0x7f7d4c1e16d0 2024-02-02T11:49:21.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.599+0000 7f7d41ffb640 1 -- 172.21.15.161:0/1145536119 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3953 (secure 0 0 0) 0x7f7d440535d0 con 0x7f7d4c1e16d0 2024-02-02T11:49:21.604 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:21.604 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3677988163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3677988163},{"type":"v1","addr":"172.21.15.162:6833","nonce":3677988163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/456037269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":456037269},{"type":"v1","addr":"172.21.15.161:6835","nonce":456037269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-02T11:48:51.812809+0000","modified":"2024-02-02T11:48:54.494091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/2509813318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":2509813318},{"type":"v1","addr":"172.21.15.161:6837","nonce":2509813318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-02T11:49:21.604 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 7 2024-02-02T11:49:21.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.603+0000 7f7d53796640 1 -- 172.21.15.161:0/1145536119 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7d30065a90 msgr2=0x7f7d30067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:21.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.603+0000 7f7d53796640 1 --2- 172.21.15.161:0/1145536119 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7d30065a90 0x7f7d30067f50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7d480af000 tx=0x7f7d480aa000 comp rx=0 tx=0).stop 2024-02-02T11:49:21.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.603+0000 7f7d53796640 1 -- 172.21.15.161:0/1145536119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d4c1e16d0 msgr2=0x7f7d4c1e1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:21.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.603+0000 7f7d53796640 1 --2- 172.21.15.161:0/1145536119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d4c1e16d0 0x7f7d4c1e1b50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c149940 tx=0x7f7d4400cb90 comp rx=0 tx=0).stop 2024-02-02T11:49:21.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.603+0000 7f7d53796640 1 -- 172.21.15.161:0/1145536119 shutdown_connections 2024-02-02T11:49:21.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.603+0000 7f7d53796640 1 --2- 172.21.15.161:0/1145536119 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7d30065a90 0x7f7d30067f50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.603+0000 7f7d53796640 1 --2- 172.21.15.161:0/1145536119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d4c1e16d0 0x7f7d4c1e1b50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.603+0000 7f7d53796640 1 --2- 172.21.15.161:0/1145536119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d4c144510 0x7f7d4c144970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.603+0000 7f7d53796640 1 --2- 172.21.15.161:0/1145536119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d38003980 0x7f7d4c13dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.603+0000 7f7d53796640 1 -- 172.21.15.161:0/1145536119 >> 172.21.15.161:0/1145536119 conn(0x7f7d4c069d20 msgr2=0x7f7d4c0716c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:21.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.603+0000 7f7d53796640 1 -- 172.21.15.161:0/1145536119 shutdown_connections 2024-02-02T11:49:21.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.603+0000 7f7d53796640 1 -- 172.21.15.161:0/1145536119 wait complete. 2024-02-02T11:49:21.621 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:49:21.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.767+0000 7f6eb9552640 1 Processor -- start 2024-02-02T11:49:21.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.767+0000 7f6eb9552640 1 -- start start 2024-02-02T11:49:21.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb9552640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb40bc340 0x7f6eb41415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb9552640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6eb40b8020 0x7f6eb4151f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb9552640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb4071550 con 0x7f6eb4141b30 2024-02-02T11:49:21.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb9552640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb4071810 con 0x7f6eb40b8020 2024-02-02T11:49:21.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb9552640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4071950 con 0x7f6eb40bc340 2024-02-02T11:49:21.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb27fc640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6eb4141b30 0x7f6eb4147c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59078/0 (socket says 172.21.15.161:59078) 2024-02-02T11:49:21.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb27fc640 1 -- 172.21.15.161:0/2246921932 learned_addr learned my addr 172.21.15.161:0/2246921932 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:21.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb2ffd640 1 --2- 172.21.15.161:0/2246921932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb40bc340 0x7f6eb41415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb1ffb640 1 -- 172.21.15.161:0/2246921932 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4212456247 0 0) 0x7f6eb4071550 con 0x7f6eb4141b30 2024-02-02T11:49:21.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb37fe640 1 --2- 172.21.15.161:0/2246921932 >> v2:172.21.15.162:3300/0 conn(0x7f6eb40b8020 0x7f6eb4151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb1ffb640 1 -- 172.21.15.161:0/2246921932 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e9c005740 con 0x7f6eb4141b30 2024-02-02T11:49:21.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb1ffb640 1 -- 172.21.15.161:0/2246921932 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1290876775 0 0) 0x7f6e9c005740 con 0x7f6eb4141b30 2024-02-02T11:49:21.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb1ffb640 1 -- 172.21.15.161:0/2246921932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb40bc340 msgr2=0x7f6eb41415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:21.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb1ffb640 1 --2- 172.21.15.161:0/2246921932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb40bc340 0x7f6eb41415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb1ffb640 1 -- 172.21.15.161:0/2246921932 >> v2:172.21.15.162:3300/0 conn(0x7f6eb40b8020 msgr2=0x7f6eb4151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:21.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb1ffb640 1 --2- 172.21.15.161:0/2246921932 >> v2:172.21.15.162:3300/0 conn(0x7f6eb40b8020 0x7f6eb4151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb1ffb640 1 -- 172.21.15.161:0/2246921932 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb40bc720 con 0x7f6eb4141b30 2024-02-02T11:49:21.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb1ffb640 1 -- 172.21.15.161:0/2246921932 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f6ea8001a00 con 0x7f6eb4141b30 2024-02-02T11:49:21.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb1ffb640 1 -- 172.21.15.161:0/2246921932 >> v1:172.21.15.161:6789/0 conn(0x7f6eb4141b30 legacy=0x7f6eb4147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:21.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb1ffb640 1 --2- 172.21.15.161:0/2246921932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb40bc340 0x7f6e9c005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb1ffb640 1 --2- 172.21.15.161:0/2246921932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e9c006110 0x7f6e9c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb1ffb640 1 --2- 172.21.15.161:0/2246921932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e9c006f20 0x7f6e9c0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb1ffb640 1 -- 172.21.15.161:0/2246921932 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4071810 con 0x7f6e9c006f20 2024-02-02T11:49:21.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb1ffb640 1 -- 172.21.15.161:0/2246921932 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c00dba0 con 0x7f6e9c006110 2024-02-02T11:49:21.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb1ffb640 1 -- 172.21.15.161:0/2246921932 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c00dd30 con 0x7f6eb40bc340 2024-02-02T11:49:21.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb37fe640 1 --2- 172.21.15.161:0/2246921932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e9c006f20 0x7f6e9c0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb2ffd640 1 --2- 172.21.15.161:0/2246921932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb40bc340 0x7f6e9c005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb27fc640 1 --2- 172.21.15.161:0/2246921932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e9c006110 0x7f6e9c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb37fe640 1 -- 172.21.15.161:0/2246921932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb40bc340 msgr2=0x7f6e9c005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:21.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb37fe640 1 --2- 172.21.15.161:0/2246921932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb40bc340 0x7f6e9c005b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb37fe640 1 -- 172.21.15.161:0/2246921932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e9c006110 msgr2=0x7f6e9c0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:21.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb37fe640 1 --2- 172.21.15.161:0/2246921932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e9c006110 0x7f6e9c0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb37fe640 1 -- 172.21.15.161:0/2246921932 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c005740 con 0x7f6e9c006f20 2024-02-02T11:49:21.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb27fc640 1 --2- 172.21.15.161:0/2246921932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e9c006110 0x7f6e9c0069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:21.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb37fe640 1 --2- 172.21.15.161:0/2246921932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e9c006f20 0x7f6e9c0073a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009ab0 tx=0x7f6ea401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c93cf0025a7d915 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:21.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb1ffb640 1 -- 172.21.15.161:0/2246921932 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40a5620 con 0x7f6e9c006f20 2024-02-02T11:49:21.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb1ffb640 1 -- 172.21.15.161:0/2246921932 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea40a5780 con 0x7f6e9c006f20 2024-02-02T11:49:21.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.771+0000 7f6eb1ffb640 1 -- 172.21.15.161:0/2246921932 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40a5b30 con 0x7f6e9c006f20 2024-02-02T11:49:21.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb9552640 1 -- 172.21.15.161:0/2246921932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e9c006f20 msgr2=0x7f6e9c0073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:21.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb9552640 1 --2- 172.21.15.161:0/2246921932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e9c006f20 0x7f6e9c0073a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009ab0 tx=0x7f6ea401ca30 comp rx=0 tx=0).stop 2024-02-02T11:49:21.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb37fe640 1 -- 172.21.15.161:0/2246921932 reap_dead start 2024-02-02T11:49:21.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb9552640 1 -- 172.21.15.161:0/2246921932 shutdown_connections 2024-02-02T11:49:21.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb9552640 1 -- 172.21.15.161:0/2246921932 >> 172.21.15.161:0/2246921932 conn(0x7f6eb4069ef0 msgr2=0x7f6eb406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:21.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb9552640 1 -- 172.21.15.161:0/2246921932 shutdown_connections 2024-02-02T11:49:21.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb9552640 1 -- 172.21.15.161:0/2246921932 wait complete. 2024-02-02T11:49:21.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb9552640 1 Processor -- start 2024-02-02T11:49:21.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb9552640 1 -- start start 2024-02-02T11:49:21.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb9552640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e9c006f20 0x7f6eb40b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb9552640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb41e2990 0x7f6eb41e2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb9552640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb413ae90 0x7f6eb413b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb9552640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4147160 con 0x7f6eb413ae90 2024-02-02T11:49:21.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb9552640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40b22f0 con 0x7f6e9c006f20 2024-02-02T11:49:21.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb9552640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40b17b0 con 0x7f6eb41e2990 2024-02-02T11:49:21.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb37fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb413ae90 0x7f6eb413b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb37fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb413ae90 0x7f6eb413b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40816/0 (socket says 172.21.15.161:40816) 2024-02-02T11:49:21.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb37fe640 1 -- 172.21.15.161:0/89908081 learned_addr learned my addr 172.21.15.161:0/89908081 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:21.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb27fc640 1 --2- 172.21.15.161:0/89908081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb41e2990 0x7f6eb41e2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb37fe640 1 -- 172.21.15.161:0/89908081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb41e2990 msgr2=0x7f6eb41e2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:21.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb37fe640 1 --2- 172.21.15.161:0/89908081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb41e2990 0x7f6eb41e2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb2ffd640 1 --2- 172.21.15.161:0/89908081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e9c006f20 0x7f6eb40b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb37fe640 1 -- 172.21.15.161:0/89908081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e9c006f20 msgr2=0x7f6eb40b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:21.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb37fe640 1 --2- 172.21.15.161:0/89908081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e9c006f20 0x7f6eb40b1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb37fe640 1 -- 172.21.15.161:0/89908081 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb41e3330 con 0x7f6eb413ae90 2024-02-02T11:49:21.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb37fe640 1 --2- 172.21.15.161:0/89908081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb413ae90 0x7f6eb413b310 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009ab0 tx=0x7f6e9c007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:21.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6e9b7fe640 1 -- 172.21.15.161:0/89908081 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40a5620 con 0x7f6eb413ae90 2024-02-02T11:49:21.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6e9b7fe640 1 -- 172.21.15.161:0/89908081 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea4004230 con 0x7f6eb413ae90 2024-02-02T11:49:21.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb9552640 1 -- 172.21.15.161:0/89908081 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb414b8f0 con 0x7f6eb413ae90 2024-02-02T11:49:21.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6e9b7fe640 1 -- 172.21.15.161:0/89908081 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4003620 con 0x7f6eb413ae90 2024-02-02T11:49:21.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb9552640 1 -- 172.21.15.161:0/89908081 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb414a6c0 con 0x7f6eb413ae90 2024-02-02T11:49:21.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.775+0000 7f6eb9552640 1 -- 172.21.15.161:0/89908081 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb414a240 con 0x7f6eb413ae90 2024-02-02T11:49:21.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.779+0000 7f6e9b7fe640 1 -- 172.21.15.161:0/89908081 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6ea40b4070 con 0x7f6eb413ae90 2024-02-02T11:49:21.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.779+0000 7f6e9b7fe640 1 --2- 172.21.15.161:0/89908081 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6ea0065a60 0x7f6ea0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:21.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.779+0000 7f6eb2ffd640 1 --2- 172.21.15.161:0/89908081 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6ea0065a60 0x7f6ea0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:21.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.779+0000 7f6e9b7fe640 1 -- 172.21.15.161:0/89908081 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ea411c860 con 0x7f6eb413ae90 2024-02-02T11:49:21.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.779+0000 7f6eb2ffd640 1 --2- 172.21.15.161:0/89908081 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6ea0065a60 0x7f6ea0067f20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6eac009930 tx=0x7f6eac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:21.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.783+0000 7f6e9b7fe640 1 -- 172.21.15.161:0/89908081 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6eb414a240 con 0x7f6eb413ae90 2024-02-02T11:49:21.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.923+0000 7f6eb9552640 1 -- 172.21.15.161:0/89908081 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6eb414a240 con 0x7f6eb413ae90 2024-02-02T11:49:21.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.927+0000 7f6e9b7fe640 1 -- 172.21.15.161:0/89908081 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f6eb414a240 con 0x7f6eb413ae90 2024-02-02T11:49:21.930 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:21.930 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":20,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:48:52.816101+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:48:50.155565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-02T11:48:50.795158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:49:21.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.927+0000 7f6eb9552640 1 -- 172.21.15.161:0/89908081 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6ea0065a60 msgr2=0x7f6ea0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:21.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.927+0000 7f6eb9552640 1 --2- 172.21.15.161:0/89908081 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6ea0065a60 0x7f6ea0067f20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6eac009930 tx=0x7f6eac008040 comp rx=0 tx=0).stop 2024-02-02T11:49:21.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.927+0000 7f6eb9552640 1 -- 172.21.15.161:0/89908081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb413ae90 msgr2=0x7f6eb413b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:21.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.927+0000 7f6eb9552640 1 --2- 172.21.15.161:0/89908081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb413ae90 0x7f6eb413b310 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009ab0 tx=0x7f6e9c007a10 comp rx=0 tx=0).stop 2024-02-02T11:49:21.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.927+0000 7f6eb9552640 1 -- 172.21.15.161:0/89908081 shutdown_connections 2024-02-02T11:49:21.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.927+0000 7f6eb9552640 1 --2- 172.21.15.161:0/89908081 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6ea0065a60 0x7f6ea0067f20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.927+0000 7f6eb9552640 1 --2- 172.21.15.161:0/89908081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb413ae90 0x7f6eb413b310 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.927+0000 7f6eb9552640 1 --2- 172.21.15.161:0/89908081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb41e2990 0x7f6eb41e2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.927+0000 7f6eb9552640 1 --2- 172.21.15.161:0/89908081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e9c006f20 0x7f6eb40b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:21.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.927+0000 7f6eb9552640 1 -- 172.21.15.161:0/89908081 >> 172.21.15.161:0/89908081 conn(0x7f6eb4069ef0 msgr2=0x7f6eb413ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:21.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.927+0000 7f6eb9552640 1 -- 172.21.15.161:0/89908081 shutdown_connections 2024-02-02T11:49:21.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:21.927+0000 7f6eb9552640 1 -- 172.21.15.161:0/89908081 wait complete. 2024-02-02T11:49:21.947 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-02-02T11:49:22.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.063+0000 7fb3686ce640 1 Processor -- start 2024-02-02T11:49:22.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.063+0000 7fb3686ce640 1 -- start start 2024-02-02T11:49:22.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb3686ce640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb3600bc340 0x7fb360142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:22.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb3686ce640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb360142d50 0x7fb360148d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:22.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb3686ce640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb360071770 con 0x7fb3601492a0 2024-02-02T11:49:22.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb3686ce640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3601496d0 con 0x7fb3600bc340 2024-02-02T11:49:22.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb3686ce640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3600b37e0 con 0x7fb360142d50 2024-02-02T11:49:22.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb36646a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb3600bc340 0x7fb360142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:22.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb366c6b640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb3601492a0 0x7fb3600b53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59094/0 (socket says 172.21.15.161:59094) 2024-02-02T11:49:22.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb366c6b640 1 -- 172.21.15.161:0/3024736555 learned_addr learned my addr 172.21.15.161:0/3024736555 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:22.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb365c69640 1 --2- 172.21.15.161:0/3024736555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb360142d50 0x7fb360148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:22.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb36646a640 1 -- 172.21.15.161:0/3024736555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb360142d50 msgr2=0x7fb360148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:22.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb36646a640 1 --2- 172.21.15.161:0/3024736555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb360142d50 0x7fb360148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:22.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb36646a640 1 -- 172.21.15.161:0/3024736555 >> v1:172.21.15.161:6789/0 conn(0x7fb3601492a0 legacy=0x7fb3600b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:22.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb36646a640 1 -- 172.21.15.161:0/3024736555 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3600b3ac0 con 0x7fb3600bc340 2024-02-02T11:49:22.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb36646a640 1 --2- 172.21.15.161:0/3024736555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3600bc340 0x7fb360142810 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0097c0 tx=0x7fb35c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8442dffb73f4c469 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:22.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb365468640 1 -- 172.21.15.161:0/3024736555 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c0a8970 con 0x7fb3600bc340 2024-02-02T11:49:22.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb365468640 1 -- 172.21.15.161:0/3024736555 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35c0a8ad0 con 0x7fb3600bc340 2024-02-02T11:49:22.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb365468640 1 -- 172.21.15.161:0/3024736555 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c0a8e60 con 0x7fb3600bc340 2024-02-02T11:49:22.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb3686ce640 1 -- 172.21.15.161:0/3024736555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3600bc340 msgr2=0x7fb360142810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:22.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb3686ce640 1 --2- 172.21.15.161:0/3024736555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3600bc340 0x7fb360142810 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0097c0 tx=0x7fb35c01ec70 comp rx=0 tx=0).stop 2024-02-02T11:49:22.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb3686ce640 1 -- 172.21.15.161:0/3024736555 shutdown_connections 2024-02-02T11:49:22.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb3686ce640 1 --2- 172.21.15.161:0/3024736555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb360142d50 0x7fb360148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:22.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb3686ce640 1 --2- 172.21.15.161:0/3024736555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3600bc340 0x7fb360142810 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:22.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb3686ce640 1 -- 172.21.15.161:0/3024736555 >> 172.21.15.161:0/3024736555 conn(0x7fb360069ef0 msgr2=0x7fb36006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:22.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb3686ce640 1 -- 172.21.15.161:0/3024736555 shutdown_connections 2024-02-02T11:49:22.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.067+0000 7fb3686ce640 1 -- 172.21.15.161:0/3024736555 wait complete. 2024-02-02T11:49:22.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb3686ce640 1 Processor -- start 2024-02-02T11:49:22.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb3686ce640 1 -- start start 2024-02-02T11:49:22.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb3686ce640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3600bc340 0x7fb360070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:22.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb3686ce640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3601492a0 0x7fb36006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:22.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb3686ce640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb360147c60 0x7fb3601480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:22.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb3686ce640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3600700b0 con 0x7fb3600bc340 2024-02-02T11:49:22.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb3686ce640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3601e35d0 con 0x7fb360147c60 2024-02-02T11:49:22.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb3686ce640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3601477d0 con 0x7fb3601492a0 2024-02-02T11:49:22.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb36646a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3600bc340 0x7fb360070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:22.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb36646a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3600bc340 0x7fb360070870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40832/0 (socket says 172.21.15.161:40832) 2024-02-02T11:49:22.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb36646a640 1 -- 172.21.15.161:0/4094462316 learned_addr learned my addr 172.21.15.161:0/4094462316 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:22.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb365c69640 1 --2- 172.21.15.161:0/4094462316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3601492a0 0x7fb36006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:22.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb36646a640 1 -- 172.21.15.161:0/4094462316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3601492a0 msgr2=0x7fb36006fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:22.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb36646a640 1 --2- 172.21.15.161:0/4094462316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3601492a0 0x7fb36006fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:22.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb366c6b640 1 --2- 172.21.15.161:0/4094462316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb360147c60 0x7fb3601480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:22.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb36646a640 1 -- 172.21.15.161:0/4094462316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb360147c60 msgr2=0x7fb3601480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:22.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb36646a640 1 --2- 172.21.15.161:0/4094462316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb360147c60 0x7fb3601480f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:22.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb36646a640 1 -- 172.21.15.161:0/4094462316 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c009420 con 0x7fb3600bc340 2024-02-02T11:49:22.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb36646a640 1 --2- 172.21.15.161:0/4094462316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3600bc340 0x7fb360070870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0b3040 tx=0x7fb35c01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:22.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb356ffd640 1 -- 172.21.15.161:0/4094462316 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c0b9630 con 0x7fb3600bc340 2024-02-02T11:49:22.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb356ffd640 1 -- 172.21.15.161:0/4094462316 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35c0b97b0 con 0x7fb3600bc340 2024-02-02T11:49:22.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb356ffd640 1 -- 172.21.15.161:0/4094462316 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c0b9b60 con 0x7fb3600bc340 2024-02-02T11:49:22.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb3686ce640 1 -- 172.21.15.161:0/4094462316 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb360136710 con 0x7fb3600bc340 2024-02-02T11:49:22.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb3686ce640 1 -- 172.21.15.161:0/4094462316 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36013be40 con 0x7fb3600bc340 2024-02-02T11:49:22.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb3686ce640 1 -- 172.21.15.161:0/4094462316 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36004e000 con 0x7fb3600bc340 2024-02-02T11:49:22.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.071+0000 7fb356ffd640 1 -- 172.21.15.161:0/4094462316 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb35c0b7040 con 0x7fb3600bc340 2024-02-02T11:49:22.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.075+0000 7fb356ffd640 1 --2- 172.21.15.161:0/4094462316 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb344065a60 0x7fb344067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:22.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.075+0000 7fb356ffd640 1 -- 172.21.15.161:0/4094462316 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb35c121090 con 0x7fb3600bc340 2024-02-02T11:49:22.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.075+0000 7fb365c69640 1 --2- 172.21.15.161:0/4094462316 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb344065a60 0x7fb344067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:22.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.075+0000 7fb365c69640 1 --2- 172.21.15.161:0/4094462316 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb344065a60 0x7fb344067f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb3600bb4b0 tx=0x7fb350008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:22.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.079+0000 7fb356ffd640 1 -- 172.21.15.161:0/4094462316 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb35c0eeae0 con 0x7fb3600bc340 2024-02-02T11:49:22.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.251+0000 7fb3686ce640 1 -- 172.21.15.161:0/4094462316 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb3600b4cb0 con 0x7fb3600bc340 2024-02-02T11:49:22.255 INFO:tasks.ceph.mon.a.smithi161.stderr:2024-02-02T11:49:22.251+0000 7fa514f4b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-02T11:49:22.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.267+0000 7fb356ffd640 1 -- 172.21.15.161:0/4094462316 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb35c0b5090 con 0x7fb3600bc340 2024-02-02T11:49:22.270 INFO:teuthology.orchestra.run.smithi161.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-02T11:49:22.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.267+0000 7fb3686ce640 1 -- 172.21.15.161:0/4094462316 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb344065a60 msgr2=0x7fb344067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:22.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.267+0000 7fb3686ce640 1 --2- 172.21.15.161:0/4094462316 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb344065a60 0x7fb344067f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb3600bb4b0 tx=0x7fb350008040 comp rx=0 tx=0).stop 2024-02-02T11:49:22.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.267+0000 7fb3686ce640 1 -- 172.21.15.161:0/4094462316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3600bc340 msgr2=0x7fb360070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:22.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.267+0000 7fb3686ce640 1 --2- 172.21.15.161:0/4094462316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3600bc340 0x7fb360070870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0b3040 tx=0x7fb35c01ba10 comp rx=0 tx=0).stop 2024-02-02T11:49:22.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.271+0000 7fb3686ce640 1 -- 172.21.15.161:0/4094462316 shutdown_connections 2024-02-02T11:49:22.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.271+0000 7fb3686ce640 1 --2- 172.21.15.161:0/4094462316 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb344065a60 0x7fb344067f20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:22.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.271+0000 7fb3686ce640 1 --2- 172.21.15.161:0/4094462316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb360147c60 0x7fb3601480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:22.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.271+0000 7fb3686ce640 1 --2- 172.21.15.161:0/4094462316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3601492a0 0x7fb36006fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:22.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.271+0000 7fb3686ce640 1 --2- 172.21.15.161:0/4094462316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3600bc340 0x7fb360070870 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:22.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.271+0000 7fb3686ce640 1 -- 172.21.15.161:0/4094462316 >> 172.21.15.161:0/4094462316 conn(0x7fb360069ef0 msgr2=0x7fb36013e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:22.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.271+0000 7fb3686ce640 1 -- 172.21.15.161:0/4094462316 shutdown_connections 2024-02-02T11:49:22.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.271+0000 7fb3686ce640 1 -- 172.21.15.161:0/4094462316 wait complete. 2024-02-02T11:49:22.278 INFO:tasks.ceph.mds.c.smithi161.stderr: -3204> 2024-02-02T11:48:55.784+0000 7f2799425640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-02T11:49:22.288 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-02-02T11:49:22.341 INFO:tasks.ceph.mds.c.smithi161.stdout:starting mds.c at 2024-02-02T11:49:22.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.395+0000 7f64163f5640 1 Processor -- start 2024-02-02T11:49:22.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.395+0000 7f64163f5640 1 -- start start 2024-02-02T11:49:22.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.395+0000 7f64163f5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100b8df0 0x7f6410147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:22.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.395+0000 7f64163f5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f64100b8530 0x7f6410152000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:22.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.395+0000 7f64163f5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f641006ec30 con 0x7f6410070e40 2024-02-02T11:49:22.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.395+0000 7f64163f5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64100b30e0 con 0x7f64100b8530 2024-02-02T11:49:22.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.395+0000 7f64163f5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64100b3770 con 0x7f64100b8df0 2024-02-02T11:49:22.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.395+0000 7f6414992640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f64100b8530 0x7f6410152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:22.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.395+0000 7f6414992640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f64100b8530 0x7f6410152000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40856/0 (socket says 172.21.15.161:40856) 2024-02-02T11:49:22.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.395+0000 7f6414992640 1 -- 172.21.15.161:0/2867647273 learned_addr learned my addr 172.21.15.161:0/2867647273 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:22.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.395+0000 7f640ffff640 1 --2- 172.21.15.161:0/2867647273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100b8df0 0x7f6410147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:22.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.395+0000 7f6414992640 1 -- 172.21.15.161:0/2867647273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100b8df0 msgr2=0x7f6410147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:22.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.395+0000 7f6414992640 1 --2- 172.21.15.161:0/2867647273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100b8df0 0x7f6410147eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:22.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.395+0000 7f6414992640 1 -- 172.21.15.161:0/2867647273 >> v1:172.21.15.162:6789/0 conn(0x7f6410070e40 legacy=0x7f6410141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:22.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.395+0000 7f6414992640 1 -- 172.21.15.161:0/2867647273 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6410071890 con 0x7f64100b8530 2024-02-02T11:49:22.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f6414992640 1 --2- 172.21.15.161:0/2867647273 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64100b8530 0x7f6410152000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6400009870 tx=0x7f640001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d810620cd6ec6ce0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:22.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f640effd640 1 -- 172.21.15.161:0/2867647273 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64000ac410 con 0x7f64100b8530 2024-02-02T11:49:22.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f640effd640 1 -- 172.21.15.161:0/2867647273 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64000ac570 con 0x7f64100b8530 2024-02-02T11:49:22.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f640effd640 1 -- 172.21.15.161:0/2867647273 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64000ac900 con 0x7f64100b8530 2024-02-02T11:49:22.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f64163f5640 1 -- 172.21.15.161:0/2867647273 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64100b8530 msgr2=0x7f6410152000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:22.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f64163f5640 1 --2- 172.21.15.161:0/2867647273 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64100b8530 0x7f6410152000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6400009870 tx=0x7f640001c500 comp rx=0 tx=0).stop 2024-02-02T11:49:22.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f64163f5640 1 -- 172.21.15.161:0/2867647273 shutdown_connections 2024-02-02T11:49:22.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f64163f5640 1 --2- 172.21.15.161:0/2867647273 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64100b8530 0x7f6410152000 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:22.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f64163f5640 1 --2- 172.21.15.161:0/2867647273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100b8df0 0x7f6410147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:22.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f64163f5640 1 -- 172.21.15.161:0/2867647273 >> 172.21.15.161:0/2867647273 conn(0x7f641006a120 msgr2=0x7f641006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:22.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f64163f5640 1 -- 172.21.15.161:0/2867647273 shutdown_connections 2024-02-02T11:49:22.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f64163f5640 1 -- 172.21.15.161:0/2867647273 wait complete. 2024-02-02T11:49:22.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f64163f5640 1 Processor -- start 2024-02-02T11:49:22.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f64163f5640 1 -- start start 2024-02-02T11:49:22.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f64163f5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64100b8530 0x7f641006f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:22.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f64163f5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100b8df0 0x7f64101e6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:22.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f64163f5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64101e69a0 0x7f64101360d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:22.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f64163f5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641006ff30 con 0x7f64101e69a0 2024-02-02T11:49:22.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f64163f5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6410146790 con 0x7f64100b8530 2024-02-02T11:49:22.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f64163f5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6410147170 con 0x7f64100b8df0 2024-02-02T11:49:22.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f6414992640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64101e69a0 0x7f64101360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:22.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f6414992640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64101e69a0 0x7f64101360d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40862/0 (socket says 172.21.15.161:40862) 2024-02-02T11:49:22.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.399+0000 7f6414992640 1 -- 172.21.15.161:0/1673705770 learned_addr learned my addr 172.21.15.161:0/1673705770 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f640f7fe640 1 --2- 172.21.15.161:0/1673705770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100b8df0 0x7f64101e6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f640ffff640 1 --2- 172.21.15.161:0/1673705770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64100b8530 0x7f641006f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f6414992640 1 -- 172.21.15.161:0/1673705770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100b8df0 msgr2=0x7f64101e6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f6414992640 1 --2- 172.21.15.161:0/1673705770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100b8df0 0x7f64101e6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f6414992640 1 -- 172.21.15.161:0/1673705770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64100b8530 msgr2=0x7f641006f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f6414992640 1 --2- 172.21.15.161:0/1673705770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64100b8530 0x7f641006f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f6414992640 1 -- 172.21.15.161:0/1673705770 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64000094d0 con 0x7f64101e69a0 2024-02-02T11:49:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f640f7fe640 1 --2- 172.21.15.161:0/1673705770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100b8df0 0x7f64101e6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f640ffff640 1 --2- 172.21.15.161:0/1673705770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64100b8530 0x7f641006f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f6414992640 1 --2- 172.21.15.161:0/1673705770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64101e69a0 0x7f64101360d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f640001abb0 tx=0x7f64000192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f640cff9640 1 -- 172.21.15.161:0/1673705770 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64000ac410 con 0x7f64101e69a0 2024-02-02T11:49:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f640cff9640 1 -- 172.21.15.161:0/1673705770 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64000b65f0 con 0x7f64101e69a0 2024-02-02T11:49:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f64163f5640 1 -- 172.21.15.161:0/1673705770 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64100b5d80 con 0x7f64101e69a0 2024-02-02T11:49:22.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f640cff9640 1 -- 172.21.15.161:0/1673705770 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64000b6960 con 0x7f64101e69a0 2024-02-02T11:49:22.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f64163f5640 1 -- 172.21.15.161:0/1673705770 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6410146e00 con 0x7f64101e69a0 2024-02-02T11:49:22.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f64163f5640 1 -- 172.21.15.161:0/1673705770 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64100b62a0 con 0x7f64101e69a0 2024-02-02T11:49:22.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f640cff9640 1 -- 172.21.15.161:0/1673705770 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f64000b6ac0 con 0x7f64101e69a0 2024-02-02T11:49:22.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f640cff9640 1 --2- 172.21.15.161:0/1673705770 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f63fc065a60 0x7f63fc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:22.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f640cff9640 1 -- 172.21.15.161:0/1673705770 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f640011dc00 con 0x7f64101e69a0 2024-02-02T11:49:22.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f640ffff640 1 --2- 172.21.15.161:0/1673705770 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f63fc065a60 0x7f63fc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:22.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.403+0000 7f640ffff640 1 --2- 172.21.15.161:0/1673705770 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f63fc065a60 0x7f63fc067f20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6408007eb0 tx=0x7f6408007400 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:22.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.407+0000 7f640cff9640 1 -- 172.21.15.161:0/1673705770 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6400124080 con 0x7f64101e69a0 2024-02-02T11:49:22.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:22.587+0000 7f64163f5640 1 -- 172.21.15.161:0/1673705770 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6410147300 con 0x7f64101e69a0 2024-02-02T11:49:23.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.275+0000 7f640cff9640 1 -- 172.21.15.161:0/1673705770 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f64000b10a0 con 0x7f64101e69a0 2024-02-02T11:49:23.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.275+0000 7f64163f5640 1 -- 172.21.15.161:0/1673705770 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f63fc065a60 msgr2=0x7f63fc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:23.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.275+0000 7f64163f5640 1 --2- 172.21.15.161:0/1673705770 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f63fc065a60 0x7f63fc067f20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6408007eb0 tx=0x7f6408007400 comp rx=0 tx=0).stop 2024-02-02T11:49:23.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.275+0000 7f64163f5640 1 -- 172.21.15.161:0/1673705770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64101e69a0 msgr2=0x7f64101360d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:23.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.275+0000 7f64163f5640 1 --2- 172.21.15.161:0/1673705770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64101e69a0 0x7f64101360d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f640001abb0 tx=0x7f64000192a0 comp rx=0 tx=0).stop 2024-02-02T11:49:23.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.275+0000 7f64163f5640 1 -- 172.21.15.161:0/1673705770 shutdown_connections 2024-02-02T11:49:23.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.275+0000 7f64163f5640 1 --2- 172.21.15.161:0/1673705770 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f63fc065a60 0x7f63fc067f20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:23.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.275+0000 7f64163f5640 1 --2- 172.21.15.161:0/1673705770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64101e69a0 0x7f64101360d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:23.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.275+0000 7f64163f5640 1 --2- 172.21.15.161:0/1673705770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100b8df0 0x7f64101e6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:23.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.275+0000 7f64163f5640 1 --2- 172.21.15.161:0/1673705770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64100b8530 0x7f641006f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:23.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.275+0000 7f64163f5640 1 -- 172.21.15.161:0/1673705770 >> 172.21.15.161:0/1673705770 conn(0x7f641006a120 msgr2=0x7f64101443e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:23.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.275+0000 7f64163f5640 1 -- 172.21.15.161:0/1673705770 shutdown_connections 2024-02-02T11:49:23.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.275+0000 7f64163f5640 1 -- 172.21.15.161:0/1673705770 wait complete. 2024-02-02T11:49:23.300 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-02-02T11:49:23.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.415+0000 7f862f918640 1 Processor -- start 2024-02-02T11:49:23.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.415+0000 7f862f918640 1 -- start start 2024-02-02T11:49:23.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.415+0000 7f862f918640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f86280b8240 0x7f86280ba140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:23.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.415+0000 7f862f918640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86280b76c0 0x7f862814e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:23.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.415+0000 7f862f918640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f862814a910 0x7f8628144460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:23.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.415+0000 7f862f918640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86280b7e30 con 0x7f86280b8240 2024-02-02T11:49:23.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.415+0000 7f862f918640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86280bbd30 con 0x7f862814a910 2024-02-02T11:49:23.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.415+0000 7f862f918640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86280ba680 con 0x7f86280b76c0 2024-02-02T11:49:23.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.415+0000 7f862d6b4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f86280b8240 0x7f86280ba140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:23.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.415+0000 7f862d6b4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f86280b8240 0x7f86280ba140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34200/0 (socket says 172.21.15.161:34200) 2024-02-02T11:49:23.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.415+0000 7f862d6b4640 1 -- 172.21.15.161:0/947574938 learned_addr learned my addr 172.21.15.161:0/947574938 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:23.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.415+0000 7f862ceb3640 1 --2- 172.21.15.161:0/947574938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86280b76c0 0x7f862814e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:23.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.415+0000 7f862deb5640 1 --2- 172.21.15.161:0/947574938 >> v2:172.21.15.162:3300/0 conn(0x7f862814a910 0x7f8628144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:23.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.415+0000 7f862d6b4640 1 -- 172.21.15.161:0/947574938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86280b76c0 msgr2=0x7f862814e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:23.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.415+0000 7f862d6b4640 1 --2- 172.21.15.161:0/947574938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86280b76c0 0x7f862814e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:23.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.415+0000 7f862d6b4640 1 -- 172.21.15.161:0/947574938 >> v2:172.21.15.162:3300/0 conn(0x7f862814a910 msgr2=0x7f8628144460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:23.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.415+0000 7f862d6b4640 1 --2- 172.21.15.161:0/947574938 >> v2:172.21.15.162:3300/0 conn(0x7f862814a910 0x7f8628144460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:23.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.415+0000 7f862d6b4640 1 -- 172.21.15.161:0/947574938 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86280b7b50 con 0x7f86280b8240 2024-02-02T11:49:23.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.415+0000 7f862deb5640 1 --2- 172.21.15.161:0/947574938 >> v2:172.21.15.162:3300/0 conn(0x7f862814a910 0x7f8628144460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:23.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862d6b4640 1 --2- 172.21.15.161:0/947574938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86280b8240 0x7f86280ba140 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f86280bdc10 tx=0x7f862401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aaed3642cb6ec2b server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:23.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f861ffff640 1 -- 172.21.15.161:0/947574938 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86240ab600 con 0x7f86280b8240 2024-02-02T11:49:23.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f861ffff640 1 -- 172.21.15.161:0/947574938 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86240a7050 con 0x7f86280b8240 2024-02-02T11:49:23.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f861ffff640 1 -- 172.21.15.161:0/947574938 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86240ab980 con 0x7f86280b8240 2024-02-02T11:49:23.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862f918640 1 -- 172.21.15.161:0/947574938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86280b8240 msgr2=0x7f86280ba140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:23.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862f918640 1 --2- 172.21.15.161:0/947574938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86280b8240 0x7f86280ba140 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f86280bdc10 tx=0x7f862401c470 comp rx=0 tx=0).stop 2024-02-02T11:49:23.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862f918640 1 -- 172.21.15.161:0/947574938 shutdown_connections 2024-02-02T11:49:23.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862f918640 1 --2- 172.21.15.161:0/947574938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86280b76c0 0x7f862814e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:23.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862f918640 1 --2- 172.21.15.161:0/947574938 >> v2:172.21.15.162:3300/0 conn(0x7f862814a910 0x7f8628144460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:23.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862f918640 1 --2- 172.21.15.161:0/947574938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86280b8240 0x7f86280ba140 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:23.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862f918640 1 -- 172.21.15.161:0/947574938 >> 172.21.15.161:0/947574938 conn(0x7f86280c0280 msgr2=0x7f86280c0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:23.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862f918640 1 -- 172.21.15.161:0/947574938 shutdown_connections 2024-02-02T11:49:23.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862f918640 1 -- 172.21.15.161:0/947574938 wait complete. 2024-02-02T11:49:23.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862f918640 1 Processor -- start 2024-02-02T11:49:23.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862f918640 1 -- start start 2024-02-02T11:49:23.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862f918640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86280b8240 0x7f8628141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:23.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862f918640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f862814a910 0x7f8628133f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:23.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862f918640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8628134450 0x7f862814caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:23.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862f918640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8628141e40 con 0x7f86280b8240 2024-02-02T11:49:23.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862f918640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862813c560 con 0x7f8628134450 2024-02-02T11:49:23.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862f918640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862813ce00 con 0x7f862814a910 2024-02-02T11:49:23.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862d6b4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86280b8240 0x7f8628141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:23.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862d6b4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86280b8240 0x7f8628141900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34206/0 (socket says 172.21.15.161:34206) 2024-02-02T11:49:23.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862d6b4640 1 -- 172.21.15.161:0/1616956670 learned_addr learned my addr 172.21.15.161:0/1616956670 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:23.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862d6b4640 1 -- 172.21.15.161:0/1616956670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f862814a910 msgr2=0x7f8628133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:23.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862d6b4640 1 --2- 172.21.15.161:0/1616956670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f862814a910 0x7f8628133f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:23.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862d6b4640 1 -- 172.21.15.161:0/1616956670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8628134450 msgr2=0x7f862814caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:23.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862deb5640 1 --2- 172.21.15.161:0/1616956670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8628134450 0x7f862814caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:23.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862d6b4640 1 --2- 172.21.15.161:0/1616956670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8628134450 0x7f862814caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:23.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862d6b4640 1 -- 172.21.15.161:0/1616956670 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86240094d0 con 0x7f86280b8240 2024-02-02T11:49:23.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862d6b4640 1 --2- 172.21.15.161:0/1616956670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86280b8240 0x7f8628141900 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f862401cd10 tx=0x7f862401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:23.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f861dffb640 1 -- 172.21.15.161:0/1616956670 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86240b6620 con 0x7f86280b8240 2024-02-02T11:49:23.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f861dffb640 1 -- 172.21.15.161:0/1616956670 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86240b67a0 con 0x7f86280b8240 2024-02-02T11:49:23.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862f918640 1 -- 172.21.15.161:0/1616956670 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862814ba60 con 0x7f86280b8240 2024-02-02T11:49:23.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f861dffb640 1 -- 172.21.15.161:0/1616956670 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86240b6b50 con 0x7f86280b8240 2024-02-02T11:49:23.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.419+0000 7f862f918640 1 -- 172.21.15.161:0/1616956670 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862813ca90 con 0x7f86280b8240 2024-02-02T11:49:23.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.423+0000 7f862f918640 1 -- 172.21.15.161:0/1616956670 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f862813cf90 con 0x7f86280b8240 2024-02-02T11:49:23.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.423+0000 7f861dffb640 1 -- 172.21.15.161:0/1616956670 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f86240b2040 con 0x7f86280b8240 2024-02-02T11:49:23.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.423+0000 7f861dffb640 1 --2- 172.21.15.161:0/1616956670 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f860c065a90 0x7f860c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:23.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.423+0000 7f861dffb640 1 -- 172.21.15.161:0/1616956670 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f862411d790 con 0x7f86280b8240 2024-02-02T11:49:23.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.423+0000 7f862ceb3640 1 --2- 172.21.15.161:0/1616956670 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f860c065a90 0x7f860c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:23.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.423+0000 7f862ceb3640 1 --2- 172.21.15.161:0/1616956670 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f860c065a90 0x7f860c067f50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f862813aee0 tx=0x7f8618008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:23.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.427+0000 7f861dffb640 1 -- 172.21.15.161:0/1616956670 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f86240eb0f0 con 0x7f86280b8240 2024-02-02T11:49:23.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:23.571+0000 7f862f918640 1 -- 172.21.15.161:0/1616956670 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f862804e000 con 0x7f86280b8240 2024-02-02T11:49:24.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.279+0000 7f861dffb640 1 -- 172.21.15.161:0/1616956670 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f86240ee710 con 0x7f86280b8240 2024-02-02T11:49:24.282 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_metadata' removed 2024-02-02T11:49:24.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.283+0000 7f862f918640 1 -- 172.21.15.161:0/1616956670 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f860c065a90 msgr2=0x7f860c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:24.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.283+0000 7f862f918640 1 --2- 172.21.15.161:0/1616956670 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f860c065a90 0x7f860c067f50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f862813aee0 tx=0x7f8618008040 comp rx=0 tx=0).stop 2024-02-02T11:49:24.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.283+0000 7f862f918640 1 -- 172.21.15.161:0/1616956670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86280b8240 msgr2=0x7f8628141900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:24.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.283+0000 7f862f918640 1 --2- 172.21.15.161:0/1616956670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86280b8240 0x7f8628141900 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f862401cd10 tx=0x7f862401acb0 comp rx=0 tx=0).stop 2024-02-02T11:49:24.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.283+0000 7f862f918640 1 -- 172.21.15.161:0/1616956670 shutdown_connections 2024-02-02T11:49:24.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.283+0000 7f862f918640 1 --2- 172.21.15.161:0/1616956670 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f860c065a90 0x7f860c067f50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:24.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.283+0000 7f862f918640 1 --2- 172.21.15.161:0/1616956670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8628134450 0x7f862814caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:24.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.283+0000 7f862f918640 1 --2- 172.21.15.161:0/1616956670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f862814a910 0x7f8628133f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:24.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.283+0000 7f862f918640 1 --2- 172.21.15.161:0/1616956670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86280b8240 0x7f8628141900 secure :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f862401cd10 tx=0x7f862401acb0 comp rx=0 tx=0).stop 2024-02-02T11:49:24.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.283+0000 7f862f918640 1 -- 172.21.15.161:0/1616956670 >> 172.21.15.161:0/1616956670 conn(0x7f86280c0280 msgr2=0x7f8628142320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:24.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.287+0000 7f862f918640 1 -- 172.21.15.161:0/1616956670 shutdown_connections 2024-02-02T11:49:24.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.287+0000 7f862f918640 1 -- 172.21.15.161:0/1616956670 wait complete. 2024-02-02T11:49:24.312 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-02-02T11:49:24.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.435+0000 7fbe53d00640 1 Processor -- start 2024-02-02T11:49:24.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.435+0000 7fbe53d00640 1 -- start start 2024-02-02T11:49:24.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.435+0000 7fbe53d00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbe4c06f520 0x7fbe4c071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:24.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.435+0000 7fbe53d00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbe4c147c20 0x7fbe4c148050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:24.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.435+0000 7fbe53d00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4c0b8350 con 0x7fbe4c06af90 2024-02-02T11:49:24.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.435+0000 7fbe53d00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4c0b8170 con 0x7fbe4c06f520 2024-02-02T11:49:24.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.435+0000 7fbe53d00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4c0b0020 con 0x7fbe4c147c20 2024-02-02T11:49:24.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.435+0000 7fbe51a9c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fbe4c06af90 0x7fbe4c070160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40780/0 (socket says 172.21.15.161:40780) 2024-02-02T11:49:24.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.435+0000 7fbe51a9c640 1 -- 172.21.15.161:0/1131007305 learned_addr learned my addr 172.21.15.161:0/1131007305 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:24.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.435+0000 7fbe5129b640 1 --2- 172.21.15.161:0/1131007305 >> v2:172.21.15.161:3300/0 conn(0x7fbe4c06f520 0x7fbe4c071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:24.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.435+0000 7fbe50a9a640 1 -- 172.21.15.161:0/1131007305 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376172823 0 0) 0x7fbe4c0b8350 con 0x7fbe4c06af90 2024-02-02T11:49:24.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.435+0000 7fbe50a9a640 1 -- 172.21.15.161:0/1131007305 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe38003530 con 0x7fbe4c06af90 2024-02-02T11:49:24.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.435+0000 7fbe5229d640 1 --2- 172.21.15.161:0/1131007305 >> v2:172.21.15.162:3300/0 conn(0x7fbe4c147c20 0x7fbe4c148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:24.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.435+0000 7fbe5129b640 1 -- 172.21.15.161:0/1131007305 >> v2:172.21.15.162:3300/0 conn(0x7fbe4c147c20 msgr2=0x7fbe4c148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:24.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.435+0000 7fbe5129b640 1 --2- 172.21.15.161:0/1131007305 >> v2:172.21.15.162:3300/0 conn(0x7fbe4c147c20 0x7fbe4c148050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:24.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.435+0000 7fbe5129b640 1 -- 172.21.15.161:0/1131007305 >> v1:172.21.15.161:6789/0 conn(0x7fbe4c06af90 legacy=0x7fbe4c070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:24.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.435+0000 7fbe5129b640 1 -- 172.21.15.161:0/1131007305 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c0afd40 con 0x7fbe4c06f520 2024-02-02T11:49:24.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.439+0000 7fbe5129b640 1 --2- 172.21.15.161:0/1131007305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe4c06f520 0x7fbe4c071dd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c14f040 tx=0x7fbe4801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffc3b3231350b18 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:24.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.439+0000 7fbe50a9a640 1 -- 172.21.15.161:0/1131007305 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe480ab600 con 0x7fbe4c06f520 2024-02-02T11:49:24.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.439+0000 7fbe50a9a640 1 -- 172.21.15.161:0/1131007305 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe480a7050 con 0x7fbe4c06f520 2024-02-02T11:49:24.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.439+0000 7fbe50a9a640 1 -- 172.21.15.161:0/1131007305 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe480ab960 con 0x7fbe4c06f520 2024-02-02T11:49:24.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.439+0000 7fbe53d00640 1 -- 172.21.15.161:0/1131007305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe4c06f520 msgr2=0x7fbe4c071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:24.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.439+0000 7fbe53d00640 1 --2- 172.21.15.161:0/1131007305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe4c06f520 0x7fbe4c071dd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c14f040 tx=0x7fbe4801c460 comp rx=0 tx=0).stop 2024-02-02T11:49:24.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.439+0000 7fbe53d00640 1 -- 172.21.15.161:0/1131007305 shutdown_connections 2024-02-02T11:49:24.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.439+0000 7fbe53d00640 1 --2- 172.21.15.161:0/1131007305 >> v2:172.21.15.162:3300/0 conn(0x7fbe4c147c20 0x7fbe4c148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:24.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.439+0000 7fbe53d00640 1 --2- 172.21.15.161:0/1131007305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe4c06f520 0x7fbe4c071dd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:24.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.439+0000 7fbe53d00640 1 -- 172.21.15.161:0/1131007305 >> 172.21.15.161:0/1131007305 conn(0x7fbe4c0b9140 msgr2=0x7fbe4c0b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:24.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.439+0000 7fbe53d00640 1 -- 172.21.15.161:0/1131007305 shutdown_connections 2024-02-02T11:49:24.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.439+0000 7fbe53d00640 1 -- 172.21.15.161:0/1131007305 wait complete. 2024-02-02T11:49:24.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.439+0000 7fbe53d00640 1 Processor -- start 2024-02-02T11:49:24.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.439+0000 7fbe53d00640 1 -- start start 2024-02-02T11:49:24.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.439+0000 7fbe53d00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe4c06af90 0x7fbe4c0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:24.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.439+0000 7fbe53d00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe4c06f520 0x7fbe4c13f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:24.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.439+0000 7fbe53d00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe4c147c20 0x7fbe4c0b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:24.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe53d00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0afb60 con 0x7fbe4c06af90 2024-02-02T11:49:24.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe53d00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c13fc60 con 0x7fbe4c147c20 2024-02-02T11:49:24.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe53d00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0b04b0 con 0x7fbe4c06f520 2024-02-02T11:49:24.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe51a9c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe4c06af90 0x7fbe4c0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:24.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe51a9c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe4c06af90 0x7fbe4c0b0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34224/0 (socket says 172.21.15.161:34224) 2024-02-02T11:49:24.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe51a9c640 1 -- 172.21.15.161:0/593976863 learned_addr learned my addr 172.21.15.161:0/593976863 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:24.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe5229d640 1 --2- 172.21.15.161:0/593976863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe4c147c20 0x7fbe4c0b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:24.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe5129b640 1 --2- 172.21.15.161:0/593976863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe4c06f520 0x7fbe4c13f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:24.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe51a9c640 1 -- 172.21.15.161:0/593976863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe4c06f520 msgr2=0x7fbe4c13f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:24.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe51a9c640 1 --2- 172.21.15.161:0/593976863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe4c06f520 0x7fbe4c13f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:24.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe51a9c640 1 -- 172.21.15.161:0/593976863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe4c147c20 msgr2=0x7fbe4c0b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:24.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe51a9c640 1 --2- 172.21.15.161:0/593976863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe4c147c20 0x7fbe4c0b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:24.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe51a9c640 1 -- 172.21.15.161:0/593976863 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe48009420 con 0x7fbe4c06af90 2024-02-02T11:49:24.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe5229d640 1 --2- 172.21.15.161:0/593976863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe4c147c20 0x7fbe4c0b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:24.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe51a9c640 1 --2- 172.21.15.161:0/593976863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe4c06af90 0x7fbe4c0b0940 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00c3c0 tx=0x7fbe3c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:24.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe427fc640 1 -- 172.21.15.161:0/593976863 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c005cf0 con 0x7fbe4c06af90 2024-02-02T11:49:24.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe427fc640 1 -- 172.21.15.161:0/593976863 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c005e50 con 0x7fbe4c06af90 2024-02-02T11:49:24.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe427fc640 1 -- 172.21.15.161:0/593976863 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c0072f0 con 0x7fbe4c06af90 2024-02-02T11:49:24.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe53d00640 1 -- 172.21.15.161:0/593976863 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe4c14db70 con 0x7fbe4c06af90 2024-02-02T11:49:24.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe53d00640 1 -- 172.21.15.161:0/593976863 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4c1405f0 con 0x7fbe4c06af90 2024-02-02T11:49:24.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe53d00640 1 -- 172.21.15.161:0/593976863 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe4c04e000 con 0x7fbe4c06af90 2024-02-02T11:49:24.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe427fc640 1 -- 172.21.15.161:0/593976863 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbe3c007450 con 0x7fbe4c06af90 2024-02-02T11:49:24.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe427fc640 1 --2- 172.21.15.161:0/593976863 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbe30065a90 0x7fbe30067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:24.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe427fc640 1 -- 172.21.15.161:0/593976863 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fbe3c082550 con 0x7fbe4c06af90 2024-02-02T11:49:24.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe5129b640 1 --2- 172.21.15.161:0/593976863 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbe30065a90 0x7fbe30067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:24.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.443+0000 7fbe5129b640 1 --2- 172.21.15.161:0/593976863 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbe30065a90 0x7fbe30067f50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbe480ad000 tx=0x7fbe480a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:24.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.447+0000 7fbe427fc640 1 -- 172.21.15.161:0/593976863 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbe3c050100 con 0x7fbe4c06af90 2024-02-02T11:49:24.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:24.595+0000 7fbe53d00640 1 -- 172.21.15.161:0/593976863 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbe4c13e630 con 0x7fbe4c06af90 2024-02-02T11:49:25.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.283+0000 7fbe427fc640 1 -- 172.21.15.161:0/593976863 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbe3c0170d0 con 0x7fbe4c06af90 2024-02-02T11:49:25.288 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data' removed 2024-02-02T11:49:25.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.287+0000 7fbe53d00640 1 -- 172.21.15.161:0/593976863 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbe30065a90 msgr2=0x7fbe30067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:25.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.287+0000 7fbe53d00640 1 --2- 172.21.15.161:0/593976863 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbe30065a90 0x7fbe30067f50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbe480ad000 tx=0x7fbe480a6000 comp rx=0 tx=0).stop 2024-02-02T11:49:25.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.287+0000 7fbe53d00640 1 -- 172.21.15.161:0/593976863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe4c06af90 msgr2=0x7fbe4c0b0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:25.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.287+0000 7fbe53d00640 1 --2- 172.21.15.161:0/593976863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe4c06af90 0x7fbe4c0b0940 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00c3c0 tx=0x7fbe3c00c880 comp rx=0 tx=0).stop 2024-02-02T11:49:25.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.287+0000 7fbe53d00640 1 -- 172.21.15.161:0/593976863 shutdown_connections 2024-02-02T11:49:25.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.287+0000 7fbe53d00640 1 --2- 172.21.15.161:0/593976863 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbe30065a90 0x7fbe30067f50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:25.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.287+0000 7fbe53d00640 1 --2- 172.21.15.161:0/593976863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe4c147c20 0x7fbe4c0b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:25.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.287+0000 7fbe53d00640 1 --2- 172.21.15.161:0/593976863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe4c06f520 0x7fbe4c13f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:25.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.287+0000 7fbe53d00640 1 --2- 172.21.15.161:0/593976863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe4c06af90 0x7fbe4c0b0940 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:25.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.287+0000 7fbe53d00640 1 -- 172.21.15.161:0/593976863 >> 172.21.15.161:0/593976863 conn(0x7fbe4c0b9140 msgr2=0x7fbe4c13d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:25.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.287+0000 7fbe53d00640 1 -- 172.21.15.161:0/593976863 shutdown_connections 2024-02-02T11:49:25.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.287+0000 7fbe53d00640 1 -- 172.21.15.161:0/593976863 wait complete. 2024-02-02T11:49:25.319 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-02T11:49:25.320 INFO:tasks.ceph.mds.a:Stopping old one... 2024-02-02T11:49:25.320 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-02T11:49:25.320 INFO:teuthology.orchestra.run:waiting for 300 2024-02-02T11:49:25.320 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-02T11:49:25.320 INFO:tasks.ceph.mds.c:Stopping old one... 2024-02-02T11:49:25.320 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-02T11:49:25.320 INFO:teuthology.orchestra.run:waiting for 300 2024-02-02T11:49:25.321 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-02T11:49:25.321 INFO:tasks.ceph.mds.b:Stopping old one... 2024-02-02T11:49:25.321 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-02T11:49:25.321 INFO:teuthology.orchestra.run:waiting for 300 2024-02-02T11:49:25.333 INFO:tasks.ceph.mds.a:Stopped 2024-02-02T11:49:25.333 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-02T11:49:25.334 INFO:tasks.ceph.mds.c:Stopped 2024-02-02T11:49:25.334 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-02T11:49:25.335 INFO:tasks.ceph.mds.b:Stopped 2024-02-02T11:49:25.335 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-02T11:49:25.378 INFO:tasks.ceph.mds.a:Started 2024-02-02T11:49:25.378 DEBUG:teuthology.parallel:result is None 2024-02-02T11:49:25.379 INFO:tasks.ceph.mds.c:Started 2024-02-02T11:49:25.379 DEBUG:teuthology.parallel:result is None 2024-02-02T11:49:25.381 INFO:tasks.ceph.mds.b:Started 2024-02-02T11:49:25.381 DEBUG:teuthology.parallel:result is None 2024-02-02T11:49:25.381 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-02-02T11:49:25.437 INFO:tasks.ceph.mds.a.smithi161.stdout:starting mds.a at 2024-02-02T11:49:25.443 INFO:tasks.ceph.mds.c.smithi161.stdout:starting mds.c at 2024-02-02T11:49:25.453 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-02-02T11:49:25.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.495+0000 7f46b09e7640 1 Processor -- start 2024-02-02T11:49:25.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.495+0000 7f46b09e7640 1 -- start start 2024-02-02T11:49:25.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.495+0000 7f46b09e7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f46ac148d60 0x7f46ac1491b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:25.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.495+0000 7f46b09e7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f46ac151100 0x7f46ac1534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:25.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.495+0000 7f46b09e7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ac071770 con 0x7f46ac0bc340 2024-02-02T11:49:25.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.495+0000 7f46b09e7640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ac1496f0 con 0x7f46ac148d60 2024-02-02T11:49:25.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.495+0000 7f46b09e7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ac142f20 con 0x7f46ac151100 2024-02-02T11:49:25.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.495+0000 7f46a9d9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f46ac148d60 0x7f46ac1491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:25.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.495+0000 7f46a9d9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f46ac148d60 0x7f46ac1491b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34282/0 (socket says 172.21.15.161:34282) 2024-02-02T11:49:25.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.495+0000 7f46a9d9b640 1 -- 172.21.15.161:0/1351799669 learned_addr learned my addr 172.21.15.161:0/1351799669 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:25.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.495+0000 7f46aad9d640 1 --2- 172.21.15.161:0/1351799669 >> v2:172.21.15.162:3300/0 conn(0x7f46ac151100 0x7f46ac1534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:25.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.495+0000 7f46a9d9b640 1 -- 172.21.15.161:0/1351799669 >> v2:172.21.15.162:3300/0 conn(0x7f46ac151100 msgr2=0x7f46ac1534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:25.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.495+0000 7f46a9d9b640 1 --2- 172.21.15.161:0/1351799669 >> v2:172.21.15.162:3300/0 conn(0x7f46ac151100 0x7f46ac1534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:25.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.495+0000 7f46a9d9b640 1 -- 172.21.15.161:0/1351799669 >> v1:172.21.15.162:6789/0 conn(0x7f46ac0bc340 legacy=0x7f46ac142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:25.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.495+0000 7f46a9d9b640 1 -- 172.21.15.161:0/1351799669 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac0b37e0 con 0x7f46ac148d60 2024-02-02T11:49:25.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46a9d9b640 1 --2- 172.21.15.161:0/1351799669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46ac148d60 0x7f46ac1491b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f46ac1463e0 tx=0x7f46a001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a132e8eba96941 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:25.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46a959a640 1 -- 172.21.15.161:0/1351799669 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a00a89f0 con 0x7f46ac148d60 2024-02-02T11:49:25.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46a959a640 1 -- 172.21.15.161:0/1351799669 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a00a8b50 con 0x7f46ac148d60 2024-02-02T11:49:25.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46a959a640 1 -- 172.21.15.161:0/1351799669 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a00b0440 con 0x7f46ac148d60 2024-02-02T11:49:25.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46b09e7640 1 -- 172.21.15.161:0/1351799669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46ac148d60 msgr2=0x7f46ac1491b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:25.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46b09e7640 1 --2- 172.21.15.161:0/1351799669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46ac148d60 0x7f46ac1491b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f46ac1463e0 tx=0x7f46a001ecf0 comp rx=0 tx=0).stop 2024-02-02T11:49:25.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46b09e7640 1 -- 172.21.15.161:0/1351799669 shutdown_connections 2024-02-02T11:49:25.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46b09e7640 1 --2- 172.21.15.161:0/1351799669 >> v2:172.21.15.162:3300/0 conn(0x7f46ac151100 0x7f46ac1534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:25.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46b09e7640 1 --2- 172.21.15.161:0/1351799669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46ac148d60 0x7f46ac1491b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:25.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46b09e7640 1 -- 172.21.15.161:0/1351799669 >> 172.21.15.161:0/1351799669 conn(0x7f46ac069ef0 msgr2=0x7f46ac06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:25.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46b09e7640 1 -- 172.21.15.161:0/1351799669 shutdown_connections 2024-02-02T11:49:25.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46b09e7640 1 -- 172.21.15.161:0/1351799669 wait complete. 2024-02-02T11:49:25.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46b09e7640 1 Processor -- start 2024-02-02T11:49:25.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46b09e7640 1 -- start start 2024-02-02T11:49:25.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46b09e7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ac0bc340 0x7f46ac1e1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:25.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46b09e7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46ac148d60 0x7f46ac139b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:25.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46b09e7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46ac151100 0x7f46ac146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:25.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46b09e7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac147ae0 con 0x7f46ac151100 2024-02-02T11:49:25.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46b09e7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac13a0b0 con 0x7f46ac0bc340 2024-02-02T11:49:25.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46b09e7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac1e20b0 con 0x7f46ac148d60 2024-02-02T11:49:25.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46aad9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46ac151100 0x7f46ac146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:25.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46aad9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46ac151100 0x7f46ac146980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34296/0 (socket says 172.21.15.161:34296) 2024-02-02T11:49:25.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46aad9d640 1 -- 172.21.15.161:0/1893717757 learned_addr learned my addr 172.21.15.161:0/1893717757 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:25.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46aa59c640 1 --2- 172.21.15.161:0/1893717757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ac0bc340 0x7f46ac1e1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:25.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46a9d9b640 1 --2- 172.21.15.161:0/1893717757 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46ac148d60 0x7f46ac139b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:25.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46aad9d640 1 -- 172.21.15.161:0/1893717757 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46ac148d60 msgr2=0x7f46ac139b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:25.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46aad9d640 1 --2- 172.21.15.161:0/1893717757 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46ac148d60 0x7f46ac139b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:25.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46aad9d640 1 -- 172.21.15.161:0/1893717757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ac0bc340 msgr2=0x7f46ac1e1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:25.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46aad9d640 1 --2- 172.21.15.161:0/1893717757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ac0bc340 0x7f46ac1e1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:25.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46aad9d640 1 -- 172.21.15.161:0/1893717757 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a00094d0 con 0x7f46ac151100 2024-02-02T11:49:25.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46aad9d640 1 --2- 172.21.15.161:0/1893717757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46ac151100 0x7f46ac146980 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f469c00efc0 tx=0x7f469c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:25.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f469affd640 1 -- 172.21.15.161:0/1893717757 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c009ba0 con 0x7f46ac151100 2024-02-02T11:49:25.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f469affd640 1 -- 172.21.15.161:0/1893717757 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c00f040 con 0x7f46ac151100 2024-02-02T11:49:25.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46b09e7640 1 -- 172.21.15.161:0/1893717757 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac1ddd10 con 0x7f46ac151100 2024-02-02T11:49:25.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f469affd640 1 -- 172.21.15.161:0/1893717757 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c0146c0 con 0x7f46ac151100 2024-02-02T11:49:25.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.499+0000 7f46b09e7640 1 -- 172.21.15.161:0/1893717757 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ac1de2d0 con 0x7f46ac151100 2024-02-02T11:49:25.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.503+0000 7f46b09e7640 1 -- 172.21.15.161:0/1893717757 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ac1de4c0 con 0x7f46ac151100 2024-02-02T11:49:25.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.503+0000 7f469affd640 1 -- 172.21.15.161:0/1893717757 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f469c014820 con 0x7f46ac151100 2024-02-02T11:49:25.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.503+0000 7f469affd640 1 --2- 172.21.15.161:0/1893717757 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f468c065a60 0x7f468c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:25.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.503+0000 7f469affd640 1 -- 172.21.15.161:0/1893717757 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f469c083860 con 0x7f46ac151100 2024-02-02T11:49:25.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.503+0000 7f46aa59c640 1 --2- 172.21.15.161:0/1893717757 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f468c065a60 0x7f468c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:25.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.503+0000 7f46aa59c640 1 --2- 172.21.15.161:0/1893717757 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f468c065a60 0x7f468c067f20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f46a4007fd0 tx=0x7f46a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:25.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.507+0000 7f469affd640 1 -- 172.21.15.161:0/1893717757 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f469c051660 con 0x7f46ac151100 2024-02-02T11:49:25.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:25.671+0000 7f46b09e7640 1 -- 172.21.15.161:0/1893717757 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f46ac04e000 con 0x7f46ac151100 2024-02-02T11:49:26.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.495+0000 7f469affd640 1 -- 172.21.15.161:0/1893717757 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f469c054c80 con 0x7f46ac151100 2024-02-02T11:49:26.498 INFO:teuthology.orchestra.run.smithi161.stderr: removed all blocklist entries 2024-02-02T11:49:26.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.499+0000 7f46b09e7640 1 -- 172.21.15.161:0/1893717757 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f468c065a60 msgr2=0x7f468c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:26.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.499+0000 7f46b09e7640 1 --2- 172.21.15.161:0/1893717757 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f468c065a60 0x7f468c067f20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f46a4007fd0 tx=0x7f46a4009040 comp rx=0 tx=0).stop 2024-02-02T11:49:26.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.499+0000 7f46b09e7640 1 -- 172.21.15.161:0/1893717757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46ac151100 msgr2=0x7f46ac146980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:26.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.499+0000 7f46b09e7640 1 --2- 172.21.15.161:0/1893717757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46ac151100 0x7f46ac146980 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f469c00efc0 tx=0x7f469c00c490 comp rx=0 tx=0).stop 2024-02-02T11:49:26.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.499+0000 7f46b09e7640 1 -- 172.21.15.161:0/1893717757 shutdown_connections 2024-02-02T11:49:26.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.499+0000 7f46b09e7640 1 --2- 172.21.15.161:0/1893717757 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f468c065a60 0x7f468c067f20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:26.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.499+0000 7f46b09e7640 1 --2- 172.21.15.161:0/1893717757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46ac151100 0x7f46ac146980 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:26.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.499+0000 7f46b09e7640 1 --2- 172.21.15.161:0/1893717757 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46ac148d60 0x7f46ac139b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:26.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.499+0000 7f46b09e7640 1 --2- 172.21.15.161:0/1893717757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46ac0bc340 0x7f46ac1e1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:26.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.499+0000 7f46b09e7640 1 -- 172.21.15.161:0/1893717757 >> 172.21.15.161:0/1893717757 conn(0x7f46ac069ef0 msgr2=0x7f46ac0b8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:26.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.499+0000 7f46b09e7640 1 -- 172.21.15.161:0/1893717757 shutdown_connections 2024-02-02T11:49:26.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.499+0000 7f46b09e7640 1 -- 172.21.15.161:0/1893717757 wait complete. 2024-02-02T11:49:26.528 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-02-02T11:49:26.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.647+0000 7feae13b8640 1 Processor -- start 2024-02-02T11:49:26.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.647+0000 7feae13b8640 1 -- start start 2024-02-02T11:49:26.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.647+0000 7feae13b8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7feadc0bc340 0x7feadc142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:26.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.647+0000 7feae13b8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feadc149470 0x7feadc153110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:26.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.647+0000 7feae13b8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feadc071770 con 0x7feadc142d50 2024-02-02T11:49:26.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.647+0000 7feae13b8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feadc0b37e0 con 0x7feadc0bc340 2024-02-02T11:49:26.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.647+0000 7feae13b8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc0b3ac0 con 0x7feadc149470 2024-02-02T11:49:26.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.647+0000 7feadaffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7feadc0bc340 0x7feadc142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:26.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.647+0000 7feadb7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feadc149470 0x7feadc153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:26.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.647+0000 7feada7fc640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7feadc142d50 0x7feadc148d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.161:55322/0 (socket says 172.21.15.161:55322) 2024-02-02T11:49:26.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.647+0000 7feada7fc640 1 -- 172.21.15.161:0/3574157617 learned_addr learned my addr 172.21.15.161:0/3574157617 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:26.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.647+0000 7feadaffd640 1 -- 172.21.15.161:0/3574157617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feadc149470 msgr2=0x7feadc153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:26.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.647+0000 7feadaffd640 1 --2- 172.21.15.161:0/3574157617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feadc149470 0x7feadc153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:26.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.647+0000 7feadaffd640 1 -- 172.21.15.161:0/3574157617 >> v1:172.21.15.162:6789/0 conn(0x7feadc142d50 legacy=0x7feadc148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:26.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.647+0000 7feadaffd640 1 -- 172.21.15.161:0/3574157617 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc0b3da0 con 0x7feadc0bc340 2024-02-02T11:49:26.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.651+0000 7feadaffd640 1 --2- 172.21.15.161:0/3574157617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feadc0bc340 0x7feadc142810 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7feacc0097c0 tx=0x7feacc01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb9438211193ea23 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:26.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.651+0000 7fead9ffb640 1 -- 172.21.15.161:0/3574157617 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc0a8970 con 0x7feadc0bc340 2024-02-02T11:49:26.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.651+0000 7fead9ffb640 1 -- 172.21.15.161:0/3574157617 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc0a8ad0 con 0x7feadc0bc340 2024-02-02T11:49:26.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.651+0000 7fead9ffb640 1 -- 172.21.15.161:0/3574157617 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc0a8e60 con 0x7feadc0bc340 2024-02-02T11:49:26.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.651+0000 7feae13b8640 1 -- 172.21.15.161:0/3574157617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feadc0bc340 msgr2=0x7feadc142810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:26.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.651+0000 7feae13b8640 1 --2- 172.21.15.161:0/3574157617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feadc0bc340 0x7feadc142810 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7feacc0097c0 tx=0x7feacc01ec70 comp rx=0 tx=0).stop 2024-02-02T11:49:26.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.651+0000 7feae13b8640 1 -- 172.21.15.161:0/3574157617 shutdown_connections 2024-02-02T11:49:26.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.651+0000 7feae13b8640 1 --2- 172.21.15.161:0/3574157617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feadc149470 0x7feadc153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:26.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.651+0000 7feae13b8640 1 --2- 172.21.15.161:0/3574157617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feadc0bc340 0x7feadc142810 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:26.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.651+0000 7feae13b8640 1 -- 172.21.15.161:0/3574157617 >> 172.21.15.161:0/3574157617 conn(0x7feadc069ef0 msgr2=0x7feadc06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:26.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.651+0000 7feae13b8640 1 -- 172.21.15.161:0/3574157617 shutdown_connections 2024-02-02T11:49:26.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.651+0000 7feae13b8640 1 -- 172.21.15.161:0/3574157617 wait complete. 2024-02-02T11:49:26.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.651+0000 7feae13b8640 1 Processor -- start 2024-02-02T11:49:26.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.651+0000 7feae13b8640 1 -- start start 2024-02-02T11:49:26.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feae13b8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feadc0bc340 0x7feadc148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:26.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feae13b8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feadc149470 0x7feadc1e1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:26.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feae13b8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feadc136e00 0x7feadc1ddbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:26.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feae13b8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc141d80 con 0x7feadc0bc340 2024-02-02T11:49:26.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feae13b8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc146860 con 0x7feadc149470 2024-02-02T11:49:26.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feae13b8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc136120 con 0x7feadc136e00 2024-02-02T11:49:26.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feadaffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feadc0bc340 0x7feadc148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:26.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feadaffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feadc0bc340 0x7feadc148150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34306/0 (socket says 172.21.15.161:34306) 2024-02-02T11:49:26.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feadaffd640 1 -- 172.21.15.161:0/3055040496 learned_addr learned my addr 172.21.15.161:0/3055040496 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:26.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feada7fc640 1 --2- 172.21.15.161:0/3055040496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feadc149470 0x7feadc1e1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:26.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feadb7fe640 1 --2- 172.21.15.161:0/3055040496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feadc136e00 0x7feadc1ddbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:26.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feadaffd640 1 -- 172.21.15.161:0/3055040496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feadc136e00 msgr2=0x7feadc1ddbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:26.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feadaffd640 1 --2- 172.21.15.161:0/3055040496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feadc136e00 0x7feadc1ddbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:26.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feadaffd640 1 -- 172.21.15.161:0/3055040496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feadc149470 msgr2=0x7feadc1e1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:26.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feadaffd640 1 --2- 172.21.15.161:0/3055040496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feadc149470 0x7feadc1e1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:26.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feadaffd640 1 -- 172.21.15.161:0/3055040496 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feacc009420 con 0x7feadc0bc340 2024-02-02T11:49:26.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feadaffd640 1 --2- 172.21.15.161:0/3055040496 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feadc0bc340 0x7feadc148150 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7feacc01c8a0 tx=0x7feacc01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:26.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feac37fe640 1 -- 172.21.15.161:0/3055040496 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc0b9630 con 0x7feadc0bc340 2024-02-02T11:49:26.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feac37fe640 1 -- 172.21.15.161:0/3055040496 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc0b97b0 con 0x7feadc0bc340 2024-02-02T11:49:26.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feac37fe640 1 -- 172.21.15.161:0/3055040496 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc0b9b60 con 0x7feadc0bc340 2024-02-02T11:49:26.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feae13b8640 1 -- 172.21.15.161:0/3055040496 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feadc148690 con 0x7feadc0bc340 2024-02-02T11:49:26.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feae13b8640 1 -- 172.21.15.161:0/3055040496 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feadc1470e0 con 0x7feadc0bc340 2024-02-02T11:49:26.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feae13b8640 1 -- 172.21.15.161:0/3055040496 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feadc148820 con 0x7feadc0bc340 2024-02-02T11:49:26.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feac37fe640 1 -- 172.21.15.161:0/3055040496 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feacc0b7040 con 0x7feadc0bc340 2024-02-02T11:49:26.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feac37fe640 1 --2- 172.21.15.161:0/3055040496 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7feac8065a60 0x7feac8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:26.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feac37fe640 1 -- 172.21.15.161:0/3055040496 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feacc120cd0 con 0x7feadc0bc340 2024-02-02T11:49:26.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feada7fc640 1 --2- 172.21.15.161:0/3055040496 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7feac8065a60 0x7feac8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:26.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.655+0000 7feada7fc640 1 --2- 172.21.15.161:0/3055040496 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7feac8065a60 0x7feac8067f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feadc1463b0 tx=0x7fead0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:26.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.659+0000 7feac37fe640 1 -- 172.21.15.161:0/3055040496 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7feadc148820 con 0x7feadc0bc340 2024-02-02T11:49:26.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.871+0000 7feae13b8640 1 -- 172.21.15.161:0/3055040496 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7feadc146e00 con 0x7feadc0bc340 2024-02-02T11:49:26.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.871+0000 7feac37fe640 1 -- 172.21.15.161:0/3055040496 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+5491 (secure 0 0 0) 0x7feadc146e00 con 0x7feadc0bc340 2024-02-02T11:49:26.874 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:26.874 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-02-02T11:49:26.874 INFO:teuthology.orchestra.run.smithi161.stdout: "auth_dump": [ 2024-02-02T11:49:26.874 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.874 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mds.a", 2024-02-02T11:49:26.874 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQBp1rxlxOawJxAAWSZawj3hS89wA1DPGE7yHg==", 2024-02-02T11:49:26.874 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.874 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2024-02-02T11:49:26.874 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2024-02-02T11:49:26.874 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2024-02-02T11:49:26.874 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2024-02-02T11:49:26.875 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.875 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.875 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.875 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mds.b", 2024-02-02T11:49:26.875 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQBp1rxlCYiNNhAAGqk9Tlg8Ax72P7SD1HJ3qg==", 2024-02-02T11:49:26.875 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.875 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2024-02-02T11:49:26.875 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2024-02-02T11:49:26.875 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2024-02-02T11:49:26.875 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2024-02-02T11:49:26.875 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.875 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.876 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.876 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mds.c", 2024-02-02T11:49:26.876 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQBp1rxlJaKPMBAAwUlSQGoRtA9BOYUiin0wPw==", 2024-02-02T11:49:26.876 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.876 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2024-02-02T11:49:26.876 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2024-02-02T11:49:26.876 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2024-02-02T11:49:26.876 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2024-02-02T11:49:26.876 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.876 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.876 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.876 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.0", 2024-02-02T11:49:26.876 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQBt1rxlYDpRBRAAaf9rBuQ+CXaL59M7j9xrNw==", 2024-02-02T11:49:26.877 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.877 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2024-02-02T11:49:26.877 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2024-02-02T11:49:26.877 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2024-02-02T11:49:26.877 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.877 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.877 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.877 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.1", 2024-02-02T11:49:26.877 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQBw1rxlG55oDBAACBKhNZqFQHR3ljkr4k9JwQ==", 2024-02-02T11:49:26.877 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.877 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2024-02-02T11:49:26.877 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2024-02-02T11:49:26.877 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2024-02-02T11:49:26.877 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.877 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.878 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.878 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.2", 2024-02-02T11:49:26.878 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQBz1rxllNJUFRAAU932UD89z/nyyuLZQ8Fjyw==", 2024-02-02T11:49:26.878 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.878 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2024-02-02T11:49:26.878 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2024-02-02T11:49:26.878 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2024-02-02T11:49:26.878 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.878 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.878 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.878 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.3", 2024-02-02T11:49:26.878 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQB21rxlLe8QHhAAiWoWiIUOEdgT6DkemPzrcA==", 2024-02-02T11:49:26.878 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.878 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2024-02-02T11:49:26.878 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2024-02-02T11:49:26.878 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2024-02-02T11:49:26.879 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.879 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.879 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.879 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.4", 2024-02-02T11:49:26.879 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQB81rxl5fyyHhAA6KPyf/xxUmu/eoY4VdNXGw==", 2024-02-02T11:49:26.879 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.879 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2024-02-02T11:49:26.879 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2024-02-02T11:49:26.879 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2024-02-02T11:49:26.879 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.879 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.879 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.879 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.5", 2024-02-02T11:49:26.879 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQB/1rxlroG5JRAA0dXPT9pnOdKVCNpJoR4IdQ==", 2024-02-02T11:49:26.879 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.879 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2024-02-02T11:49:26.880 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2024-02-02T11:49:26.880 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2024-02-02T11:49:26.880 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.880 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.880 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.880 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.6", 2024-02-02T11:49:26.880 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQCC1rxlv922LhAA9K1LeUlZqdXuJwckWT7oQw==", 2024-02-02T11:49:26.880 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.880 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2024-02-02T11:49:26.880 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2024-02-02T11:49:26.880 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2024-02-02T11:49:26.880 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.880 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.880 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.881 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.7", 2024-02-02T11:49:26.881 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQCF1rxlwx9iNRAA27J1KGMoczm20Aa+zYOU8w==", 2024-02-02T11:49:26.881 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.881 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2024-02-02T11:49:26.881 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2024-02-02T11:49:26.881 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2024-02-02T11:49:26.881 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.881 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.881 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.881 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.0", 2024-02-02T11:49:26.881 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQBq1rxlnABLARAAW/Va1VLc/q9UBtLt0a0gKg==", 2024-02-02T11:49:26.881 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.881 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2024-02-02T11:49:26.881 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow r", 2024-02-02T11:49:26.881 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow rw", 2024-02-02T11:49:26.881 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow rwx" 2024-02-02T11:49:26.881 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.882 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.882 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.882 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.admin", 2024-02-02T11:49:26.882 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQBp1rxlR51tBxAABbzxZahfKYl0M7QrtLzrXQ==", 2024-02-02T11:49:26.882 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.882 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow *", 2024-02-02T11:49:26.882 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2024-02-02T11:49:26.882 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2024-02-02T11:49:26.882 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2024-02-02T11:49:26.882 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.882 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.882 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.882 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.bootstrap-mds", 2024-02-02T11:49:26.882 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQCL1rxlgu//KBAAVy35lCOKFUSgFmfJYsnFvg==", 2024-02-02T11:49:26.882 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.882 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile bootstrap-mds" 2024-02-02T11:49:26.883 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.883 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.883 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.883 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.bootstrap-mgr", 2024-02-02T11:49:26.883 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQCL1rxlRQsAKRAAJrGcZSwoOkpNBju8efO6zw==", 2024-02-02T11:49:26.883 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.883 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile bootstrap-mgr" 2024-02-02T11:49:26.883 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.883 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.883 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.883 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.bootstrap-osd", 2024-02-02T11:49:26.883 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQCL1rxlhyMAKRAASknSmcfMXh066ey0/kxeog==", 2024-02-02T11:49:26.883 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.883 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile bootstrap-osd" 2024-02-02T11:49:26.883 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.883 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.883 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.883 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.bootstrap-rbd", 2024-02-02T11:49:26.884 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQCL1rxlqDwAKRAAOpUC4ndBJy+TCSPRzQjqFg==", 2024-02-02T11:49:26.884 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.884 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile bootstrap-rbd" 2024-02-02T11:49:26.884 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.884 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.884 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.884 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-02-02T11:49:26.884 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQCL1rxlelMAKRAA+3PSLNxXOx2RKPLI3GAKsQ==", 2024-02-02T11:49:26.884 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.884 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-02-02T11:49:26.884 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.884 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.884 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.884 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.bootstrap-rgw", 2024-02-02T11:49:26.884 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQCL1rxlqGoAKRAAyM7Ut2YL2Lj3aU1ICG4dOQ==", 2024-02-02T11:49:26.885 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.885 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile bootstrap-rgw" 2024-02-02T11:49:26.885 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.885 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.885 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.885 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mgr.x", 2024-02-02T11:49:26.885 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQBp1rxlVo5eJBAAHd9UNm1vBCM9RgVJT77dog==", 2024-02-02T11:49:26.885 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.885 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow *", 2024-02-02T11:49:26.885 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile mgr", 2024-02-02T11:49:26.885 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2024-02-02T11:49:26.885 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.885 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-02T11:49:26.885 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:26.885 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mgr.y", 2024-02-02T11:49:26.885 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQBp1rxl6AKeIRAA9stWSYjJgcwek6W7OP/Rhg==", 2024-02-02T11:49:26.886 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2024-02-02T11:49:26.886 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow *", 2024-02-02T11:49:26.886 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile mgr", 2024-02-02T11:49:26.886 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2024-02-02T11:49:26.886 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.886 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:26.886 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-02-02T11:49:26.886 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-02-02T11:49:26.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.871+0000 7feae13b8640 1 -- 172.21.15.161:0/3055040496 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7feac8065a60 msgr2=0x7feac8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:26.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.871+0000 7feae13b8640 1 --2- 172.21.15.161:0/3055040496 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7feac8065a60 0x7feac8067f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feadc1463b0 tx=0x7fead0009040 comp rx=0 tx=0).stop 2024-02-02T11:49:26.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.871+0000 7feae13b8640 1 -- 172.21.15.161:0/3055040496 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feadc0bc340 msgr2=0x7feadc148150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:26.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.871+0000 7feae13b8640 1 --2- 172.21.15.161:0/3055040496 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feadc0bc340 0x7feadc148150 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7feacc01c8a0 tx=0x7feacc01ba10 comp rx=0 tx=0).stop 2024-02-02T11:49:26.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.871+0000 7feae13b8640 1 -- 172.21.15.161:0/3055040496 shutdown_connections 2024-02-02T11:49:26.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.871+0000 7feae13b8640 1 --2- 172.21.15.161:0/3055040496 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7feac8065a60 0x7feac8067f20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:26.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.871+0000 7feae13b8640 1 --2- 172.21.15.161:0/3055040496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feadc136e00 0x7feadc1ddbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:26.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.871+0000 7feae13b8640 1 --2- 172.21.15.161:0/3055040496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feadc149470 0x7feadc1e1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:26.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.871+0000 7feae13b8640 1 --2- 172.21.15.161:0/3055040496 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feadc0bc340 0x7feadc148150 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:26.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.871+0000 7feae13b8640 1 -- 172.21.15.161:0/3055040496 >> 172.21.15.161:0/3055040496 conn(0x7feadc069ef0 msgr2=0x7feadc0b71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:26.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.871+0000 7feae13b8640 1 -- 172.21.15.161:0/3055040496 shutdown_connections 2024-02-02T11:49:26.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:26.871+0000 7feae13b8640 1 -- 172.21.15.161:0/3055040496 wait complete. 2024-02-02T11:49:26.893 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-02-02T11:49:27.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef8289640 1 Processor -- start 2024-02-02T11:49:27.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef8289640 1 -- start start 2024-02-02T11:49:27.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef8289640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9ef00bc340 0x7f9ef01415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef8289640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef0071550 con 0x7f9ef00b8020 2024-02-02T11:49:27.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef8289640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef0071810 con 0x7f9ef0141b30 2024-02-02T11:49:27.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef8289640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef00bc720 con 0x7f9ef00bc340 2024-02-02T11:49:27.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef6826640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f9ef00b8020 0x7f9ef0151f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40804/0 (socket says 172.21.15.161:40804) 2024-02-02T11:49:27.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef6826640 1 -- 172.21.15.161:0/4139593176 learned_addr learned my addr 172.21.15.161:0/4139593176 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:27.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef6025640 1 --2- 172.21.15.161:0/4139593176 >> v2:172.21.15.162:3300/0 conn(0x7f9ef00bc340 0x7f9ef01415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5023640 1 -- 172.21.15.161:0/4139593176 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404948912 0 0) 0x7f9ef0071550 con 0x7f9ef00b8020 2024-02-02T11:49:27.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5023640 1 -- 172.21.15.161:0/4139593176 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9edc003530 con 0x7f9ef00b8020 2024-02-02T11:49:27.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5023640 1 -- 172.21.15.161:0/4139593176 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3196350205 0 0) 0x7f9edc003530 con 0x7f9ef00b8020 2024-02-02T11:49:27.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5023640 1 -- 172.21.15.161:0/4139593176 >> v2:172.21.15.162:3300/0 conn(0x7f9ef00bc340 msgr2=0x7f9ef01415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:27.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5023640 1 --2- 172.21.15.161:0/4139593176 >> v2:172.21.15.162:3300/0 conn(0x7f9ef00bc340 0x7f9ef01415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5023640 1 -- 172.21.15.161:0/4139593176 >> v1:172.21.15.162:6789/0 conn(0x7f9ef0141b30 legacy=0x7f9ef0147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5023640 1 -- 172.21.15.161:0/4139593176 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef00b2d90 con 0x7f9ef00b8020 2024-02-02T11:49:27.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5023640 1 -- 172.21.15.161:0/4139593176 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f9ee8001a00 con 0x7f9ef00b8020 2024-02-02T11:49:27.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5023640 1 -- 172.21.15.161:0/4139593176 >> v1:172.21.15.161:6789/0 conn(0x7f9ef00b8020 legacy=0x7f9ef0151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5023640 1 --2- 172.21.15.161:0/4139593176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9edc0039d0 0x7f9edc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5023640 1 --2- 172.21.15.161:0/4139593176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0047d0 0x7f9edc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5023640 1 --2- 172.21.15.161:0/4139593176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9edc0051e0 0x7f9edc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5023640 1 -- 172.21.15.161:0/4139593176 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00bc720 con 0x7f9edc0047d0 2024-02-02T11:49:27.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5023640 1 -- 172.21.15.161:0/4139593176 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc00c130 con 0x7f9edc0039d0 2024-02-02T11:49:27.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5023640 1 -- 172.21.15.161:0/4139593176 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc00c2f0 con 0x7f9edc0051e0 2024-02-02T11:49:27.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5824640 1 --2- 172.21.15.161:0/4139593176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0047d0 0x7f9edc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef6826640 1 --2- 172.21.15.161:0/4139593176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9edc0051e0 0x7f9edc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef6025640 1 --2- 172.21.15.161:0/4139593176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9edc0039d0 0x7f9edc003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5824640 1 -- 172.21.15.161:0/4139593176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9edc0051e0 msgr2=0x7f9edc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:27.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5824640 1 --2- 172.21.15.161:0/4139593176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9edc0051e0 0x7f9edc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5824640 1 -- 172.21.15.161:0/4139593176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9edc0039d0 msgr2=0x7f9edc003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:27.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5824640 1 --2- 172.21.15.161:0/4139593176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9edc0039d0 0x7f9edc003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef5824640 1 -- 172.21.15.161:0/4139593176 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc003530 con 0x7f9edc0047d0 2024-02-02T11:49:27.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.007+0000 7f9ef6826640 1 -- 172.21.15.161:0/4139593176 reap_dead start 2024-02-02T11:49:27.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef5824640 1 --2- 172.21.15.161:0/4139593176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0047d0 0x7f9edc004c50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9eec001750 tx=0x7f9eec01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b87102112882dd server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:27.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef5023640 1 -- 172.21.15.161:0/4139593176 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec0052d0 con 0x7f9edc0047d0 2024-02-02T11:49:27.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef5023640 1 -- 172.21.15.161:0/4139593176 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eec0a7050 con 0x7f9edc0047d0 2024-02-02T11:49:27.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef5023640 1 -- 172.21.15.161:0/4139593176 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec003600 con 0x7f9edc0047d0 2024-02-02T11:49:27.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef8289640 1 -- 172.21.15.161:0/4139593176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0047d0 msgr2=0x7f9edc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef8289640 1 --2- 172.21.15.161:0/4139593176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0047d0 0x7f9edc004c50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9eec001750 tx=0x7f9eec01c3c0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef8289640 1 -- 172.21.15.161:0/4139593176 shutdown_connections 2024-02-02T11:49:27.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef8289640 1 --2- 172.21.15.161:0/4139593176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0047d0 0x7f9edc004c50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef8289640 1 -- 172.21.15.161:0/4139593176 >> 172.21.15.161:0/4139593176 conn(0x7f9ef0069ef0 msgr2=0x7f9ef006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:27.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef8289640 1 -- 172.21.15.161:0/4139593176 shutdown_connections 2024-02-02T11:49:27.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef8289640 1 -- 172.21.15.161:0/4139593176 wait complete. 2024-02-02T11:49:27.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef8289640 1 Processor -- start 2024-02-02T11:49:27.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef8289640 1 -- start start 2024-02-02T11:49:27.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef8289640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0047d0 0x7f9ef0146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef8289640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ef01d2fa0 0x7f9ef01e4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef8289640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ef01e4ba0 0x7f9ef013b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef8289640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef0147240 con 0x7f9edc0047d0 2024-02-02T11:49:27.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef8289640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef01e5020 con 0x7f9ef01d2fa0 2024-02-02T11:49:27.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef8289640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef01d37d0 con 0x7f9ef01e4ba0 2024-02-02T11:49:27.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef6025640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0047d0 0x7f9ef0146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef6025640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0047d0 0x7f9ef0146d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34334/0 (socket says 172.21.15.161:34334) 2024-02-02T11:49:27.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.011+0000 7f9ef6025640 1 -- 172.21.15.161:0/1413939628 learned_addr learned my addr 172.21.15.161:0/1413939628 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:27.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.015+0000 7f9ef5824640 1 --2- 172.21.15.161:0/1413939628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ef01d2fa0 0x7f9ef01e4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.015+0000 7f9ef6826640 1 --2- 172.21.15.161:0/1413939628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ef01e4ba0 0x7f9ef013b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.015+0000 7f9ef6025640 1 -- 172.21.15.161:0/1413939628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ef01e4ba0 msgr2=0x7f9ef013b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.015+0000 7f9ef6025640 1 --2- 172.21.15.161:0/1413939628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ef01e4ba0 0x7f9ef013b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.015+0000 7f9ef6025640 1 -- 172.21.15.161:0/1413939628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ef01d2fa0 msgr2=0x7f9ef01e4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.015+0000 7f9ef6025640 1 --2- 172.21.15.161:0/1413939628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ef01d2fa0 0x7f9ef01e4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.015+0000 7f9ef6025640 1 -- 172.21.15.161:0/1413939628 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef00b6500 con 0x7f9edc0047d0 2024-02-02T11:49:27.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.015+0000 7f9ef6025640 1 --2- 172.21.15.161:0/1413939628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0047d0 0x7f9ef0146d00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0011500 tx=0x7f9ee00119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:27.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.015+0000 7f9ee6ffd640 1 -- 172.21.15.161:0/1413939628 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0015870 con 0x7f9edc0047d0 2024-02-02T11:49:27.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.015+0000 7f9ee6ffd640 1 -- 172.21.15.161:0/1413939628 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee00159d0 con 0x7f9edc0047d0 2024-02-02T11:49:27.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.015+0000 7f9ef8289640 1 -- 172.21.15.161:0/1413939628 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef0143f50 con 0x7f9edc0047d0 2024-02-02T11:49:27.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.015+0000 7f9ee6ffd640 1 -- 172.21.15.161:0/1413939628 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0015d40 con 0x7f9edc0047d0 2024-02-02T11:49:27.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.015+0000 7f9ef8289640 1 -- 172.21.15.161:0/1413939628 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef0144510 con 0x7f9edc0047d0 2024-02-02T11:49:27.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.015+0000 7f9ef8289640 1 -- 172.21.15.161:0/1413939628 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef004e000 con 0x7f9edc0047d0 2024-02-02T11:49:27.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.015+0000 7f9ee6ffd640 1 -- 172.21.15.161:0/1413939628 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9ee0013400 con 0x7f9edc0047d0 2024-02-02T11:49:27.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.015+0000 7f9ee6ffd640 1 --2- 172.21.15.161:0/1413939628 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9ed4065a90 0x7f9ed4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.015+0000 7f9ee6ffd640 1 -- 172.21.15.161:0/1413939628 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9ee0083630 con 0x7f9edc0047d0 2024-02-02T11:49:27.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.015+0000 7f9ef5824640 1 --2- 172.21.15.161:0/1413939628 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9ed4065a90 0x7f9ed4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.015+0000 7f9ef5824640 1 --2- 172.21.15.161:0/1413939628 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9ed4065a90 0x7f9ed4067f50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9edc004750 tx=0x7f9eec0011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:27.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.019+0000 7f9ee6ffd640 1 -- 172.21.15.161:0/1413939628 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9ee0051350 con 0x7f9edc0047d0 2024-02-02T11:49:27.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.227+0000 7f9ef8289640 1 -- 172.21.15.161:0/1413939628 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f9ef0140080 con 0x7f9edc0047d0 2024-02-02T11:49:27.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.235+0000 7f9ee6ffd640 1 -- 172.21.15.161:0/1413939628 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9ee0054970 con 0x7f9edc0047d0 2024-02-02T11:49:27.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.239+0000 7f9ef8289640 1 -- 172.21.15.161:0/1413939628 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9ed4065a90 msgr2=0x7f9ed4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.239+0000 7f9ef8289640 1 --2- 172.21.15.161:0/1413939628 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9ed4065a90 0x7f9ed4067f50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9edc004750 tx=0x7f9eec0011a0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.239+0000 7f9ef8289640 1 -- 172.21.15.161:0/1413939628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0047d0 msgr2=0x7f9ef0146d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.239+0000 7f9ef8289640 1 --2- 172.21.15.161:0/1413939628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0047d0 0x7f9ef0146d00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0011500 tx=0x7f9ee00119c0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.239+0000 7f9ef8289640 1 -- 172.21.15.161:0/1413939628 shutdown_connections 2024-02-02T11:49:27.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.239+0000 7f9ef8289640 1 --2- 172.21.15.161:0/1413939628 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9ed4065a90 0x7f9ed4067f50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.239+0000 7f9ef8289640 1 --2- 172.21.15.161:0/1413939628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ef01e4ba0 0x7f9ef013b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.239+0000 7f9ef8289640 1 --2- 172.21.15.161:0/1413939628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ef01d2fa0 0x7f9ef01e4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.239+0000 7f9ef8289640 1 --2- 172.21.15.161:0/1413939628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9edc0047d0 0x7f9ef0146d00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.239+0000 7f9ef8289640 1 -- 172.21.15.161:0/1413939628 >> 172.21.15.161:0/1413939628 conn(0x7f9ef0069ef0 msgr2=0x7f9ef013f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:27.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.239+0000 7f9ef8289640 1 -- 172.21.15.161:0/1413939628 shutdown_connections 2024-02-02T11:49:27.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.239+0000 7f9ef8289640 1 -- 172.21.15.161:0/1413939628 wait complete. 2024-02-02T11:49:27.258 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-02-02T11:49:27.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb91c2640 1 Processor -- start 2024-02-02T11:49:27.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb91c2640 1 -- start start 2024-02-02T11:49:27.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb91c2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1eb4070010 0x7f1eb4070910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb91c2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb4071180 con 0x7f1eb4071610 2024-02-02T11:49:27.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb91c2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb40b9c10 con 0x7f1eb4141700 2024-02-02T11:49:27.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb91c2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb40ba1d0 con 0x7f1eb4070010 2024-02-02T11:49:27.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb259c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f1eb4071610 0x7f1eb4147630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40810/0 (socket says 172.21.15.161:40810) 2024-02-02T11:49:27.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb259c640 1 -- 172.21.15.161:0/738687162 learned_addr learned my addr 172.21.15.161:0/738687162 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:27.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb2d9d640 1 --2- 172.21.15.161:0/738687162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1eb4070010 0x7f1eb4070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb1d9b640 1 -- 172.21.15.161:0/738687162 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418658995 0 0) 0x7f1eb4071180 con 0x7f1eb4071610 2024-02-02T11:49:27.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb1d9b640 1 -- 172.21.15.161:0/738687162 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e9c003530 con 0x7f1eb4071610 2024-02-02T11:49:27.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb1d9b640 1 -- 172.21.15.161:0/738687162 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 947660303 0 0) 0x7f1e9c003530 con 0x7f1eb4071610 2024-02-02T11:49:27.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb1d9b640 1 -- 172.21.15.161:0/738687162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1eb4070010 msgr2=0x7f1eb4070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:27.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb1d9b640 1 --2- 172.21.15.161:0/738687162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1eb4070010 0x7f1eb4070910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb1d9b640 1 -- 172.21.15.161:0/738687162 >> v1:172.21.15.162:6789/0 conn(0x7f1eb4141700 legacy=0x7f1eb4151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb1d9b640 1 -- 172.21.15.161:0/738687162 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb40b9ef0 con 0x7f1eb4071610 2024-02-02T11:49:27.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb1d9b640 1 -- 172.21.15.161:0/738687162 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f1ea8001a00 con 0x7f1eb4071610 2024-02-02T11:49:27.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb1d9b640 1 -- 172.21.15.161:0/738687162 >> v1:172.21.15.161:6789/0 conn(0x7f1eb4071610 legacy=0x7f1eb4147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb1d9b640 1 --2- 172.21.15.161:0/738687162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e9c0039b0 0x7f1e9c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb1d9b640 1 --2- 172.21.15.161:0/738687162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e9c0047d0 0x7f1e9c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb1d9b640 1 --2- 172.21.15.161:0/738687162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1eb4070010 0x7f1e9c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb1d9b640 1 -- 172.21.15.161:0/738687162 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb40ba1d0 con 0x7f1e9c0047d0 2024-02-02T11:49:27.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb1d9b640 1 -- 172.21.15.161:0/738687162 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c00ba40 con 0x7f1e9c0039b0 2024-02-02T11:49:27.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb1d9b640 1 -- 172.21.15.161:0/738687162 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c00bc00 con 0x7f1eb4070010 2024-02-02T11:49:27.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb259c640 1 --2- 172.21.15.161:0/738687162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e9c0047d0 0x7f1e9c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb2d9d640 1 --2- 172.21.15.161:0/738687162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e9c0039b0 0x7f1e9c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb359e640 1 --2- 172.21.15.161:0/738687162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1eb4070010 0x7f1e9c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb259c640 1 -- 172.21.15.161:0/738687162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1eb4070010 msgr2=0x7f1e9c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:27.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb259c640 1 --2- 172.21.15.161:0/738687162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1eb4070010 0x7f1e9c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb259c640 1 -- 172.21.15.161:0/738687162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e9c0039b0 msgr2=0x7f1e9c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:27.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb259c640 1 --2- 172.21.15.161:0/738687162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e9c0039b0 0x7f1e9c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.379+0000 7f1eb259c640 1 -- 172.21.15.161:0/738687162 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9c003530 con 0x7f1e9c0047d0 2024-02-02T11:49:27.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.383+0000 7f1eb259c640 1 --2- 172.21.15.161:0/738687162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e9c0047d0 0x7f1e9c004c50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800a800 tx=0x7f1ea801fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa69f7129c13f77e server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:27.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.383+0000 7f1eb1d9b640 1 -- 172.21.15.161:0/738687162 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea80aa670 con 0x7f1e9c0047d0 2024-02-02T11:49:27.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.383+0000 7f1eb1d9b640 1 -- 172.21.15.161:0/738687162 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea80aa7d0 con 0x7f1e9c0047d0 2024-02-02T11:49:27.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.383+0000 7f1eb1d9b640 1 -- 172.21.15.161:0/738687162 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea80aabc0 con 0x7f1e9c0047d0 2024-02-02T11:49:27.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.383+0000 7f1eb91c2640 1 -- 172.21.15.161:0/738687162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e9c0047d0 msgr2=0x7f1e9c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.383+0000 7f1eb91c2640 1 --2- 172.21.15.161:0/738687162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e9c0047d0 0x7f1e9c004c50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800a800 tx=0x7f1ea801fa40 comp rx=0 tx=0).stop 2024-02-02T11:49:27.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.383+0000 7f1eb359e640 1 -- 172.21.15.161:0/738687162 reap_dead start 2024-02-02T11:49:27.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.383+0000 7f1eb91c2640 1 -- 172.21.15.161:0/738687162 shutdown_connections 2024-02-02T11:49:27.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.383+0000 7f1eb91c2640 1 -- 172.21.15.161:0/738687162 >> 172.21.15.161:0/738687162 conn(0x7f1eb406ae30 msgr2=0x7f1eb406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:27.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.383+0000 7f1eb91c2640 1 -- 172.21.15.161:0/738687162 shutdown_connections 2024-02-02T11:49:27.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.383+0000 7f1eb91c2640 1 -- 172.21.15.161:0/738687162 wait complete. 2024-02-02T11:49:27.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.383+0000 7f1eb91c2640 1 Processor -- start 2024-02-02T11:49:27.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.383+0000 7f1eb91c2640 1 -- start start 2024-02-02T11:49:27.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb91c2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e9c0047d0 0x7f1eb4146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb91c2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1eb41cfb00 0x7f1eb41cff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb91c2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1eb4139370 0x7f1eb4139820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb91c2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb4146b70 con 0x7f1eb41cfb00 2024-02-02T11:49:27.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb91c2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb40bc5f0 con 0x7f1eb4139370 2024-02-02T11:49:27.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb91c2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb40bd2e0 con 0x7f1e9c0047d0 2024-02-02T11:49:27.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1eb41cfb00 0x7f1eb41cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1eb41cfb00 0x7f1eb41cff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34358/0 (socket says 172.21.15.161:34358) 2024-02-02T11:49:27.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb259c640 1 -- 172.21.15.161:0/1048597984 learned_addr learned my addr 172.21.15.161:0/1048597984 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:27.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb359e640 1 --2- 172.21.15.161:0/1048597984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1eb4139370 0x7f1eb4139820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb2d9d640 1 --2- 172.21.15.161:0/1048597984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e9c0047d0 0x7f1eb4146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb259c640 1 -- 172.21.15.161:0/1048597984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e9c0047d0 msgr2=0x7f1eb4146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb259c640 1 --2- 172.21.15.161:0/1048597984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e9c0047d0 0x7f1eb4146630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb259c640 1 -- 172.21.15.161:0/1048597984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1eb4139370 msgr2=0x7f1eb4139820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb259c640 1 --2- 172.21.15.161:0/1048597984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1eb4139370 0x7f1eb4139820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb259c640 1 -- 172.21.15.161:0/1048597984 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb41d04a0 con 0x7f1eb41cfb00 2024-02-02T11:49:27.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb259c640 1 --2- 172.21.15.161:0/1048597984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1eb41cfb00 0x7f1eb41cff60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8001cc0 tx=0x7f1e9c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:27.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1e9b7fe640 1 -- 172.21.15.161:0/1048597984 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea80b9070 con 0x7f1eb41cfb00 2024-02-02T11:49:27.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1e9b7fe640 1 -- 172.21.15.161:0/1048597984 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea80aa4f0 con 0x7f1eb41cfb00 2024-02-02T11:49:27.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb91c2640 1 -- 172.21.15.161:0/1048597984 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb40bd550 con 0x7f1eb41cfb00 2024-02-02T11:49:27.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1e9b7fe640 1 -- 172.21.15.161:0/1048597984 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8001a00 con 0x7f1eb41cfb00 2024-02-02T11:49:27.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb91c2640 1 -- 172.21.15.161:0/1048597984 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb40bbf30 con 0x7f1eb41cfb00 2024-02-02T11:49:27.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb91c2640 1 -- 172.21.15.161:0/1048597984 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb404e000 con 0x7f1eb41cfb00 2024-02-02T11:49:27.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1e9b7fe640 1 -- 172.21.15.161:0/1048597984 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1ea80aa940 con 0x7f1eb41cfb00 2024-02-02T11:49:27.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1e9b7fe640 1 --2- 172.21.15.161:0/1048597984 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1ea0065a90 0x7f1ea0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb2d9d640 1 --2- 172.21.15.161:0/1048597984 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1ea0065a90 0x7f1ea0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1e9b7fe640 1 -- 172.21.15.161:0/1048597984 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1ea81209a0 con 0x7f1eb41cfb00 2024-02-02T11:49:27.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.387+0000 7f1eb2d9d640 1 --2- 172.21.15.161:0/1048597984 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1ea0065a90 0x7f1ea0067f50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1eac009a30 tx=0x7f1eac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:27.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.391+0000 7f1e9b7fe640 1 -- 172.21.15.161:0/1048597984 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1ea80ee6b0 con 0x7f1eb41cfb00 2024-02-02T11:49:27.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.595+0000 7f1eb91c2640 1 -- 172.21.15.161:0/1048597984 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f1eb4140130 con 0x7f1eb41cfb00 2024-02-02T11:49:27.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.603+0000 7f1e9b7fe640 1 -- 172.21.15.161:0/1048597984 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1ea80f1cd0 con 0x7f1eb41cfb00 2024-02-02T11:49:27.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.603+0000 7f1eb91c2640 1 -- 172.21.15.161:0/1048597984 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1ea0065a90 msgr2=0x7f1ea0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.603+0000 7f1eb91c2640 1 --2- 172.21.15.161:0/1048597984 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1ea0065a90 0x7f1ea0067f50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1eac009a30 tx=0x7f1eac008040 comp rx=0 tx=0).stop 2024-02-02T11:49:27.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.603+0000 7f1eb91c2640 1 -- 172.21.15.161:0/1048597984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1eb41cfb00 msgr2=0x7f1eb41cff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.603+0000 7f1eb91c2640 1 --2- 172.21.15.161:0/1048597984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1eb41cfb00 0x7f1eb41cff60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8001cc0 tx=0x7f1e9c005800 comp rx=0 tx=0).stop 2024-02-02T11:49:27.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.603+0000 7f1eb91c2640 1 -- 172.21.15.161:0/1048597984 shutdown_connections 2024-02-02T11:49:27.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.603+0000 7f1eb91c2640 1 --2- 172.21.15.161:0/1048597984 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f1ea0065a90 0x7f1ea0067f50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.603+0000 7f1eb91c2640 1 --2- 172.21.15.161:0/1048597984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1eb4139370 0x7f1eb4139820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.603+0000 7f1eb91c2640 1 --2- 172.21.15.161:0/1048597984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1eb41cfb00 0x7f1eb41cff60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.603+0000 7f1eb91c2640 1 --2- 172.21.15.161:0/1048597984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e9c0047d0 0x7f1eb4146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.603+0000 7f1eb91c2640 1 -- 172.21.15.161:0/1048597984 >> 172.21.15.161:0/1048597984 conn(0x7f1eb406ae30 msgr2=0x7f1eb4070700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:27.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.603+0000 7f1eb91c2640 1 -- 172.21.15.161:0/1048597984 shutdown_connections 2024-02-02T11:49:27.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.603+0000 7f1eb91c2640 1 -- 172.21.15.161:0/1048597984 wait complete. 2024-02-02T11:49:27.623 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-02-02T11:49:27.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.727+0000 7f0a4ac7f640 1 Processor -- start 2024-02-02T11:49:27.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a4ac7f640 1 -- start start 2024-02-02T11:49:27.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a4ac7f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0a4406a4c0 0x7f0a4406a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a4ac7f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0a441532f0 0x7f0a441556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a4ac7f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a440bb370 con 0x7f0a4414b540 2024-02-02T11:49:27.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a4ac7f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a4406ae40 con 0x7f0a441532f0 2024-02-02T11:49:27.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a4ac7f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a440bc320 con 0x7f0a4406a4c0 2024-02-02T11:49:27.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a4921c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0a441532f0 0x7f0a441556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a4921c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0a441532f0 0x7f0a441556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34370/0 (socket says 172.21.15.161:34370) 2024-02-02T11:49:27.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a48a1b640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0a4414b540 0x7f0a440bac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40818/0 (socket says 172.21.15.161:40818) 2024-02-02T11:49:27.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a4921c640 1 -- 172.21.15.161:0/839515005 learned_addr learned my addr 172.21.15.161:0/839515005 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:27.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a3bfff640 1 --2- 172.21.15.161:0/839515005 >> v2:172.21.15.162:3300/0 conn(0x7f0a4406a4c0 0x7f0a4406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a4921c640 1 -- 172.21.15.161:0/839515005 >> v2:172.21.15.162:3300/0 conn(0x7f0a4406a4c0 msgr2=0x7f0a4406a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:27.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a4921c640 1 --2- 172.21.15.161:0/839515005 >> v2:172.21.15.162:3300/0 conn(0x7f0a4406a4c0 0x7f0a4406a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a4921c640 1 -- 172.21.15.161:0/839515005 >> v1:172.21.15.161:6789/0 conn(0x7f0a4414b540 legacy=0x7f0a440bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a4921c640 1 -- 172.21.15.161:0/839515005 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a440bc590 con 0x7f0a441532f0 2024-02-02T11:49:27.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a3b7fe640 1 -- 172.21.15.161:0/839515005 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1561199216 0 0) 0x7f0a440bb370 con 0x7f0a4414b540 2024-02-02T11:49:27.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a4921c640 1 --2- 172.21.15.161:0/839515005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a441532f0 0x7f0a441556e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0a440c1040 tx=0x7f0a3c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40671ade608ea6d4 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:27.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a3b7fe640 1 -- 172.21.15.161:0/839515005 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c0a57a0 con 0x7f0a441532f0 2024-02-02T11:49:27.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a3b7fe640 1 -- 172.21.15.161:0/839515005 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3c0a5900 con 0x7f0a441532f0 2024-02-02T11:49:27.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.731+0000 7f0a3b7fe640 1 -- 172.21.15.161:0/839515005 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c0a5c90 con 0x7f0a441532f0 2024-02-02T11:49:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4ac7f640 1 -- 172.21.15.161:0/839515005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a441532f0 msgr2=0x7f0a441556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4ac7f640 1 --2- 172.21.15.161:0/839515005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a441532f0 0x7f0a441556e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0a440c1040 tx=0x7f0a3c01c9d0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4ac7f640 1 -- 172.21.15.161:0/839515005 shutdown_connections 2024-02-02T11:49:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4ac7f640 1 --2- 172.21.15.161:0/839515005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a441532f0 0x7f0a441556e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4ac7f640 1 --2- 172.21.15.161:0/839515005 >> v2:172.21.15.162:3300/0 conn(0x7f0a4406a4c0 0x7f0a4406a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4ac7f640 1 -- 172.21.15.161:0/839515005 >> 172.21.15.161:0/839515005 conn(0x7f0a440c02e0 msgr2=0x7f0a440c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4ac7f640 1 -- 172.21.15.161:0/839515005 shutdown_connections 2024-02-02T11:49:27.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4ac7f640 1 -- 172.21.15.161:0/839515005 wait complete. 2024-02-02T11:49:27.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4ac7f640 1 Processor -- start 2024-02-02T11:49:27.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4ac7f640 1 -- start start 2024-02-02T11:49:27.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4ac7f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a4406a4c0 0x7f0a44153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4ac7f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a4414b540 0x7f0a441e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4ac7f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a441532f0 0x7f0a44143d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4ac7f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a440b49c0 con 0x7f0a4406a4c0 2024-02-02T11:49:27.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4ac7f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a44154340 con 0x7f0a441532f0 2024-02-02T11:49:27.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4ac7f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a441e6c30 con 0x7f0a4414b540 2024-02-02T11:49:27.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a48a1b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a4406a4c0 0x7f0a44153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a48a1b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a4406a4c0 0x7f0a44153e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34372/0 (socket says 172.21.15.161:34372) 2024-02-02T11:49:27.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a48a1b640 1 -- 172.21.15.161:0/2710372240 learned_addr learned my addr 172.21.15.161:0/2710372240 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:27.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a48a1b640 1 -- 172.21.15.161:0/2710372240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a4414b540 msgr2=0x7f0a441e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a3bfff640 1 --2- 172.21.15.161:0/2710372240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a4414b540 0x7f0a441e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4921c640 1 --2- 172.21.15.161:0/2710372240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a441532f0 0x7f0a44143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a48a1b640 1 --2- 172.21.15.161:0/2710372240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a4414b540 0x7f0a441e66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a48a1b640 1 -- 172.21.15.161:0/2710372240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a441532f0 msgr2=0x7f0a44143d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a48a1b640 1 --2- 172.21.15.161:0/2710372240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a441532f0 0x7f0a44143d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a48a1b640 1 -- 172.21.15.161:0/2710372240 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c009b30 con 0x7f0a4406a4c0 2024-02-02T11:49:27.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a48a1b640 1 --2- 172.21.15.161:0/2710372240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a4406a4c0 0x7f0a44153e00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0a400011f0 tx=0x7f0a4000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:27.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a397fa640 1 -- 172.21.15.161:0/2710372240 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a400074e0 con 0x7f0a4406a4c0 2024-02-02T11:49:27.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a397fa640 1 -- 172.21.15.161:0/2710372240 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a40007640 con 0x7f0a4406a4c0 2024-02-02T11:49:27.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4ac7f640 1 -- 172.21.15.161:0/2710372240 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a440b46e0 con 0x7f0a4406a4c0 2024-02-02T11:49:27.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a397fa640 1 -- 172.21.15.161:0/2710372240 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40004a10 con 0x7f0a4406a4c0 2024-02-02T11:49:27.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4ac7f640 1 -- 172.21.15.161:0/2710372240 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a441e61d0 con 0x7f0a4406a4c0 2024-02-02T11:49:27.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.735+0000 7f0a4ac7f640 1 -- 172.21.15.161:0/2710372240 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a441e63f0 con 0x7f0a4406a4c0 2024-02-02T11:49:27.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.739+0000 7f0a397fa640 1 -- 172.21.15.161:0/2710372240 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0a40004b70 con 0x7f0a4406a4c0 2024-02-02T11:49:27.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.739+0000 7f0a397fa640 1 --2- 172.21.15.161:0/2710372240 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0a30065a60 0x7f0a30067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:27.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.739+0000 7f0a397fa640 1 -- 172.21.15.161:0/2710372240 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0a400822d0 con 0x7f0a4406a4c0 2024-02-02T11:49:27.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.739+0000 7f0a3bfff640 1 --2- 172.21.15.161:0/2710372240 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0a30065a60 0x7f0a30067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:27.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.739+0000 7f0a3bfff640 1 --2- 172.21.15.161:0/2710372240 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0a30065a60 0x7f0a30067f20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0a44154700 tx=0x7f0a34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:27.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.743+0000 7f0a397fa640 1 -- 172.21.15.161:0/2710372240 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0a40050070 con 0x7f0a4406a4c0 2024-02-02T11:49:27.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.935+0000 7f0a4ac7f640 1 -- 172.21.15.161:0/2710372240 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f0a4404e000 con 0x7f0a4406a4c0 2024-02-02T11:49:27.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.943+0000 7f0a397fa640 1 -- 172.21.15.161:0/2710372240 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0a40053690 con 0x7f0a4406a4c0 2024-02-02T11:49:27.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.947+0000 7f0a4ac7f640 1 -- 172.21.15.161:0/2710372240 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0a30065a60 msgr2=0x7f0a30067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.947+0000 7f0a4ac7f640 1 --2- 172.21.15.161:0/2710372240 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0a30065a60 0x7f0a30067f20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0a44154700 tx=0x7f0a34008040 comp rx=0 tx=0).stop 2024-02-02T11:49:27.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.947+0000 7f0a4ac7f640 1 -- 172.21.15.161:0/2710372240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a4406a4c0 msgr2=0x7f0a44153e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:27.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.947+0000 7f0a4ac7f640 1 --2- 172.21.15.161:0/2710372240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a4406a4c0 0x7f0a44153e00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0a400011f0 tx=0x7f0a4000c9b0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.947+0000 7f0a4ac7f640 1 -- 172.21.15.161:0/2710372240 shutdown_connections 2024-02-02T11:49:27.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.947+0000 7f0a4ac7f640 1 --2- 172.21.15.161:0/2710372240 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0a30065a60 0x7f0a30067f20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.947+0000 7f0a4ac7f640 1 --2- 172.21.15.161:0/2710372240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a441532f0 0x7f0a44143d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.947+0000 7f0a4ac7f640 1 --2- 172.21.15.161:0/2710372240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a4414b540 0x7f0a441e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.947+0000 7f0a4ac7f640 1 --2- 172.21.15.161:0/2710372240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a4406a4c0 0x7f0a44153e00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:27.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.947+0000 7f0a4ac7f640 1 -- 172.21.15.161:0/2710372240 >> 172.21.15.161:0/2710372240 conn(0x7f0a440c02e0 msgr2=0x7f0a44148c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:27.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.947+0000 7f0a4ac7f640 1 -- 172.21.15.161:0/2710372240 shutdown_connections 2024-02-02T11:49:27.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:27.947+0000 7f0a4ac7f640 1 -- 172.21.15.161:0/2710372240 wait complete. 2024-02-02T11:49:27.965 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-02-02T11:49:28.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.071+0000 7fc5fbca7640 1 Processor -- start 2024-02-02T11:49:28.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.071+0000 7fc5fbca7640 1 -- start start 2024-02-02T11:49:28.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.071+0000 7fc5fbca7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc5f4071160 0x7fc5f40b9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.071+0000 7fc5fbca7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc5f40b42d0 0x7fc5f40b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.071+0000 7fc5fbca7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f41429f0 0x7fc5f414bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.071+0000 7fc5fbca7640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f40b5140 con 0x7fc5f4071160 2024-02-02T11:49:28.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.071+0000 7fc5fbca7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f40b3c40 con 0x7fc5f40b42d0 2024-02-02T11:49:28.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.071+0000 7fc5fbca7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f40b4720 con 0x7fc5f41429f0 2024-02-02T11:49:28.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.071+0000 7fc5f9a43640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc5f4071160 0x7fc5f40b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:28.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.071+0000 7fc5f9a43640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc5f4071160 0x7fc5f40b9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34374/0 (socket says 172.21.15.161:34374) 2024-02-02T11:49:28.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.071+0000 7fc5f9a43640 1 -- 172.21.15.161:0/2873346391 learned_addr learned my addr 172.21.15.161:0/2873346391 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:28.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.071+0000 7fc5fa244640 1 --2- 172.21.15.161:0/2873346391 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f41429f0 0x7fc5f414bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:28.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.071+0000 7fc5f9242640 1 --2- 172.21.15.161:0/2873346391 >> v2:172.21.15.162:3300/0 conn(0x7fc5f40b42d0 0x7fc5f40b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:28.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.071+0000 7fc5f9a43640 1 -- 172.21.15.161:0/2873346391 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f41429f0 msgr2=0x7fc5f414bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:28.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.071+0000 7fc5f9a43640 1 --2- 172.21.15.161:0/2873346391 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f41429f0 0x7fc5f414bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.071+0000 7fc5f9a43640 1 -- 172.21.15.161:0/2873346391 >> v2:172.21.15.162:3300/0 conn(0x7fc5f40b42d0 msgr2=0x7fc5f40b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:28.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.071+0000 7fc5f9a43640 1 --2- 172.21.15.161:0/2873346391 >> v2:172.21.15.162:3300/0 conn(0x7fc5f40b42d0 0x7fc5f40b8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.071+0000 7fc5f9a43640 1 -- 172.21.15.161:0/2873346391 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f40b9f60 con 0x7fc5f4071160 2024-02-02T11:49:28.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.075+0000 7fc5f9a43640 1 --2- 172.21.15.161:0/2873346391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5f4071160 0x7fc5f40b9900 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40bbca0 tx=0x7fc5ec01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17fa09d9e18cfe1 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:28.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.075+0000 7fc5f8a41640 1 -- 172.21.15.161:0/2873346391 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec0a5840 con 0x7fc5f4071160 2024-02-02T11:49:28.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.075+0000 7fc5f8a41640 1 -- 172.21.15.161:0/2873346391 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec0a59a0 con 0x7fc5f4071160 2024-02-02T11:49:28.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.075+0000 7fc5f8a41640 1 -- 172.21.15.161:0/2873346391 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec0a5d30 con 0x7fc5f4071160 2024-02-02T11:49:28.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.075+0000 7fc5fbca7640 1 -- 172.21.15.161:0/2873346391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5f4071160 msgr2=0x7fc5f40b9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:28.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.075+0000 7fc5fbca7640 1 --2- 172.21.15.161:0/2873346391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5f4071160 0x7fc5f40b9900 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40bbca0 tx=0x7fc5ec01c9a0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.075+0000 7fc5fbca7640 1 -- 172.21.15.161:0/2873346391 shutdown_connections 2024-02-02T11:49:28.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.075+0000 7fc5fbca7640 1 --2- 172.21.15.161:0/2873346391 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f41429f0 0x7fc5f414bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.075+0000 7fc5fbca7640 1 --2- 172.21.15.161:0/2873346391 >> v2:172.21.15.162:3300/0 conn(0x7fc5f40b42d0 0x7fc5f40b8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.075+0000 7fc5fbca7640 1 --2- 172.21.15.161:0/2873346391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5f4071160 0x7fc5f40b9900 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.075+0000 7fc5fbca7640 1 -- 172.21.15.161:0/2873346391 >> 172.21.15.161:0/2873346391 conn(0x7fc5f40be150 msgr2=0x7fc5f40be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:28.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.075+0000 7fc5fbca7640 1 -- 172.21.15.161:0/2873346391 shutdown_connections 2024-02-02T11:49:28.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.075+0000 7fc5fbca7640 1 -- 172.21.15.161:0/2873346391 wait complete. 2024-02-02T11:49:28.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5fbca7640 1 Processor -- start 2024-02-02T11:49:28.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5fbca7640 1 -- start start 2024-02-02T11:49:28.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5fbca7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f4071160 0x7fc5f4146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5fbca7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5f40b42d0 0x7fc5f4147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5fbca7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f41429f0 0x7fc5f4148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5fbca7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f4146fd0 con 0x7fc5f40b42d0 2024-02-02T11:49:28.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5fbca7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f4147ae0 con 0x7fc5f4071160 2024-02-02T11:49:28.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5fbca7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f4146330 con 0x7fc5f41429f0 2024-02-02T11:49:28.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5f9242640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5f40b42d0 0x7fc5f4147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:28.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5f9242640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5f40b42d0 0x7fc5f4147f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34380/0 (socket says 172.21.15.161:34380) 2024-02-02T11:49:28.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5f9242640 1 -- 172.21.15.161:0/2754523505 learned_addr learned my addr 172.21.15.161:0/2754523505 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:28.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5f9a43640 1 --2- 172.21.15.161:0/2754523505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f4071160 0x7fc5f4146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:28.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5f9242640 1 -- 172.21.15.161:0/2754523505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f41429f0 msgr2=0x7fc5f4148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:28.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5f9242640 1 --2- 172.21.15.161:0/2754523505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f41429f0 0x7fc5f4148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5f9242640 1 -- 172.21.15.161:0/2754523505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f4071160 msgr2=0x7fc5f4146a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:28.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5f9242640 1 --2- 172.21.15.161:0/2754523505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f4071160 0x7fc5f4146a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5f9242640 1 -- 172.21.15.161:0/2754523505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec009b30 con 0x7fc5f40b42d0 2024-02-02T11:49:28.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5f9242640 1 --2- 172.21.15.161:0/2754523505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5f40b42d0 0x7fc5f4147f70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc5e400d800 tx=0x7fc5e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:28.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5ea7fc640 1 -- 172.21.15.161:0/2754523505 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4009640 con 0x7fc5f40b42d0 2024-02-02T11:49:28.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5ea7fc640 1 -- 172.21.15.161:0/2754523505 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e40097a0 con 0x7fc5f40b42d0 2024-02-02T11:49:28.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5fbca7640 1 -- 172.21.15.161:0/2754523505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f41495e0 con 0x7fc5f40b42d0 2024-02-02T11:49:28.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5ea7fc640 1 -- 172.21.15.161:0/2754523505 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4009b10 con 0x7fc5f40b42d0 2024-02-02T11:49:28.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5fbca7640 1 -- 172.21.15.161:0/2754523505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f413df00 con 0x7fc5f40b42d0 2024-02-02T11:49:28.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5fbca7640 1 -- 172.21.15.161:0/2754523505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f4147c90 con 0x7fc5f40b42d0 2024-02-02T11:49:28.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5ea7fc640 1 -- 172.21.15.161:0/2754523505 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc5e4009c70 con 0x7fc5f40b42d0 2024-02-02T11:49:28.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5ea7fc640 1 --2- 172.21.15.161:0/2754523505 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc5d8065a60 0x7fc5d8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.079+0000 7fc5ea7fc640 1 -- 172.21.15.161:0/2754523505 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc5e40838e0 con 0x7fc5f40b42d0 2024-02-02T11:49:28.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.083+0000 7fc5f9a43640 1 --2- 172.21.15.161:0/2754523505 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc5d8065a60 0x7fc5d8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:28.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.083+0000 7fc5f9a43640 1 --2- 172.21.15.161:0/2754523505 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc5d8065a60 0x7fc5d8067f20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0ae000 tx=0x7fc5ec0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:28.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.083+0000 7fc5ea7fc640 1 -- 172.21.15.161:0/2754523505 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc5e4051760 con 0x7fc5f40b42d0 2024-02-02T11:49:28.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.279+0000 7fc5fbca7640 1 -- 172.21.15.161:0/2754523505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fc5f413dd10 con 0x7fc5f40b42d0 2024-02-02T11:49:28.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.287+0000 7fc5ea7fc640 1 -- 172.21.15.161:0/2754523505 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc5f413dd10 con 0x7fc5f40b42d0 2024-02-02T11:49:28.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.287+0000 7fc5fbca7640 1 -- 172.21.15.161:0/2754523505 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc5d8065a60 msgr2=0x7fc5d8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:28.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.287+0000 7fc5fbca7640 1 --2- 172.21.15.161:0/2754523505 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc5d8065a60 0x7fc5d8067f20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0ae000 tx=0x7fc5ec0a7070 comp rx=0 tx=0).stop 2024-02-02T11:49:28.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.287+0000 7fc5fbca7640 1 -- 172.21.15.161:0/2754523505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5f40b42d0 msgr2=0x7fc5f4147f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:28.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.287+0000 7fc5fbca7640 1 --2- 172.21.15.161:0/2754523505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5f40b42d0 0x7fc5f4147f70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc5e400d800 tx=0x7fc5e400dcc0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.287+0000 7fc5fbca7640 1 -- 172.21.15.161:0/2754523505 shutdown_connections 2024-02-02T11:49:28.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.287+0000 7fc5fbca7640 1 --2- 172.21.15.161:0/2754523505 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc5d8065a60 0x7fc5d8067f20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.287+0000 7fc5fbca7640 1 --2- 172.21.15.161:0/2754523505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5f41429f0 0x7fc5f4148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.287+0000 7fc5fbca7640 1 --2- 172.21.15.161:0/2754523505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5f40b42d0 0x7fc5f4147f70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.287+0000 7fc5fbca7640 1 --2- 172.21.15.161:0/2754523505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f4071160 0x7fc5f4146a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.287+0000 7fc5fbca7640 1 -- 172.21.15.161:0/2754523505 >> 172.21.15.161:0/2754523505 conn(0x7fc5f40be150 msgr2=0x7fc5f413f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:28.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.287+0000 7fc5fbca7640 1 -- 172.21.15.161:0/2754523505 shutdown_connections 2024-02-02T11:49:28.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.287+0000 7fc5fbca7640 1 -- 172.21.15.161:0/2754523505 wait complete. 2024-02-02T11:49:28.307 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-02-02T11:49:28.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.411+0000 7f976403e640 1 Processor -- start 2024-02-02T11:49:28.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.411+0000 7f976403e640 1 -- start start 2024-02-02T11:49:28.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.411+0000 7f976403e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f975c14b540 0x7f975c0bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.411+0000 7f976403e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f975c06a900 0x7f975c14e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.411+0000 7f976403e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975c06ad70 con 0x7f975c06a4c0 2024-02-02T11:49:28.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.411+0000 7f976403e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975c0bc320 con 0x7f975c06a900 2024-02-02T11:49:28.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.411+0000 7f976403e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c0bb650 con 0x7f975c14b540 2024-02-02T11:49:28.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.411+0000 7f97625db640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f975c06a900 0x7f975c14e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:28.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.411+0000 7f97615d9640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f975c06a4c0 0x7f975c14dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40826/0 (socket says 172.21.15.161:40826) 2024-02-02T11:49:28.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.411+0000 7f97625db640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f975c06a900 0x7f975c14e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34392/0 (socket says 172.21.15.161:34392) 2024-02-02T11:49:28.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.411+0000 7f97615d9640 1 -- 172.21.15.161:0/1138278833 learned_addr learned my addr 172.21.15.161:0/1138278833 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:28.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.411+0000 7f9761dda640 1 --2- 172.21.15.161:0/1138278833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f975c14b540 0x7f975c0bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:28.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.411+0000 7f97625db640 1 -- 172.21.15.161:0/1138278833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f975c14b540 msgr2=0x7f975c0bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:28.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.411+0000 7f97625db640 1 --2- 172.21.15.161:0/1138278833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f975c14b540 0x7f975c0bac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.411+0000 7f97625db640 1 -- 172.21.15.161:0/1138278833 >> v1:172.21.15.161:6789/0 conn(0x7f975c06a4c0 legacy=0x7f975c14dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:28.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.411+0000 7f97625db640 1 -- 172.21.15.161:0/1138278833 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c0bc590 con 0x7f975c06a900 2024-02-02T11:49:28.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.411+0000 7f9760dd8640 1 -- 172.21.15.161:0/1138278833 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397118180 0 0) 0x7f975c06ad70 con 0x7f975c06a4c0 2024-02-02T11:49:28.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.411+0000 7f9761dda640 1 --2- 172.21.15.161:0/1138278833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f975c14b540 0x7f975c0bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:28.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.415+0000 7f97625db640 1 --2- 172.21.15.161:0/1138278833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f975c06a900 0x7f975c14e6e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9754009d90 tx=0x7f975401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2275b2ae331be1 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:28.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.415+0000 7f9760dd8640 1 -- 172.21.15.161:0/1138278833 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97540af600 con 0x7f975c06a900 2024-02-02T11:49:28.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.415+0000 7f9760dd8640 1 -- 172.21.15.161:0/1138278833 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97540ab050 con 0x7f975c06a900 2024-02-02T11:49:28.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.415+0000 7f9760dd8640 1 -- 172.21.15.161:0/1138278833 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97540af980 con 0x7f975c06a900 2024-02-02T11:49:28.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.415+0000 7f976403e640 1 -- 172.21.15.161:0/1138278833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f975c06a900 msgr2=0x7f975c14e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:28.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.415+0000 7f976403e640 1 --2- 172.21.15.161:0/1138278833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f975c06a900 0x7f975c14e6e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9754009d90 tx=0x7f975401f130 comp rx=0 tx=0).stop 2024-02-02T11:49:28.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.415+0000 7f976403e640 1 -- 172.21.15.161:0/1138278833 shutdown_connections 2024-02-02T11:49:28.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.415+0000 7f976403e640 1 --2- 172.21.15.161:0/1138278833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f975c06a900 0x7f975c14e6e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.415+0000 7f976403e640 1 --2- 172.21.15.161:0/1138278833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f975c14b540 0x7f975c0bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.415+0000 7f976403e640 1 -- 172.21.15.161:0/1138278833 >> 172.21.15.161:0/1138278833 conn(0x7f975c0c02e0 msgr2=0x7f975c0c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:28.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.415+0000 7f976403e640 1 -- 172.21.15.161:0/1138278833 shutdown_connections 2024-02-02T11:49:28.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.415+0000 7f976403e640 1 -- 172.21.15.161:0/1138278833 wait complete. 2024-02-02T11:49:28.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.415+0000 7f976403e640 1 Processor -- start 2024-02-02T11:49:28.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.415+0000 7f976403e640 1 -- start start 2024-02-02T11:49:28.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f976403e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f975c06a4c0 0x7f975c0a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f976403e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f975c06a900 0x7f975c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f976403e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f975c14b540 0x7f975c1df9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f976403e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c06b080 con 0x7f975c06a4c0 2024-02-02T11:49:28.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f976403e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c0b3d80 con 0x7f975c14b540 2024-02-02T11:49:28.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f976403e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c0a1940 con 0x7f975c06a900 2024-02-02T11:49:28.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f9761dda640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f975c06a4c0 0x7f975c0a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:28.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f9761dda640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f975c06a4c0 0x7f975c0a5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34404/0 (socket says 172.21.15.161:34404) 2024-02-02T11:49:28.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f9761dda640 1 -- 172.21.15.161:0/2292469226 learned_addr learned my addr 172.21.15.161:0/2292469226 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:28.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f9761dda640 1 -- 172.21.15.161:0/2292469226 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f975c06a900 msgr2=0x7f975c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:28.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f9761dda640 1 --2- 172.21.15.161:0/2292469226 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f975c06a900 0x7f975c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f9761dda640 1 -- 172.21.15.161:0/2292469226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f975c14b540 msgr2=0x7f975c1df9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:28.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f9761dda640 1 --2- 172.21.15.161:0/2292469226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f975c14b540 0x7f975c1df9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f9761dda640 1 -- 172.21.15.161:0/2292469226 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9754009a70 con 0x7f975c06a4c0 2024-02-02T11:49:28.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f9761dda640 1 --2- 172.21.15.161:0/2292469226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f975c06a4c0 0x7f975c0a5910 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f975800c7c0 tx=0x7f975800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:28.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f97527fc640 1 -- 172.21.15.161:0/2292469226 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9758007a30 con 0x7f975c06a4c0 2024-02-02T11:49:28.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f97527fc640 1 -- 172.21.15.161:0/2292469226 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9758007b90 con 0x7f975c06a4c0 2024-02-02T11:49:28.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f976403e640 1 -- 172.21.15.161:0/2292469226 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975c0b3fd0 con 0x7f975c06a4c0 2024-02-02T11:49:28.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f97527fc640 1 -- 172.21.15.161:0/2292469226 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975800ce70 con 0x7f975c06a4c0 2024-02-02T11:49:28.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f976403e640 1 -- 172.21.15.161:0/2292469226 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975c0b4590 con 0x7f975c06a4c0 2024-02-02T11:49:28.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f976403e640 1 -- 172.21.15.161:0/2292469226 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975c04e000 con 0x7f975c06a4c0 2024-02-02T11:49:28.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f97527fc640 1 -- 172.21.15.161:0/2292469226 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f97580193f0 con 0x7f975c06a4c0 2024-02-02T11:49:28.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f97527fc640 1 --2- 172.21.15.161:0/2292469226 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9740065a90 0x7f9740067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f97527fc640 1 -- 172.21.15.161:0/2292469226 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f97580831e0 con 0x7f975c06a4c0 2024-02-02T11:49:28.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f97615d9640 1 --2- 172.21.15.161:0/2292469226 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9740065a90 0x7f9740067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:28.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.419+0000 7f97615d9640 1 --2- 172.21.15.161:0/2292469226 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9740065a90 0x7f9740067f50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f975c0bb220 tx=0x7f974c007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:28.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.423+0000 7f97527fc640 1 -- 172.21.15.161:0/2292469226 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9758050f80 con 0x7f975c06a4c0 2024-02-02T11:49:28.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.623+0000 7f976403e640 1 -- 172.21.15.161:0/2292469226 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f975c1df700 con 0x7f975c06a4c0 2024-02-02T11:49:28.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.631+0000 7f97527fc640 1 -- 172.21.15.161:0/2292469226 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f97580545a0 con 0x7f975c06a4c0 2024-02-02T11:49:28.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.635+0000 7f976403e640 1 -- 172.21.15.161:0/2292469226 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9740065a90 msgr2=0x7f9740067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:28.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.635+0000 7f976403e640 1 --2- 172.21.15.161:0/2292469226 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9740065a90 0x7f9740067f50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f975c0bb220 tx=0x7f974c007970 comp rx=0 tx=0).stop 2024-02-02T11:49:28.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.635+0000 7f976403e640 1 -- 172.21.15.161:0/2292469226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f975c06a4c0 msgr2=0x7f975c0a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:28.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.635+0000 7f976403e640 1 --2- 172.21.15.161:0/2292469226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f975c06a4c0 0x7f975c0a5910 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f975800c7c0 tx=0x7f975800cc80 comp rx=0 tx=0).stop 2024-02-02T11:49:28.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.635+0000 7f976403e640 1 -- 172.21.15.161:0/2292469226 shutdown_connections 2024-02-02T11:49:28.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.635+0000 7f976403e640 1 --2- 172.21.15.161:0/2292469226 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9740065a90 0x7f9740067f50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.635+0000 7f976403e640 1 --2- 172.21.15.161:0/2292469226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f975c14b540 0x7f975c1df9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.635+0000 7f976403e640 1 --2- 172.21.15.161:0/2292469226 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f975c06a900 0x7f975c0b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.635+0000 7f976403e640 1 --2- 172.21.15.161:0/2292469226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f975c06a4c0 0x7f975c0a5910 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.635+0000 7f976403e640 1 -- 172.21.15.161:0/2292469226 >> 172.21.15.161:0/2292469226 conn(0x7f975c0c02e0 msgr2=0x7f975c149c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:28.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.635+0000 7f976403e640 1 -- 172.21.15.161:0/2292469226 shutdown_connections 2024-02-02T11:49:28.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.635+0000 7f976403e640 1 -- 172.21.15.161:0/2292469226 wait complete. 2024-02-02T11:49:28.653 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-02-02T11:49:28.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6888397640 1 Processor -- start 2024-02-02T11:49:28.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6888397640 1 -- start start 2024-02-02T11:49:28.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6888397640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688014b540 0x7f68801564f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6888397640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f688006cdc0 con 0x7f6880144ea0 2024-02-02T11:49:28.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6888397640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6880071610 con 0x7f68800b8ad0 2024-02-02T11:49:28.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6888397640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688006ee40 con 0x7f688014b540 2024-02-02T11:49:28.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6886133640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6880144ea0 0x7f6880070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40842/0 (socket says 172.21.15.161:40842) 2024-02-02T11:49:28.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6886133640 1 -- 172.21.15.161:0/3437607660 learned_addr learned my addr 172.21.15.161:0/3437607660 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:28.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6886934640 1 --2- 172.21.15.161:0/3437607660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688014b540 0x7f68801564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:28.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885131640 1 -- 172.21.15.161:0/3437607660 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585350270 0 0) 0x7f688006cdc0 con 0x7f6880144ea0 2024-02-02T11:49:28.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885131640 1 -- 172.21.15.161:0/3437607660 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f686c003530 con 0x7f6880144ea0 2024-02-02T11:49:28.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885131640 1 -- 172.21.15.161:0/3437607660 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4266192958 0 0) 0x7f686c003530 con 0x7f6880144ea0 2024-02-02T11:49:28.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885131640 1 -- 172.21.15.161:0/3437607660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688014b540 msgr2=0x7f68801564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:28.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885131640 1 --2- 172.21.15.161:0/3437607660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688014b540 0x7f68801564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885131640 1 -- 172.21.15.161:0/3437607660 >> v1:172.21.15.162:6789/0 conn(0x7f68800b8ad0 legacy=0x7f688014ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:28.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885131640 1 -- 172.21.15.161:0/3437607660 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688006c490 con 0x7f6880144ea0 2024-02-02T11:49:28.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885131640 1 -- 172.21.15.161:0/3437607660 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f6870001680 con 0x7f6880144ea0 2024-02-02T11:49:28.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885131640 1 -- 172.21.15.161:0/3437607660 >> v1:172.21.15.161:6789/0 conn(0x7f6880144ea0 legacy=0x7f6880070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:28.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885131640 1 --2- 172.21.15.161:0/3437607660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f686c0039b0 0x7f686c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885131640 1 --2- 172.21.15.161:0/3437607660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f686c0047d0 0x7f686c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885131640 1 --2- 172.21.15.161:0/3437607660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688014b540 0x7f686c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885131640 1 -- 172.21.15.161:0/3437607660 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688006ee40 con 0x7f686c0047d0 2024-02-02T11:49:28.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885131640 1 -- 172.21.15.161:0/3437607660 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c00bad0 con 0x7f686c0039b0 2024-02-02T11:49:28.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885131640 1 -- 172.21.15.161:0/3437607660 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686c00bc90 con 0x7f688014b540 2024-02-02T11:49:28.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885932640 1 --2- 172.21.15.161:0/3437607660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f686c0047d0 0x7f686c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:28.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6886934640 1 --2- 172.21.15.161:0/3437607660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688014b540 0x7f686c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:28.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6886133640 1 --2- 172.21.15.161:0/3437607660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f686c0039b0 0x7f686c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:28.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885932640 1 -- 172.21.15.161:0/3437607660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688014b540 msgr2=0x7f686c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:28.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885932640 1 --2- 172.21.15.161:0/3437607660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688014b540 0x7f686c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885932640 1 -- 172.21.15.161:0/3437607660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f686c0039b0 msgr2=0x7f686c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:28.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885932640 1 --2- 172.21.15.161:0/3437607660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f686c0039b0 0x7f686c003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6885932640 1 -- 172.21.15.161:0/3437607660 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c003530 con 0x7f686c0047d0 2024-02-02T11:49:28.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.771+0000 7f6886934640 1 --2- 172.21.15.161:0/3437607660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688014b540 0x7f686c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:28.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.775+0000 7f6885932640 1 --2- 172.21.15.161:0/3437607660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f686c0047d0 0x7f686c004c50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f687c001750 tx=0x7f687c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b01a549260ec11a server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:28.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.775+0000 7f6885131640 1 -- 172.21.15.161:0/3437607660 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c0052d0 con 0x7f686c0047d0 2024-02-02T11:49:28.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.775+0000 7f6885131640 1 -- 172.21.15.161:0/3437607660 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687c0a7050 con 0x7f686c0047d0 2024-02-02T11:49:28.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.775+0000 7f6885131640 1 -- 172.21.15.161:0/3437607660 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c003600 con 0x7f686c0047d0 2024-02-02T11:49:28.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.775+0000 7f6888397640 1 -- 172.21.15.161:0/3437607660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f686c0047d0 msgr2=0x7f686c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:28.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.775+0000 7f6888397640 1 --2- 172.21.15.161:0/3437607660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f686c0047d0 0x7f686c004c50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f687c001750 tx=0x7f687c01c3a0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.775+0000 7f6886934640 1 -- 172.21.15.161:0/3437607660 reap_dead start 2024-02-02T11:49:28.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.775+0000 7f6888397640 1 -- 172.21.15.161:0/3437607660 shutdown_connections 2024-02-02T11:49:28.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.775+0000 7f6888397640 1 -- 172.21.15.161:0/3437607660 >> 172.21.15.161:0/3437607660 conn(0x7f68800be150 msgr2=0x7f68800be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:28.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.775+0000 7f6888397640 1 -- 172.21.15.161:0/3437607660 shutdown_connections 2024-02-02T11:49:28.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.775+0000 7f6888397640 1 -- 172.21.15.161:0/3437607660 wait complete. 2024-02-02T11:49:28.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.775+0000 7f6888397640 1 Processor -- start 2024-02-02T11:49:28.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.775+0000 7f6888397640 1 -- start start 2024-02-02T11:49:28.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6888397640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f686c0047d0 0x7f68800a2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6888397640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68800bc0c0 0x7f68800bda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6888397640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68801e30e0 0x7f68801435f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6888397640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68801e40f0 con 0x7f68801e30e0 2024-02-02T11:49:28.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6888397640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68800a33c0 con 0x7f68800bc0c0 2024-02-02T11:49:28.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6888397640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68800bd050 con 0x7f686c0047d0 2024-02-02T11:49:28.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6886934640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68801e30e0 0x7f68801435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:28.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6886934640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68801e30e0 0x7f68801435f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34426/0 (socket says 172.21.15.161:34426) 2024-02-02T11:49:28.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6886934640 1 -- 172.21.15.161:0/1008397468 learned_addr learned my addr 172.21.15.161:0/1008397468 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:28.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6886133640 1 --2- 172.21.15.161:0/1008397468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f686c0047d0 0x7f68800a2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:28.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6885932640 1 --2- 172.21.15.161:0/1008397468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68800bc0c0 0x7f68800bda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:28.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6886934640 1 -- 172.21.15.161:0/1008397468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f686c0047d0 msgr2=0x7f68800a2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:28.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6886934640 1 --2- 172.21.15.161:0/1008397468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f686c0047d0 0x7f68800a2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6886934640 1 -- 172.21.15.161:0/1008397468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68800bc0c0 msgr2=0x7f68800bda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:28.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6886934640 1 --2- 172.21.15.161:0/1008397468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68800bc0c0 0x7f68800bda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6886934640 1 -- 172.21.15.161:0/1008397468 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68800a19e0 con 0x7f68801e30e0 2024-02-02T11:49:28.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6886934640 1 --2- 172.21.15.161:0/1008397468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68801e30e0 0x7f68801435f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f688006b7d0 tx=0x7f687800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:28.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6876ffd640 1 -- 172.21.15.161:0/1008397468 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878017400 con 0x7f68801e30e0 2024-02-02T11:49:28.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6876ffd640 1 -- 172.21.15.161:0/1008397468 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6878011040 con 0x7f68801e30e0 2024-02-02T11:49:28.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6888397640 1 -- 172.21.15.161:0/1008397468 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68800bc750 con 0x7f68801e30e0 2024-02-02T11:49:28.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6876ffd640 1 -- 172.21.15.161:0/1008397468 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878017780 con 0x7f68801e30e0 2024-02-02T11:49:28.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6888397640 1 -- 172.21.15.161:0/1008397468 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68800bd540 con 0x7f68801e30e0 2024-02-02T11:49:28.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6888397640 1 -- 172.21.15.161:0/1008397468 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6880071a20 con 0x7f68801e30e0 2024-02-02T11:49:28.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6876ffd640 1 -- 172.21.15.161:0/1008397468 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f68780203b0 con 0x7f68801e30e0 2024-02-02T11:49:28.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6876ffd640 1 --2- 172.21.15.161:0/1008397468 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6864065a90 0x7f6864067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:28.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6886133640 1 --2- 172.21.15.161:0/1008397468 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6864065a90 0x7f6864067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:28.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6876ffd640 1 -- 172.21.15.161:0/1008397468 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6878082f20 con 0x7f68801e30e0 2024-02-02T11:49:28.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.779+0000 7f6886133640 1 --2- 172.21.15.161:0/1008397468 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6864065a90 0x7f6864067f50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6870001060 tx=0x7f6870009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:28.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.783+0000 7f6876ffd640 1 -- 172.21.15.161:0/1008397468 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6878050d70 con 0x7f68801e30e0 2024-02-02T11:49:28.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.979+0000 7f6888397640 1 -- 172.21.15.161:0/1008397468 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f68800a19e0 con 0x7f68801e30e0 2024-02-02T11:49:28.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.987+0000 7f6876ffd640 1 -- 172.21.15.161:0/1008397468 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f68800a19e0 con 0x7f68801e30e0 2024-02-02T11:49:28.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.991+0000 7f6888397640 1 -- 172.21.15.161:0/1008397468 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6864065a90 msgr2=0x7f6864067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:28.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.991+0000 7f6888397640 1 --2- 172.21.15.161:0/1008397468 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6864065a90 0x7f6864067f50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6870001060 tx=0x7f6870009040 comp rx=0 tx=0).stop 2024-02-02T11:49:28.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.991+0000 7f6888397640 1 -- 172.21.15.161:0/1008397468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68801e30e0 msgr2=0x7f68801435f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:28.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.991+0000 7f6888397640 1 --2- 172.21.15.161:0/1008397468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68801e30e0 0x7f68801435f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f688006b7d0 tx=0x7f687800f4a0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.991+0000 7f6888397640 1 -- 172.21.15.161:0/1008397468 shutdown_connections 2024-02-02T11:49:28.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.991+0000 7f6888397640 1 --2- 172.21.15.161:0/1008397468 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6864065a90 0x7f6864067f50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.991+0000 7f6888397640 1 --2- 172.21.15.161:0/1008397468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68801e30e0 0x7f68801435f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.991+0000 7f6888397640 1 --2- 172.21.15.161:0/1008397468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68800bc0c0 0x7f68800bda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.991+0000 7f6888397640 1 --2- 172.21.15.161:0/1008397468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f686c0047d0 0x7f68800a2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:28.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.991+0000 7f6888397640 1 -- 172.21.15.161:0/1008397468 >> 172.21.15.161:0/1008397468 conn(0x7f68800be150 msgr2=0x7f688013db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:28.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.991+0000 7f6888397640 1 -- 172.21.15.161:0/1008397468 shutdown_connections 2024-02-02T11:49:28.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:28.991+0000 7f6888397640 1 -- 172.21.15.161:0/1008397468 wait complete. 2024-02-02T11:49:29.008 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:49:29.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.123+0000 7fd06ff62640 1 Processor -- start 2024-02-02T11:49:29.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.123+0000 7fd06ff62640 1 -- start start 2024-02-02T11:49:29.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.127+0000 7fd06ff62640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0680bc340 0x7fd0681415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.127+0000 7fd06ff62640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd0680b8020 0x7fd068151f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.127+0000 7fd06ff62640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd068071550 con 0x7fd068141b30 2024-02-02T11:49:29.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.127+0000 7fd06ff62640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd068071810 con 0x7fd0680b8020 2024-02-02T11:49:29.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.127+0000 7fd06ff62640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd068071950 con 0x7fd0680bc340 2024-02-02T11:49:29.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.127+0000 7fd06dcfe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0680bc340 0x7fd0681415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.127+0000 7fd06e4ff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd0680b8020 0x7fd068151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.127+0000 7fd06dcfe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0680bc340 0x7fd0681415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.161:55386/0 (socket says 172.21.15.161:55386) 2024-02-02T11:49:29.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.127+0000 7fd06dcfe640 1 -- 172.21.15.161:0/2391676743 learned_addr learned my addr 172.21.15.161:0/2391676743 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:29.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.127+0000 7fd06ccfc640 1 -- 172.21.15.161:0/2391676743 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429003639 0 0) 0x7fd068071550 con 0x7fd068141b30 2024-02-02T11:49:29.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.127+0000 7fd06ccfc640 1 -- 172.21.15.161:0/2391676743 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd054003530 con 0x7fd068141b30 2024-02-02T11:49:29.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.127+0000 7fd06dcfe640 1 -- 172.21.15.161:0/2391676743 >> v2:172.21.15.162:3300/0 conn(0x7fd0680b8020 msgr2=0x7fd068151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:29.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.127+0000 7fd06dcfe640 1 --2- 172.21.15.161:0/2391676743 >> v2:172.21.15.162:3300/0 conn(0x7fd0680b8020 0x7fd068151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.127+0000 7fd06dcfe640 1 -- 172.21.15.161:0/2391676743 >> v1:172.21.15.162:6789/0 conn(0x7fd068141b30 legacy=0x7fd068147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:29.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.127+0000 7fd06dcfe640 1 -- 172.21.15.161:0/2391676743 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0680bc720 con 0x7fd0680bc340 2024-02-02T11:49:29.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.127+0000 7fd06dcfe640 1 --2- 172.21.15.161:0/2391676743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0680bc340 0x7fd0681415f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd058009870 tx=0x7fd05801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64139a92f5c59664 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:29.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.127+0000 7fd06ccfc640 1 -- 172.21.15.161:0/2391676743 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0580ab600 con 0x7fd0680bc340 2024-02-02T11:49:29.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ccfc640 1 -- 172.21.15.161:0/2391676743 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0580a7050 con 0x7fd0680bc340 2024-02-02T11:49:29.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ccfc640 1 -- 172.21.15.161:0/2391676743 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0580ab960 con 0x7fd0680bc340 2024-02-02T11:49:29.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ff62640 1 -- 172.21.15.161:0/2391676743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0680bc340 msgr2=0x7fd0681415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:29.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ff62640 1 --2- 172.21.15.161:0/2391676743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0680bc340 0x7fd0681415f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd058009870 tx=0x7fd05801c4b0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ff62640 1 -- 172.21.15.161:0/2391676743 shutdown_connections 2024-02-02T11:49:29.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ff62640 1 --2- 172.21.15.161:0/2391676743 >> v2:172.21.15.162:3300/0 conn(0x7fd0680b8020 0x7fd068151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ff62640 1 --2- 172.21.15.161:0/2391676743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0680bc340 0x7fd0681415f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ff62640 1 -- 172.21.15.161:0/2391676743 >> 172.21.15.161:0/2391676743 conn(0x7fd068069ef0 msgr2=0x7fd06806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:29.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ff62640 1 -- 172.21.15.161:0/2391676743 shutdown_connections 2024-02-02T11:49:29.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ff62640 1 -- 172.21.15.161:0/2391676743 wait complete. 2024-02-02T11:49:29.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ff62640 1 Processor -- start 2024-02-02T11:49:29.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ff62640 1 -- start start 2024-02-02T11:49:29.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ff62640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0680b8020 0x7fd0680afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ff62640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0680bc340 0x7fd0681e74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ff62640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd068141b30 0x7fd0681e79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ff62640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0680b0420 con 0x7fd0680bc340 2024-02-02T11:49:29.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ff62640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0680b2630 con 0x7fd0680b8020 2024-02-02T11:49:29.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ff62640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0680b2350 con 0x7fd068141b30 2024-02-02T11:49:29.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06d4fd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0680bc340 0x7fd0681e74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06d4fd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0680bc340 0x7fd0681e74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34428/0 (socket says 172.21.15.161:34428) 2024-02-02T11:49:29.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06d4fd640 1 -- 172.21.15.161:0/3632780887 learned_addr learned my addr 172.21.15.161:0/3632780887 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:29.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06dcfe640 1 --2- 172.21.15.161:0/3632780887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0680b8020 0x7fd0680afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06e4ff640 1 --2- 172.21.15.161:0/3632780887 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd068141b30 0x7fd0681e79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06d4fd640 1 -- 172.21.15.161:0/3632780887 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd068141b30 msgr2=0x7fd0681e79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:29.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06d4fd640 1 --2- 172.21.15.161:0/3632780887 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd068141b30 0x7fd0681e79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06d4fd640 1 -- 172.21.15.161:0/3632780887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0680b8020 msgr2=0x7fd0680afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:29.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06d4fd640 1 --2- 172.21.15.161:0/3632780887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0680b8020 0x7fd0680afee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06d4fd640 1 -- 172.21.15.161:0/3632780887 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0580094d0 con 0x7fd0680bc340 2024-02-02T11:49:29.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06d4fd640 1 --2- 172.21.15.161:0/3632780887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0680bc340 0x7fd0681e74b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd06400c500 tx=0x7fd06400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:29.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd05e7fc640 1 -- 172.21.15.161:0/3632780887 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0640052d0 con 0x7fd0680bc340 2024-02-02T11:49:29.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd05e7fc640 1 -- 172.21.15.161:0/3632780887 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd064005450 con 0x7fd0680bc340 2024-02-02T11:49:29.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ff62640 1 -- 172.21.15.161:0/3632780887 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0681e6f90 con 0x7fd0680bc340 2024-02-02T11:49:29.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd05e7fc640 1 -- 172.21.15.161:0/3632780887 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd064012870 con 0x7fd0680bc340 2024-02-02T11:49:29.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.131+0000 7fd06ff62640 1 -- 172.21.15.161:0/3632780887 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0680b2040 con 0x7fd0680bc340 2024-02-02T11:49:29.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.135+0000 7fd06ff62640 1 -- 172.21.15.161:0/3632780887 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0681e7180 con 0x7fd0680bc340 2024-02-02T11:49:29.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.135+0000 7fd05e7fc640 1 -- 172.21.15.161:0/3632780887 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd0640129d0 con 0x7fd0680bc340 2024-02-02T11:49:29.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.135+0000 7fd05e7fc640 1 --2- 172.21.15.161:0/3632780887 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd04c065a60 0x7fd04c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.135+0000 7fd05e7fc640 1 -- 172.21.15.161:0/3632780887 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd0640829d0 con 0x7fd0680bc340 2024-02-02T11:49:29.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.135+0000 7fd06dcfe640 1 --2- 172.21.15.161:0/3632780887 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd04c065a60 0x7fd04c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.135+0000 7fd06dcfe640 1 --2- 172.21.15.161:0/3632780887 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd04c065a60 0x7fd04c067f20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd0580ad000 tx=0x7fd0580a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:29.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.139+0000 7fd05e7fc640 1 -- 172.21.15.161:0/3632780887 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd0640506f0 con 0x7fd0680bc340 2024-02-02T11:49:29.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.295+0000 7fd06ff62640 1 -- 172.21.15.161:0/3632780887 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd06804e000 con 0x7fd0680bc340 2024-02-02T11:49:29.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.295+0000 7fd05e7fc640 1 -- 172.21.15.161:0/3632780887 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+12437 (secure 0 0 0) 0x7fd064053d10 con 0x7fd0680bc340 2024-02-02T11:49:29.299 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:29.299 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:49:26.489797+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:49:29.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.295+0000 7fd06ff62640 1 -- 172.21.15.161:0/3632780887 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd04c065a60 msgr2=0x7fd04c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:29.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.299+0000 7fd06ff62640 1 --2- 172.21.15.161:0/3632780887 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd04c065a60 0x7fd04c067f20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd0580ad000 tx=0x7fd0580a6000 comp rx=0 tx=0).stop 2024-02-02T11:49:29.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.299+0000 7fd06ff62640 1 -- 172.21.15.161:0/3632780887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0680bc340 msgr2=0x7fd0681e74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:29.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.299+0000 7fd06ff62640 1 --2- 172.21.15.161:0/3632780887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0680bc340 0x7fd0681e74b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd06400c500 tx=0x7fd06400c9c0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.299+0000 7fd06ff62640 1 -- 172.21.15.161:0/3632780887 shutdown_connections 2024-02-02T11:49:29.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.299+0000 7fd06ff62640 1 --2- 172.21.15.161:0/3632780887 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd04c065a60 0x7fd04c067f20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.299+0000 7fd06ff62640 1 --2- 172.21.15.161:0/3632780887 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd068141b30 0x7fd0681e79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.299+0000 7fd06ff62640 1 --2- 172.21.15.161:0/3632780887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0680bc340 0x7fd0681e74b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.299+0000 7fd06ff62640 1 --2- 172.21.15.161:0/3632780887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0680b8020 0x7fd0680afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.299+0000 7fd06ff62640 1 -- 172.21.15.161:0/3632780887 >> 172.21.15.161:0/3632780887 conn(0x7fd068069ef0 msgr2=0x7fd06806fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:29.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.299+0000 7fd06ff62640 1 -- 172.21.15.161:0/3632780887 shutdown_connections 2024-02-02T11:49:29.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.299+0000 7fd06ff62640 1 -- 172.21.15.161:0/3632780887 wait complete. 2024-02-02T11:49:29.317 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-02T11:48:40.330782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-02T11:49:29.318 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-02T11:49:29.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.435+0000 7fd86b4c3640 1 Processor -- start 2024-02-02T11:49:29.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.435+0000 7fd86b4c3640 1 -- start start 2024-02-02T11:49:29.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.439+0000 7fd86b4c3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd8640b8df0 0x7fd864147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.439+0000 7fd86b4c3640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86406ec30 con 0x7fd8640b8530 2024-02-02T11:49:29.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.439+0000 7fd86b4c3640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd864071890 con 0x7fd864070e40 2024-02-02T11:49:29.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.439+0000 7fd86b4c3640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8640b30e0 con 0x7fd8640b8df0 2024-02-02T11:49:29.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.439+0000 7fd86925f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd8640b8df0 0x7fd864147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.439+0000 7fd869a60640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd8640b8530 0x7fd864152000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40858/0 (socket says 172.21.15.161:40858) 2024-02-02T11:49:29.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.439+0000 7fd869a60640 1 -- 172.21.15.161:0/1545879139 learned_addr learned my addr 172.21.15.161:0/1545879139 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:29.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.439+0000 7fd86925f640 1 -- 172.21.15.161:0/1545879139 >> v1:172.21.15.162:6789/0 conn(0x7fd864070e40 legacy=0x7fd864141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:29.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.439+0000 7fd86925f640 1 -- 172.21.15.161:0/1545879139 >> v1:172.21.15.161:6789/0 conn(0x7fd8640b8530 legacy=0x7fd864152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:29.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.439+0000 7fd85bfff640 1 -- 172.21.15.161:0/1545879139 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918570627 0 0) 0x7fd86406ec30 con 0x7fd8640b8530 2024-02-02T11:49:29.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.439+0000 7fd86925f640 1 -- 172.21.15.161:0/1545879139 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8640712d0 con 0x7fd8640b8df0 2024-02-02T11:49:29.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.439+0000 7fd86925f640 1 --2- 172.21.15.161:0/1545879139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8640b8df0 0x7fd864147eb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd8600097c0 tx=0x7fd86001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43418217f6832e86 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:29.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.439+0000 7fd85bfff640 1 -- 172.21.15.161:0/1545879139 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8600ab600 con 0x7fd8640b8df0 2024-02-02T11:49:29.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.439+0000 7fd85bfff640 1 -- 172.21.15.161:0/1545879139 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8600a7050 con 0x7fd8640b8df0 2024-02-02T11:49:29.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.439+0000 7fd85bfff640 1 -- 172.21.15.161:0/1545879139 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8600ab980 con 0x7fd8640b8df0 2024-02-02T11:49:29.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.439+0000 7fd86b4c3640 1 -- 172.21.15.161:0/1545879139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8640b8df0 msgr2=0x7fd864147eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:29.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.439+0000 7fd86b4c3640 1 --2- 172.21.15.161:0/1545879139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8640b8df0 0x7fd864147eb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd8600097c0 tx=0x7fd86001c440 comp rx=0 tx=0).stop 2024-02-02T11:49:29.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86b4c3640 1 -- 172.21.15.161:0/1545879139 shutdown_connections 2024-02-02T11:49:29.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86b4c3640 1 --2- 172.21.15.161:0/1545879139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8640b8df0 0x7fd864147eb0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86b4c3640 1 -- 172.21.15.161:0/1545879139 >> 172.21.15.161:0/1545879139 conn(0x7fd86406a120 msgr2=0x7fd86406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:29.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86b4c3640 1 -- 172.21.15.161:0/1545879139 shutdown_connections 2024-02-02T11:49:29.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86b4c3640 1 -- 172.21.15.161:0/1545879139 wait complete. 2024-02-02T11:49:29.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86b4c3640 1 Processor -- start 2024-02-02T11:49:29.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86b4c3640 1 -- start start 2024-02-02T11:49:29.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86b4c3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8640b8530 0x7fd864138770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86b4c3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8640b8df0 0x7fd8641e5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86b4c3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd8641e6390 0x7fd8640b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86b4c3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd864138cb0 con 0x7fd8640b8530 2024-02-02T11:49:29.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86b4c3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86413f560 con 0x7fd8640b8df0 2024-02-02T11:49:29.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86b4c3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd864139a70 con 0x7fd8641e6390 2024-02-02T11:49:29.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86925f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8640b8530 0x7fd864138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86925f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8640b8530 0x7fd864138770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34442/0 (socket says 172.21.15.161:34442) 2024-02-02T11:49:29.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86925f640 1 -- 172.21.15.161:0/832074570 learned_addr learned my addr 172.21.15.161:0/832074570 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:29.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd869a60640 1 --2- 172.21.15.161:0/832074570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd8641e6390 0x7fd8640b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd868a5e640 1 --2- 172.21.15.161:0/832074570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8640b8df0 0x7fd8641e5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86925f640 1 -- 172.21.15.161:0/832074570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd8641e6390 msgr2=0x7fd8640b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:29.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86925f640 1 --2- 172.21.15.161:0/832074570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd8641e6390 0x7fd8640b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86925f640 1 -- 172.21.15.161:0/832074570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8640b8df0 msgr2=0x7fd8641e5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:29.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86925f640 1 --2- 172.21.15.161:0/832074570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8640b8df0 0x7fd8641e5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86925f640 1 -- 172.21.15.161:0/832074570 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd860009420 con 0x7fd8640b8530 2024-02-02T11:49:29.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd868a5e640 1 --2- 172.21.15.161:0/832074570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8640b8df0 0x7fd8641e5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:29.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86925f640 1 --2- 172.21.15.161:0/832074570 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8640b8530 0x7fd864138770 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd860019050 tx=0x7fd86001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:29.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd859ffb640 1 -- 172.21.15.161:0/832074570 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8600b7650 con 0x7fd8640b8530 2024-02-02T11:49:29.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd859ffb640 1 -- 172.21.15.161:0/832074570 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8600abe90 con 0x7fd8640b8530 2024-02-02T11:49:29.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86b4c3640 1 -- 172.21.15.161:0/832074570 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd864140280 con 0x7fd8640b8530 2024-02-02T11:49:29.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd859ffb640 1 -- 172.21.15.161:0/832074570 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8600b7a10 con 0x7fd8640b8530 2024-02-02T11:49:29.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86b4c3640 1 -- 172.21.15.161:0/832074570 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8641410d0 con 0x7fd8640b8530 2024-02-02T11:49:29.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.443+0000 7fd86b4c3640 1 -- 172.21.15.161:0/832074570 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86404e000 con 0x7fd8640b8530 2024-02-02T11:49:29.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.447+0000 7fd859ffb640 1 -- 172.21.15.161:0/832074570 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd8600b7b70 con 0x7fd8640b8530 2024-02-02T11:49:29.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.447+0000 7fd859ffb640 1 --2- 172.21.15.161:0/832074570 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd848065a90 0x7fd848067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.447+0000 7fd859ffb640 1 -- 172.21.15.161:0/832074570 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd86011d820 con 0x7fd8640b8530 2024-02-02T11:49:29.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.447+0000 7fd868a5e640 1 --2- 172.21.15.161:0/832074570 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd848065a90 0x7fd848067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.447+0000 7fd868a5e640 1 --2- 172.21.15.161:0/832074570 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd848065a90 0x7fd848067f50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd864139050 tx=0x7fd854008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:29.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.451+0000 7fd859ffb640 1 -- 172.21.15.161:0/832074570 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd8600eb650 con 0x7fd8640b8530 2024-02-02T11:49:29.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.607+0000 7fd86b4c3640 1 -- 172.21.15.161:0/832074570 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8640b7970 con 0x7fd8640b8530 2024-02-02T11:49:29.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.607+0000 7fd859ffb640 1 -- 172.21.15.161:0/832074570 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8600b00a0 con 0x7fd8640b8530 2024-02-02T11:49:29.610 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-02-02T11:49:29.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.607+0000 7fd86b4c3640 1 -- 172.21.15.161:0/832074570 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd848065a90 msgr2=0x7fd848067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:29.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.607+0000 7fd86b4c3640 1 --2- 172.21.15.161:0/832074570 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd848065a90 0x7fd848067f50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd864139050 tx=0x7fd854008040 comp rx=0 tx=0).stop 2024-02-02T11:49:29.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.607+0000 7fd86b4c3640 1 -- 172.21.15.161:0/832074570 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8640b8530 msgr2=0x7fd864138770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:29.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.607+0000 7fd86b4c3640 1 --2- 172.21.15.161:0/832074570 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8640b8530 0x7fd864138770 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd860019050 tx=0x7fd86001ac80 comp rx=0 tx=0).stop 2024-02-02T11:49:29.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.611+0000 7fd86b4c3640 1 -- 172.21.15.161:0/832074570 shutdown_connections 2024-02-02T11:49:29.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.611+0000 7fd86b4c3640 1 --2- 172.21.15.161:0/832074570 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd848065a90 0x7fd848067f50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.611+0000 7fd86b4c3640 1 --2- 172.21.15.161:0/832074570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd8641e6390 0x7fd8640b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.611+0000 7fd86b4c3640 1 --2- 172.21.15.161:0/832074570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8640b8df0 0x7fd8641e5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.611+0000 7fd86b4c3640 1 --2- 172.21.15.161:0/832074570 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8640b8530 0x7fd864138770 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.611+0000 7fd86b4c3640 1 -- 172.21.15.161:0/832074570 >> 172.21.15.161:0/832074570 conn(0x7fd86406a120 msgr2=0x7fd86406ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:29.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.611+0000 7fd86b4c3640 1 -- 172.21.15.161:0/832074570 shutdown_connections 2024-02-02T11:49:29.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.611+0000 7fd86b4c3640 1 -- 172.21.15.161:0/832074570 wait complete. 2024-02-02T11:49:29.629 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-02T11:49:29.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe356543640 1 Processor -- start 2024-02-02T11:49:29.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe356543640 1 -- start start 2024-02-02T11:49:29.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe356543640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe35014b540 0x7fe3500bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe356543640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe35006a4c0 0x7fe35006a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe356543640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3500bc590 con 0x7fe35014dfd0 2024-02-02T11:49:29.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe356543640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe35006ae40 con 0x7fe35006a4c0 2024-02-02T11:49:29.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe356543640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500bc320 con 0x7fe35014b540 2024-02-02T11:49:29.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe354ae0640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fe35014dfd0 0x7fe35014e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40864/0 (socket says 172.21.15.161:40864) 2024-02-02T11:49:29.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe354ae0640 1 -- 172.21.15.161:0/192630234 learned_addr learned my addr 172.21.15.161:0/192630234 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:29.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34f7fe640 1 --2- 172.21.15.161:0/192630234 >> v2:172.21.15.162:3300/0 conn(0x7fe35006a4c0 0x7fe35006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34ffff640 1 --2- 172.21.15.161:0/192630234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe35014b540 0x7fe3500bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34effd640 1 -- 172.21.15.161:0/192630234 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1725399199 0 0) 0x7fe3500bc590 con 0x7fe35014dfd0 2024-02-02T11:49:29.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34effd640 1 -- 172.21.15.161:0/192630234 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe338003530 con 0x7fe35014dfd0 2024-02-02T11:49:29.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34effd640 1 -- 172.21.15.161:0/192630234 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3099319286 0 0) 0x7fe338003530 con 0x7fe35014dfd0 2024-02-02T11:49:29.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34effd640 1 -- 172.21.15.161:0/192630234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe35014b540 msgr2=0x7fe3500bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:29.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34effd640 1 --2- 172.21.15.161:0/192630234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe35014b540 0x7fe3500bac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34effd640 1 -- 172.21.15.161:0/192630234 >> v2:172.21.15.162:3300/0 conn(0x7fe35006a4c0 msgr2=0x7fe35006a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:29.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34effd640 1 --2- 172.21.15.161:0/192630234 >> v2:172.21.15.162:3300/0 conn(0x7fe35006a4c0 0x7fe35006a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34effd640 1 -- 172.21.15.161:0/192630234 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3500b3a10 con 0x7fe35014dfd0 2024-02-02T11:49:29.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34effd640 1 -- 172.21.15.161:0/192630234 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7fe348001a00 con 0x7fe35014dfd0 2024-02-02T11:49:29.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34effd640 1 -- 172.21.15.161:0/192630234 >> v1:172.21.15.161:6789/0 conn(0x7fe35014dfd0 legacy=0x7fe35014e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:29.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34effd640 1 --2- 172.21.15.161:0/192630234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe338003980 0x7fe338003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34effd640 1 --2- 172.21.15.161:0/192630234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3380047d0 0x7fe338004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34effd640 1 --2- 172.21.15.161:0/192630234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe35014b540 0x7fe338005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34effd640 1 -- 172.21.15.161:0/192630234 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35006ae40 con 0x7fe3380047d0 2024-02-02T11:49:29.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34effd640 1 -- 172.21.15.161:0/192630234 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33800b990 con 0x7fe338003980 2024-02-02T11:49:29.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34effd640 1 -- 172.21.15.161:0/192630234 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33800bad0 con 0x7fe35014b540 2024-02-02T11:49:29.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34f7fe640 1 --2- 172.21.15.161:0/192630234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3380047d0 0x7fe338004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34ffff640 1 --2- 172.21.15.161:0/192630234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe338003980 0x7fe338003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34f7fe640 1 -- 172.21.15.161:0/192630234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe35014b540 msgr2=0x7fe338005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:29.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe354ae0640 1 --2- 172.21.15.161:0/192630234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe35014b540 0x7fe338005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34f7fe640 1 --2- 172.21.15.161:0/192630234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe35014b540 0x7fe338005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34f7fe640 1 -- 172.21.15.161:0/192630234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe338003980 msgr2=0x7fe338003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:29.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34f7fe640 1 --2- 172.21.15.161:0/192630234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe338003980 0x7fe338003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34f7fe640 1 -- 172.21.15.161:0/192630234 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe338003530 con 0x7fe3380047d0 2024-02-02T11:49:29.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.743+0000 7fe34ffff640 1 --2- 172.21.15.161:0/192630234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe338003980 0x7fe338003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:29.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe34f7fe640 1 --2- 172.21.15.161:0/192630234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3380047d0 0x7fe338004c50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe344009ae0 tx=0x7fe34401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41042c10edc2778e server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:29.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe34effd640 1 -- 172.21.15.161:0/192630234 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3440a55a0 con 0x7fe3380047d0 2024-02-02T11:49:29.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe34effd640 1 -- 172.21.15.161:0/192630234 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3440a5700 con 0x7fe3380047d0 2024-02-02T11:49:29.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe34effd640 1 -- 172.21.15.161:0/192630234 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3440a5ab0 con 0x7fe3380047d0 2024-02-02T11:49:29.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe356543640 1 -- 172.21.15.161:0/192630234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3380047d0 msgr2=0x7fe338004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:29.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe356543640 1 --2- 172.21.15.161:0/192630234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3380047d0 0x7fe338004c50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe344009ae0 tx=0x7fe34401ca90 comp rx=0 tx=0).stop 2024-02-02T11:49:29.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe354ae0640 1 -- 172.21.15.161:0/192630234 reap_dead start 2024-02-02T11:49:29.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe356543640 1 -- 172.21.15.161:0/192630234 shutdown_connections 2024-02-02T11:49:29.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe356543640 1 -- 172.21.15.161:0/192630234 >> 172.21.15.161:0/192630234 conn(0x7fe3500c02e0 msgr2=0x7fe3500c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:29.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe356543640 1 -- 172.21.15.161:0/192630234 shutdown_connections 2024-02-02T11:49:29.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe356543640 1 -- 172.21.15.161:0/192630234 wait complete. 2024-02-02T11:49:29.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe356543640 1 Processor -- start 2024-02-02T11:49:29.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe356543640 1 -- start start 2024-02-02T11:49:29.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe356543640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3380047d0 0x7fe35014d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe356543640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3501d3820 0x7fe3501e3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe356543640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3501457d0 0x7fe350145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe356543640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35014dcb0 con 0x7fe3380047d0 2024-02-02T11:49:29.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe356543640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3501e3370 con 0x7fe3501d3820 2024-02-02T11:49:29.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe356543640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500a3a40 con 0x7fe3501457d0 2024-02-02T11:49:29.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe34ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3380047d0 0x7fe35014d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe34ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3380047d0 0x7fe35014d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34460/0 (socket says 172.21.15.161:34460) 2024-02-02T11:49:29.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe34ffff640 1 -- 172.21.15.161:0/1009363331 learned_addr learned my addr 172.21.15.161:0/1009363331 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:29.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe34f7fe640 1 --2- 172.21.15.161:0/1009363331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3501d3820 0x7fe3501e3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe354ae0640 1 --2- 172.21.15.161:0/1009363331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3501457d0 0x7fe350145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe34ffff640 1 -- 172.21.15.161:0/1009363331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3501457d0 msgr2=0x7fe350145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:29.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe34ffff640 1 --2- 172.21.15.161:0/1009363331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3501457d0 0x7fe350145c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe34ffff640 1 -- 172.21.15.161:0/1009363331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3501d3820 msgr2=0x7fe3501e3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:29.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe34ffff640 1 --2- 172.21.15.161:0/1009363331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3501d3820 0x7fe3501e3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe34ffff640 1 -- 172.21.15.161:0/1009363331 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3500a3c90 con 0x7fe3380047d0 2024-02-02T11:49:29.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.747+0000 7fe34ffff640 1 --2- 172.21.15.161:0/1009363331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3380047d0 0x7fe35014d770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe3400108c0 tx=0x7fe340010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:29.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.751+0000 7fe34cff9640 1 -- 172.21.15.161:0/1009363331 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340004220 con 0x7fe3380047d0 2024-02-02T11:49:29.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.751+0000 7fe34cff9640 1 -- 172.21.15.161:0/1009363331 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe340004380 con 0x7fe3380047d0 2024-02-02T11:49:29.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.751+0000 7fe356543640 1 -- 172.21.15.161:0/1009363331 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3501e3000 con 0x7fe3380047d0 2024-02-02T11:49:29.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.751+0000 7fe34cff9640 1 -- 172.21.15.161:0/1009363331 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34000eb80 con 0x7fe3380047d0 2024-02-02T11:49:29.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.751+0000 7fe356543640 1 -- 172.21.15.161:0/1009363331 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3500a4380 con 0x7fe3380047d0 2024-02-02T11:49:29.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.751+0000 7fe356543640 1 -- 172.21.15.161:0/1009363331 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe35004e000 con 0x7fe3380047d0 2024-02-02T11:49:29.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.751+0000 7fe34cff9640 1 -- 172.21.15.161:0/1009363331 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe34000ece0 con 0x7fe3380047d0 2024-02-02T11:49:29.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.751+0000 7fe34cff9640 1 --2- 172.21.15.161:0/1009363331 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fe33c065a90 0x7fe33c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:29.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.751+0000 7fe34cff9640 1 -- 172.21.15.161:0/1009363331 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe340082ee0 con 0x7fe3380047d0 2024-02-02T11:49:29.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.751+0000 7fe34f7fe640 1 --2- 172.21.15.161:0/1009363331 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fe33c065a90 0x7fe33c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:29.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.751+0000 7fe34f7fe640 1 --2- 172.21.15.161:0/1009363331 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fe33c065a90 0x7fe33c067f50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe3440af000 tx=0x7fe3440046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:29.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.755+0000 7fe34cff9640 1 -- 172.21.15.161:0/1009363331 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe340050c80 con 0x7fe3380047d0 2024-02-02T11:49:29.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.911+0000 7fe356543640 1 -- 172.21.15.161:0/1009363331 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe3500a6260 con 0x7fe3380047d0 2024-02-02T11:49:29.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.911+0000 7fe34cff9640 1 -- 172.21.15.161:0/1009363331 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe340021060 con 0x7fe3380047d0 2024-02-02T11:49:29.915 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:29.915 INFO:teuthology.orchestra.run.smithi161.stdout:[ 2024-02-02T11:49:29.915 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-02-02T11:49:29.915 INFO:teuthology.orchestra.run.smithi161.stdout: "poolnum": 1, 2024-02-02T11:49:29.915 INFO:teuthology.orchestra.run.smithi161.stdout: "poolname": ".mgr" 2024-02-02T11:49:29.915 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-02T11:49:29.915 INFO:teuthology.orchestra.run.smithi161.stdout:] 2024-02-02T11:49:29.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.915+0000 7fe356543640 1 -- 172.21.15.161:0/1009363331 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fe33c065a90 msgr2=0x7fe33c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:29.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.915+0000 7fe356543640 1 --2- 172.21.15.161:0/1009363331 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fe33c065a90 0x7fe33c067f50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe3440af000 tx=0x7fe3440046d0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.915+0000 7fe356543640 1 -- 172.21.15.161:0/1009363331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3380047d0 msgr2=0x7fe35014d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:29.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.915+0000 7fe356543640 1 --2- 172.21.15.161:0/1009363331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3380047d0 0x7fe35014d770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe3400108c0 tx=0x7fe340010d80 comp rx=0 tx=0).stop 2024-02-02T11:49:29.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.915+0000 7fe356543640 1 -- 172.21.15.161:0/1009363331 shutdown_connections 2024-02-02T11:49:29.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.915+0000 7fe356543640 1 --2- 172.21.15.161:0/1009363331 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fe33c065a90 0x7fe33c067f50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.915+0000 7fe356543640 1 --2- 172.21.15.161:0/1009363331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3501457d0 0x7fe350145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.915+0000 7fe356543640 1 --2- 172.21.15.161:0/1009363331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3501d3820 0x7fe3501e3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.915+0000 7fe356543640 1 --2- 172.21.15.161:0/1009363331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3380047d0 0x7fe35014d770 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:29.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.915+0000 7fe356543640 1 -- 172.21.15.161:0/1009363331 >> 172.21.15.161:0/1009363331 conn(0x7fe3500c02e0 msgr2=0x7fe350148cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:29.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.915+0000 7fe356543640 1 -- 172.21.15.161:0/1009363331 shutdown_connections 2024-02-02T11:49:29.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:29.915+0000 7fe356543640 1 -- 172.21.15.161:0/1009363331 wait complete. 2024-02-02T11:49:29.934 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-02T11:49:29.934 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-02T11:49:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d92bae640 1 Processor -- start 2024-02-02T11:49:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d92bae640 1 -- start start 2024-02-02T11:49:30.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d92bae640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d8c0b8df0 0x7f8d8c142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:30.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d92bae640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d8c148a80 con 0x7f8d8c0b8540 2024-02-02T11:49:30.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d92bae640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d8c0b3890 con 0x7f8d8c142d80 2024-02-02T11:49:30.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d92bae640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c0b3b70 con 0x7f8d8c0b8df0 2024-02-02T11:49:30.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d8bfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f8d8c0b8540 0x7f8d8c148f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40866/0 (socket says 172.21.15.161:40866) 2024-02-02T11:49:30.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d8bfff640 1 -- 172.21.15.161:0/676727849 learned_addr learned my addr 172.21.15.161:0/676727849 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:30.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d9094a640 1 --2- 172.21.15.161:0/676727849 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d8c0b8df0 0x7f8d8c142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:30.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d8b7fe640 1 -- 172.21.15.161:0/676727849 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755017640 0 0) 0x7f8d8c148a80 con 0x7f8d8c0b8540 2024-02-02T11:49:30.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d8b7fe640 1 -- 172.21.15.161:0/676727849 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d74003530 con 0x7f8d8c0b8540 2024-02-02T11:49:30.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d8b7fe640 1 -- 172.21.15.161:0/676727849 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1169470959 0 0) 0x7f8d74003530 con 0x7f8d8c0b8540 2024-02-02T11:49:30.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d8b7fe640 1 -- 172.21.15.161:0/676727849 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d8c0b8df0 msgr2=0x7f8d8c142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:30.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d8b7fe640 1 --2- 172.21.15.161:0/676727849 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d8c0b8df0 0x7f8d8c142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:30.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d8b7fe640 1 -- 172.21.15.161:0/676727849 >> v1:172.21.15.162:6789/0 conn(0x7f8d8c142d80 legacy=0x7f8d8c1531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:30.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d8b7fe640 1 -- 172.21.15.161:0/676727849 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c0b3e50 con 0x7f8d8c0b8540 2024-02-02T11:49:30.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d8b7fe640 1 -- 172.21.15.161:0/676727849 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f8d80001680 con 0x7f8d8c0b8540 2024-02-02T11:49:30.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d8b7fe640 1 -- 172.21.15.161:0/676727849 >> v1:172.21.15.161:6789/0 conn(0x7f8d8c0b8540 legacy=0x7f8d8c148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:30.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d8b7fe640 1 --2- 172.21.15.161:0/676727849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d740039b0 0x7f8d74003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:30.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d8b7fe640 1 --2- 172.21.15.161:0/676727849 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d8c0b8df0 0x7f8d740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:30.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d8b7fe640 1 --2- 172.21.15.161:0/676727849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d74004d10 0x7f8d74005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:30.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d8b7fe640 1 -- 172.21.15.161:0/676727849 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c0b3b70 con 0x7f8d74004d10 2024-02-02T11:49:30.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d8b7fe640 1 -- 172.21.15.161:0/676727849 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7400ba40 con 0x7f8d740039b0 2024-02-02T11:49:30.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d8b7fe640 1 -- 172.21.15.161:0/676727849 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7400bc00 con 0x7f8d8c0b8df0 2024-02-02T11:49:30.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d9114b640 1 --2- 172.21.15.161:0/676727849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d74004d10 0x7f8d74005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:30.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d8bfff640 1 --2- 172.21.15.161:0/676727849 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d8c0b8df0 0x7f8d740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:30.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d9094a640 1 --2- 172.21.15.161:0/676727849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d740039b0 0x7f8d74003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:30.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d9114b640 1 -- 172.21.15.161:0/676727849 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d8c0b8df0 msgr2=0x7f8d740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:30.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d9114b640 1 --2- 172.21.15.161:0/676727849 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d8c0b8df0 0x7f8d740047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:30.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d9114b640 1 -- 172.21.15.161:0/676727849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d740039b0 msgr2=0x7f8d74003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:30.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d9114b640 1 --2- 172.21.15.161:0/676727849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d740039b0 0x7f8d74003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:30.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.055+0000 7f8d9114b640 1 -- 172.21.15.161:0/676727849 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d74003530 con 0x7f8d74004d10 2024-02-02T11:49:30.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.059+0000 7f8d9114b640 1 --2- 172.21.15.161:0/676727849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d74004d10 0x7f8d74005190 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c1431b0 tx=0x7f8d8401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d87f066d97d526 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:30.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.059+0000 7f8d8b7fe640 1 -- 172.21.15.161:0/676727849 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d84003b80 con 0x7f8d74004d10 2024-02-02T11:49:30.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.059+0000 7f8d8b7fe640 1 -- 172.21.15.161:0/676727849 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d84003ce0 con 0x7f8d74004d10 2024-02-02T11:49:30.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.059+0000 7f8d8b7fe640 1 -- 172.21.15.161:0/676727849 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d84005310 con 0x7f8d74004d10 2024-02-02T11:49:30.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.059+0000 7f8d92bae640 1 -- 172.21.15.161:0/676727849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d74004d10 msgr2=0x7f8d74005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:30.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.059+0000 7f8d92bae640 1 --2- 172.21.15.161:0/676727849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d74004d10 0x7f8d74005190 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c1431b0 tx=0x7f8d8401c6e0 comp rx=0 tx=0).stop 2024-02-02T11:49:30.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.059+0000 7f8d9114b640 1 -- 172.21.15.161:0/676727849 reap_dead start 2024-02-02T11:49:30.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.059+0000 7f8d92bae640 1 -- 172.21.15.161:0/676727849 shutdown_connections 2024-02-02T11:49:30.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.059+0000 7f8d92bae640 1 -- 172.21.15.161:0/676727849 >> 172.21.15.161:0/676727849 conn(0x7f8d8c06a120 msgr2=0x7f8d8c06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:30.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.059+0000 7f8d92bae640 1 -- 172.21.15.161:0/676727849 shutdown_connections 2024-02-02T11:49:30.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.059+0000 7f8d92bae640 1 -- 172.21.15.161:0/676727849 wait complete. 2024-02-02T11:49:30.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.059+0000 7f8d92bae640 1 Processor -- start 2024-02-02T11:49:30.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.059+0000 7f8d92bae640 1 -- start start 2024-02-02T11:49:30.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d92bae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d74004d10 0x7f8d8c143880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:30.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d92bae640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d8c1e0f80 0x7f8d8c141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:30.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d92bae640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d8c0bc2f0 0x7f8d8c0bc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:30.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d92bae640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c141e50 con 0x7f8d8c0bc2f0 2024-02-02T11:49:30.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d92bae640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c145d90 con 0x7f8d74004d10 2024-02-02T11:49:30.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d92bae640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c1e1400 con 0x7f8d8c1e0f80 2024-02-02T11:49:30.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d9114b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d8c0bc2f0 0x7f8d8c0bc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:30.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d9114b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d8c0bc2f0 0x7f8d8c0bc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34476/0 (socket says 172.21.15.161:34476) 2024-02-02T11:49:30.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d9114b640 1 -- 172.21.15.161:0/3921183977 learned_addr learned my addr 172.21.15.161:0/3921183977 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:30.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d8bfff640 1 --2- 172.21.15.161:0/3921183977 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d8c1e0f80 0x7f8d8c141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:30.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d9094a640 1 --2- 172.21.15.161:0/3921183977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d74004d10 0x7f8d8c143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:30.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d9114b640 1 -- 172.21.15.161:0/3921183977 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d8c1e0f80 msgr2=0x7f8d8c141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:30.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d9114b640 1 --2- 172.21.15.161:0/3921183977 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d8c1e0f80 0x7f8d8c141910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:30.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d9114b640 1 -- 172.21.15.161:0/3921183977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d74004d10 msgr2=0x7f8d8c143880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:30.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d9114b640 1 --2- 172.21.15.161:0/3921183977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d74004d10 0x7f8d8c143880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:30.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d9114b640 1 -- 172.21.15.161:0/3921183977 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c144700 con 0x7f8d8c0bc2f0 2024-02-02T11:49:30.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d9094a640 1 --2- 172.21.15.161:0/3921183977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d74004d10 0x7f8d8c143880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:49:30.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d9114b640 1 --2- 172.21.15.161:0/3921183977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d8c0bc2f0 0x7f8d8c0bc770 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8d8401cbc0 tx=0x7f8d74005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:30.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d897fa640 1 -- 172.21.15.161:0/3921183977 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d840b5070 con 0x7f8d8c0bc2f0 2024-02-02T11:49:30.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d897fa640 1 -- 172.21.15.161:0/3921183977 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d84003e50 con 0x7f8d8c0bc2f0 2024-02-02T11:49:30.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d92bae640 1 -- 172.21.15.161:0/3921183977 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8c1449e0 con 0x7f8d8c0bc2f0 2024-02-02T11:49:30.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d897fa640 1 -- 172.21.15.161:0/3921183977 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d84005500 con 0x7f8d8c0bc2f0 2024-02-02T11:49:30.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d92bae640 1 -- 172.21.15.161:0/3921183977 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8c143360 con 0x7f8d8c0bc2f0 2024-02-02T11:49:30.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d92bae640 1 -- 172.21.15.161:0/3921183977 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d8c144f00 con 0x7f8d8c0bc2f0 2024-02-02T11:49:30.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d897fa640 1 -- 172.21.15.161:0/3921183977 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8d84005660 con 0x7f8d8c0bc2f0 2024-02-02T11:49:30.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d897fa640 1 --2- 172.21.15.161:0/3921183977 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8d78065a60 0x7f8d78067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:30.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d897fa640 1 -- 172.21.15.161:0/3921183977 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8d8411cc10 con 0x7f8d8c0bc2f0 2024-02-02T11:49:30.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d9094a640 1 --2- 172.21.15.161:0/3921183977 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8d78065a60 0x7f8d78067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:30.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.063+0000 7f8d9094a640 1 --2- 172.21.15.161:0/3921183977 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8d78065a60 0x7f8d78067f20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009af0 tx=0x7f8d7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:30.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.067+0000 7f8d897fa640 1 -- 172.21.15.161:0/3921183977 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8d8c144f00 con 0x7f8d8c0bc2f0 2024-02-02T11:49:30.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.223+0000 7f8d92bae640 1 -- 172.21.15.161:0/3921183977 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8d8c1431c0 con 0x7f8d8c0bc2f0 2024-02-02T11:49:30.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.451+0000 7f8d897fa640 1 -- 172.21.15.161:0/3921183977 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8d8c1431c0 con 0x7f8d8c0bc2f0 2024-02-02T11:49:30.455 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_metadata' created 2024-02-02T11:49:30.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.459+0000 7f8d92bae640 1 -- 172.21.15.161:0/3921183977 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8d78065a60 msgr2=0x7f8d78067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:30.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.459+0000 7f8d92bae640 1 --2- 172.21.15.161:0/3921183977 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8d78065a60 0x7f8d78067f20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009af0 tx=0x7f8d7c008040 comp rx=0 tx=0).stop 2024-02-02T11:49:30.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.459+0000 7f8d92bae640 1 -- 172.21.15.161:0/3921183977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d8c0bc2f0 msgr2=0x7f8d8c0bc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:30.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.459+0000 7f8d92bae640 1 --2- 172.21.15.161:0/3921183977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d8c0bc2f0 0x7f8d8c0bc770 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8d8401cbc0 tx=0x7f8d74005800 comp rx=0 tx=0).stop 2024-02-02T11:49:30.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.459+0000 7f8d92bae640 1 -- 172.21.15.161:0/3921183977 shutdown_connections 2024-02-02T11:49:30.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.459+0000 7f8d92bae640 1 --2- 172.21.15.161:0/3921183977 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8d78065a60 0x7f8d78067f20 secure :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009af0 tx=0x7f8d7c008040 comp rx=0 tx=0).stop 2024-02-02T11:49:30.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.459+0000 7f8d92bae640 1 --2- 172.21.15.161:0/3921183977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d8c0bc2f0 0x7f8d8c0bc770 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:30.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.459+0000 7f8d92bae640 1 --2- 172.21.15.161:0/3921183977 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d8c1e0f80 0x7f8d8c141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:30.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.459+0000 7f8d92bae640 1 --2- 172.21.15.161:0/3921183977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d74004d10 0x7f8d8c143880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:30.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.459+0000 7f8d92bae640 1 -- 172.21.15.161:0/3921183977 >> 172.21.15.161:0/3921183977 conn(0x7f8d8c06a120 msgr2=0x7f8d8c1402d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:30.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.459+0000 7f8d92bae640 1 -- 172.21.15.161:0/3921183977 shutdown_connections 2024-02-02T11:49:30.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.459+0000 7f8d92bae640 1 -- 172.21.15.161:0/3921183977 wait complete. 2024-02-02T11:49:30.484 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-02T11:49:30.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.603+0000 7ff314084640 1 Processor -- start 2024-02-02T11:49:30.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.603+0000 7ff314084640 1 -- start start 2024-02-02T11:49:30.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.603+0000 7ff314084640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff30c0b8b40 0x7ff30c0b8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:30.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.603+0000 7ff314084640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff30c144a80 0x7ff30c14ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:30.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.603+0000 7ff314084640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff30c144ee0 0x7ff30c14b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:30.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.603+0000 7ff314084640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff30c0b6e80 con 0x7ff30c144ee0 2024-02-02T11:49:30.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.603+0000 7ff314084640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff30c0b7160 con 0x7ff30c0b8b40 2024-02-02T11:49:30.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.603+0000 7ff314084640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c0bc6c0 con 0x7ff30c144a80 2024-02-02T11:49:30.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.603+0000 7ff312621640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff30c144ee0 0x7ff30c14b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:30.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.603+0000 7ff312621640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff30c144ee0 0x7ff30c14b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34482/0 (socket says 172.21.15.161:34482) 2024-02-02T11:49:30.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.603+0000 7ff312621640 1 -- 172.21.15.161:0/217578327 learned_addr learned my addr 172.21.15.161:0/217578327 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:30.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.603+0000 7ff311e20640 1 --2- 172.21.15.161:0/217578327 >> v2:172.21.15.162:3300/0 conn(0x7ff30c0b8b40 0x7ff30c0b8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:30.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.603+0000 7ff31161f640 1 --2- 172.21.15.161:0/217578327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff30c144a80 0x7ff30c14ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:30.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.603+0000 7ff312621640 1 -- 172.21.15.161:0/217578327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff30c144a80 msgr2=0x7ff30c14ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:30.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.603+0000 7ff312621640 1 --2- 172.21.15.161:0/217578327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff30c144a80 0x7ff30c14ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:30.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.603+0000 7ff312621640 1 -- 172.21.15.161:0/217578327 >> v2:172.21.15.162:3300/0 conn(0x7ff30c0b8b40 msgr2=0x7ff30c0b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:30.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.603+0000 7ff312621640 1 --2- 172.21.15.161:0/217578327 >> v2:172.21.15.162:3300/0 conn(0x7ff30c0b8b40 0x7ff30c0b8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:30.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.603+0000 7ff312621640 1 -- 172.21.15.161:0/217578327 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff30c0bc9a0 con 0x7ff30c144ee0 2024-02-02T11:49:30.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff312621640 1 --2- 172.21.15.161:0/217578327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff30c144ee0 0x7ff30c14b1a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0ba8f0 tx=0x7ff30401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec466971545353ce server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:30.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff310e1e640 1 -- 172.21.15.161:0/217578327 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3040af400 con 0x7ff30c144ee0 2024-02-02T11:49:30.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff310e1e640 1 -- 172.21.15.161:0/217578327 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3040ab050 con 0x7ff30c144ee0 2024-02-02T11:49:30.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff310e1e640 1 -- 172.21.15.161:0/217578327 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3040af780 con 0x7ff30c144ee0 2024-02-02T11:49:30.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff314084640 1 -- 172.21.15.161:0/217578327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff30c144ee0 msgr2=0x7ff30c14b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:30.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff314084640 1 --2- 172.21.15.161:0/217578327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff30c144ee0 0x7ff30c14b1a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0ba8f0 tx=0x7ff30401f1c0 comp rx=0 tx=0).stop 2024-02-02T11:49:30.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff314084640 1 -- 172.21.15.161:0/217578327 shutdown_connections 2024-02-02T11:49:30.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff314084640 1 --2- 172.21.15.161:0/217578327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff30c144a80 0x7ff30c14ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:30.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff314084640 1 --2- 172.21.15.161:0/217578327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff30c144ee0 0x7ff30c14b1a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:30.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff314084640 1 --2- 172.21.15.161:0/217578327 >> v2:172.21.15.162:3300/0 conn(0x7ff30c0b8b40 0x7ff30c0b8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:30.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff314084640 1 -- 172.21.15.161:0/217578327 >> 172.21.15.161:0/217578327 conn(0x7ff30c0c02f0 msgr2=0x7ff30c0c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:30.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff314084640 1 -- 172.21.15.161:0/217578327 shutdown_connections 2024-02-02T11:49:30.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff314084640 1 -- 172.21.15.161:0/217578327 wait complete. 2024-02-02T11:49:30.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff314084640 1 Processor -- start 2024-02-02T11:49:30.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff314084640 1 -- start start 2024-02-02T11:49:30.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff314084640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff30c0b8b40 0x7ff30c1d3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:30.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff314084640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff30c144a80 0x7ff30c1d4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:30.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff314084640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff30c144ee0 0x7ff30c1d6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:30.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff314084640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c1d46d0 con 0x7ff30c0b8b40 2024-02-02T11:49:30.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff314084640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c1d5ee0 con 0x7ff30c144a80 2024-02-02T11:49:30.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff314084640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c1d5b60 con 0x7ff30c144ee0 2024-02-02T11:49:30.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff311e20640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff30c0b8b40 0x7ff30c1d3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:30.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff311e20640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff30c0b8b40 0x7ff30c1d3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34492/0 (socket says 172.21.15.161:34492) 2024-02-02T11:49:30.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff311e20640 1 -- 172.21.15.161:0/113005124 learned_addr learned my addr 172.21.15.161:0/113005124 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:30.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff31161f640 1 --2- 172.21.15.161:0/113005124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff30c144a80 0x7ff30c1d4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:30.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff312621640 1 --2- 172.21.15.161:0/113005124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff30c144ee0 0x7ff30c1d6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:30.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff311e20640 1 -- 172.21.15.161:0/113005124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff30c144ee0 msgr2=0x7ff30c1d6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:30.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff311e20640 1 --2- 172.21.15.161:0/113005124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff30c144ee0 0x7ff30c1d6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:30.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff311e20640 1 -- 172.21.15.161:0/113005124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff30c144a80 msgr2=0x7ff30c1d4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:30.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.607+0000 7ff311e20640 1 --2- 172.21.15.161:0/113005124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff30c144a80 0x7ff30c1d4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:30.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.611+0000 7ff311e20640 1 -- 172.21.15.161:0/113005124 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff304009b30 con 0x7ff30c0b8b40 2024-02-02T11:49:30.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.611+0000 7ff31161f640 1 --2- 172.21.15.161:0/113005124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff30c144a80 0x7ff30c1d4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:49:30.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.611+0000 7ff311e20640 1 --2- 172.21.15.161:0/113005124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff30c0b8b40 0x7ff30c1d3d00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff30800d800 tx=0x7ff30800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:30.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.611+0000 7ff3027fc640 1 -- 172.21.15.161:0/113005124 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3080096a0 con 0x7ff30c0b8b40 2024-02-02T11:49:30.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.611+0000 7ff3027fc640 1 -- 172.21.15.161:0/113005124 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff308009800 con 0x7ff30c0b8b40 2024-02-02T11:49:30.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.611+0000 7ff314084640 1 -- 172.21.15.161:0/113005124 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff30c1d4430 con 0x7ff30c0b8b40 2024-02-02T11:49:30.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.611+0000 7ff3027fc640 1 -- 172.21.15.161:0/113005124 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff308009b70 con 0x7ff30c0b8b40 2024-02-02T11:49:30.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.611+0000 7ff314084640 1 -- 172.21.15.161:0/113005124 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff30c1d77d0 con 0x7ff30c0b8b40 2024-02-02T11:49:30.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.611+0000 7ff314084640 1 -- 172.21.15.161:0/113005124 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff30c04e000 con 0x7ff30c0b8b40 2024-02-02T11:49:30.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.611+0000 7ff3027fc640 1 -- 172.21.15.161:0/113005124 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff308009cd0 con 0x7ff30c0b8b40 2024-02-02T11:49:30.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.611+0000 7ff3027fc640 1 --2- 172.21.15.161:0/113005124 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff2f0065a60 0x7ff2f0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:30.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.611+0000 7ff3027fc640 1 -- 172.21.15.161:0/113005124 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5227+0+0 (secure 0 0 0) 0x7ff308083b90 con 0x7ff30c0b8b40 2024-02-02T11:49:30.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.611+0000 7ff31161f640 1 --2- 172.21.15.161:0/113005124 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff2f0065a60 0x7ff2f0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:30.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.611+0000 7ff31161f640 1 --2- 172.21.15.161:0/113005124 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff2f0065a60 0x7ff2f0067f20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0bd240 tx=0x7ff2fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:30.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.615+0000 7ff3027fc640 1 -- 172.21.15.161:0/113005124 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff308051950 con 0x7ff30c0b8b40 2024-02-02T11:49:30.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:30.767+0000 7ff314084640 1 -- 172.21.15.161:0/113005124 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff30c14a390 con 0x7ff30c0b8b40 2024-02-02T11:49:31.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.459+0000 7ff3027fc640 1 -- 172.21.15.161:0/113005124 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff308054f70 con 0x7ff30c0b8b40 2024-02-02T11:49:31.471 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data' created 2024-02-02T11:49:31.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.475+0000 7ff314084640 1 -- 172.21.15.161:0/113005124 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff2f0065a60 msgr2=0x7ff2f0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:31.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.475+0000 7ff314084640 1 --2- 172.21.15.161:0/113005124 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff2f0065a60 0x7ff2f0067f20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0bd240 tx=0x7ff2fc008040 comp rx=0 tx=0).stop 2024-02-02T11:49:31.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.475+0000 7ff314084640 1 -- 172.21.15.161:0/113005124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff30c0b8b40 msgr2=0x7ff30c1d3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:31.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.475+0000 7ff314084640 1 --2- 172.21.15.161:0/113005124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff30c0b8b40 0x7ff30c1d3d00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff30800d800 tx=0x7ff30800dcc0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.479+0000 7ff314084640 1 -- 172.21.15.161:0/113005124 shutdown_connections 2024-02-02T11:49:31.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.479+0000 7ff314084640 1 --2- 172.21.15.161:0/113005124 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff2f0065a60 0x7ff2f0067f20 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0bd240 tx=0x7ff2fc008040 comp rx=0 tx=0).stop 2024-02-02T11:49:31.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.479+0000 7ff314084640 1 --2- 172.21.15.161:0/113005124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff30c144ee0 0x7ff30c1d6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.479+0000 7ff314084640 1 --2- 172.21.15.161:0/113005124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff30c144a80 0x7ff30c1d4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.479+0000 7ff314084640 1 --2- 172.21.15.161:0/113005124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff30c0b8b40 0x7ff30c1d3d00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.479+0000 7ff314084640 1 -- 172.21.15.161:0/113005124 >> 172.21.15.161:0/113005124 conn(0x7ff30c0c02f0 msgr2=0x7ff30c148c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:31.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.479+0000 7ff314084640 1 -- 172.21.15.161:0/113005124 shutdown_connections 2024-02-02T11:49:31.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.479+0000 7ff314084640 1 -- 172.21.15.161:0/113005124 wait complete. 2024-02-02T11:49:31.508 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-02T11:49:31.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.623+0000 7f30a5e5f640 1 Processor -- start 2024-02-02T11:49:31.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.623+0000 7f30a5e5f640 1 -- start start 2024-02-02T11:49:31.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f30a5e5f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a00b8b40 0x7f30a00b8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:31.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f30a5e5f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a00b6e80 con 0x7f30a014b370 2024-02-02T11:49:31.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f30a5e5f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a00b7160 con 0x7f30a0144a80 2024-02-02T11:49:31.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f30a5e5f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00bc6c0 con 0x7f30a00b8b40 2024-02-02T11:49:31.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309ffff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f30a014b370 0x7f30a01552e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40882/0 (socket says 172.21.15.161:40882) 2024-02-02T11:49:31.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309ffff640 1 -- 172.21.15.161:0/3954846907 learned_addr learned my addr 172.21.15.161:0/3954846907 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:31.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309f7fe640 1 --2- 172.21.15.161:0/3954846907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a00b8b40 0x7f30a00b8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:31.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309e7fc640 1 -- 172.21.15.161:0/3954846907 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435970724 0 0) 0x7f30a00b6e80 con 0x7f30a014b370 2024-02-02T11:49:31.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309e7fc640 1 -- 172.21.15.161:0/3954846907 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3088003530 con 0x7f30a014b370 2024-02-02T11:49:31.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309e7fc640 1 -- 172.21.15.161:0/3954846907 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2505572909 0 0) 0x7f3088003530 con 0x7f30a014b370 2024-02-02T11:49:31.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309e7fc640 1 -- 172.21.15.161:0/3954846907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a00b8b40 msgr2=0x7f30a00b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:31.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309e7fc640 1 --2- 172.21.15.161:0/3954846907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a00b8b40 0x7f30a00b8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309e7fc640 1 -- 172.21.15.161:0/3954846907 >> v1:172.21.15.162:6789/0 conn(0x7f30a0144a80 legacy=0x7f30a014ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:31.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309e7fc640 1 -- 172.21.15.161:0/3954846907 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a00bc9a0 con 0x7f30a014b370 2024-02-02T11:49:31.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309e7fc640 1 -- 172.21.15.161:0/3954846907 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f3098001a00 con 0x7f30a014b370 2024-02-02T11:49:31.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309e7fc640 1 -- 172.21.15.161:0/3954846907 >> v1:172.21.15.161:6789/0 conn(0x7f30a014b370 legacy=0x7f30a01552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:31.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309e7fc640 1 --2- 172.21.15.161:0/3954846907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30880039b0 0x7f3088003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:31.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309e7fc640 1 --2- 172.21.15.161:0/3954846907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30880047d0 0x7f3088004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:31.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309e7fc640 1 --2- 172.21.15.161:0/3954846907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a00b8b40 0x7f3088005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:31.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309e7fc640 1 -- 172.21.15.161:0/3954846907 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00bc6c0 con 0x7f30880047d0 2024-02-02T11:49:31.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309e7fc640 1 -- 172.21.15.161:0/3954846907 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308800bad0 con 0x7f30880039b0 2024-02-02T11:49:31.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309e7fc640 1 -- 172.21.15.161:0/3954846907 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308800bc90 con 0x7f30a00b8b40 2024-02-02T11:49:31.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309effd640 1 --2- 172.21.15.161:0/3954846907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30880047d0 0x7f3088004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:31.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309f7fe640 1 --2- 172.21.15.161:0/3954846907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30880039b0 0x7f3088003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:31.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309ffff640 1 --2- 172.21.15.161:0/3954846907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a00b8b40 0x7f3088005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:31.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309effd640 1 -- 172.21.15.161:0/3954846907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a00b8b40 msgr2=0x7f3088005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:31.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309effd640 1 --2- 172.21.15.161:0/3954846907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a00b8b40 0x7f3088005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309effd640 1 -- 172.21.15.161:0/3954846907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30880039b0 msgr2=0x7f3088003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:31.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309effd640 1 --2- 172.21.15.161:0/3954846907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30880039b0 0x7f3088003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309effd640 1 -- 172.21.15.161:0/3954846907 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3088003530 con 0x7f30880047d0 2024-02-02T11:49:31.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309f7fe640 1 --2- 172.21.15.161:0/3954846907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30880039b0 0x7f3088003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:31.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309ffff640 1 --2- 172.21.15.161:0/3954846907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a00b8b40 0x7f3088005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:31.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.627+0000 7f309effd640 1 --2- 172.21.15.161:0/3954846907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30880047d0 0x7f3088004c50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3094001750 tx=0x7f309401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145e7389b86d5a70 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:31.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f309e7fc640 1 -- 172.21.15.161:0/3954846907 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30940052d0 con 0x7f30880047d0 2024-02-02T11:49:31.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f309e7fc640 1 -- 172.21.15.161:0/3954846907 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30940a7050 con 0x7f30880047d0 2024-02-02T11:49:31.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f309e7fc640 1 -- 172.21.15.161:0/3954846907 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094003600 con 0x7f30880047d0 2024-02-02T11:49:31.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f30a5e5f640 1 -- 172.21.15.161:0/3954846907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30880047d0 msgr2=0x7f3088004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:31.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f30a5e5f640 1 --2- 172.21.15.161:0/3954846907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30880047d0 0x7f3088004c50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3094001750 tx=0x7f309401c3a0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f309ffff640 1 -- 172.21.15.161:0/3954846907 reap_dead start 2024-02-02T11:49:31.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f30a5e5f640 1 -- 172.21.15.161:0/3954846907 shutdown_connections 2024-02-02T11:49:31.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f30a5e5f640 1 -- 172.21.15.161:0/3954846907 >> 172.21.15.161:0/3954846907 conn(0x7f30a00c02f0 msgr2=0x7f30a00c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:31.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f30a5e5f640 1 -- 172.21.15.161:0/3954846907 shutdown_connections 2024-02-02T11:49:31.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f30a5e5f640 1 -- 172.21.15.161:0/3954846907 wait complete. 2024-02-02T11:49:31.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f30a5e5f640 1 Processor -- start 2024-02-02T11:49:31.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f30a5e5f640 1 -- start start 2024-02-02T11:49:31.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f30a5e5f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30880047d0 0x7f30a01d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:31.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f30a5e5f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a0145210 0x7f30a0142eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:31.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f30a5e5f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30a0145690 0x7f30a01433f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:31.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f30a5e5f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a01d1260 con 0x7f30a0145690 2024-02-02T11:49:31.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f30a5e5f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00a6570 con 0x7f30880047d0 2024-02-02T11:49:31.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f30a5e5f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a0147100 con 0x7f30a0145210 2024-02-02T11:49:31.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f309ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30a0145690 0x7f30a01433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:31.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f309ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30a0145690 0x7f30a01433f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34522/0 (socket says 172.21.15.161:34522) 2024-02-02T11:49:31.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f309ffff640 1 -- 172.21.15.161:0/3127630281 learned_addr learned my addr 172.21.15.161:0/3127630281 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:31.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f309f7fe640 1 --2- 172.21.15.161:0/3127630281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30880047d0 0x7f30a01d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:31.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f309effd640 1 --2- 172.21.15.161:0/3127630281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a0145210 0x7f30a0142eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:31.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f309ffff640 1 -- 172.21.15.161:0/3127630281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a0145210 msgr2=0x7f30a0142eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:31.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f309ffff640 1 --2- 172.21.15.161:0/3127630281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a0145210 0x7f30a0142eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f309ffff640 1 -- 172.21.15.161:0/3127630281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30880047d0 msgr2=0x7f30a01d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:31.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f309ffff640 1 --2- 172.21.15.161:0/3127630281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30880047d0 0x7f30a01d0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f309ffff640 1 -- 172.21.15.161:0/3127630281 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a01473e0 con 0x7f30a0145690 2024-02-02T11:49:31.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f309ffff640 1 --2- 172.21.15.161:0/3127630281 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30a0145690 0x7f30a01433f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f30a0067340 tx=0x7f309800b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:31.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f3087fff640 1 -- 172.21.15.161:0/3127630281 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309800b8d0 con 0x7f30a0145690 2024-02-02T11:49:31.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f3087fff640 1 -- 172.21.15.161:0/3127630281 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309800ba70 con 0x7f30a0145690 2024-02-02T11:49:31.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f30a5e5f640 1 -- 172.21.15.161:0/3127630281 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a01476c0 con 0x7f30a0145690 2024-02-02T11:49:31.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f3087fff640 1 -- 172.21.15.161:0/3127630281 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309800be20 con 0x7f30a0145690 2024-02-02T11:49:31.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.631+0000 7f30a5e5f640 1 -- 172.21.15.161:0/3127630281 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a0143930 con 0x7f30a0145690 2024-02-02T11:49:31.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.635+0000 7f30a5e5f640 1 -- 172.21.15.161:0/3127630281 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a004e000 con 0x7f30a0145690 2024-02-02T11:49:31.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.635+0000 7f3087fff640 1 -- 172.21.15.161:0/3127630281 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3098007110 con 0x7f30a0145690 2024-02-02T11:49:31.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.635+0000 7f3087fff640 1 --2- 172.21.15.161:0/3127630281 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f308c065a60 0x7f308c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:31.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.635+0000 7f3087fff640 1 -- 172.21.15.161:0/3127630281 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3098083270 con 0x7f30a0145690 2024-02-02T11:49:31.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.635+0000 7f309f7fe640 1 --2- 172.21.15.161:0/3127630281 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f308c065a60 0x7f308c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:31.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.635+0000 7f309f7fe640 1 --2- 172.21.15.161:0/3127630281 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f308c065a60 0x7f308c067f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3090009ac0 tx=0x7f3090008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:31.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.639+0000 7f3087fff640 1 -- 172.21.15.161:0/3127630281 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3098050d20 con 0x7f30a0145690 2024-02-02T11:49:31.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.827+0000 7f30a5e5f640 1 -- 172.21.15.161:0/3127630281 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f30a0147b70 con 0x7f30a0145690 2024-02-02T11:49:31.840 INFO:teuthology.orchestra.run.smithi161.stderr:new fs with metadata pool 4 and data pool 5 2024-02-02T11:49:31.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.835+0000 7f3087fff640 1 -- 172.21.15.161:0/3127630281 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3098054340 con 0x7f30a0145690 2024-02-02T11:49:31.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.843+0000 7f30a5e5f640 1 -- 172.21.15.161:0/3127630281 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f308c065a60 msgr2=0x7f308c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:31.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.843+0000 7f30a5e5f640 1 --2- 172.21.15.161:0/3127630281 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f308c065a60 0x7f308c067f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3090009ac0 tx=0x7f3090008040 comp rx=0 tx=0).stop 2024-02-02T11:49:31.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.843+0000 7f30a5e5f640 1 -- 172.21.15.161:0/3127630281 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30a0145690 msgr2=0x7f30a01433f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:31.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.843+0000 7f30a5e5f640 1 --2- 172.21.15.161:0/3127630281 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30a0145690 0x7f30a01433f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f30a0067340 tx=0x7f309800b0d0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.843+0000 7f30a5e5f640 1 -- 172.21.15.161:0/3127630281 shutdown_connections 2024-02-02T11:49:31.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.843+0000 7f30a5e5f640 1 --2- 172.21.15.161:0/3127630281 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f308c065a60 0x7f308c067f20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.843+0000 7f30a5e5f640 1 --2- 172.21.15.161:0/3127630281 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30a0145690 0x7f30a01433f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.843+0000 7f30a5e5f640 1 --2- 172.21.15.161:0/3127630281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a0145210 0x7f30a0142eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.843+0000 7f30a5e5f640 1 --2- 172.21.15.161:0/3127630281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30880047d0 0x7f30a01d0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.843+0000 7f30a5e5f640 1 -- 172.21.15.161:0/3127630281 >> 172.21.15.161:0/3127630281 conn(0x7f30a00c02f0 msgr2=0x7f30a00b8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:31.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.843+0000 7f30a5e5f640 1 -- 172.21.15.161:0/3127630281 shutdown_connections 2024-02-02T11:49:31.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.843+0000 7f30a5e5f640 1 -- 172.21.15.161:0/3127630281 wait complete. 2024-02-02T11:49:31.877 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:49:31.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.979+0000 7f4be6b1a640 1 Processor -- start 2024-02-02T11:49:31.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.979+0000 7f4be6b1a640 1 -- start start 2024-02-02T11:49:31.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4be6b1a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4be0071a20 0x7f4be0070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:31.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4be6b1a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4be0147920 0x7f4be01440d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:31.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4be6b1a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be00b2c80 con 0x7f4be00708d0 2024-02-02T11:49:31.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4be6b1a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be006fdb0 con 0x7f4be0147920 2024-02-02T11:49:31.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4be6b1a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be0070370 con 0x7f4be0071a20 2024-02-02T11:49:31.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4be50b7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4be0147920 0x7f4be01440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:31.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4be50b7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4be0147920 0x7f4be01440d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34534/0 (socket says 172.21.15.161:34534) 2024-02-02T11:49:31.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4be50b7640 1 -- 172.21.15.161:0/2751976090 learned_addr learned my addr 172.21.15.161:0/2751976090 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:31.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4be50b7640 1 -- 172.21.15.161:0/2751976090 >> v2:172.21.15.162:3300/0 conn(0x7f4be0071a20 msgr2=0x7f4be0070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:31.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4be50b7640 1 --2- 172.21.15.161:0/2751976090 >> v2:172.21.15.162:3300/0 conn(0x7f4be0071a20 0x7f4be0070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4be50b7640 1 -- 172.21.15.161:0/2751976090 >> v1:172.21.15.162:6789/0 conn(0x7f4be00708d0 legacy=0x7f4be0147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:31.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4be50b7640 1 -- 172.21.15.161:0/2751976090 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be00b2ed0 con 0x7f4be0147920 2024-02-02T11:49:31.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4be50b7640 1 --2- 172.21.15.161:0/2751976090 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4be0147920 0x7f4be01440d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4be006d230 tx=0x7f4bd801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67bfd70b28ade0a server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:31.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4bdf7fe640 1 -- 172.21.15.161:0/2751976090 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd80aa610 con 0x7f4be0147920 2024-02-02T11:49:31.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4bdf7fe640 1 -- 172.21.15.161:0/2751976090 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd80a6040 con 0x7f4be0147920 2024-02-02T11:49:31.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4bdf7fe640 1 -- 172.21.15.161:0/2751976090 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd80aa990 con 0x7f4be0147920 2024-02-02T11:49:31.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4be6b1a640 1 -- 172.21.15.161:0/2751976090 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4be0147920 msgr2=0x7f4be01440d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:31.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4be6b1a640 1 --2- 172.21.15.161:0/2751976090 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4be0147920 0x7f4be01440d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4be006d230 tx=0x7f4bd801c490 comp rx=0 tx=0).stop 2024-02-02T11:49:31.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4be6b1a640 1 -- 172.21.15.161:0/2751976090 shutdown_connections 2024-02-02T11:49:31.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.983+0000 7f4be6b1a640 1 --2- 172.21.15.161:0/2751976090 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4be0147920 0x7f4be01440d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4be6b1a640 1 --2- 172.21.15.161:0/2751976090 >> v2:172.21.15.162:3300/0 conn(0x7f4be0071a20 0x7f4be0070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4be6b1a640 1 -- 172.21.15.161:0/2751976090 >> 172.21.15.161:0/2751976090 conn(0x7f4be0069ef0 msgr2=0x7f4be006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:31.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4be6b1a640 1 -- 172.21.15.161:0/2751976090 shutdown_connections 2024-02-02T11:49:31.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4be6b1a640 1 -- 172.21.15.161:0/2751976090 wait complete. 2024-02-02T11:49:31.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4be6b1a640 1 Processor -- start 2024-02-02T11:49:31.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4be6b1a640 1 -- start start 2024-02-02T11:49:31.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4be6b1a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4be00708d0 0x7f4be0133e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:31.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4be6b1a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4be0071a20 0x7f4be0136840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:31.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4be6b1a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be0147920 0x7f4be01e12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:31.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4be6b1a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be0136d80 con 0x7f4be0071a20 2024-02-02T11:49:31.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4be6b1a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be0132110 con 0x7f4be0147920 2024-02-02T11:49:31.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4be6b1a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be01323f0 con 0x7f4be00708d0 2024-02-02T11:49:31.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4bdffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4be0071a20 0x7f4be0136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:31.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4bdffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4be0071a20 0x7f4be0136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34540/0 (socket says 172.21.15.161:34540) 2024-02-02T11:49:31.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4bdffff640 1 -- 172.21.15.161:0/3915717229 learned_addr learned my addr 172.21.15.161:0/3915717229 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:31.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4be50b7640 1 --2- 172.21.15.161:0/3915717229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be0147920 0x7f4be01e12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:31.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4bdffff640 1 -- 172.21.15.161:0/3915717229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4be00708d0 msgr2=0x7f4be0133e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:31.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4bdffff640 1 --2- 172.21.15.161:0/3915717229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4be00708d0 0x7f4be0133e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4bdffff640 1 -- 172.21.15.161:0/3915717229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be0147920 msgr2=0x7f4be01e12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:31.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4bdffff640 1 --2- 172.21.15.161:0/3915717229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be0147920 0x7f4be01e12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:31.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4bdffff640 1 -- 172.21.15.161:0/3915717229 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd80094d0 con 0x7f4be0071a20 2024-02-02T11:49:31.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4bdffff640 1 --2- 172.21.15.161:0/3915717229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4be0071a20 0x7f4be0136840 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400b550 tx=0x7f4bd400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:31.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4bdd7fa640 1 -- 172.21.15.161:0/3915717229 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4010870 con 0x7f4be0071a20 2024-02-02T11:49:31.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4bdd7fa640 1 -- 172.21.15.161:0/3915717229 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd40109f0 con 0x7f4be0071a20 2024-02-02T11:49:31.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4be6b1a640 1 -- 172.21.15.161:0/3915717229 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be01326d0 con 0x7f4be0071a20 2024-02-02T11:49:31.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4bdd7fa640 1 -- 172.21.15.161:0/3915717229 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4010da0 con 0x7f4be0071a20 2024-02-02T11:49:31.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4be6b1a640 1 -- 172.21.15.161:0/3915717229 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be012cfb0 con 0x7f4be0071a20 2024-02-02T11:49:31.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4be6b1a640 1 -- 172.21.15.161:0/3915717229 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be004e000 con 0x7f4be0071a20 2024-02-02T11:49:31.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.987+0000 7f4bdd7fa640 1 -- 172.21.15.161:0/3915717229 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4bd400f3c0 con 0x7f4be0071a20 2024-02-02T11:49:31.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.991+0000 7f4bdd7fa640 1 --2- 172.21.15.161:0/3915717229 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4bcc065a90 0x7f4bcc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:31.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.991+0000 7f4bdd7fa640 1 -- 172.21.15.161:0/3915717229 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4bd40830e0 con 0x7f4be0071a20 2024-02-02T11:49:31.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.991+0000 7f4be48b6640 1 --2- 172.21.15.161:0/3915717229 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4bcc065a90 0x7f4bcc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:31.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.991+0000 7f4be48b6640 1 --2- 172.21.15.161:0/3915717229 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4bcc065a90 0x7f4bcc067f50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0001c90 tx=0x7f4bd0007d20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:31.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:31.995+0000 7f4bdd7fa640 1 -- 172.21.15.161:0/3915717229 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4bd4050aa0 con 0x7f4be0071a20 2024-02-02T11:49:32.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.147+0000 7f4be6b1a640 1 -- 172.21.15.161:0/3915717229 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4be00735c0 con 0x7f4be0071a20 2024-02-02T11:49:32.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.151+0000 7f4bdd7fa640 1 -- 172.21.15.161:0/3915717229 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16162 (secure 0 0 0) 0x7f4bd40540c0 con 0x7f4be0071a20 2024-02-02T11:49:32.153 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:32.153 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":30,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:49:31.832389+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:49:30.264273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-02T11:49:30.811831+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:49:32.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.151+0000 7f4be6b1a640 1 -- 172.21.15.161:0/3915717229 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4bcc065a90 msgr2=0x7f4bcc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:32.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.151+0000 7f4be6b1a640 1 --2- 172.21.15.161:0/3915717229 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4bcc065a90 0x7f4bcc067f50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0001c90 tx=0x7f4bd0007d20 comp rx=0 tx=0).stop 2024-02-02T11:49:32.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.151+0000 7f4be6b1a640 1 -- 172.21.15.161:0/3915717229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4be0071a20 msgr2=0x7f4be0136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:32.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.151+0000 7f4be6b1a640 1 --2- 172.21.15.161:0/3915717229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4be0071a20 0x7f4be0136840 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400b550 tx=0x7f4bd400ba10 comp rx=0 tx=0).stop 2024-02-02T11:49:32.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.151+0000 7f4be6b1a640 1 -- 172.21.15.161:0/3915717229 shutdown_connections 2024-02-02T11:49:32.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.151+0000 7f4be6b1a640 1 --2- 172.21.15.161:0/3915717229 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4bcc065a90 0x7f4bcc067f50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:32.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.151+0000 7f4be6b1a640 1 --2- 172.21.15.161:0/3915717229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be0147920 0x7f4be01e12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:32.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.151+0000 7f4be6b1a640 1 --2- 172.21.15.161:0/3915717229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4be0071a20 0x7f4be0136840 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:32.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.151+0000 7f4be6b1a640 1 --2- 172.21.15.161:0/3915717229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4be00708d0 0x7f4be0133e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:32.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.151+0000 7f4be6b1a640 1 -- 172.21.15.161:0/3915717229 >> 172.21.15.161:0/3915717229 conn(0x7f4be0069ef0 msgr2=0x7f4be0137380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:32.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.151+0000 7f4be6b1a640 1 -- 172.21.15.161:0/3915717229 shutdown_connections 2024-02-02T11:49:32.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.151+0000 7f4be6b1a640 1 -- 172.21.15.161:0/3915717229 wait complete. 2024-02-02T11:49:32.171 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:49:32.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.283+0000 7f335abdd640 1 Processor -- start 2024-02-02T11:49:32.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.283+0000 7f335abdd640 1 -- start start 2024-02-02T11:49:32.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.283+0000 7f335abdd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f335406a900 0x7f3354156a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:32.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.283+0000 7f335abdd640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33540bb370 con 0x7f335406a4c0 2024-02-02T11:49:32.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.283+0000 7f335abdd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33540bc590 con 0x7f335414b540 2024-02-02T11:49:32.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.283+0000 7f335abdd640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33540bc320 con 0x7f335406a900 2024-02-02T11:49:32.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.283+0000 7f335917a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f335406a900 0x7f3354156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:32.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.283+0000 7f335917a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f335406a900 0x7f3354156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34548/0 (socket says 172.21.15.161:34548) 2024-02-02T11:49:32.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.283+0000 7f335917a640 1 -- 172.21.15.161:0/3499576325 learned_addr learned my addr 172.21.15.161:0/3499576325 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:32.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.283+0000 7f3353fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f335406a4c0 0x7f33541532f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40890/0 (socket says 172.21.15.161:40890) 2024-02-02T11:49:32.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.283+0000 7f335917a640 1 -- 172.21.15.161:0/3499576325 >> v1:172.21.15.162:6789/0 conn(0x7f335414b540 legacy=0x7f33540bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:32.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.283+0000 7f335917a640 1 -- 172.21.15.161:0/3499576325 >> v1:172.21.15.161:6789/0 conn(0x7f335406a4c0 legacy=0x7f33541532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:32.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.283+0000 7f335917a640 1 -- 172.21.15.161:0/3499576325 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33540b3a10 con 0x7f335406a900 2024-02-02T11:49:32.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.283+0000 7f33537fe640 1 -- 172.21.15.161:0/3499576325 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009039309 0 0) 0x7f33540bb370 con 0x7f335406a4c0 2024-02-02T11:49:32.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f335917a640 1 --2- 172.21.15.161:0/3499576325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f335406a900 0x7f3354156a20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3344009870 tx=0x7f334401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12796b7b791998cd server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:32.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f33537fe640 1 -- 172.21.15.161:0/3499576325 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33440a8a30 con 0x7f335406a900 2024-02-02T11:49:32.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f33537fe640 1 -- 172.21.15.161:0/3499576325 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33440a8b90 con 0x7f335406a900 2024-02-02T11:49:32.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f33537fe640 1 -- 172.21.15.161:0/3499576325 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33440b0440 con 0x7f335406a900 2024-02-02T11:49:32.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f335abdd640 1 -- 172.21.15.161:0/3499576325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f335406a900 msgr2=0x7f3354156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:32.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f335abdd640 1 --2- 172.21.15.161:0/3499576325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f335406a900 0x7f3354156a20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3344009870 tx=0x7f334401ed30 comp rx=0 tx=0).stop 2024-02-02T11:49:32.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f335abdd640 1 -- 172.21.15.161:0/3499576325 shutdown_connections 2024-02-02T11:49:32.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f335abdd640 1 --2- 172.21.15.161:0/3499576325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f335406a900 0x7f3354156a20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:32.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f335abdd640 1 -- 172.21.15.161:0/3499576325 >> 172.21.15.161:0/3499576325 conn(0x7f33540c02e0 msgr2=0x7f33540c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:32.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f335abdd640 1 -- 172.21.15.161:0/3499576325 shutdown_connections 2024-02-02T11:49:32.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f335abdd640 1 -- 172.21.15.161:0/3499576325 wait complete. 2024-02-02T11:49:32.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f335abdd640 1 Processor -- start 2024-02-02T11:49:32.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f335abdd640 1 -- start start 2024-02-02T11:49:32.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f335abdd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f335406a4c0 0x7f33540b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:32.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f335abdd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f335406a900 0x7f33540b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:32.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f335abdd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f335414b540 0x7f33540b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:32.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f335abdd640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33540b6d00 con 0x7f335406a900 2024-02-02T11:49:32.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f335abdd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33540b5d50 con 0x7f335414b540 2024-02-02T11:49:32.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f335abdd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3354148810 con 0x7f335406a4c0 2024-02-02T11:49:32.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f3353fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f335406a900 0x7f33540b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:32.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f3353fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f335406a900 0x7f33540b4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34550/0 (socket says 172.21.15.161:34550) 2024-02-02T11:49:32.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f3353fff640 1 -- 172.21.15.161:0/2761828839 learned_addr learned my addr 172.21.15.161:0/2761828839 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:32.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f3358979640 1 --2- 172.21.15.161:0/2761828839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f335406a4c0 0x7f33540b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:32.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f335917a640 1 --2- 172.21.15.161:0/2761828839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f335414b540 0x7f33540b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:32.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f3353fff640 1 -- 172.21.15.161:0/2761828839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f335406a4c0 msgr2=0x7f33540b67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:32.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f3353fff640 1 --2- 172.21.15.161:0/2761828839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f335406a4c0 0x7f33540b67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:32.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f3353fff640 1 -- 172.21.15.161:0/2761828839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f335414b540 msgr2=0x7f33540b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:32.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f3353fff640 1 --2- 172.21.15.161:0/2761828839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f335414b540 0x7f33540b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:32.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.287+0000 7f3353fff640 1 -- 172.21.15.161:0/2761828839 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33440094d0 con 0x7f335406a900 2024-02-02T11:49:32.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.291+0000 7f3353fff640 1 --2- 172.21.15.161:0/2761828839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f335406a900 0x7f33540b4ef0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f333c00c440 tx=0x7f333c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:32.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.291+0000 7f33517fa640 1 -- 172.21.15.161:0/2761828839 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c0074e0 con 0x7f335406a900 2024-02-02T11:49:32.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.291+0000 7f33517fa640 1 -- 172.21.15.161:0/2761828839 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333c007640 con 0x7f335406a900 2024-02-02T11:49:32.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.291+0000 7f335abdd640 1 -- 172.21.15.161:0/2761828839 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33540b5fc0 con 0x7f335406a900 2024-02-02T11:49:32.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.291+0000 7f33517fa640 1 -- 172.21.15.161:0/2761828839 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c004a10 con 0x7f335406a900 2024-02-02T11:49:32.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.291+0000 7f335abdd640 1 -- 172.21.15.161:0/2761828839 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33540b6fc0 con 0x7f335406a900 2024-02-02T11:49:32.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.291+0000 7f335abdd640 1 -- 172.21.15.161:0/2761828839 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f335404e000 con 0x7f335406a900 2024-02-02T11:49:32.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.291+0000 7f33517fa640 1 -- 172.21.15.161:0/2761828839 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f333c004b70 con 0x7f335406a900 2024-02-02T11:49:32.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.291+0000 7f33517fa640 1 --2- 172.21.15.161:0/2761828839 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3334065a90 0x7f3334067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:32.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.291+0000 7f3358979640 1 --2- 172.21.15.161:0/2761828839 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3334065a90 0x7f3334067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:32.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.291+0000 7f33517fa640 1 -- 172.21.15.161:0/2761828839 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f333c0821e0 con 0x7f335406a900 2024-02-02T11:49:32.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.291+0000 7f3358979640 1 --2- 172.21.15.161:0/2761828839 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3334065a90 0x7f3334067f50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3354149580 tx=0x7f334c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:32.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.295+0000 7f33517fa640 1 -- 172.21.15.161:0/2761828839 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f333c04fc30 con 0x7f335406a900 2024-02-02T11:49:32.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.439+0000 7f335abdd640 1 -- 172.21.15.161:0/2761828839 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33540a6260 con 0x7f335406a900 2024-02-02T11:49:32.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.443+0000 7f33517fa640 1 -- 172.21.15.161:0/2761828839 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16162 (secure 0 0 0) 0x7f333c053250 con 0x7f335406a900 2024-02-02T11:49:32.445 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:32.445 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":30,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:49:31.832389+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:49:30.264273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-02T11:49:30.811831+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:49:32.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.443+0000 7f335abdd640 1 -- 172.21.15.161:0/2761828839 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3334065a90 msgr2=0x7f3334067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:32.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.443+0000 7f335abdd640 1 --2- 172.21.15.161:0/2761828839 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3334065a90 0x7f3334067f50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3354149580 tx=0x7f334c009040 comp rx=0 tx=0).stop 2024-02-02T11:49:32.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.443+0000 7f335abdd640 1 -- 172.21.15.161:0/2761828839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f335406a900 msgr2=0x7f33540b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:32.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.443+0000 7f335abdd640 1 --2- 172.21.15.161:0/2761828839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f335406a900 0x7f33540b4ef0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f333c00c440 tx=0x7f333c00c900 comp rx=0 tx=0).stop 2024-02-02T11:49:32.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.443+0000 7f335abdd640 1 -- 172.21.15.161:0/2761828839 shutdown_connections 2024-02-02T11:49:32.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.443+0000 7f335abdd640 1 --2- 172.21.15.161:0/2761828839 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f3334065a90 0x7f3334067f50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:32.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.443+0000 7f335abdd640 1 --2- 172.21.15.161:0/2761828839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f335414b540 0x7f33540b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:32.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.443+0000 7f335abdd640 1 --2- 172.21.15.161:0/2761828839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f335406a900 0x7f33540b4ef0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:32.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.443+0000 7f335abdd640 1 --2- 172.21.15.161:0/2761828839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f335406a4c0 0x7f33540b67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:32.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.443+0000 7f335abdd640 1 -- 172.21.15.161:0/2761828839 >> 172.21.15.161:0/2761828839 conn(0x7f33540c02e0 msgr2=0x7f33540a1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:32.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.443+0000 7f335abdd640 1 -- 172.21.15.161:0/2761828839 shutdown_connections 2024-02-02T11:49:32.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.443+0000 7f335abdd640 1 -- 172.21.15.161:0/2761828839 wait complete. 2024-02-02T11:49:32.463 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-02T11:49:32.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.575+0000 7efefcad4640 1 Processor -- start 2024-02-02T11:49:32.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.575+0000 7efefcad4640 1 -- start start 2024-02-02T11:49:32.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efefcad4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efef80b8b40 0x7efef80b8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:32.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efefcad4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efef8144a80 0x7efef814ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:32.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efefcad4640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef80b6e80 con 0x7efef8144ee0 2024-02-02T11:49:32.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efefcad4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef80b7160 con 0x7efef8144a80 2024-02-02T11:49:32.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efefcad4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef80bc6c0 con 0x7efef80b8b40 2024-02-02T11:49:32.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef6d9d640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7efef8144ee0 0x7efef814dfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:44998/0 (socket says 172.21.15.161:44998) 2024-02-02T11:49:32.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef6d9d640 1 -- 172.21.15.161:0/3288032162 learned_addr learned my addr 172.21.15.161:0/3288032162 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:32.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef5d9b640 1 --2- 172.21.15.161:0/3288032162 >> v2:172.21.15.162:3300/0 conn(0x7efef8144a80 0x7efef814ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:32.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef559a640 1 -- 172.21.15.161:0/3288032162 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594280119 0 0) 0x7efef80b6e80 con 0x7efef8144ee0 2024-02-02T11:49:32.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef659c640 1 --2- 172.21.15.161:0/3288032162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efef80b8b40 0x7efef80b8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:32.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef559a640 1 -- 172.21.15.161:0/3288032162 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efee4003530 con 0x7efef8144ee0 2024-02-02T11:49:32.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef559a640 1 -- 172.21.15.161:0/3288032162 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 895950318 0 0) 0x7efee4003530 con 0x7efef8144ee0 2024-02-02T11:49:32.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef559a640 1 -- 172.21.15.161:0/3288032162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efef80b8b40 msgr2=0x7efef80b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:32.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef559a640 1 --2- 172.21.15.161:0/3288032162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efef80b8b40 0x7efef80b8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:32.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef559a640 1 -- 172.21.15.161:0/3288032162 >> v2:172.21.15.162:3300/0 conn(0x7efef8144a80 msgr2=0x7efef814ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:32.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef559a640 1 --2- 172.21.15.161:0/3288032162 >> v2:172.21.15.162:3300/0 conn(0x7efef8144a80 0x7efef814ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:32.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef559a640 1 -- 172.21.15.161:0/3288032162 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef80bc9a0 con 0x7efef8144ee0 2024-02-02T11:49:32.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef559a640 1 -- 172.21.15.161:0/3288032162 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7efee0001680 con 0x7efef8144ee0 2024-02-02T11:49:32.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef559a640 1 -- 172.21.15.161:0/3288032162 >> v1:172.21.15.161:6789/0 conn(0x7efef8144ee0 legacy=0x7efef814dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:32.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef559a640 1 --2- 172.21.15.161:0/3288032162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efef80b8b40 0x7efee4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:32.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef559a640 1 --2- 172.21.15.161:0/3288032162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee4003f50 0x7efee40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:32.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef559a640 1 --2- 172.21.15.161:0/3288032162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efee4004d10 0x7efee4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:32.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef559a640 1 -- 172.21.15.161:0/3288032162 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef80b7160 con 0x7efee4003f50 2024-02-02T11:49:32.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef559a640 1 -- 172.21.15.161:0/3288032162 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef80bc6c0 con 0x7efee4004d10 2024-02-02T11:49:32.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef559a640 1 -- 172.21.15.161:0/3288032162 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee400ba10 con 0x7efef80b8b40 2024-02-02T11:49:32.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef5d9b640 1 --2- 172.21.15.161:0/3288032162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee4003f50 0x7efee40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:32.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef659c640 1 --2- 172.21.15.161:0/3288032162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efef80b8b40 0x7efee4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:32.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef6d9d640 1 --2- 172.21.15.161:0/3288032162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efee4004d10 0x7efee4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:32.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef5d9b640 1 -- 172.21.15.161:0/3288032162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efef80b8b40 msgr2=0x7efee4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:32.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef5d9b640 1 --2- 172.21.15.161:0/3288032162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efef80b8b40 0x7efee4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:32.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef5d9b640 1 -- 172.21.15.161:0/3288032162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efee4004d10 msgr2=0x7efee4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:32.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef5d9b640 1 --2- 172.21.15.161:0/3288032162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efee4004d10 0x7efee4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:32.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef5d9b640 1 -- 172.21.15.161:0/3288032162 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee4003530 con 0x7efee4003f50 2024-02-02T11:49:32.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.579+0000 7efef6d9d640 1 --2- 172.21.15.161:0/3288032162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efee4004d10 0x7efee4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:32.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efef5d9b640 1 --2- 172.21.15.161:0/3288032162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee4003f50 0x7efee40047d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efef0009fc0 tx=0x7efef001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a9f7d40af6e847 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:32.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efef559a640 1 -- 172.21.15.161:0/3288032162 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef00a5cb0 con 0x7efee4003f50 2024-02-02T11:49:32.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efef559a640 1 -- 172.21.15.161:0/3288032162 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef000f040 con 0x7efee4003f50 2024-02-02T11:49:32.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efef559a640 1 -- 172.21.15.161:0/3288032162 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef00ad680 con 0x7efee4003f50 2024-02-02T11:49:32.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efefcad4640 1 -- 172.21.15.161:0/3288032162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee4003f50 msgr2=0x7efee40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:32.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efefcad4640 1 --2- 172.21.15.161:0/3288032162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee4003f50 0x7efee40047d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efef0009fc0 tx=0x7efef001cca0 comp rx=0 tx=0).stop 2024-02-02T11:49:32.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efef6d9d640 1 -- 172.21.15.161:0/3288032162 reap_dead start 2024-02-02T11:49:32.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efefcad4640 1 -- 172.21.15.161:0/3288032162 shutdown_connections 2024-02-02T11:49:32.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efefcad4640 1 -- 172.21.15.161:0/3288032162 >> 172.21.15.161:0/3288032162 conn(0x7efef80c02f0 msgr2=0x7efef80c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:32.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efefcad4640 1 -- 172.21.15.161:0/3288032162 shutdown_connections 2024-02-02T11:49:32.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efefcad4640 1 -- 172.21.15.161:0/3288032162 wait complete. 2024-02-02T11:49:32.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efefcad4640 1 Processor -- start 2024-02-02T11:49:32.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efefcad4640 1 -- start start 2024-02-02T11:49:32.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efefcad4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efee4003f50 0x7efef813f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:32.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efefcad4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efef81e38e0 0x7efef81473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:32.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efefcad4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efef81e3d20 0x7efef8147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:32.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efefcad4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef813f750 con 0x7efef81e38e0 2024-02-02T11:49:32.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efefcad4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef81412f0 con 0x7efee4003f50 2024-02-02T11:49:32.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efefcad4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef81e3450 con 0x7efef81e3d20 2024-02-02T11:49:32.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efef5d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efef81e38e0 0x7efef81473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:32.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efef5d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efef81e38e0 0x7efef81473e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34932/0 (socket says 172.21.15.161:34932) 2024-02-02T11:49:32.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efef5d9b640 1 -- 172.21.15.161:0/3911774299 learned_addr learned my addr 172.21.15.161:0/3911774299 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:32.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efef6d9d640 1 --2- 172.21.15.161:0/3911774299 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efef81e3d20 0x7efef8147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:32.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efef659c640 1 --2- 172.21.15.161:0/3911774299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efee4003f50 0x7efef813f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:32.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efef5d9b640 1 -- 172.21.15.161:0/3911774299 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efef81e3d20 msgr2=0x7efef8147920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:32.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efef5d9b640 1 --2- 172.21.15.161:0/3911774299 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efef81e3d20 0x7efef8147920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:32.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efef5d9b640 1 -- 172.21.15.161:0/3911774299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efee4003f50 msgr2=0x7efef813f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:32.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efef5d9b640 1 --2- 172.21.15.161:0/3911774299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efee4003f50 0x7efef813f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:32.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efef5d9b640 1 -- 172.21.15.161:0/3911774299 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef8140730 con 0x7efef81e38e0 2024-02-02T11:49:32.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efef659c640 1 --2- 172.21.15.161:0/3911774299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efee4003f50 0x7efef813f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:32.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efef5d9b640 1 --2- 172.21.15.161:0/3911774299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efef81e38e0 0x7efef81473e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7efef001c710 tx=0x7efef0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:32.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efeeeffd640 1 -- 172.21.15.161:0/3911774299 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef00adc40 con 0x7efef81e38e0 2024-02-02T11:49:32.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efeeeffd640 1 -- 172.21.15.161:0/3911774299 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef00adda0 con 0x7efef81e38e0 2024-02-02T11:49:32.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efefcad4640 1 -- 172.21.15.161:0/3911774299 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef80bda10 con 0x7efef81e38e0 2024-02-02T11:49:32.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efeeeffd640 1 -- 172.21.15.161:0/3911774299 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef00b6650 con 0x7efef81e38e0 2024-02-02T11:49:32.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.583+0000 7efefcad4640 1 -- 172.21.15.161:0/3911774299 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef81414f0 con 0x7efef81e38e0 2024-02-02T11:49:32.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.587+0000 7efefcad4640 1 -- 172.21.15.161:0/3911774299 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef80bd870 con 0x7efef81e38e0 2024-02-02T11:49:32.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.587+0000 7efeeeffd640 1 -- 172.21.15.161:0/3911774299 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efef00b4040 con 0x7efef81e38e0 2024-02-02T11:49:32.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.587+0000 7efeeeffd640 1 --2- 172.21.15.161:0/3911774299 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7efed8065a90 0x7efed8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:32.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.587+0000 7efef659c640 1 --2- 172.21.15.161:0/3911774299 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7efed8065a90 0x7efed8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:32.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.587+0000 7efeeeffd640 1 -- 172.21.15.161:0/3911774299 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efef011dc40 con 0x7efef81e38e0 2024-02-02T11:49:32.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.587+0000 7efef659c640 1 --2- 172.21.15.161:0/3911774299 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7efed8065a90 0x7efed8067f50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efee8006cf0 tx=0x7efee8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:32.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.591+0000 7efeeeffd640 1 -- 172.21.15.161:0/3911774299 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efef80bd870 con 0x7efef81e38e0 2024-02-02T11:49:32.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:32.767+0000 7efefcad4640 1 -- 172.21.15.161:0/3911774299 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efef8140590 con 0x7efef81e38e0 2024-02-02T11:49:33.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.483+0000 7efeeeffd640 1 -- 172.21.15.161:0/3911774299 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7efef8140590 con 0x7efef81e38e0 2024-02-02T11:49:33.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.483+0000 7efefcad4640 1 -- 172.21.15.161:0/3911774299 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7efed8065a90 msgr2=0x7efed8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:33.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.483+0000 7efefcad4640 1 --2- 172.21.15.161:0/3911774299 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7efed8065a90 0x7efed8067f50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efee8006cf0 tx=0x7efee8008040 comp rx=0 tx=0).stop 2024-02-02T11:49:33.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.483+0000 7efefcad4640 1 -- 172.21.15.161:0/3911774299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efef81e38e0 msgr2=0x7efef81473e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:33.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.483+0000 7efefcad4640 1 --2- 172.21.15.161:0/3911774299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efef81e38e0 0x7efef81473e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7efef001c710 tx=0x7efef0009750 comp rx=0 tx=0).stop 2024-02-02T11:49:33.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.483+0000 7efefcad4640 1 -- 172.21.15.161:0/3911774299 shutdown_connections 2024-02-02T11:49:33.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.483+0000 7efefcad4640 1 --2- 172.21.15.161:0/3911774299 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7efed8065a90 0x7efed8067f50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:33.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.483+0000 7efefcad4640 1 --2- 172.21.15.161:0/3911774299 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efef81e3d20 0x7efef8147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:33.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.483+0000 7efefcad4640 1 --2- 172.21.15.161:0/3911774299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efef81e38e0 0x7efef81473e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:33.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.483+0000 7efefcad4640 1 --2- 172.21.15.161:0/3911774299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efee4003f50 0x7efef813f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:33.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.483+0000 7efefcad4640 1 -- 172.21.15.161:0/3911774299 >> 172.21.15.161:0/3911774299 conn(0x7efef80c02f0 msgr2=0x7efef80c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:33.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.483+0000 7efefcad4640 1 -- 172.21.15.161:0/3911774299 shutdown_connections 2024-02-02T11:49:33.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.483+0000 7efefcad4640 1 -- 172.21.15.161:0/3911774299 wait complete. 2024-02-02T11:49:33.508 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-02-02T11:49:33.508 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-02T11:49:33.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.627+0000 7f2939081640 1 Processor -- start 2024-02-02T11:49:33.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.627+0000 7f2939081640 1 -- start start 2024-02-02T11:49:33.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.631+0000 7f2939081640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f293406fc30 0x7f29340709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:33.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.631+0000 7f2939081640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2934144100 0x7f2934144590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:33.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.631+0000 7f2939081640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2934070ef0 con 0x7f29341474b0 2024-02-02T11:49:33.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.631+0000 7f2939081640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2934071640 con 0x7f293406fc30 2024-02-02T11:49:33.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.631+0000 7f2939081640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293406ecc0 con 0x7f2934144100 2024-02-02T11:49:33.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.631+0000 7f2932d9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f293406fc30 0x7f29340709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:33.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.631+0000 7f2932d9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f293406fc30 0x7f29340709b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34940/0 (socket says 172.21.15.161:34940) 2024-02-02T11:49:33.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.631+0000 7f2932d9d640 1 -- 172.21.15.161:0/3631048081 learned_addr learned my addr 172.21.15.161:0/3631048081 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:33.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.631+0000 7f2932d9d640 1 -- 172.21.15.161:0/3631048081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2934144100 msgr2=0x7f2934144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:33.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.631+0000 7f2932d9d640 1 --2- 172.21.15.161:0/3631048081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2934144100 0x7f2934144590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:33.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.631+0000 7f2932d9d640 1 -- 172.21.15.161:0/3631048081 >> v1:172.21.15.162:6789/0 conn(0x7f29341474b0 legacy=0x7f29341478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:33.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.631+0000 7f2932d9d640 1 -- 172.21.15.161:0/3631048081 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293406ef30 con 0x7f293406fc30 2024-02-02T11:49:33.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.631+0000 7f2932d9d640 1 --2- 172.21.15.161:0/3631048081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f293406fc30 0x7f29340709b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2924006fd0 tx=0x7f292401e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f2a3ea6e06c496 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:33.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.631+0000 7f293259c640 1 -- 172.21.15.161:0/3631048081 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2924004230 con 0x7f293406fc30 2024-02-02T11:49:33.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.631+0000 7f293259c640 1 -- 172.21.15.161:0/3631048081 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29240ab070 con 0x7f293406fc30 2024-02-02T11:49:33.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.631+0000 7f293259c640 1 -- 172.21.15.161:0/3631048081 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29240a7770 con 0x7f293406fc30 2024-02-02T11:49:33.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.631+0000 7f2939081640 1 -- 172.21.15.161:0/3631048081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f293406fc30 msgr2=0x7f29340709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:33.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.631+0000 7f2939081640 1 --2- 172.21.15.161:0/3631048081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f293406fc30 0x7f29340709b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2924006fd0 tx=0x7f292401e960 comp rx=0 tx=0).stop 2024-02-02T11:49:33.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f2939081640 1 -- 172.21.15.161:0/3631048081 shutdown_connections 2024-02-02T11:49:33.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f2939081640 1 --2- 172.21.15.161:0/3631048081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2934144100 0x7f2934144590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:33.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f2939081640 1 --2- 172.21.15.161:0/3631048081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f293406fc30 0x7f29340709b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:33.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f2939081640 1 -- 172.21.15.161:0/3631048081 >> 172.21.15.161:0/3631048081 conn(0x7f293406a120 msgr2=0x7f293406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:33.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f2939081640 1 -- 172.21.15.161:0/3631048081 shutdown_connections 2024-02-02T11:49:33.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f2939081640 1 -- 172.21.15.161:0/3631048081 wait complete. 2024-02-02T11:49:33.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f2939081640 1 Processor -- start 2024-02-02T11:49:33.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f2939081640 1 -- start start 2024-02-02T11:49:33.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f2939081640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293406fc30 0x7f2934132010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:33.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f2939081640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2934144100 0x7f29340b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:33.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f2939081640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29341474b0 0x7f29340b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:33.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f2939081640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2934146ba0 con 0x7f29341474b0 2024-02-02T11:49:33.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f2939081640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293414ff80 con 0x7f2934144100 2024-02-02T11:49:33.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f2939081640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2934150260 con 0x7f293406fc30 2024-02-02T11:49:33.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f293359e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29341474b0 0x7f29340b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:33.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f293359e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29341474b0 0x7f29340b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34946/0 (socket says 172.21.15.161:34946) 2024-02-02T11:49:33.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f293359e640 1 -- 172.21.15.161:0/1799598950 learned_addr learned my addr 172.21.15.161:0/1799598950 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:33.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f2932d9d640 1 --2- 172.21.15.161:0/1799598950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293406fc30 0x7f2934132010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:33.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f292a59c640 1 --2- 172.21.15.161:0/1799598950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2934144100 0x7f29340b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:33.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f293359e640 1 -- 172.21.15.161:0/1799598950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293406fc30 msgr2=0x7f2934132010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:33.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f293359e640 1 --2- 172.21.15.161:0/1799598950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293406fc30 0x7f2934132010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:33.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f293359e640 1 -- 172.21.15.161:0/1799598950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2934144100 msgr2=0x7f29340b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:33.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f293359e640 1 --2- 172.21.15.161:0/1799598950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2934144100 0x7f29340b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:33.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f293359e640 1 -- 172.21.15.161:0/1799598950 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292400b780 con 0x7f29341474b0 2024-02-02T11:49:33.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f292a59c640 1 --2- 172.21.15.161:0/1799598950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2934144100 0x7f29340b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:49:33.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f293359e640 1 --2- 172.21.15.161:0/1799598950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29341474b0 0x7f29340b2140 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f292c00b970 tx=0x7f292c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:33.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f292bfff640 1 -- 172.21.15.161:0/1799598950 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c00cb40 con 0x7f29341474b0 2024-02-02T11:49:33.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f292bfff640 1 -- 172.21.15.161:0/1799598950 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292c00ccc0 con 0x7f29341474b0 2024-02-02T11:49:33.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f2939081640 1 -- 172.21.15.161:0/1799598950 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2934150540 con 0x7f29341474b0 2024-02-02T11:49:33.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f292bfff640 1 -- 172.21.15.161:0/1799598950 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c014680 con 0x7f29341474b0 2024-02-02T11:49:33.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f2939081640 1 -- 172.21.15.161:0/1799598950 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29340b2740 con 0x7f29341474b0 2024-02-02T11:49:33.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.635+0000 7f2939081640 1 -- 172.21.15.161:0/1799598950 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f293404e000 con 0x7f29341474b0 2024-02-02T11:49:33.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.639+0000 7f292bfff640 1 -- 172.21.15.161:0/1799598950 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f292c01d3b0 con 0x7f29341474b0 2024-02-02T11:49:33.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.639+0000 7f292bfff640 1 --2- 172.21.15.161:0/1799598950 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2914065a90 0x7f2914067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:33.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.639+0000 7f292bfff640 1 -- 172.21.15.161:0/1799598950 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f292c083020 con 0x7f29341474b0 2024-02-02T11:49:33.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.639+0000 7f2932d9d640 1 --2- 172.21.15.161:0/1799598950 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2914065a90 0x7f2914067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:33.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.639+0000 7f2932d9d640 1 --2- 172.21.15.161:0/1799598950 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2914065a90 0x7f2914067f50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f29240b1000 tx=0x7f29240a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:33.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.643+0000 7f292bfff640 1 -- 172.21.15.161:0/1799598950 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f292c054500 con 0x7f29341474b0 2024-02-02T11:49:33.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:33.819+0000 7f2939081640 1 -- 172.21.15.161:0/1799598950 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f29341509f0 con 0x7f29341474b0 2024-02-02T11:49:34.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.503+0000 7f292bfff640 1 -- 172.21.15.161:0/1799598950 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f292c0190c0 con 0x7f29341474b0 2024-02-02T11:49:34.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.507+0000 7f2939081640 1 -- 172.21.15.161:0/1799598950 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2914065a90 msgr2=0x7f2914067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:34.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.507+0000 7f2939081640 1 --2- 172.21.15.161:0/1799598950 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2914065a90 0x7f2914067f50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f29240b1000 tx=0x7f29240a9070 comp rx=0 tx=0).stop 2024-02-02T11:49:34.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.507+0000 7f2939081640 1 -- 172.21.15.161:0/1799598950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29341474b0 msgr2=0x7f29340b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:34.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.507+0000 7f2939081640 1 --2- 172.21.15.161:0/1799598950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29341474b0 0x7f29340b2140 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f292c00b970 tx=0x7f292c00be30 comp rx=0 tx=0).stop 2024-02-02T11:49:34.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.507+0000 7f2939081640 1 -- 172.21.15.161:0/1799598950 shutdown_connections 2024-02-02T11:49:34.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.507+0000 7f2939081640 1 --2- 172.21.15.161:0/1799598950 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2914065a90 0x7f2914067f50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.507+0000 7f2939081640 1 --2- 172.21.15.161:0/1799598950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29341474b0 0x7f29340b2140 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.507+0000 7f2939081640 1 --2- 172.21.15.161:0/1799598950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2934144100 0x7f29340b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.507+0000 7f2939081640 1 --2- 172.21.15.161:0/1799598950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f293406fc30 0x7f2934132010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.507+0000 7f2939081640 1 -- 172.21.15.161:0/1799598950 >> 172.21.15.161:0/1799598950 conn(0x7f293406a120 msgr2=0x7f29340b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:34.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.507+0000 7f2939081640 1 -- 172.21.15.161:0/1799598950 shutdown_connections 2024-02-02T11:49:34.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.507+0000 7f2939081640 1 -- 172.21.15.161:0/1799598950 wait complete. 2024-02-02T11:49:34.532 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-02-02T11:49:34.532 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-02T11:49:34.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.647+0000 7f2ab4cd5640 1 Processor -- start 2024-02-02T11:49:34.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2ab4cd5640 1 -- start start 2024-02-02T11:49:34.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2ab4cd5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2ab00bc340 0x7f2ab0142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:34.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2ab4cd5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2ab0142d50 0x7f2ab0148d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:34.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2ab4cd5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ab01492a0 0x7f2ab00b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:34.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2ab4cd5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab0149710 con 0x7f2ab00bc340 2024-02-02T11:49:34.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2ab4cd5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab0071770 con 0x7f2ab0142d50 2024-02-02T11:49:34.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2ab4cd5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab00b37e0 con 0x7f2ab01492a0 2024-02-02T11:49:34.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2aae59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2ab00bc340 0x7f2ab0142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:34.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2aae59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2ab00bc340 0x7f2ab0142810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34948/0 (socket says 172.21.15.161:34948) 2024-02-02T11:49:34.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2aae59c640 1 -- 172.21.15.161:0/2444380985 learned_addr learned my addr 172.21.15.161:0/2444380985 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:34.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2aadd9b640 1 --2- 172.21.15.161:0/2444380985 >> v2:172.21.15.162:3300/0 conn(0x7f2ab0142d50 0x7f2ab0148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:34.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2aaed9d640 1 --2- 172.21.15.161:0/2444380985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ab01492a0 0x7f2ab00b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:34.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2aae59c640 1 -- 172.21.15.161:0/2444380985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ab01492a0 msgr2=0x7f2ab00b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:34.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2aae59c640 1 --2- 172.21.15.161:0/2444380985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ab01492a0 0x7f2ab00b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2aae59c640 1 -- 172.21.15.161:0/2444380985 >> v2:172.21.15.162:3300/0 conn(0x7f2ab0142d50 msgr2=0x7f2ab0148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:34.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2aae59c640 1 --2- 172.21.15.161:0/2444380985 >> v2:172.21.15.162:3300/0 conn(0x7f2ab0142d50 0x7f2ab0148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2aae59c640 1 -- 172.21.15.161:0/2444380985 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab00b3ac0 con 0x7f2ab00bc340 2024-02-02T11:49:34.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2aae59c640 1 --2- 172.21.15.161:0/2444380985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ab00bc340 0x7f2ab0142810 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2ab006d0c0 tx=0x7f2aa001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cda14cb0fb0e3e server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:34.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2aad59a640 1 -- 172.21.15.161:0/2444380985 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa00af400 con 0x7f2ab00bc340 2024-02-02T11:49:34.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2aad59a640 1 -- 172.21.15.161:0/2444380985 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa00ab050 con 0x7f2ab00bc340 2024-02-02T11:49:34.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.651+0000 7f2aad59a640 1 -- 172.21.15.161:0/2444380985 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa00af780 con 0x7f2ab00bc340 2024-02-02T11:49:34.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2ab4cd5640 1 -- 172.21.15.161:0/2444380985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ab00bc340 msgr2=0x7f2ab0142810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:34.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2ab4cd5640 1 --2- 172.21.15.161:0/2444380985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ab00bc340 0x7f2ab0142810 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2ab006d0c0 tx=0x7f2aa001f1c0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2ab4cd5640 1 -- 172.21.15.161:0/2444380985 shutdown_connections 2024-02-02T11:49:34.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2ab4cd5640 1 --2- 172.21.15.161:0/2444380985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ab01492a0 0x7f2ab00b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2ab4cd5640 1 --2- 172.21.15.161:0/2444380985 >> v2:172.21.15.162:3300/0 conn(0x7f2ab0142d50 0x7f2ab0148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2ab4cd5640 1 --2- 172.21.15.161:0/2444380985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ab00bc340 0x7f2ab0142810 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2ab4cd5640 1 -- 172.21.15.161:0/2444380985 >> 172.21.15.161:0/2444380985 conn(0x7f2ab0069ef0 msgr2=0x7f2ab006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:34.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2ab4cd5640 1 -- 172.21.15.161:0/2444380985 shutdown_connections 2024-02-02T11:49:34.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2ab4cd5640 1 -- 172.21.15.161:0/2444380985 wait complete. 2024-02-02T11:49:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2ab4cd5640 1 Processor -- start 2024-02-02T11:49:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2ab4cd5640 1 -- start start 2024-02-02T11:49:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2ab4cd5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ab00bc340 0x7f2ab0147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2ab4cd5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ab01492a0 0x7f2ab01440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2ab4cd5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ab0144620 0x7f2ab0135030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2ab4cd5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab01482c0 con 0x7f2ab0144620 2024-02-02T11:49:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2ab4cd5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab0143830 con 0x7f2ab01492a0 2024-02-02T11:49:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2ab4cd5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab01431e0 con 0x7f2ab00bc340 2024-02-02T11:49:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2aaed9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ab0144620 0x7f2ab0135030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2aaed9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ab0144620 0x7f2ab0135030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34964/0 (socket says 172.21.15.161:34964) 2024-02-02T11:49:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2aaed9d640 1 -- 172.21.15.161:0/2226964707 learned_addr learned my addr 172.21.15.161:0/2226964707 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2aae59c640 1 --2- 172.21.15.161:0/2226964707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ab00bc340 0x7f2ab0147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2aadd9b640 1 --2- 172.21.15.161:0/2226964707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ab01492a0 0x7f2ab01440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2aaed9d640 1 -- 172.21.15.161:0/2226964707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ab00bc340 msgr2=0x7f2ab0147d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2aaed9d640 1 --2- 172.21.15.161:0/2226964707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ab00bc340 0x7f2ab0147d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2aaed9d640 1 -- 172.21.15.161:0/2226964707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ab01492a0 msgr2=0x7f2ab01440e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2aaed9d640 1 --2- 172.21.15.161:0/2226964707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ab01492a0 0x7f2ab01440e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2aaed9d640 1 -- 172.21.15.161:0/2226964707 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa0009b30 con 0x7f2ab0144620 2024-02-02T11:49:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2aaed9d640 1 --2- 172.21.15.161:0/2226964707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ab0144620 0x7f2ab0135030 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800d560 tx=0x7f2aa800da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2aa6ffd640 1 -- 172.21.15.161:0/2226964707 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa80125f0 con 0x7f2ab0144620 2024-02-02T11:49:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2aa6ffd640 1 -- 172.21.15.161:0/2226964707 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa8012770 con 0x7f2ab0144620 2024-02-02T11:49:34.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2ab4cd5640 1 -- 172.21.15.161:0/2226964707 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab01434c0 con 0x7f2ab0144620 2024-02-02T11:49:34.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2aa6ffd640 1 -- 172.21.15.161:0/2226964707 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8012b20 con 0x7f2ab0144620 2024-02-02T11:49:34.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.655+0000 7f2ab4cd5640 1 -- 172.21.15.161:0/2226964707 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab00b2f30 con 0x7f2ab0144620 2024-02-02T11:49:34.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.659+0000 7f2ab4cd5640 1 -- 172.21.15.161:0/2226964707 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab01439e0 con 0x7f2ab0144620 2024-02-02T11:49:34.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.659+0000 7f2aa6ffd640 1 -- 172.21.15.161:0/2226964707 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2aa8012c80 con 0x7f2ab0144620 2024-02-02T11:49:34.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.659+0000 7f2aa6ffd640 1 --2- 172.21.15.161:0/2226964707 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2a90065a60 0x7f2a90067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:34.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.659+0000 7f2aa6ffd640 1 -- 172.21.15.161:0/2226964707 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2aa8083e30 con 0x7f2ab0144620 2024-02-02T11:49:34.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.659+0000 7f2aae59c640 1 --2- 172.21.15.161:0/2226964707 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2a90065a60 0x7f2a90067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:34.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.659+0000 7f2aae59c640 1 --2- 172.21.15.161:0/2226964707 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2a90065a60 0x7f2a90067f20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00b1000 tx=0x7f2aa00aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:34.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.663+0000 7f2aa6ffd640 1 -- 172.21.15.161:0/2226964707 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2aa80518d0 con 0x7f2ab0144620 2024-02-02T11:49:34.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.847+0000 7f2ab4cd5640 1 -- 172.21.15.161:0/2226964707 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ab01439a0 con 0x7f2ab0144620 2024-02-02T11:49:34.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.847+0000 7f2aa6ffd640 1 -- 172.21.15.161:0/2226964707 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3958 (secure 0 0 0) 0x7f2aa8054ef0 con 0x7f2ab0144620 2024-02-02T11:49:34.852 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:34.852 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4535,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/236294405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":236294405},{"type":"v1","addr":"172.21.15.162:6833","nonce":236294405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3772183556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3772183556},{"type":"v1","addr":"172.21.15.161:6835","nonce":3772183556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-02T11:49:31.833135+0000","modified":"2024-02-02T11:49:34.491389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/1621598548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1621598548},{"type":"v1","addr":"172.21.15.161:6837","nonce":1621598548}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-02T11:49:34.852 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 14 2024-02-02T11:49:34.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.851+0000 7f2ab4cd5640 1 -- 172.21.15.161:0/2226964707 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2a90065a60 msgr2=0x7f2a90067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:34.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.851+0000 7f2ab4cd5640 1 --2- 172.21.15.161:0/2226964707 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2a90065a60 0x7f2a90067f20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00b1000 tx=0x7f2aa00aa000 comp rx=0 tx=0).stop 2024-02-02T11:49:34.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.851+0000 7f2ab4cd5640 1 -- 172.21.15.161:0/2226964707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ab0144620 msgr2=0x7f2ab0135030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:34.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.851+0000 7f2ab4cd5640 1 --2- 172.21.15.161:0/2226964707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ab0144620 0x7f2ab0135030 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800d560 tx=0x7f2aa800da20 comp rx=0 tx=0).stop 2024-02-02T11:49:34.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.851+0000 7f2ab4cd5640 1 -- 172.21.15.161:0/2226964707 shutdown_connections 2024-02-02T11:49:34.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.851+0000 7f2ab4cd5640 1 --2- 172.21.15.161:0/2226964707 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2a90065a60 0x7f2a90067f20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.851+0000 7f2ab4cd5640 1 --2- 172.21.15.161:0/2226964707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ab0144620 0x7f2ab0135030 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.851+0000 7f2ab4cd5640 1 --2- 172.21.15.161:0/2226964707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ab01492a0 0x7f2ab01440e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.851+0000 7f2ab4cd5640 1 --2- 172.21.15.161:0/2226964707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ab00bc340 0x7f2ab0147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.851+0000 7f2ab4cd5640 1 -- 172.21.15.161:0/2226964707 >> 172.21.15.161:0/2226964707 conn(0x7f2ab0069ef0 msgr2=0x7f2ab013e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:34.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.851+0000 7f2ab4cd5640 1 -- 172.21.15.161:0/2226964707 shutdown_connections 2024-02-02T11:49:34.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.851+0000 7f2ab4cd5640 1 -- 172.21.15.161:0/2226964707 wait complete. 2024-02-02T11:49:34.869 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T11:49:34.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.971+0000 7f7def814640 1 Processor -- start 2024-02-02T11:49:34.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.971+0000 7f7def814640 1 -- start start 2024-02-02T11:49:34.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.971+0000 7f7def814640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7de806f4f0 0x7f7de806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:34.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.971+0000 7f7def814640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7de814ded0 0x7f7de814e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:34.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.971+0000 7f7def814640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de80707e0 con 0x7f7de80bc340 2024-02-02T11:49:34.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.971+0000 7f7def814640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de80703c0 con 0x7f7de814ded0 2024-02-02T11:49:34.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.971+0000 7f7def814640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80b8750 con 0x7f7de806f4f0 2024-02-02T11:49:34.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.971+0000 7f7deddb1640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7de814ded0 0x7f7de814e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:34.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.971+0000 7f7deddb1640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7de814ded0 0x7f7de814e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34966/0 (socket says 172.21.15.161:34966) 2024-02-02T11:49:34.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.971+0000 7f7ded5b0640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7de80bc340 0x7f7de8144830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:45014/0 (socket says 172.21.15.161:45014) 2024-02-02T11:49:34.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.971+0000 7f7deddb1640 1 -- 172.21.15.161:0/226028084 learned_addr learned my addr 172.21.15.161:0/226028084 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:34.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.975+0000 7f7decdaf640 1 --2- 172.21.15.161:0/226028084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7de806f4f0 0x7f7de806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:34.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.975+0000 7f7deddb1640 1 -- 172.21.15.161:0/226028084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7de806f4f0 msgr2=0x7f7de806eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:34.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.975+0000 7f7deddb1640 1 --2- 172.21.15.161:0/226028084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7de806f4f0 0x7f7de806eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.975+0000 7f7ddbfff640 1 -- 172.21.15.161:0/226028084 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163367157 0 0) 0x7f7de80707e0 con 0x7f7de80bc340 2024-02-02T11:49:34.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.975+0000 7f7deddb1640 1 -- 172.21.15.161:0/226028084 >> v1:172.21.15.161:6789/0 conn(0x7f7de80bc340 legacy=0x7f7de8144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:34.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.975+0000 7f7deddb1640 1 -- 172.21.15.161:0/226028084 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de806fa10 con 0x7f7de814ded0 2024-02-02T11:49:34.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.975+0000 7f7deddb1640 1 --2- 172.21.15.161:0/226028084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de814ded0 0x7f7de814e380 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009870 tx=0x7f7de001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32ded070b948221 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:34.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.975+0000 7f7ddbfff640 1 -- 172.21.15.161:0/226028084 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de00aa650 con 0x7f7de814ded0 2024-02-02T11:49:34.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.975+0000 7f7ddbfff640 1 -- 172.21.15.161:0/226028084 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de00aa7b0 con 0x7f7de814ded0 2024-02-02T11:49:34.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.975+0000 7f7ddbfff640 1 -- 172.21.15.161:0/226028084 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de00aab40 con 0x7f7de814ded0 2024-02-02T11:49:34.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7def814640 1 -- 172.21.15.161:0/226028084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de814ded0 msgr2=0x7f7de814e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:34.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7def814640 1 --2- 172.21.15.161:0/226028084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de814ded0 0x7f7de814e380 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009870 tx=0x7f7de001c510 comp rx=0 tx=0).stop 2024-02-02T11:49:34.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7def814640 1 -- 172.21.15.161:0/226028084 shutdown_connections 2024-02-02T11:49:34.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7def814640 1 --2- 172.21.15.161:0/226028084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de814ded0 0x7f7de814e380 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7def814640 1 --2- 172.21.15.161:0/226028084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7de806f4f0 0x7f7de806eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7def814640 1 -- 172.21.15.161:0/226028084 >> 172.21.15.161:0/226028084 conn(0x7f7de8069ef0 msgr2=0x7f7de806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:34.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7def814640 1 -- 172.21.15.161:0/226028084 shutdown_connections 2024-02-02T11:49:34.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7def814640 1 -- 172.21.15.161:0/226028084 wait complete. 2024-02-02T11:49:34.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7def814640 1 Processor -- start 2024-02-02T11:49:34.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7def814640 1 -- start start 2024-02-02T11:49:34.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7def814640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7de806f4f0 0x7f7de814d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:34.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7def814640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7de80bc340 0x7f7de8142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:34.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7def814640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de814ded0 0x7f7de80b5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:34.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7def814640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de8143530 con 0x7f7de814ded0 2024-02-02T11:49:34.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7def814640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de813b730 con 0x7f7de80bc340 2024-02-02T11:49:34.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7def814640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de813ba10 con 0x7f7de806f4f0 2024-02-02T11:49:34.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7deddb1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de814ded0 0x7f7de80b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:34.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7deddb1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de814ded0 0x7f7de80b5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34980/0 (socket says 172.21.15.161:34980) 2024-02-02T11:49:34.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7deddb1640 1 -- 172.21.15.161:0/3655691698 learned_addr learned my addr 172.21.15.161:0/3655691698 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:34.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7decdaf640 1 --2- 172.21.15.161:0/3655691698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7de80bc340 0x7f7de8142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:34.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7ded5b0640 1 --2- 172.21.15.161:0/3655691698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7de806f4f0 0x7f7de814d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:34.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7deddb1640 1 -- 172.21.15.161:0/3655691698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7de806f4f0 msgr2=0x7f7de814d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:34.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7deddb1640 1 --2- 172.21.15.161:0/3655691698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7de806f4f0 0x7f7de814d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7deddb1640 1 -- 172.21.15.161:0/3655691698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7de80bc340 msgr2=0x7f7de8142ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:34.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7deddb1640 1 --2- 172.21.15.161:0/3655691698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7de80bc340 0x7f7de8142ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:34.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7deddb1640 1 -- 172.21.15.161:0/3655691698 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de00094d0 con 0x7f7de814ded0 2024-02-02T11:49:34.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7decdaf640 1 --2- 172.21.15.161:0/3655691698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7de80bc340 0x7f7de8142ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:34.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7deddb1640 1 --2- 172.21.15.161:0/3655691698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de814ded0 0x7f7de80b5540 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7de001abc0 tx=0x7f7de001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:34.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7dd9ffb640 1 -- 172.21.15.161:0/3655691698 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de00aae70 con 0x7f7de814ded0 2024-02-02T11:49:34.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7dd9ffb640 1 -- 172.21.15.161:0/3655691698 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de00b7070 con 0x7f7de814ded0 2024-02-02T11:49:34.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7def814640 1 -- 172.21.15.161:0/3655691698 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de813bcf0 con 0x7f7de814ded0 2024-02-02T11:49:34.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7dd9ffb640 1 -- 172.21.15.161:0/3655691698 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de0004230 con 0x7f7de814ded0 2024-02-02T11:49:34.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7def814640 1 -- 172.21.15.161:0/3655691698 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de813bfd0 con 0x7f7de814ded0 2024-02-02T11:49:34.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.979+0000 7f7def814640 1 -- 172.21.15.161:0/3655691698 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de804e000 con 0x7f7de814ded0 2024-02-02T11:49:34.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.983+0000 7f7dd9ffb640 1 -- 172.21.15.161:0/3655691698 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7de0004390 con 0x7f7de814ded0 2024-02-02T11:49:34.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.983+0000 7f7dd9ffb640 1 --2- 172.21.15.161:0/3655691698 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7dcc065a90 0x7f7dcc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:34.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.983+0000 7f7dd9ffb640 1 -- 172.21.15.161:0/3655691698 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7de011d820 con 0x7f7de814ded0 2024-02-02T11:49:34.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.983+0000 7f7ded5b0640 1 --2- 172.21.15.161:0/3655691698 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7dcc065a90 0x7f7dcc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:34.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.983+0000 7f7ded5b0640 1 --2- 172.21.15.161:0/3655691698 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7dcc065a90 0x7f7dcc067f50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc000f70 tx=0x7f7ddc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:34.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:34.987+0000 7f7dd9ffb640 1 -- 172.21.15.161:0/3655691698 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7de00eb150 con 0x7f7de814ded0 2024-02-02T11:49:35.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.127+0000 7f7def814640 1 -- 172.21.15.161:0/3655691698 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7de81e1fa0 con 0x7f7de814ded0 2024-02-02T11:49:35.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.131+0000 7f7dd9ffb640 1 -- 172.21.15.161:0/3655691698 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16149 (secure 0 0 0) 0x7f7de00b9030 con 0x7f7de814ded0 2024-02-02T11:49:35.136 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:35.136 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":31,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:49:32.837266+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:49:30.264273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-02T11:49:30.811831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T11:49:35.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.131+0000 7f7def814640 1 -- 172.21.15.161:0/3655691698 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7dcc065a90 msgr2=0x7f7dcc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:35.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.131+0000 7f7def814640 1 --2- 172.21.15.161:0/3655691698 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7dcc065a90 0x7f7dcc067f50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc000f70 tx=0x7f7ddc009040 comp rx=0 tx=0).stop 2024-02-02T11:49:35.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.131+0000 7f7def814640 1 -- 172.21.15.161:0/3655691698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de814ded0 msgr2=0x7f7de80b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:35.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.131+0000 7f7def814640 1 --2- 172.21.15.161:0/3655691698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de814ded0 0x7f7de80b5540 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7de001abc0 tx=0x7f7de001ad50 comp rx=0 tx=0).stop 2024-02-02T11:49:35.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.131+0000 7f7def814640 1 -- 172.21.15.161:0/3655691698 shutdown_connections 2024-02-02T11:49:35.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.131+0000 7f7def814640 1 --2- 172.21.15.161:0/3655691698 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7dcc065a90 0x7f7dcc067f50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.131+0000 7f7def814640 1 --2- 172.21.15.161:0/3655691698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de814ded0 0x7f7de80b5540 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.131+0000 7f7def814640 1 --2- 172.21.15.161:0/3655691698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7de80bc340 0x7f7de8142ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.131+0000 7f7def814640 1 --2- 172.21.15.161:0/3655691698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7de806f4f0 0x7f7de814d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.131+0000 7f7def814640 1 -- 172.21.15.161:0/3655691698 >> 172.21.15.161:0/3655691698 conn(0x7f7de8069ef0 msgr2=0x7f7de80ba090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:35.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.131+0000 7f7def814640 1 -- 172.21.15.161:0/3655691698 shutdown_connections 2024-02-02T11:49:35.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.131+0000 7f7def814640 1 -- 172.21.15.161:0/3655691698 wait complete. 2024-02-02T11:49:35.151 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-02T11:49:35.151 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-02T11:49:35.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f096d35a640 1 Processor -- start 2024-02-02T11:49:35.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f096d35a640 1 -- start start 2024-02-02T11:49:35.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f096d35a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0968148d60 0x7f09681491b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:35.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f096d35a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0968151100 0x7f09681534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:35.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f096d35a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0968071770 con 0x7f09680bc340 2024-02-02T11:49:35.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f096d35a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09681496f0 con 0x7f0968148d60 2024-02-02T11:49:35.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f096d35a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0968142f20 con 0x7f0968151100 2024-02-02T11:49:35.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f0966ffd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f09680bc340 0x7f0968142810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:45028/0 (socket says 172.21.15.161:45028) 2024-02-02T11:49:35.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f095e7fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0968148d60 0x7f09681491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:35.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f0966ffd640 1 -- 172.21.15.161:0/4247030581 learned_addr learned my addr 172.21.15.161:0/4247030581 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:35.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f09667fc640 1 -- 172.21.15.161:0/4247030581 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623588728 0 0) 0x7f0968071770 con 0x7f09680bc340 2024-02-02T11:49:35.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f09667fc640 1 -- 172.21.15.161:0/4247030581 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0954003530 con 0x7f09680bc340 2024-02-02T11:49:35.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f095e7fc640 1 -- 172.21.15.161:0/4247030581 >> v2:172.21.15.162:3300/0 conn(0x7f0968151100 msgr2=0x7f09681534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:35.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f095e7fc640 1 --2- 172.21.15.161:0/4247030581 >> v2:172.21.15.162:3300/0 conn(0x7f0968151100 0x7f09681534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f095e7fc640 1 -- 172.21.15.161:0/4247030581 >> v1:172.21.15.161:6789/0 conn(0x7f09680bc340 legacy=0x7f0968142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:35.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f095e7fc640 1 -- 172.21.15.161:0/4247030581 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09680b37e0 con 0x7f0968148d60 2024-02-02T11:49:35.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f095e7fc640 1 --2- 172.21.15.161:0/4247030581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0968148d60 0x7f09681491b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f09681463e0 tx=0x7f095801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b85da129377dcd server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:35.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f09667fc640 1 -- 172.21.15.161:0/4247030581 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09580a8950 con 0x7f0968148d60 2024-02-02T11:49:35.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f09667fc640 1 -- 172.21.15.161:0/4247030581 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09580a8ab0 con 0x7f0968148d60 2024-02-02T11:49:35.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.267+0000 7f09667fc640 1 -- 172.21.15.161:0/4247030581 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09580a8e20 con 0x7f0968148d60 2024-02-02T11:49:35.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f096d35a640 1 -- 172.21.15.161:0/4247030581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0968148d60 msgr2=0x7f09681491b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:35.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f096d35a640 1 --2- 172.21.15.161:0/4247030581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0968148d60 0x7f09681491b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f09681463e0 tx=0x7f095801ec50 comp rx=0 tx=0).stop 2024-02-02T11:49:35.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f096d35a640 1 -- 172.21.15.161:0/4247030581 shutdown_connections 2024-02-02T11:49:35.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f096d35a640 1 --2- 172.21.15.161:0/4247030581 >> v2:172.21.15.162:3300/0 conn(0x7f0968151100 0x7f09681534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f096d35a640 1 --2- 172.21.15.161:0/4247030581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0968148d60 0x7f09681491b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f096d35a640 1 -- 172.21.15.161:0/4247030581 >> 172.21.15.161:0/4247030581 conn(0x7f0968069ef0 msgr2=0x7f096806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:35.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f096d35a640 1 -- 172.21.15.161:0/4247030581 shutdown_connections 2024-02-02T11:49:35.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f096d35a640 1 -- 172.21.15.161:0/4247030581 wait complete. 2024-02-02T11:49:35.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f096d35a640 1 Processor -- start 2024-02-02T11:49:35.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f096d35a640 1 -- start start 2024-02-02T11:49:35.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f096d35a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09680bc340 0x7f09680bb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:35.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f096d35a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0968148d60 0x7f0968138180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:35.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f096d35a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0968151100 0x7f09681386c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:35.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f096d35a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09681481e0 con 0x7f0968148d60 2024-02-02T11:49:35.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f096d35a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0968138c00 con 0x7f09680bc340 2024-02-02T11:49:35.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f096d35a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09680bb5d0 con 0x7f0968151100 2024-02-02T11:49:35.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f095e7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0968148d60 0x7f0968138180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:35.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f095e7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0968148d60 0x7f0968138180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35006/0 (socket says 172.21.15.161:35006) 2024-02-02T11:49:35.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f095e7fc640 1 -- 172.21.15.161:0/417866670 learned_addr learned my addr 172.21.15.161:0/417866670 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:35.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f0966ffd640 1 --2- 172.21.15.161:0/417866670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09680bc340 0x7f09680bb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:35.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f09677fe640 1 --2- 172.21.15.161:0/417866670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0968151100 0x7f09681386c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:35.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f095e7fc640 1 -- 172.21.15.161:0/417866670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0968151100 msgr2=0x7f09681386c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:35.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f095e7fc640 1 --2- 172.21.15.161:0/417866670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0968151100 0x7f09681386c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f095e7fc640 1 -- 172.21.15.161:0/417866670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09680bc340 msgr2=0x7f09680bb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:35.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f095e7fc640 1 --2- 172.21.15.161:0/417866670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09680bc340 0x7f09680bb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f095e7fc640 1 -- 172.21.15.161:0/417866670 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0958009420 con 0x7f0968148d60 2024-02-02T11:49:35.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f095e7fc640 1 --2- 172.21.15.161:0/417866670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0968148d60 0x7f0968138180 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f095801b860 tx=0x7f095801b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:35.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f095ffff640 1 -- 172.21.15.161:0/417866670 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09580044d0 con 0x7f0968148d60 2024-02-02T11:49:35.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f095ffff640 1 -- 172.21.15.161:0/417866670 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0958003620 con 0x7f0968148d60 2024-02-02T11:49:35.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f096d35a640 1 -- 172.21.15.161:0/417866670 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f096813c6b0 con 0x7f0968148d60 2024-02-02T11:49:35.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f095ffff640 1 -- 172.21.15.161:0/417866670 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0958003990 con 0x7f0968148d60 2024-02-02T11:49:35.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f096d35a640 1 -- 172.21.15.161:0/417866670 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f096813cc70 con 0x7f0968148d60 2024-02-02T11:49:35.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.271+0000 7f096d35a640 1 -- 172.21.15.161:0/417866670 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f096813c510 con 0x7f0968148d60 2024-02-02T11:49:35.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.275+0000 7f095ffff640 1 -- 172.21.15.161:0/417866670 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f09580b7040 con 0x7f0968148d60 2024-02-02T11:49:35.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.275+0000 7f095ffff640 1 --2- 172.21.15.161:0/417866670 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0948065a60 0x7f0948067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:35.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.275+0000 7f095ffff640 1 -- 172.21.15.161:0/417866670 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0958120a10 con 0x7f0968148d60 2024-02-02T11:49:35.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.275+0000 7f0966ffd640 1 --2- 172.21.15.161:0/417866670 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0948065a60 0x7f0948067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:35.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.275+0000 7f0966ffd640 1 --2- 172.21.15.161:0/417866670 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0948065a60 0x7f0948067f20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0950007fd0 tx=0x7f0950009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:35.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.279+0000 7f095ffff640 1 -- 172.21.15.161:0/417866670 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f096813c510 con 0x7f0968148d60 2024-02-02T11:49:35.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.431+0000 7f096d35a640 1 -- 172.21.15.161:0/417866670 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09680b3da0 con 0x7f0948065a60 2024-02-02T11:49:35.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.439+0000 7f095ffff640 1 -- 172.21.15.161:0/417866670 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249831 (secure 0 0 0) 0x7f09500058e0 con 0x7f0948065a60 2024-02-02T11:49:35.446 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:35.447 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-02-02T11:49:35.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.443+0000 7f096d35a640 1 -- 172.21.15.161:0/417866670 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0948065a60 msgr2=0x7f0948067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:35.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.443+0000 7f096d35a640 1 --2- 172.21.15.161:0/417866670 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0948065a60 0x7f0948067f20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0950007fd0 tx=0x7f0950009040 comp rx=0 tx=0).stop 2024-02-02T11:49:35.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.443+0000 7f096d35a640 1 -- 172.21.15.161:0/417866670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0968148d60 msgr2=0x7f0968138180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:35.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.443+0000 7f096d35a640 1 --2- 172.21.15.161:0/417866670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0968148d60 0x7f0968138180 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f095801b860 tx=0x7f095801b9f0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.443+0000 7f096d35a640 1 -- 172.21.15.161:0/417866670 shutdown_connections 2024-02-02T11:49:35.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.443+0000 7f096d35a640 1 --2- 172.21.15.161:0/417866670 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0948065a60 0x7f0948067f20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.443+0000 7f096d35a640 1 --2- 172.21.15.161:0/417866670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0968151100 0x7f09681386c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.443+0000 7f096d35a640 1 --2- 172.21.15.161:0/417866670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0968148d60 0x7f0968138180 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.443+0000 7f096d35a640 1 --2- 172.21.15.161:0/417866670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09680bc340 0x7f09680bb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.443+0000 7f096d35a640 1 -- 172.21.15.161:0/417866670 >> 172.21.15.161:0/417866670 conn(0x7f0968069ef0 msgr2=0x7f09680b83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:35.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.443+0000 7f096d35a640 1 -- 172.21.15.161:0/417866670 shutdown_connections 2024-02-02T11:49:35.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.443+0000 7f096d35a640 1 -- 172.21.15.161:0/417866670 wait complete. 2024-02-02T11:49:35.463 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-02-02T11:49:34.264187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":223760,"kb_used_data":3496,"kb_used_omap":13,"kb_used_meta":220146,"kb_avail":754750960,"statfs":{"total":773094113280,"available":772864983040,"internally_reserved":0,"allocated":3579904,"data_stored":2053560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225429592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":75,"apply_latency_ms":75,"commit_latency_ns":75000000,"apply_latency_ns":75000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000747"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-02T11:49:24.490920+0000","last_change":"2024-02-02T11:48:41.563754+0000","last_active":"2024-02-02T11:49:24.490920+0000","last_peered":"2024-02-02T11:49:24.490920+0000","last_clean":"2024-02-02T11:49:24.490920+0000","last_became_active":"2024-02-02T11:48:41.562629+0000","last_became_peered":"2024-02-02T11:48:41.562629+0000","last_unstale":"2024-02-02T11:49:24.490920+0000","last_undegraded":"2024-02-02T11:49:24.490920+0000","last_fullsized":"2024-02-02T11:49:24.490920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_clean_scrub_stamp":"2024-02-02T11:48:40.536978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:22:02.923582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":699471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.639}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.714}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31408,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":699471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-02T11:49:35.468 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-02T11:49:35.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.619+0000 7f2ee3f36640 1 Processor -- start 2024-02-02T11:49:35.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.619+0000 7f2ee3f36640 1 -- start start 2024-02-02T11:49:35.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.623+0000 7f2ee3f36640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2edc071160 0x7f2edc0b9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:35.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.623+0000 7f2ee3f36640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2edc1429f0 0x7f2edc153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:35.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.623+0000 7f2ee3f36640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2edc0b3c40 con 0x7f2edc0b42d0 2024-02-02T11:49:35.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.623+0000 7f2ee3f36640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2edc0b5140 con 0x7f2edc1429f0 2024-02-02T11:49:35.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.623+0000 7f2ee3f36640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2edc0b4720 con 0x7f2edc071160 2024-02-02T11:49:35.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.623+0000 7f2ee24d3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2edc1429f0 0x7f2edc153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:35.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.623+0000 7f2ee24d3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2edc1429f0 0x7f2edc153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35022/0 (socket says 172.21.15.161:35022) 2024-02-02T11:49:35.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.623+0000 7f2ee24d3640 1 -- 172.21.15.161:0/956345354 learned_addr learned my addr 172.21.15.161:0/956345354 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:35.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.623+0000 7f2ee1cd2640 1 --2- 172.21.15.161:0/956345354 >> v2:172.21.15.162:3300/0 conn(0x7f2edc071160 0x7f2edc0b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:35.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.623+0000 7f2ee24d3640 1 -- 172.21.15.161:0/956345354 >> v2:172.21.15.162:3300/0 conn(0x7f2edc071160 msgr2=0x7f2edc0b9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:35.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.623+0000 7f2ee24d3640 1 --2- 172.21.15.161:0/956345354 >> v2:172.21.15.162:3300/0 conn(0x7f2edc071160 0x7f2edc0b9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.623+0000 7f2ee24d3640 1 -- 172.21.15.161:0/956345354 >> v1:172.21.15.162:6789/0 conn(0x7f2edc0b42d0 legacy=0x7f2edc0b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:35.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.623+0000 7f2ee24d3640 1 -- 172.21.15.161:0/956345354 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc0b9f60 con 0x7f2edc1429f0 2024-02-02T11:49:35.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.623+0000 7f2ee24d3640 1 --2- 172.21.15.161:0/956345354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2edc1429f0 0x7f2edc153260 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2edc070b20 tx=0x7f2ed401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ffd2c7d8d2b3dd server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:35.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.623+0000 7f2ee0cd0640 1 -- 172.21.15.161:0/956345354 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed40a5790 con 0x7f2edc1429f0 2024-02-02T11:49:35.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.623+0000 7f2ee0cd0640 1 -- 172.21.15.161:0/956345354 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed40a58f0 con 0x7f2edc1429f0 2024-02-02T11:49:35.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.623+0000 7f2ee0cd0640 1 -- 172.21.15.161:0/956345354 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed40a5c80 con 0x7f2edc1429f0 2024-02-02T11:49:35.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee3f36640 1 -- 172.21.15.161:0/956345354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2edc1429f0 msgr2=0x7f2edc153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:35.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee3f36640 1 --2- 172.21.15.161:0/956345354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2edc1429f0 0x7f2edc153260 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2edc070b20 tx=0x7f2ed401c8d0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee3f36640 1 -- 172.21.15.161:0/956345354 shutdown_connections 2024-02-02T11:49:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee3f36640 1 --2- 172.21.15.161:0/956345354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2edc1429f0 0x7f2edc153260 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee3f36640 1 --2- 172.21.15.161:0/956345354 >> v2:172.21.15.162:3300/0 conn(0x7f2edc071160 0x7f2edc0b9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee3f36640 1 -- 172.21.15.161:0/956345354 >> 172.21.15.161:0/956345354 conn(0x7f2edc0be150 msgr2=0x7f2edc0be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee3f36640 1 -- 172.21.15.161:0/956345354 shutdown_connections 2024-02-02T11:49:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee3f36640 1 -- 172.21.15.161:0/956345354 wait complete. 2024-02-02T11:49:35.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee3f36640 1 Processor -- start 2024-02-02T11:49:35.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee3f36640 1 -- start start 2024-02-02T11:49:35.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee3f36640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2edc071160 0x7f2edc13f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:35.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee3f36640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2edc0b42d0 0x7f2edc1e6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:35.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee3f36640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2edc1429f0 0x7f2edc06bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:35.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee3f36640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc13ff30 con 0x7f2edc1429f0 2024-02-02T11:49:35.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee3f36640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc06ce80 con 0x7f2edc0b42d0 2024-02-02T11:49:35.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee3f36640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc0bde30 con 0x7f2edc071160 2024-02-02T11:49:35.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee24d3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2edc1429f0 0x7f2edc06bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:35.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee24d3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2edc1429f0 0x7f2edc06bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35038/0 (socket says 172.21.15.161:35038) 2024-02-02T11:49:35.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee24d3640 1 -- 172.21.15.161:0/1204451643 learned_addr learned my addr 172.21.15.161:0/1204451643 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:35.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee14d1640 1 --2- 172.21.15.161:0/1204451643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2edc0b42d0 0x7f2edc1e6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:35.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee1cd2640 1 --2- 172.21.15.161:0/1204451643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2edc071160 0x7f2edc13f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:35.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee24d3640 1 -- 172.21.15.161:0/1204451643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2edc071160 msgr2=0x7f2edc13f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:35.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee24d3640 1 --2- 172.21.15.161:0/1204451643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2edc071160 0x7f2edc13f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee24d3640 1 -- 172.21.15.161:0/1204451643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2edc0b42d0 msgr2=0x7f2edc1e6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:35.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee24d3640 1 --2- 172.21.15.161:0/1204451643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2edc0b42d0 0x7f2edc1e6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee24d3640 1 -- 172.21.15.161:0/1204451643 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed4009b30 con 0x7f2edc1429f0 2024-02-02T11:49:35.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee14d1640 1 --2- 172.21.15.161:0/1204451643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2edc0b42d0 0x7f2edc1e6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:35.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee1cd2640 1 --2- 172.21.15.161:0/1204451643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2edc071160 0x7f2edc13f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:35.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee24d3640 1 --2- 172.21.15.161:0/1204451643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2edc1429f0 0x7f2edc06bbb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40af040 tx=0x7f2ed4019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:35.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ed27fc640 1 -- 172.21.15.161:0/1204451643 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed40b8670 con 0x7f2edc1429f0 2024-02-02T11:49:35.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ed27fc640 1 -- 172.21.15.161:0/1204451643 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed40b87d0 con 0x7f2edc1429f0 2024-02-02T11:49:35.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee3f36640 1 -- 172.21.15.161:0/1204451643 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2edc073820 con 0x7f2edc1429f0 2024-02-02T11:49:35.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ed27fc640 1 -- 172.21.15.161:0/1204451643 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed40b8b80 con 0x7f2edc1429f0 2024-02-02T11:49:35.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.627+0000 7f2ee3f36640 1 -- 172.21.15.161:0/1204451643 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2edc06af40 con 0x7f2edc1429f0 2024-02-02T11:49:35.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.631+0000 7f2ee3f36640 1 -- 172.21.15.161:0/1204451643 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2edc04e000 con 0x7f2edc1429f0 2024-02-02T11:49:35.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.631+0000 7f2ed27fc640 1 -- 172.21.15.161:0/1204451643 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2ed40b8ce0 con 0x7f2edc1429f0 2024-02-02T11:49:35.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.631+0000 7f2ed27fc640 1 --2- 172.21.15.161:0/1204451643 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ec0065a60 0x7f2ec0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:35.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.631+0000 7f2ed27fc640 1 -- 172.21.15.161:0/1204451643 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ed411e800 con 0x7f2edc1429f0 2024-02-02T11:49:35.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.631+0000 7f2ee1cd2640 1 --2- 172.21.15.161:0/1204451643 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ec0065a60 0x7f2ec0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:35.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.631+0000 7f2ee1cd2640 1 --2- 172.21.15.161:0/1204451643 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ec0065a60 0x7f2ec0067f20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8006fd0 tx=0x7f2ed8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:35.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.635+0000 7f2ed27fc640 1 -- 172.21.15.161:0/1204451643 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2ed40ec3c0 con 0x7f2edc1429f0 2024-02-02T11:49:35.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.783+0000 7f2ee3f36640 1 -- 172.21.15.161:0/1204451643 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2edc0b93e0 con 0x7f2ec0065a60 2024-02-02T11:49:35.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.791+0000 7f2ed27fc640 1 -- 172.21.15.161:0/1204451643 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249831 (secure 0 0 0) 0x7f2ed800c040 con 0x7f2ec0065a60 2024-02-02T11:49:35.797 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:35.799 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-02-02T11:49:35.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.795+0000 7f2ee3f36640 1 -- 172.21.15.161:0/1204451643 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ec0065a60 msgr2=0x7f2ec0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:35.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.795+0000 7f2ee3f36640 1 --2- 172.21.15.161:0/1204451643 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ec0065a60 0x7f2ec0067f20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8006fd0 tx=0x7f2ed8008040 comp rx=0 tx=0).stop 2024-02-02T11:49:35.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.795+0000 7f2ee3f36640 1 -- 172.21.15.161:0/1204451643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2edc1429f0 msgr2=0x7f2edc06bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:35.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.795+0000 7f2ee3f36640 1 --2- 172.21.15.161:0/1204451643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2edc1429f0 0x7f2edc06bbb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40af040 tx=0x7f2ed4019670 comp rx=0 tx=0).stop 2024-02-02T11:49:35.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.795+0000 7f2ee3f36640 1 -- 172.21.15.161:0/1204451643 shutdown_connections 2024-02-02T11:49:35.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.795+0000 7f2ee3f36640 1 --2- 172.21.15.161:0/1204451643 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ec0065a60 0x7f2ec0067f20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.795+0000 7f2ee3f36640 1 --2- 172.21.15.161:0/1204451643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2edc1429f0 0x7f2edc06bbb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.795+0000 7f2ee3f36640 1 --2- 172.21.15.161:0/1204451643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2edc0b42d0 0x7f2edc1e6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.795+0000 7f2ee3f36640 1 --2- 172.21.15.161:0/1204451643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2edc071160 0x7f2edc13f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.795+0000 7f2ee3f36640 1 -- 172.21.15.161:0/1204451643 >> 172.21.15.161:0/1204451643 conn(0x7f2edc0be150 msgr2=0x7f2edc0bab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:35.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.795+0000 7f2ee3f36640 1 -- 172.21.15.161:0/1204451643 shutdown_connections 2024-02-02T11:49:35.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.795+0000 7f2ee3f36640 1 -- 172.21.15.161:0/1204451643 wait complete. 2024-02-02T11:49:35.815 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-02-02T11:49:34.264187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":223760,"kb_used_data":3496,"kb_used_omap":13,"kb_used_meta":220146,"kb_avail":754750960,"statfs":{"total":773094113280,"available":772864983040,"internally_reserved":0,"allocated":3579904,"data_stored":2053560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225429592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":75,"apply_latency_ms":75,"commit_latency_ns":75000000,"apply_latency_ns":75000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000747"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-02T11:49:24.490920+0000","last_change":"2024-02-02T11:48:41.563754+0000","last_active":"2024-02-02T11:49:24.490920+0000","last_peered":"2024-02-02T11:49:24.490920+0000","last_clean":"2024-02-02T11:49:24.490920+0000","last_became_active":"2024-02-02T11:48:41.562629+0000","last_became_peered":"2024-02-02T11:48:41.562629+0000","last_unstale":"2024-02-02T11:49:24.490920+0000","last_undegraded":"2024-02-02T11:49:24.490920+0000","last_fullsized":"2024-02-02T11:49:24.490920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_clean_scrub_stamp":"2024-02-02T11:48:40.536978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:22:02.923582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":699471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.639}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.714}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31408,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":699471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-02T11:49:35.819 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-02T11:49:35.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.967+0000 7f573e1d9640 1 Processor -- start 2024-02-02T11:49:35.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.967+0000 7f573e1d9640 1 -- start start 2024-02-02T11:49:35.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.967+0000 7f573e1d9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5738070db0 0x7f5738147940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:35.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.967+0000 7f573e1d9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5738147e80 0x7f57381520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:35.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.967+0000 7f573e1d9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5738071e60 con 0x7f5738141b70 2024-02-02T11:49:35.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.967+0000 7f573e1d9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57380723a0 con 0x7f5738147e80 2024-02-02T11:49:35.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.967+0000 7f573e1d9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5738071510 con 0x7f5738070db0 2024-02-02T11:49:35.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.967+0000 7f5737fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5738147e80 0x7f57381520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:35.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.967+0000 7f57377fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f5738141b70 0x7f573806a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:45040/0 (socket says 172.21.15.161:45040) 2024-02-02T11:49:35.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.967+0000 7f57377fe640 1 -- 172.21.15.161:0/4044993330 learned_addr learned my addr 172.21.15.161:0/4044993330 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:35.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.967+0000 7f572effd640 1 --2- 172.21.15.161:0/4044993330 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5738070db0 0x7f5738147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:35.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.967+0000 7f5737fff640 1 -- 172.21.15.161:0/4044993330 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5738070db0 msgr2=0x7f5738147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:35.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.967+0000 7f5737fff640 1 --2- 172.21.15.161:0/4044993330 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5738070db0 0x7f5738147940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.967+0000 7f5737fff640 1 -- 172.21.15.161:0/4044993330 >> v1:172.21.15.161:6789/0 conn(0x7f5738141b70 legacy=0x7f573806a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:35.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.967+0000 7f5736ffd640 1 -- 172.21.15.161:0/4044993330 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990261117 0 0) 0x7f5738071e60 con 0x7f5738141b70 2024-02-02T11:49:35.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.967+0000 7f5737fff640 1 -- 172.21.15.161:0/4044993330 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5738148310 con 0x7f5738147e80 2024-02-02T11:49:35.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.967+0000 7f572effd640 1 --2- 172.21.15.161:0/4044993330 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5738070db0 0x7f5738147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:35.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f5737fff640 1 --2- 172.21.15.161:0/4044993330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5738147e80 0x7f57381520a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f57300097f0 tx=0x7f573001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331261b72b519b95 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:35.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f5736ffd640 1 -- 172.21.15.161:0/4044993330 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57300a8970 con 0x7f5738147e80 2024-02-02T11:49:35.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f5736ffd640 1 -- 172.21.15.161:0/4044993330 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57300a8ad0 con 0x7f5738147e80 2024-02-02T11:49:35.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f5736ffd640 1 -- 172.21.15.161:0/4044993330 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57300a8e60 con 0x7f5738147e80 2024-02-02T11:49:35.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f573e1d9640 1 -- 172.21.15.161:0/4044993330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5738147e80 msgr2=0x7f57381520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:35.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f573e1d9640 1 --2- 172.21.15.161:0/4044993330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5738147e80 0x7f57381520a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f57300097f0 tx=0x7f573001ec70 comp rx=0 tx=0).stop 2024-02-02T11:49:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f573e1d9640 1 -- 172.21.15.161:0/4044993330 shutdown_connections 2024-02-02T11:49:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f573e1d9640 1 --2- 172.21.15.161:0/4044993330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5738147e80 0x7f57381520a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f573e1d9640 1 --2- 172.21.15.161:0/4044993330 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5738070db0 0x7f5738147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f573e1d9640 1 -- 172.21.15.161:0/4044993330 >> 172.21.15.161:0/4044993330 conn(0x7f5738069d20 msgr2=0x7f573806a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f573e1d9640 1 -- 172.21.15.161:0/4044993330 shutdown_connections 2024-02-02T11:49:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f573e1d9640 1 -- 172.21.15.161:0/4044993330 wait complete. 2024-02-02T11:49:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f573e1d9640 1 Processor -- start 2024-02-02T11:49:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f573e1d9640 1 -- start start 2024-02-02T11:49:35.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f573e1d9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5738070db0 0x7f573814a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:35.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f573e1d9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5738141b70 0x7f57380b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:35.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f573e1d9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5738147e80 0x7f57380b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:35.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f573e1d9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57381df410 con 0x7f5738070db0 2024-02-02T11:49:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f573e1d9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57381deae0 con 0x7f5738147e80 2024-02-02T11:49:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f573e1d9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57381dedc0 con 0x7f5738141b70 2024-02-02T11:49:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f57377fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5738070db0 0x7f573814a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f57377fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5738070db0 0x7f573814a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35048/0 (socket says 172.21.15.161:35048) 2024-02-02T11:49:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f57377fe640 1 -- 172.21.15.161:0/2795433613 learned_addr learned my addr 172.21.15.161:0/2795433613 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f57377fe640 1 -- 172.21.15.161:0/2795433613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5738141b70 msgr2=0x7f57380b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f57377fe640 1 --2- 172.21.15.161:0/2795433613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5738141b70 0x7f57380b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f57377fe640 1 -- 172.21.15.161:0/2795433613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5738147e80 msgr2=0x7f57380b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f57377fe640 1 --2- 172.21.15.161:0/2795433613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5738147e80 0x7f57380b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f57377fe640 1 -- 172.21.15.161:0/2795433613 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5730009420 con 0x7f5738070db0 2024-02-02T11:49:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f57377fe640 1 --2- 172.21.15.161:0/2795433613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5738070db0 0x7f573814a6b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5728001570 tx=0x7f572800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f5734ff9640 1 -- 172.21.15.161:0/2795433613 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572800a640 con 0x7f5738070db0 2024-02-02T11:49:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f5734ff9640 1 -- 172.21.15.161:0/2795433613 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572800a7c0 con 0x7f5738070db0 2024-02-02T11:49:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f573e1d9640 1 -- 172.21.15.161:0/2795433613 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57381df0a0 con 0x7f5738070db0 2024-02-02T11:49:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f5734ff9640 1 -- 172.21.15.161:0/2795433613 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572800ab70 con 0x7f5738070db0 2024-02-02T11:49:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.971+0000 7f573e1d9640 1 -- 172.21.15.161:0/2795433613 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573814abf0 con 0x7f5738070db0 2024-02-02T11:49:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.975+0000 7f573e1d9640 1 -- 172.21.15.161:0/2795433613 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573804e000 con 0x7f5738070db0 2024-02-02T11:49:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.975+0000 7f5734ff9640 1 -- 172.21.15.161:0/2795433613 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f572800acd0 con 0x7f5738070db0 2024-02-02T11:49:35.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.975+0000 7f5734ff9640 1 --2- 172.21.15.161:0/2795433613 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f5718065a60 0x7f5718067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:35.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.975+0000 7f572effd640 1 --2- 172.21.15.161:0/2795433613 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f5718065a60 0x7f5718067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:35.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.975+0000 7f5734ff9640 1 -- 172.21.15.161:0/2795433613 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5728082ad0 con 0x7f5738070db0 2024-02-02T11:49:35.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.975+0000 7f572effd640 1 --2- 172.21.15.161:0/2795433613 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f5718065a60 0x7f5718067f20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f573806af20 tx=0x7f5720008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:35.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:35.979+0000 7f5734ff9640 1 -- 172.21.15.161:0/2795433613 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5728050400 con 0x7f5738070db0 2024-02-02T11:49:36.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.119+0000 7f573e1d9640 1 -- 172.21.15.161:0/2795433613 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f57381dec50 con 0x7f5718065a60 2024-02-02T11:49:36.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.135+0000 7f5734ff9640 1 -- 172.21.15.161:0/2795433613 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249831 (secure 0 0 0) 0x7f57381dec50 con 0x7f5718065a60 2024-02-02T11:49:36.141 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:36.142 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-02-02T11:49:36.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.139+0000 7f573e1d9640 1 -- 172.21.15.161:0/2795433613 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f5718065a60 msgr2=0x7f5718067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:36.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.139+0000 7f573e1d9640 1 --2- 172.21.15.161:0/2795433613 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f5718065a60 0x7f5718067f20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f573806af20 tx=0x7f5720008040 comp rx=0 tx=0).stop 2024-02-02T11:49:36.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.139+0000 7f573e1d9640 1 -- 172.21.15.161:0/2795433613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5738070db0 msgr2=0x7f573814a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:36.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.139+0000 7f573e1d9640 1 --2- 172.21.15.161:0/2795433613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5738070db0 0x7f573814a6b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5728001570 tx=0x7f572800cd20 comp rx=0 tx=0).stop 2024-02-02T11:49:36.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.139+0000 7f573e1d9640 1 -- 172.21.15.161:0/2795433613 shutdown_connections 2024-02-02T11:49:36.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.139+0000 7f573e1d9640 1 --2- 172.21.15.161:0/2795433613 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f5718065a60 0x7f5718067f20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.139+0000 7f573e1d9640 1 --2- 172.21.15.161:0/2795433613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5738147e80 0x7f57380b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.139+0000 7f573e1d9640 1 --2- 172.21.15.161:0/2795433613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5738141b70 0x7f57380b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.139+0000 7f573e1d9640 1 --2- 172.21.15.161:0/2795433613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5738070db0 0x7f573814a6b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.139+0000 7f573e1d9640 1 -- 172.21.15.161:0/2795433613 >> 172.21.15.161:0/2795433613 conn(0x7f5738069d20 msgr2=0x7f57380b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:36.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.139+0000 7f573e1d9640 1 -- 172.21.15.161:0/2795433613 shutdown_connections 2024-02-02T11:49:36.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.139+0000 7f573e1d9640 1 -- 172.21.15.161:0/2795433613 wait complete. 2024-02-02T11:49:36.157 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-02-02T11:49:34.264187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":223760,"kb_used_data":3496,"kb_used_omap":13,"kb_used_meta":220146,"kb_avail":754750960,"statfs":{"total":773094113280,"available":772864983040,"internally_reserved":0,"allocated":3579904,"data_stored":2053560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225429592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":75,"apply_latency_ms":75,"commit_latency_ns":75000000,"apply_latency_ns":75000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000747"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:31.448976+0000","last_change":"2024-02-02T11:49:31.448976+0000","last_active":"2024-02-02T11:49:31.448976+0000","last_peered":"2024-02-02T11:49:31.448976+0000","last_clean":"2024-02-02T11:49:31.448976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:31.448976+0000","last_undegraded":"2024-02-02T11:49:31.448976+0000","last_fullsized":"2024-02-02T11:49:31.448976+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-02T11:49:30.435253+0000","last_change":"2024-02-02T11:49:30.435253+0000","last_active":"2024-02-02T11:49:30.435253+0000","last_peered":"2024-02-02T11:49:30.435253+0000","last_clean":"2024-02-02T11:49:30.435253+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-02T11:49:30.435253+0000","last_undegraded":"2024-02-02T11:49:30.435253+0000","last_fullsized":"2024-02-02T11:49:30.435253+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-02-02T11:49:24.490920+0000","last_change":"2024-02-02T11:48:41.563754+0000","last_active":"2024-02-02T11:49:24.490920+0000","last_peered":"2024-02-02T11:49:24.490920+0000","last_clean":"2024-02-02T11:49:24.490920+0000","last_became_active":"2024-02-02T11:48:41.562629+0000","last_became_peered":"2024-02-02T11:48:41.562629+0000","last_unstale":"2024-02-02T11:49:24.490920+0000","last_undegraded":"2024-02-02T11:49:24.490920+0000","last_fullsized":"2024-02-02T11:49:24.490920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_clean_scrub_stamp":"2024-02-02T11:48:40.536978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:22:02.923582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":699471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.639}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.714}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31408,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":699471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-02T11:49:36.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-02-02T11:49:36.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-02-02T11:49:36.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-02-02T11:49:36.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-02-02T11:49:36.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-02-02T11:49:36.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-02-02T11:49:36.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-02-02T11:49:36.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-02-02T11:49:36.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-02-02T11:49:36.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-02-02T11:49:36.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-02-02T11:49:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-02-02T11:49:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-02-02T11:49:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-02-02T11:49:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-02-02T11:49:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-02-02T11:49:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-02-02T11:49:36.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-02-02T11:49:36.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-02-02T11:49:36.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-02-02T11:49:36.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-02-02T11:49:36.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-02-02T11:49:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-02-02T11:49:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-02-02T11:49:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-02-02T11:49:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-02-02T11:49:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-02-02T11:49:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-02-02T11:49:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-02-02T11:49:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-02-02T11:49:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-02-02T11:49:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-02-02T11:49:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-02-02T11:49:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-02-02T11:49:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-02-02T11:49:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-02-02T11:49:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-02-02T11:49:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-02-02T11:49:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-02-02T11:49:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-02-02T11:49:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-02-02T11:49:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-02-02T11:49:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-02-02T11:49:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-02-02T11:49:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-02-02T11:49:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-02-02T11:49:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-02-02T11:49:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-02-02T11:49:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-02-02T11:49:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-02-02T11:49:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-02-02T11:49:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-02-02T11:49:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-02-02T11:49:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-02-02T11:49:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-02-02T11:49:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-02-02T11:49:36.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-02-02T11:49:36.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-02-02T11:49:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-02-02T11:49:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-02-02T11:49:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-02-02T11:49:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-02-02T11:49:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-02-02T11:49:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-02-02T11:49:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-02-02T11:49:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-02-02T11:49:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-02-02T11:49:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-02-02T11:49:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-02-02T11:49:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-02-02T11:49:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-02-02T11:49:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-02-02T11:49:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-02-02T11:49:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-02-02T11:49:36.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-02-02T11:49:36.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-02-02T11:49:36.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-02-02T11:49:36.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-02-02T11:49:36.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-02-02T11:49:36.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-02-02T11:49:36.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-02-02T11:49:36.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-02-02T11:49:36.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-02-02T11:49:36.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-02-02T11:49:36.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-02-02T11:49:36.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-02-02T11:49:36.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-02-02T11:49:36.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-02-02T11:49:36.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-02-02T11:49:36.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-02-02T11:49:36.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-02-02T11:49:36.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-02-02T11:49:36.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-02-02T11:49:36.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-02-02T11:49:36.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-02-02T11:49:36.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:31.448976+0000', 'last_change': '2024-02-02T11:49:31.448976+0000', 'last_active': '2024-02-02T11:49:31.448976+0000', 'last_peered': '2024-02-02T11:49:31.448976+0000', 'last_clean': '2024-02-02T11:49:31.448976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:31.448976+0000', 'last_undegraded': '2024-02-02T11:49:31.448976+0000', 'last_fullsized': '2024-02-02T11:49:31.448976+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:31.448976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-02-02T11:49:36.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-02T11:49:30.435253+0000', 'last_change': '2024-02-02T11:49:30.435253+0000', 'last_active': '2024-02-02T11:49:30.435253+0000', 'last_peered': '2024-02-02T11:49:30.435253+0000', 'last_clean': '2024-02-02T11:49:30.435253+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-02T11:49:30.435253+0000', 'last_undegraded': '2024-02-02T11:49:30.435253+0000', 'last_fullsized': '2024-02-02T11:49:30.435253+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'last_clean_scrub_stamp': '2024-02-02T11:49:30.435253+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-02T11:49:36.183 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-02-02T11:49:36.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.311+0000 7f414c158640 1 Processor -- start 2024-02-02T11:49:36.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.311+0000 7f414c158640 1 -- start start 2024-02-02T11:49:36.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.311+0000 7f414c158640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4144144ea0 0x7f4144070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:36.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.311+0000 7f414c158640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f414414b540 0x7f41441554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:36.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.311+0000 7f414c158640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414406cdc0 con 0x7f41440b8ad0 2024-02-02T11:49:36.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.311+0000 7f414c158640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414406ee40 con 0x7f414414b540 2024-02-02T11:49:36.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.311+0000 7f414c158640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414406c490 con 0x7f4144144ea0 2024-02-02T11:49:36.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.311+0000 7f41496f3640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f41440b8ad0 0x7f414414ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:45044/0 (socket says 172.21.15.161:45044) 2024-02-02T11:49:36.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.311+0000 7f41496f3640 1 -- 172.21.15.161:0/2578846940 learned_addr learned my addr 172.21.15.161:0/2578846940 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:36.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.311+0000 7f414a6f5640 1 --2- 172.21.15.161:0/2578846940 >> v2:172.21.15.161:3300/0 conn(0x7f414414b540 0x7f41441554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:36.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.311+0000 7f4149ef4640 1 --2- 172.21.15.161:0/2578846940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4144144ea0 0x7f4144070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:36.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.311+0000 7f4148ef2640 1 -- 172.21.15.161:0/2578846940 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846740136 0 0) 0x7f414406cdc0 con 0x7f41440b8ad0 2024-02-02T11:49:36.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.311+0000 7f4148ef2640 1 -- 172.21.15.161:0/2578846940 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4130003530 con 0x7f41440b8ad0 2024-02-02T11:49:36.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.311+0000 7f414a6f5640 1 -- 172.21.15.161:0/2578846940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4144144ea0 msgr2=0x7f4144070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:36.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.311+0000 7f414a6f5640 1 --2- 172.21.15.161:0/2578846940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4144144ea0 0x7f4144070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.311+0000 7f414a6f5640 1 -- 172.21.15.161:0/2578846940 >> v1:172.21.15.161:6789/0 conn(0x7f41440b8ad0 legacy=0x7f414414ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:36.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.311+0000 7f414a6f5640 1 -- 172.21.15.161:0/2578846940 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414406c770 con 0x7f414414b540 2024-02-02T11:49:36.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.315+0000 7f414a6f5640 1 --2- 172.21.15.161:0/2578846940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f414414b540 0x7f41441554e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f413c009d90 tx=0x7f413c01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ef4087fd309023 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:36.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.315+0000 7f4148ef2640 1 -- 172.21.15.161:0/2578846940 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c0af600 con 0x7f414414b540 2024-02-02T11:49:36.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.315+0000 7f4148ef2640 1 -- 172.21.15.161:0/2578846940 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c0ab050 con 0x7f414414b540 2024-02-02T11:49:36.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.315+0000 7f4148ef2640 1 -- 172.21.15.161:0/2578846940 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c0af980 con 0x7f414414b540 2024-02-02T11:49:36.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.315+0000 7f414c158640 1 -- 172.21.15.161:0/2578846940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f414414b540 msgr2=0x7f41441554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:36.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.315+0000 7f414c158640 1 --2- 172.21.15.161:0/2578846940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f414414b540 0x7f41441554e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f413c009d90 tx=0x7f413c01f130 comp rx=0 tx=0).stop 2024-02-02T11:49:36.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.315+0000 7f414c158640 1 -- 172.21.15.161:0/2578846940 shutdown_connections 2024-02-02T11:49:36.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.315+0000 7f414c158640 1 --2- 172.21.15.161:0/2578846940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f414414b540 0x7f41441554e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.315+0000 7f414c158640 1 --2- 172.21.15.161:0/2578846940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4144144ea0 0x7f4144070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.315+0000 7f414c158640 1 -- 172.21.15.161:0/2578846940 >> 172.21.15.161:0/2578846940 conn(0x7f41440be150 msgr2=0x7f41440be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:36.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.315+0000 7f414c158640 1 -- 172.21.15.161:0/2578846940 shutdown_connections 2024-02-02T11:49:36.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.315+0000 7f414c158640 1 -- 172.21.15.161:0/2578846940 wait complete. 2024-02-02T11:49:36.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.315+0000 7f414c158640 1 Processor -- start 2024-02-02T11:49:36.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.315+0000 7f414c158640 1 -- start start 2024-02-02T11:49:36.321 INFO:tasks.ceph.mds.c.smithi161.stderr:2024-02-02T11:49:36.315+0000 7f9bda090640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-02T11:49:36.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f414c158640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41440b8ad0 0x7f4144143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:36.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f414c158640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4144144ea0 0x7f4144144230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:36.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f414c158640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f414414b540 0x7f41441397d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:36.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f414c158640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4144144770 con 0x7f41440b8ad0 2024-02-02T11:49:36.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f414c158640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414413fd00 con 0x7f4144144ea0 2024-02-02T11:49:36.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f414c158640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4144140df0 con 0x7f414414b540 2024-02-02T11:49:36.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f4149ef4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41440b8ad0 0x7f4144143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:36.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f4149ef4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41440b8ad0 0x7f4144143a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35066/0 (socket says 172.21.15.161:35066) 2024-02-02T11:49:36.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f4149ef4640 1 -- 172.21.15.161:0/2583971407 learned_addr learned my addr 172.21.15.161:0/2583971407 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:36.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f414a6f5640 1 --2- 172.21.15.161:0/2583971407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f414414b540 0x7f41441397d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:36.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f41496f3640 1 --2- 172.21.15.161:0/2583971407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4144144ea0 0x7f4144144230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:36.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f4149ef4640 1 -- 172.21.15.161:0/2583971407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f414414b540 msgr2=0x7f41441397d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:36.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f4149ef4640 1 --2- 172.21.15.161:0/2583971407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f414414b540 0x7f41441397d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f4149ef4640 1 -- 172.21.15.161:0/2583971407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4144144ea0 msgr2=0x7f4144144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:36.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f4149ef4640 1 --2- 172.21.15.161:0/2583971407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4144144ea0 0x7f4144144230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f4149ef4640 1 -- 172.21.15.161:0/2583971407 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c009a70 con 0x7f41440b8ad0 2024-02-02T11:49:36.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f4149ef4640 1 --2- 172.21.15.161:0/2583971407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41440b8ad0 0x7f4144143a10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f414000e960 tx=0x7f414000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:36.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f413a7fc640 1 -- 172.21.15.161:0/2583971407 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140009690 con 0x7f41440b8ad0 2024-02-02T11:49:36.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f413a7fc640 1 -- 172.21.15.161:0/2583971407 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414000ca00 con 0x7f41440b8ad0 2024-02-02T11:49:36.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f414c158640 1 -- 172.21.15.161:0/2583971407 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41441404c0 con 0x7f41440b8ad0 2024-02-02T11:49:36.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f413a7fc640 1 -- 172.21.15.161:0/2583971407 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414000cd70 con 0x7f41440b8ad0 2024-02-02T11:49:36.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f414c158640 1 -- 172.21.15.161:0/2583971407 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4144140a80 con 0x7f41440b8ad0 2024-02-02T11:49:36.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f414c158640 1 -- 172.21.15.161:0/2583971407 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41440713c0 con 0x7f41440b8ad0 2024-02-02T11:49:36.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f413a7fc640 1 -- 172.21.15.161:0/2583971407 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4140013470 con 0x7f41440b8ad0 2024-02-02T11:49:36.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f413a7fc640 1 --2- 172.21.15.161:0/2583971407 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4128065a60 0x7f4128067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:36.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f41496f3640 1 --2- 172.21.15.161:0/2583971407 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4128065a60 0x7f4128067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:36.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f413a7fc640 1 -- 172.21.15.161:0/2583971407 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41400833a0 con 0x7f41440b8ad0 2024-02-02T11:49:36.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.319+0000 7f41496f3640 1 --2- 172.21.15.161:0/2583971407 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4128065a60 0x7f4128067f20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4144143f50 tx=0x7f4134009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:36.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.323+0000 7f413a7fc640 1 -- 172.21.15.161:0/2583971407 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4140050d50 con 0x7f41440b8ad0 2024-02-02T11:49:36.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.519+0000 7f414c158640 1 -- 172.21.15.161:0/2583971407 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f414404e000 con 0x7f41440b8ad0 2024-02-02T11:49:36.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.523+0000 7f413a7fc640 1 -- 172.21.15.161:0/2583971407 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2495 (secure 0 0 0) 0x7f41400179d0 con 0x7f41440b8ad0 2024-02-02T11:49:36.525 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:36.525 INFO:teuthology.orchestra.run.smithi161.stdout:{"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":68,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":31,"num_osds":8,"num_up_osds":8,"osd_up_since":1706874519,"num_in_osds":8,"osd_in_since":1706874509,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":229613568,"bytes_avail":772864499712,"bytes_total":773094113280,"write_bytes_sec":2466,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":14,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4932}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-02-02T11:49:34.264292+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-02-02T11:49:36.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.523+0000 7f414c158640 1 -- 172.21.15.161:0/2583971407 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4128065a60 msgr2=0x7f4128067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:36.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.523+0000 7f414c158640 1 --2- 172.21.15.161:0/2583971407 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4128065a60 0x7f4128067f20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4144143f50 tx=0x7f4134009040 comp rx=0 tx=0).stop 2024-02-02T11:49:36.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.523+0000 7f414c158640 1 -- 172.21.15.161:0/2583971407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41440b8ad0 msgr2=0x7f4144143a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:36.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.523+0000 7f414c158640 1 --2- 172.21.15.161:0/2583971407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41440b8ad0 0x7f4144143a10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f414000e960 tx=0x7f414000ee20 comp rx=0 tx=0).stop 2024-02-02T11:49:36.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.523+0000 7f414c158640 1 -- 172.21.15.161:0/2583971407 shutdown_connections 2024-02-02T11:49:36.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.523+0000 7f414c158640 1 --2- 172.21.15.161:0/2583971407 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4128065a60 0x7f4128067f20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.523+0000 7f414c158640 1 --2- 172.21.15.161:0/2583971407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f414414b540 0x7f41441397d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.523+0000 7f414c158640 1 --2- 172.21.15.161:0/2583971407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4144144ea0 0x7f4144144230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.523+0000 7f414c158640 1 --2- 172.21.15.161:0/2583971407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41440b8ad0 0x7f4144143a10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.523+0000 7f414c158640 1 -- 172.21.15.161:0/2583971407 >> 172.21.15.161:0/2583971407 conn(0x7f41440be150 msgr2=0x7f41440b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:36.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.523+0000 7f414c158640 1 -- 172.21.15.161:0/2583971407 shutdown_connections 2024-02-02T11:49:36.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.523+0000 7f414c158640 1 -- 172.21.15.161:0/2583971407 wait complete. 2024-02-02T11:49:36.542 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-02-02T11:49:36.542 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-02T11:49:36.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.659+0000 7fd7777a4640 1 Processor -- start 2024-02-02T11:49:36.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.659+0000 7fd7777a4640 1 -- start start 2024-02-02T11:49:36.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.659+0000 7fd7777a4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd770144ea0 0x7fd770070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:36.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.659+0000 7fd7777a4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd7700b8ad0 0x7fd77014ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:36.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.659+0000 7fd7777a4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd77006cdc0 con 0x7fd77014b370 2024-02-02T11:49:36.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.659+0000 7fd7777a4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd77006ee40 con 0x7fd7700b8ad0 2024-02-02T11:49:36.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.659+0000 7fd7777a4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77014b7c0 con 0x7fd770144ea0 2024-02-02T11:49:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.659+0000 7fd774d3f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd7700b8ad0 0x7fd77014ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.659+0000 7fd775540640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd770144ea0 0x7fd770070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.659+0000 7fd775540640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd770144ea0 0x7fd770070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.161:48142/0 (socket says 172.21.15.161:48142) 2024-02-02T11:49:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.659+0000 7fd775540640 1 -- 172.21.15.161:0/326698317 learned_addr learned my addr 172.21.15.161:0/326698317 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.659+0000 7fd775d41640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fd77014b370 0x7fd77014e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.161:55310/0 (socket says 172.21.15.161:55310) 2024-02-02T11:49:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.659+0000 7fd775540640 1 -- 172.21.15.161:0/326698317 >> v2:172.21.15.162:3300/0 conn(0x7fd7700b8ad0 msgr2=0x7fd77014ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.659+0000 7fd775540640 1 --2- 172.21.15.161:0/326698317 >> v2:172.21.15.162:3300/0 conn(0x7fd7700b8ad0 0x7fd77014ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.659+0000 7fd775540640 1 -- 172.21.15.161:0/326698317 >> v1:172.21.15.162:6789/0 conn(0x7fd77014b370 legacy=0x7fd77014e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.663+0000 7fd775540640 1 -- 172.21.15.161:0/326698317 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77006c490 con 0x7fd770144ea0 2024-02-02T11:49:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.663+0000 7fd775540640 1 --2- 172.21.15.161:0/326698317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd770144ea0 0x7fd770070f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd760009870 tx=0x7fd76001ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c5a058a62dd30ec server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.663+0000 7fd767fff640 1 -- 172.21.15.161:0/326698317 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7600a8a30 con 0x7fd770144ea0 2024-02-02T11:49:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.663+0000 7fd767fff640 1 -- 172.21.15.161:0/326698317 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7600a8b90 con 0x7fd770144ea0 2024-02-02T11:49:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.663+0000 7fd767fff640 1 -- 172.21.15.161:0/326698317 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7600b0440 con 0x7fd770144ea0 2024-02-02T11:49:36.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.663+0000 7fd7777a4640 1 -- 172.21.15.161:0/326698317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd770144ea0 msgr2=0x7fd770070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:36.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.663+0000 7fd7777a4640 1 --2- 172.21.15.161:0/326698317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd770144ea0 0x7fd770070f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd760009870 tx=0x7fd76001ed30 comp rx=0 tx=0).stop 2024-02-02T11:49:36.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.663+0000 7fd7777a4640 1 -- 172.21.15.161:0/326698317 shutdown_connections 2024-02-02T11:49:36.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.663+0000 7fd7777a4640 1 --2- 172.21.15.161:0/326698317 >> v2:172.21.15.162:3300/0 conn(0x7fd7700b8ad0 0x7fd77014ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.663+0000 7fd7777a4640 1 --2- 172.21.15.161:0/326698317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd770144ea0 0x7fd770070f00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.663+0000 7fd7777a4640 1 -- 172.21.15.161:0/326698317 >> 172.21.15.161:0/326698317 conn(0x7fd7700be150 msgr2=0x7fd7700be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:36.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.663+0000 7fd7777a4640 1 -- 172.21.15.161:0/326698317 shutdown_connections 2024-02-02T11:49:36.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.663+0000 7fd7777a4640 1 -- 172.21.15.161:0/326698317 wait complete. 2024-02-02T11:49:36.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd7777a4640 1 Processor -- start 2024-02-02T11:49:36.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd7777a4640 1 -- start start 2024-02-02T11:49:36.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd7777a4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7700b8ad0 0x7fd770142780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:36.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd7777a4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd770144ea0 0x7fd770143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:36.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd7777a4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd77014b370 0x7fd7701e02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd7777a4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7701447a0 con 0x7fd770144ea0 2024-02-02T11:49:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd7777a4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd770142cc0 con 0x7fd77014b370 2024-02-02T11:49:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd7777a4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77013fd40 con 0x7fd7700b8ad0 2024-02-02T11:49:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd774d3f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd770144ea0 0x7fd770143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd774d3f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd770144ea0 0x7fd770143640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35072/0 (socket says 172.21.15.161:35072) 2024-02-02T11:49:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd774d3f640 1 -- 172.21.15.161:0/546515079 learned_addr learned my addr 172.21.15.161:0/546515079 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd775540640 1 --2- 172.21.15.161:0/546515079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7700b8ad0 0x7fd770142780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd775d41640 1 --2- 172.21.15.161:0/546515079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd77014b370 0x7fd7701e02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd774d3f640 1 -- 172.21.15.161:0/546515079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7700b8ad0 msgr2=0x7fd770142780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd774d3f640 1 --2- 172.21.15.161:0/546515079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7700b8ad0 0x7fd770142780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd774d3f640 1 -- 172.21.15.161:0/546515079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd77014b370 msgr2=0x7fd7701e02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd774d3f640 1 --2- 172.21.15.161:0/546515079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd77014b370 0x7fd7701e02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd774d3f640 1 -- 172.21.15.161:0/546515079 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7600094d0 con 0x7fd770144ea0 2024-02-02T11:49:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd775540640 1 --2- 172.21.15.161:0/546515079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7700b8ad0 0x7fd770142780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:49:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd774d3f640 1 --2- 172.21.15.161:0/546515079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd770144ea0 0x7fd770143640 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00e930 tx=0x7fd76c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd765ffb640 1 -- 172.21.15.161:0/546515079 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c009690 con 0x7fd770144ea0 2024-02-02T11:49:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd765ffb640 1 -- 172.21.15.161:0/546515079 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c00ca00 con 0x7fd770144ea0 2024-02-02T11:49:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd765ffb640 1 -- 172.21.15.161:0/546515079 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c00cd70 con 0x7fd770144ea0 2024-02-02T11:49:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd7777a4640 1 -- 172.21.15.161:0/546515079 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd770144220 con 0x7fd770144ea0 2024-02-02T11:49:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd7777a4640 1 -- 172.21.15.161:0/546515079 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77013fa60 con 0x7fd770144ea0 2024-02-02T11:49:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd7777a4640 1 -- 172.21.15.161:0/546515079 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd770071a20 con 0x7fd770144ea0 2024-02-02T11:49:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.667+0000 7fd765ffb640 1 -- 172.21.15.161:0/546515079 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd76c013470 con 0x7fd770144ea0 2024-02-02T11:49:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.671+0000 7fd765ffb640 1 --2- 172.21.15.161:0/546515079 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd754065a60 0x7fd754067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.671+0000 7fd765ffb640 1 -- 172.21.15.161:0/546515079 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd76c083410 con 0x7fd770144ea0 2024-02-02T11:49:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.671+0000 7fd775540640 1 --2- 172.21.15.161:0/546515079 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd754065a60 0x7fd754067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.671+0000 7fd775540640 1 --2- 172.21.15.161:0/546515079 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd754065a60 0x7fd754067f20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd7600b2000 tx=0x7fd760008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:36.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.675+0000 7fd765ffb640 1 -- 172.21.15.161:0/546515079 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd76c050e90 con 0x7fd770144ea0 2024-02-02T11:49:36.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.823+0000 7fd7777a4640 1 -- 172.21.15.161:0/546515079 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd77006ca50 con 0x7fd754065a60 2024-02-02T11:49:36.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.835+0000 7fd765ffb640 1 -- 172.21.15.161:0/546515079 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264550 (secure 0 0 0) 0x7fd7600a8830 con 0x7fd754065a60 2024-02-02T11:49:36.843 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:36.845 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-02-02T11:49:36.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.839+0000 7fd7777a4640 1 -- 172.21.15.161:0/546515079 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd754065a60 msgr2=0x7fd754067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:36.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.839+0000 7fd7777a4640 1 --2- 172.21.15.161:0/546515079 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd754065a60 0x7fd754067f20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd7600b2000 tx=0x7fd760008040 comp rx=0 tx=0).stop 2024-02-02T11:49:36.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.839+0000 7fd7777a4640 1 -- 172.21.15.161:0/546515079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd770144ea0 msgr2=0x7fd770143640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:36.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.839+0000 7fd7777a4640 1 --2- 172.21.15.161:0/546515079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd770144ea0 0x7fd770143640 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00e930 tx=0x7fd76c00edf0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.839+0000 7fd7777a4640 1 -- 172.21.15.161:0/546515079 shutdown_connections 2024-02-02T11:49:36.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.839+0000 7fd7777a4640 1 --2- 172.21.15.161:0/546515079 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd754065a60 0x7fd754067f20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.839+0000 7fd7777a4640 1 --2- 172.21.15.161:0/546515079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd77014b370 0x7fd7701e02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.839+0000 7fd7777a4640 1 --2- 172.21.15.161:0/546515079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd770144ea0 0x7fd770143640 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.839+0000 7fd7777a4640 1 --2- 172.21.15.161:0/546515079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7700b8ad0 0x7fd770142780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:36.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.839+0000 7fd7777a4640 1 -- 172.21.15.161:0/546515079 >> 172.21.15.161:0/546515079 conn(0x7fd7700be150 msgr2=0x7fd7700b96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:36.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.839+0000 7fd7777a4640 1 -- 172.21.15.161:0/546515079 shutdown_connections 2024-02-02T11:49:36.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:36.839+0000 7fd7777a4640 1 -- 172.21.15.161:0/546515079 wait complete. 2024-02-02T11:49:36.861 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-02-02T11:49:36.264830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224232,"kb_used_data":3944,"kb_used_omap":13,"kb_used_meta":220146,"kb_avail":754750488,"statfs":{"total":773094113280,"available":772864499712,"internally_reserved":0,"allocated":4038656,"data_stored":2259556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225429592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.813030"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.095699+0000","last_change":"2024-02-02T11:49:31.883525+0000","last_active":"2024-02-02T11:49:33.095699+0000","last_peered":"2024-02-02T11:49:33.095699+0000","last_clean":"2024-02-02T11:49:33.095699+0000","last_became_active":"2024-02-02T11:49:31.882475+0000","last_became_peered":"2024-02-02T11:49:31.882475+0000","last_unstale":"2024-02-02T11:49:33.095699+0000","last_undegraded":"2024-02-02T11:49:33.095699+0000","last_fullsized":"2024-02-02T11:49:33.095699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:22:13.953661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097702+0000","last_change":"2024-02-02T11:49:31.857136+0000","last_active":"2024-02-02T11:49:33.097702+0000","last_peered":"2024-02-02T11:49:33.097702+0000","last_clean":"2024-02-02T11:49:33.097702+0000","last_became_active":"2024-02-02T11:49:31.856870+0000","last_became_peered":"2024-02-02T11:49:31.856870+0000","last_unstale":"2024-02-02T11:49:33.097702+0000","last_undegraded":"2024-02-02T11:49:33.097702+0000","last_fullsized":"2024-02-02T11:49:33.097702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:42:15.248499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853888+0000","last_change":"2024-02-02T11:49:31.852849+0000","last_active":"2024-02-02T11:49:32.853888+0000","last_peered":"2024-02-02T11:49:32.853888+0000","last_clean":"2024-02-02T11:49:32.853888+0000","last_became_active":"2024-02-02T11:49:31.851154+0000","last_became_peered":"2024-02-02T11:49:31.851154+0000","last_unstale":"2024-02-02T11:49:32.853888+0000","last_undegraded":"2024-02-02T11:49:32.853888+0000","last_fullsized":"2024-02-02T11:49:32.853888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:42:15.248499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852789+0000","last_change":"2024-02-02T11:49:31.890169+0000","last_active":"2024-02-02T11:49:32.852789+0000","last_peered":"2024-02-02T11:49:32.852789+0000","last_clean":"2024-02-02T11:49:32.852789+0000","last_became_active":"2024-02-02T11:49:31.889957+0000","last_became_peered":"2024-02-02T11:49:31.889957+0000","last_unstale":"2024-02-02T11:49:32.852789+0000","last_undegraded":"2024-02-02T11:49:32.852789+0000","last_fullsized":"2024-02-02T11:49:32.852789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:45:16.415767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.098012+0000","last_change":"2024-02-02T11:49:31.856621+0000","last_active":"2024-02-02T11:49:33.098012+0000","last_peered":"2024-02-02T11:49:33.098012+0000","last_clean":"2024-02-02T11:49:33.098012+0000","last_became_active":"2024-02-02T11:49:31.856336+0000","last_became_peered":"2024-02-02T11:49:31.856336+0000","last_unstale":"2024-02-02T11:49:33.098012+0000","last_undegraded":"2024-02-02T11:49:33.098012+0000","last_fullsized":"2024-02-02T11:49:33.098012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:25:20.340862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096843+0000","last_change":"2024-02-02T11:49:31.857165+0000","last_active":"2024-02-02T11:49:33.096843+0000","last_peered":"2024-02-02T11:49:33.096843+0000","last_clean":"2024-02-02T11:49:33.096843+0000","last_became_active":"2024-02-02T11:49:31.856820+0000","last_became_peered":"2024-02-02T11:49:31.856820+0000","last_unstale":"2024-02-02T11:49:33.096843+0000","last_undegraded":"2024-02-02T11:49:33.096843+0000","last_fullsized":"2024-02-02T11:49:33.096843+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:15:24.940080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096209+0000","last_change":"2024-02-02T11:49:31.893089+0000","last_active":"2024-02-02T11:49:33.096209+0000","last_peered":"2024-02-02T11:49:33.096209+0000","last_clean":"2024-02-02T11:49:33.096209+0000","last_became_active":"2024-02-02T11:49:31.892693+0000","last_became_peered":"2024-02-02T11:49:31.892693+0000","last_unstale":"2024-02-02T11:49:33.096209+0000","last_undegraded":"2024-02-02T11:49:33.096209+0000","last_fullsized":"2024-02-02T11:49:33.096209+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:07:37.247129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.095960+0000","last_change":"2024-02-02T11:49:31.882641+0000","last_active":"2024-02-02T11:49:33.095960+0000","last_peered":"2024-02-02T11:49:33.095960+0000","last_clean":"2024-02-02T11:49:33.095960+0000","last_became_active":"2024-02-02T11:49:31.882097+0000","last_became_peered":"2024-02-02T11:49:31.882097+0000","last_unstale":"2024-02-02T11:49:33.095960+0000","last_undegraded":"2024-02-02T11:49:33.095960+0000","last_fullsized":"2024-02-02T11:49:33.095960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:56:37.320994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.855571+0000","last_change":"2024-02-02T11:49:31.888576+0000","last_active":"2024-02-02T11:49:32.855571+0000","last_peered":"2024-02-02T11:49:32.855571+0000","last_clean":"2024-02-02T11:49:32.855571+0000","last_became_active":"2024-02-02T11:49:31.888051+0000","last_became_peered":"2024-02-02T11:49:31.888051+0000","last_unstale":"2024-02-02T11:49:32.855571+0000","last_undegraded":"2024-02-02T11:49:32.855571+0000","last_fullsized":"2024-02-02T11:49:32.855571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:37:23.792881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852980+0000","last_change":"2024-02-02T11:49:31.856618+0000","last_active":"2024-02-02T11:49:32.852980+0000","last_peered":"2024-02-02T11:49:32.852980+0000","last_clean":"2024-02-02T11:49:32.852980+0000","last_became_active":"2024-02-02T11:49:31.856333+0000","last_became_peered":"2024-02-02T11:49:31.856333+0000","last_unstale":"2024-02-02T11:49:32.852980+0000","last_undegraded":"2024-02-02T11:49:32.852980+0000","last_fullsized":"2024-02-02T11:49:32.852980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:35:07.707661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096866+0000","last_change":"2024-02-02T11:49:31.893089+0000","last_active":"2024-02-02T11:49:33.096866+0000","last_peered":"2024-02-02T11:49:33.096866+0000","last_clean":"2024-02-02T11:49:33.096866+0000","last_became_active":"2024-02-02T11:49:31.892515+0000","last_became_peered":"2024-02-02T11:49:31.892515+0000","last_unstale":"2024-02-02T11:49:33.096866+0000","last_undegraded":"2024-02-02T11:49:33.096866+0000","last_fullsized":"2024-02-02T11:49:33.096866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:03:54.652749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853924+0000","last_change":"2024-02-02T11:49:31.863642+0000","last_active":"2024-02-02T11:49:32.853924+0000","last_peered":"2024-02-02T11:49:32.853924+0000","last_clean":"2024-02-02T11:49:32.853924+0000","last_became_active":"2024-02-02T11:49:31.862833+0000","last_became_peered":"2024-02-02T11:49:31.862833+0000","last_unstale":"2024-02-02T11:49:32.853924+0000","last_undegraded":"2024-02-02T11:49:32.853924+0000","last_fullsized":"2024-02-02T11:49:32.853924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:56:37.320994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096215+0000","last_change":"2024-02-02T11:49:31.849297+0000","last_active":"2024-02-02T11:49:33.096215+0000","last_peered":"2024-02-02T11:49:33.096215+0000","last_clean":"2024-02-02T11:49:33.096215+0000","last_became_active":"2024-02-02T11:49:31.849003+0000","last_became_peered":"2024-02-02T11:49:31.849003+0000","last_unstale":"2024-02-02T11:49:33.096215+0000","last_undegraded":"2024-02-02T11:49:33.096215+0000","last_fullsized":"2024-02-02T11:49:33.096215+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:13:33.609511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097094+0000","last_change":"2024-02-02T11:49:31.855012+0000","last_active":"2024-02-02T11:49:33.097094+0000","last_peered":"2024-02-02T11:49:33.097094+0000","last_clean":"2024-02-02T11:49:33.097094+0000","last_became_active":"2024-02-02T11:49:31.854299+0000","last_became_peered":"2024-02-02T11:49:31.854299+0000","last_unstale":"2024-02-02T11:49:33.097094+0000","last_undegraded":"2024-02-02T11:49:33.097094+0000","last_fullsized":"2024-02-02T11:49:33.097094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:43:26.139035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853269+0000","last_change":"2024-02-02T11:49:31.885065+0000","last_active":"2024-02-02T11:49:32.853269+0000","last_peered":"2024-02-02T11:49:32.853269+0000","last_clean":"2024-02-02T11:49:32.853269+0000","last_became_active":"2024-02-02T11:49:31.884657+0000","last_became_peered":"2024-02-02T11:49:31.884657+0000","last_unstale":"2024-02-02T11:49:32.853269+0000","last_undegraded":"2024-02-02T11:49:32.853269+0000","last_fullsized":"2024-02-02T11:49:32.853269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:03:54.652749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096432+0000","last_change":"2024-02-02T11:49:31.894297+0000","last_active":"2024-02-02T11:49:33.096432+0000","last_peered":"2024-02-02T11:49:33.096432+0000","last_clean":"2024-02-02T11:49:33.096432+0000","last_became_active":"2024-02-02T11:49:31.883148+0000","last_became_peered":"2024-02-02T11:49:31.883148+0000","last_unstale":"2024-02-02T11:49:33.096432+0000","last_undegraded":"2024-02-02T11:49:33.096432+0000","last_fullsized":"2024-02-02T11:49:33.096432+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:40:24.432494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097092+0000","last_change":"2024-02-02T11:49:31.892239+0000","last_active":"2024-02-02T11:49:33.097092+0000","last_peered":"2024-02-02T11:49:33.097092+0000","last_clean":"2024-02-02T11:49:33.097092+0000","last_became_active":"2024-02-02T11:49:31.883124+0000","last_became_peered":"2024-02-02T11:49:31.883124+0000","last_unstale":"2024-02-02T11:49:33.097092+0000","last_undegraded":"2024-02-02T11:49:33.097092+0000","last_fullsized":"2024-02-02T11:49:33.097092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:01:34.013934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097826+0000","last_change":"2024-02-02T11:49:31.863784+0000","last_active":"2024-02-02T11:49:33.097826+0000","last_peered":"2024-02-02T11:49:33.097826+0000","last_clean":"2024-02-02T11:49:33.097826+0000","last_became_active":"2024-02-02T11:49:31.863527+0000","last_became_peered":"2024-02-02T11:49:31.863527+0000","last_unstale":"2024-02-02T11:49:33.097826+0000","last_undegraded":"2024-02-02T11:49:33.097826+0000","last_fullsized":"2024-02-02T11:49:33.097826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:17:29.025018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097978+0000","last_change":"2024-02-02T11:49:31.862884+0000","last_active":"2024-02-02T11:49:33.097978+0000","last_peered":"2024-02-02T11:49:33.097978+0000","last_clean":"2024-02-02T11:49:33.097978+0000","last_became_active":"2024-02-02T11:49:31.862525+0000","last_became_peered":"2024-02-02T11:49:31.862525+0000","last_unstale":"2024-02-02T11:49:33.097978+0000","last_undegraded":"2024-02-02T11:49:33.097978+0000","last_fullsized":"2024-02-02T11:49:33.097978+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:36:25.466132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096372+0000","last_change":"2024-02-02T11:49:31.854989+0000","last_active":"2024-02-02T11:49:33.096372+0000","last_peered":"2024-02-02T11:49:33.096372+0000","last_clean":"2024-02-02T11:49:33.096372+0000","last_became_active":"2024-02-02T11:49:31.854706+0000","last_became_peered":"2024-02-02T11:49:31.854706+0000","last_unstale":"2024-02-02T11:49:33.096372+0000","last_undegraded":"2024-02-02T11:49:33.096372+0000","last_fullsized":"2024-02-02T11:49:33.096372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:18:28.615559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853322+0000","last_change":"2024-02-02T11:49:31.887812+0000","last_active":"2024-02-02T11:49:32.853322+0000","last_peered":"2024-02-02T11:49:32.853322+0000","last_clean":"2024-02-02T11:49:32.853322+0000","last_became_active":"2024-02-02T11:49:31.886585+0000","last_became_peered":"2024-02-02T11:49:31.886585+0000","last_unstale":"2024-02-02T11:49:32.853322+0000","last_undegraded":"2024-02-02T11:49:32.853322+0000","last_fullsized":"2024-02-02T11:49:32.853322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:00:34.774216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852957+0000","last_change":"2024-02-02T11:49:31.856800+0000","last_active":"2024-02-02T11:49:32.852957+0000","last_peered":"2024-02-02T11:49:32.852957+0000","last_clean":"2024-02-02T11:49:32.852957+0000","last_became_active":"2024-02-02T11:49:31.856376+0000","last_became_peered":"2024-02-02T11:49:31.856376+0000","last_unstale":"2024-02-02T11:49:32.852957+0000","last_undegraded":"2024-02-02T11:49:32.852957+0000","last_fullsized":"2024-02-02T11:49:32.852957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T17:51:39.814213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096463+0000","last_change":"2024-02-02T11:49:31.876389+0000","last_active":"2024-02-02T11:49:33.096463+0000","last_peered":"2024-02-02T11:49:33.096463+0000","last_clean":"2024-02-02T11:49:33.096463+0000","last_became_active":"2024-02-02T11:49:31.876112+0000","last_became_peered":"2024-02-02T11:49:31.876112+0000","last_unstale":"2024-02-02T11:49:33.096463+0000","last_undegraded":"2024-02-02T11:49:33.096463+0000","last_fullsized":"2024-02-02T11:49:33.096463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:17:38.220781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853200+0000","last_change":"2024-02-02T11:49:31.860612+0000","last_active":"2024-02-02T11:49:32.853200+0000","last_peered":"2024-02-02T11:49:32.853200+0000","last_clean":"2024-02-02T11:49:32.853200+0000","last_became_active":"2024-02-02T11:49:31.860204+0000","last_became_peered":"2024-02-02T11:49:31.860204+0000","last_unstale":"2024-02-02T11:49:32.853200+0000","last_undegraded":"2024-02-02T11:49:32.853200+0000","last_fullsized":"2024-02-02T11:49:32.853200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:07:37.247129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853344+0000","last_change":"2024-02-02T11:49:31.875837+0000","last_active":"2024-02-02T11:49:32.853344+0000","last_peered":"2024-02-02T11:49:32.853344+0000","last_clean":"2024-02-02T11:49:32.853344+0000","last_became_active":"2024-02-02T11:49:31.875509+0000","last_became_peered":"2024-02-02T11:49:31.875509+0000","last_unstale":"2024-02-02T11:49:32.853344+0000","last_undegraded":"2024-02-02T11:49:32.853344+0000","last_fullsized":"2024-02-02T11:49:32.853344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:01:34.013934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097992+0000","last_change":"2024-02-02T11:49:31.866075+0000","last_active":"2024-02-02T11:49:33.097992+0000","last_peered":"2024-02-02T11:49:33.097992+0000","last_clean":"2024-02-02T11:49:33.097992+0000","last_became_active":"2024-02-02T11:49:31.865775+0000","last_became_peered":"2024-02-02T11:49:31.865775+0000","last_unstale":"2024-02-02T11:49:33.097992+0000","last_undegraded":"2024-02-02T11:49:33.097992+0000","last_fullsized":"2024-02-02T11:49:33.097992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:45:16.415767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853315+0000","last_change":"2024-02-02T11:49:31.888258+0000","last_active":"2024-02-02T11:49:32.853315+0000","last_peered":"2024-02-02T11:49:32.853315+0000","last_clean":"2024-02-02T11:49:32.853315+0000","last_became_active":"2024-02-02T11:49:31.888024+0000","last_became_peered":"2024-02-02T11:49:31.888024+0000","last_unstale":"2024-02-02T11:49:32.853315+0000","last_undegraded":"2024-02-02T11:49:32.853315+0000","last_fullsized":"2024-02-02T11:49:32.853315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:40:24.432494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.854171+0000","last_change":"2024-02-02T11:49:31.859800+0000","last_active":"2024-02-02T11:49:32.854171+0000","last_peered":"2024-02-02T11:49:32.854171+0000","last_clean":"2024-02-02T11:49:32.854171+0000","last_became_active":"2024-02-02T11:49:31.859045+0000","last_became_peered":"2024-02-02T11:49:31.859045+0000","last_unstale":"2024-02-02T11:49:32.854171+0000","last_undegraded":"2024-02-02T11:49:32.854171+0000","last_fullsized":"2024-02-02T11:49:32.854171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:43:26.139035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853556+0000","last_change":"2024-02-02T11:49:31.887110+0000","last_active":"2024-02-02T11:49:32.853556+0000","last_peered":"2024-02-02T11:49:32.853556+0000","last_clean":"2024-02-02T11:49:32.853556+0000","last_became_active":"2024-02-02T11:49:31.876962+0000","last_became_peered":"2024-02-02T11:49:31.876962+0000","last_unstale":"2024-02-02T11:49:32.853556+0000","last_undegraded":"2024-02-02T11:49:32.853556+0000","last_fullsized":"2024-02-02T11:49:32.853556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:47:19.733198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.095767+0000","last_change":"2024-02-02T11:49:31.883419+0000","last_active":"2024-02-02T11:49:33.095767+0000","last_peered":"2024-02-02T11:49:33.095767+0000","last_clean":"2024-02-02T11:49:33.095767+0000","last_became_active":"2024-02-02T11:49:31.882602+0000","last_became_peered":"2024-02-02T11:49:31.882602+0000","last_unstale":"2024-02-02T11:49:33.095767+0000","last_undegraded":"2024-02-02T11:49:33.095767+0000","last_fullsized":"2024-02-02T11:49:33.095767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:21:47.033719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.095369+0000","last_change":"2024-02-02T11:49:31.879185+0000","last_active":"2024-02-02T11:49:33.095369+0000","last_peered":"2024-02-02T11:49:33.095369+0000","last_clean":"2024-02-02T11:49:33.095369+0000","last_became_active":"2024-02-02T11:49:31.878494+0000","last_became_peered":"2024-02-02T11:49:31.878494+0000","last_unstale":"2024-02-02T11:49:33.095369+0000","last_undegraded":"2024-02-02T11:49:33.095369+0000","last_fullsized":"2024-02-02T11:49:33.095369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T11:59:44.183855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096007+0000","last_change":"2024-02-02T11:49:31.898339+0000","last_active":"2024-02-02T11:49:33.096007+0000","last_peered":"2024-02-02T11:49:33.096007+0000","last_clean":"2024-02-02T11:49:33.096007+0000","last_became_active":"2024-02-02T11:49:31.897907+0000","last_became_peered":"2024-02-02T11:49:31.897907+0000","last_unstale":"2024-02-02T11:49:33.096007+0000","last_undegraded":"2024-02-02T11:49:33.096007+0000","last_fullsized":"2024-02-02T11:49:33.096007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:03:22.510678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096918+0000","last_change":"2024-02-02T11:49:31.875854+0000","last_active":"2024-02-02T11:49:33.096918+0000","last_peered":"2024-02-02T11:49:33.096918+0000","last_clean":"2024-02-02T11:49:33.096918+0000","last_became_active":"2024-02-02T11:49:31.875537+0000","last_became_peered":"2024-02-02T11:49:31.875537+0000","last_unstale":"2024-02-02T11:49:33.096918+0000","last_undegraded":"2024-02-02T11:49:33.096918+0000","last_fullsized":"2024-02-02T11:49:33.096918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:14:47.389739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096038+0000","last_change":"2024-02-02T11:49:31.493146+0000","last_active":"2024-02-02T11:49:33.096038+0000","last_peered":"2024-02-02T11:49:33.096038+0000","last_clean":"2024-02-02T11:49:33.096038+0000","last_became_active":"2024-02-02T11:49:31.492487+0000","last_became_peered":"2024-02-02T11:49:31.492487+0000","last_unstale":"2024-02-02T11:49:33.096038+0000","last_undegraded":"2024-02-02T11:49:33.096038+0000","last_fullsized":"2024-02-02T11:49:33.096038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:18:27.601836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096004+0000","last_change":"2024-02-02T11:49:31.901256+0000","last_active":"2024-02-02T11:49:33.096004+0000","last_peered":"2024-02-02T11:49:33.096004+0000","last_clean":"2024-02-02T11:49:33.096004+0000","last_became_active":"2024-02-02T11:49:31.900570+0000","last_became_peered":"2024-02-02T11:49:31.900570+0000","last_unstale":"2024-02-02T11:49:33.096004+0000","last_undegraded":"2024-02-02T11:49:33.096004+0000","last_fullsized":"2024-02-02T11:49:33.096004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:06:26.302040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097146+0000","last_change":"2024-02-02T11:49:31.494826+0000","last_active":"2024-02-02T11:49:33.097146+0000","last_peered":"2024-02-02T11:49:33.097146+0000","last_clean":"2024-02-02T11:49:33.097146+0000","last_became_active":"2024-02-02T11:49:31.494294+0000","last_became_peered":"2024-02-02T11:49:31.494294+0000","last_unstale":"2024-02-02T11:49:33.097146+0000","last_undegraded":"2024-02-02T11:49:33.097146+0000","last_fullsized":"2024-02-02T11:49:33.097146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:13:32.595788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.854611+0000","last_change":"2024-02-02T11:49:31.886801+0000","last_active":"2024-02-02T11:49:32.854611+0000","last_peered":"2024-02-02T11:49:32.854611+0000","last_clean":"2024-02-02T11:49:32.854611+0000","last_became_active":"2024-02-02T11:49:31.876810+0000","last_became_peered":"2024-02-02T11:49:31.876810+0000","last_unstale":"2024-02-02T11:49:32.854611+0000","last_undegraded":"2024-02-02T11:49:32.854611+0000","last_fullsized":"2024-02-02T11:49:32.854611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:21:01.002002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.098211+0000","last_change":"2024-02-02T11:49:31.500209+0000","last_active":"2024-02-02T11:49:33.098211+0000","last_peered":"2024-02-02T11:49:33.098211+0000","last_clean":"2024-02-02T11:49:33.098211+0000","last_became_active":"2024-02-02T11:49:31.499878+0000","last_became_peered":"2024-02-02T11:49:31.499878+0000","last_unstale":"2024-02-02T11:49:33.098211+0000","last_undegraded":"2024-02-02T11:49:33.098211+0000","last_fullsized":"2024-02-02T11:49:33.098211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:00:33.760493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853327+0000","last_change":"2024-02-02T11:49:31.888257+0000","last_active":"2024-02-02T11:49:32.853327+0000","last_peered":"2024-02-02T11:49:32.853327+0000","last_clean":"2024-02-02T11:49:32.853327+0000","last_became_active":"2024-02-02T11:49:31.888035+0000","last_became_peered":"2024-02-02T11:49:31.888035+0000","last_unstale":"2024-02-02T11:49:32.853327+0000","last_undegraded":"2024-02-02T11:49:32.853327+0000","last_fullsized":"2024-02-02T11:49:32.853327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:47:19.733198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096588+0000","last_change":"2024-02-02T11:49:31.484809+0000","last_active":"2024-02-02T11:49:33.096588+0000","last_peered":"2024-02-02T11:49:33.096588+0000","last_clean":"2024-02-02T11:49:33.096588+0000","last_became_active":"2024-02-02T11:49:31.484465+0000","last_became_peered":"2024-02-02T11:49:31.484465+0000","last_unstale":"2024-02-02T11:49:33.096588+0000","last_undegraded":"2024-02-02T11:49:33.096588+0000","last_fullsized":"2024-02-02T11:49:33.096588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:19:11.947691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096627+0000","last_change":"2024-02-02T11:49:31.898115+0000","last_active":"2024-02-02T11:49:33.096627+0000","last_peered":"2024-02-02T11:49:33.096627+0000","last_clean":"2024-02-02T11:49:33.096627+0000","last_became_active":"2024-02-02T11:49:31.897616+0000","last_became_peered":"2024-02-02T11:49:31.897616+0000","last_unstale":"2024-02-02T11:49:33.096627+0000","last_undegraded":"2024-02-02T11:49:33.096627+0000","last_fullsized":"2024-02-02T11:49:33.096627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:45:16.415767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853766+0000","last_change":"2024-02-02T11:49:31.487806+0000","last_active":"2024-02-02T11:49:32.853766+0000","last_peered":"2024-02-02T11:49:32.853766+0000","last_clean":"2024-02-02T11:49:32.853766+0000","last_became_active":"2024-02-02T11:49:31.486771+0000","last_became_peered":"2024-02-02T11:49:31.486771+0000","last_unstale":"2024-02-02T11:49:32.853766+0000","last_undegraded":"2024-02-02T11:49:32.853766+0000","last_fullsized":"2024-02-02T11:49:32.853766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:25:19.327139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853482+0000","last_change":"2024-02-02T11:49:31.858253+0000","last_active":"2024-02-02T11:49:32.853482+0000","last_peered":"2024-02-02T11:49:32.853482+0000","last_clean":"2024-02-02T11:49:32.853482+0000","last_became_active":"2024-02-02T11:49:31.857435+0000","last_became_peered":"2024-02-02T11:49:31.857435+0000","last_unstale":"2024-02-02T11:49:32.853482+0000","last_undegraded":"2024-02-02T11:49:32.853482+0000","last_fullsized":"2024-02-02T11:49:32.853482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:03:22.510678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853054+0000","last_change":"2024-02-02T11:49:31.486881+0000","last_active":"2024-02-02T11:49:32.853054+0000","last_peered":"2024-02-02T11:49:32.853054+0000","last_clean":"2024-02-02T11:49:32.853054+0000","last_became_active":"2024-02-02T11:49:31.486234+0000","last_became_peered":"2024-02-02T11:49:31.486234+0000","last_unstale":"2024-02-02T11:49:32.853054+0000","last_undegraded":"2024-02-02T11:49:32.853054+0000","last_fullsized":"2024-02-02T11:49:32.853054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:24.948541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852400+0000","last_change":"2024-02-02T11:49:31.890190+0000","last_active":"2024-02-02T11:49:32.852400+0000","last_peered":"2024-02-02T11:49:32.852400+0000","last_clean":"2024-02-02T11:49:32.852400+0000","last_became_active":"2024-02-02T11:49:31.889677+0000","last_became_peered":"2024-02-02T11:49:31.889677+0000","last_unstale":"2024-02-02T11:49:32.852400+0000","last_undegraded":"2024-02-02T11:49:32.852400+0000","last_fullsized":"2024-02-02T11:49:32.852400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:17:38.220781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097210+0000","last_change":"2024-02-02T11:49:31.478538+0000","last_active":"2024-02-02T11:49:33.097210+0000","last_peered":"2024-02-02T11:49:33.097210+0000","last_clean":"2024-02-02T11:49:33.097210+0000","last_became_active":"2024-02-02T11:49:31.478161+0000","last_became_peered":"2024-02-02T11:49:31.478161+0000","last_unstale":"2024-02-02T11:49:33.097210+0000","last_undegraded":"2024-02-02T11:49:33.097210+0000","last_fullsized":"2024-02-02T11:49:33.097210+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:17:37.207058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852268+0000","last_change":"2024-02-02T11:49:31.857954+0000","last_active":"2024-02-02T11:49:32.852268+0000","last_peered":"2024-02-02T11:49:32.852268+0000","last_clean":"2024-02-02T11:49:32.852268+0000","last_became_active":"2024-02-02T11:49:31.857709+0000","last_became_peered":"2024-02-02T11:49:31.857709+0000","last_unstale":"2024-02-02T11:49:32.852268+0000","last_undegraded":"2024-02-02T11:49:32.852268+0000","last_fullsized":"2024-02-02T11:49:32.852268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T17:51:39.814213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852269+0000","last_change":"2024-02-02T11:49:31.485129+0000","last_active":"2024-02-02T11:49:32.852269+0000","last_peered":"2024-02-02T11:49:32.852269+0000","last_clean":"2024-02-02T11:49:32.852269+0000","last_became_active":"2024-02-02T11:49:31.484812+0000","last_became_peered":"2024-02-02T11:49:31.484812+0000","last_unstale":"2024-02-02T11:49:32.852269+0000","last_undegraded":"2024-02-02T11:49:32.852269+0000","last_fullsized":"2024-02-02T11:49:32.852269+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:01:32.864635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853712+0000","last_change":"2024-02-02T11:49:31.855061+0000","last_active":"2024-02-02T11:49:32.853712+0000","last_peered":"2024-02-02T11:49:32.853712+0000","last_clean":"2024-02-02T11:49:32.853712+0000","last_became_active":"2024-02-02T11:49:31.854223+0000","last_became_peered":"2024-02-02T11:49:31.854223+0000","last_unstale":"2024-02-02T11:49:32.853712+0000","last_undegraded":"2024-02-02T11:49:32.853712+0000","last_fullsized":"2024-02-02T11:49:32.853712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:01:34.013934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.098659+0000","last_change":"2024-02-02T11:49:31.495967+0000","last_active":"2024-02-02T11:49:33.098659+0000","last_peered":"2024-02-02T11:49:33.098659+0000","last_clean":"2024-02-02T11:49:33.098659+0000","last_became_active":"2024-02-02T11:49:31.495534+0000","last_became_peered":"2024-02-02T11:49:31.495534+0000","last_unstale":"2024-02-02T11:49:33.098659+0000","last_undegraded":"2024-02-02T11:49:33.098659+0000","last_fullsized":"2024-02-02T11:49:33.098659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:22:12.939938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.098558+0000","last_change":"2024-02-02T11:49:31.863123+0000","last_active":"2024-02-02T11:49:33.098558+0000","last_peered":"2024-02-02T11:49:33.098558+0000","last_clean":"2024-02-02T11:49:33.098558+0000","last_became_active":"2024-02-02T11:49:31.862684+0000","last_became_peered":"2024-02-02T11:49:31.862684+0000","last_unstale":"2024-02-02T11:49:33.098558+0000","last_undegraded":"2024-02-02T11:49:33.098558+0000","last_fullsized":"2024-02-02T11:49:33.098558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:12:23.305598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097568+0000","last_change":"2024-02-02T11:49:31.489655+0000","last_active":"2024-02-02T11:49:33.097568+0000","last_peered":"2024-02-02T11:49:33.097568+0000","last_clean":"2024-02-02T11:49:33.097568+0000","last_became_active":"2024-02-02T11:49:31.489344+0000","last_became_peered":"2024-02-02T11:49:31.489344+0000","last_unstale":"2024-02-02T11:49:33.097568+0000","last_undegraded":"2024-02-02T11:49:33.097568+0000","last_fullsized":"2024-02-02T11:49:33.097568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T11:59:43.170131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097689+0000","last_change":"2024-02-02T11:49:31.866680+0000","last_active":"2024-02-02T11:49:33.097689+0000","last_peered":"2024-02-02T11:49:33.097689+0000","last_clean":"2024-02-02T11:49:33.097689+0000","last_became_active":"2024-02-02T11:49:31.866402+0000","last_became_peered":"2024-02-02T11:49:31.866402+0000","last_unstale":"2024-02-02T11:49:33.097689+0000","last_undegraded":"2024-02-02T11:49:33.097689+0000","last_fullsized":"2024-02-02T11:49:33.097689+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:01:34.013934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.854135+0000","last_change":"2024-02-02T11:49:31.492974+0000","last_active":"2024-02-02T11:49:32.854135+0000","last_peered":"2024-02-02T11:49:32.854135+0000","last_clean":"2024-02-02T11:49:32.854135+0000","last_became_active":"2024-02-02T11:49:31.491517+0000","last_became_peered":"2024-02-02T11:49:31.491517+0000","last_unstale":"2024-02-02T11:49:32.854135+0000","last_undegraded":"2024-02-02T11:49:32.854135+0000","last_fullsized":"2024-02-02T11:49:32.854135+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:22:12.939938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853652+0000","last_change":"2024-02-02T11:49:31.853448+0000","last_active":"2024-02-02T11:49:32.853652+0000","last_peered":"2024-02-02T11:49:32.853652+0000","last_clean":"2024-02-02T11:49:32.853652+0000","last_became_active":"2024-02-02T11:49:31.852077+0000","last_became_peered":"2024-02-02T11:49:31.852077+0000","last_unstale":"2024-02-02T11:49:32.853652+0000","last_undegraded":"2024-02-02T11:49:32.853652+0000","last_fullsized":"2024-02-02T11:49:32.853652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:12:23.305598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.098240+0000","last_change":"2024-02-02T11:49:31.499503+0000","last_active":"2024-02-02T11:49:33.098240+0000","last_peered":"2024-02-02T11:49:33.098240+0000","last_clean":"2024-02-02T11:49:33.098240+0000","last_became_active":"2024-02-02T11:49:31.499234+0000","last_became_peered":"2024-02-02T11:49:31.499234+0000","last_unstale":"2024-02-02T11:49:33.098240+0000","last_undegraded":"2024-02-02T11:49:33.098240+0000","last_fullsized":"2024-02-02T11:49:33.098240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:56:34.943416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852330+0000","last_change":"2024-02-02T11:49:31.850910+0000","last_active":"2024-02-02T11:49:32.852330+0000","last_peered":"2024-02-02T11:49:32.852330+0000","last_clean":"2024-02-02T11:49:32.852330+0000","last_became_active":"2024-02-02T11:49:31.850653+0000","last_became_peered":"2024-02-02T11:49:31.850653+0000","last_unstale":"2024-02-02T11:49:32.852330+0000","last_undegraded":"2024-02-02T11:49:32.852330+0000","last_fullsized":"2024-02-02T11:49:32.852330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:21:47.033719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853987+0000","last_change":"2024-02-02T11:49:31.487326+0000","last_active":"2024-02-02T11:49:32.853987+0000","last_peered":"2024-02-02T11:49:32.853987+0000","last_clean":"2024-02-02T11:49:32.853987+0000","last_became_active":"2024-02-02T11:49:31.486083+0000","last_became_peered":"2024-02-02T11:49:31.486083+0000","last_unstale":"2024-02-02T11:49:32.853987+0000","last_undegraded":"2024-02-02T11:49:32.853987+0000","last_fullsized":"2024-02-02T11:49:32.853987+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:13:55.748956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097001+0000","last_change":"2024-02-02T11:49:31.861331+0000","last_active":"2024-02-02T11:49:33.097001+0000","last_peered":"2024-02-02T11:49:33.097001+0000","last_clean":"2024-02-02T11:49:33.097001+0000","last_became_active":"2024-02-02T11:49:31.861079+0000","last_became_peered":"2024-02-02T11:49:31.861079+0000","last_unstale":"2024-02-02T11:49:33.097001+0000","last_undegraded":"2024-02-02T11:49:33.097001+0000","last_fullsized":"2024-02-02T11:49:33.097001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:03:22.510678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852491+0000","last_change":"2024-02-02T11:49:31.487348+0000","last_active":"2024-02-02T11:49:32.852491+0000","last_peered":"2024-02-02T11:49:32.852491+0000","last_clean":"2024-02-02T11:49:32.852491+0000","last_became_active":"2024-02-02T11:49:31.486943+0000","last_became_peered":"2024-02-02T11:49:31.486943+0000","last_unstale":"2024-02-02T11:49:32.852491+0000","last_undegraded":"2024-02-02T11:49:32.852491+0000","last_fullsized":"2024-02-02T11:49:32.852491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T11:59:43.170131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096237+0000","last_change":"2024-02-02T11:49:31.900436+0000","last_active":"2024-02-02T11:49:33.096237+0000","last_peered":"2024-02-02T11:49:33.096237+0000","last_clean":"2024-02-02T11:49:33.096237+0000","last_became_active":"2024-02-02T11:49:31.900089+0000","last_became_peered":"2024-02-02T11:49:31.900089+0000","last_unstale":"2024-02-02T11:49:33.096237+0000","last_undegraded":"2024-02-02T11:49:33.096237+0000","last_fullsized":"2024-02-02T11:49:33.096237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:17:49.934776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097392+0000","last_change":"2024-02-02T11:49:31.495975+0000","last_active":"2024-02-02T11:49:33.097392+0000","last_peered":"2024-02-02T11:49:33.097392+0000","last_clean":"2024-02-02T11:49:33.097392+0000","last_became_active":"2024-02-02T11:49:31.495446+0000","last_became_peered":"2024-02-02T11:49:31.495446+0000","last_unstale":"2024-02-02T11:49:33.097392+0000","last_undegraded":"2024-02-02T11:49:33.097392+0000","last_fullsized":"2024-02-02T11:49:33.097392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:06:25.288317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.095632+0000","last_change":"2024-02-02T11:49:31.897290+0000","last_active":"2024-02-02T11:49:33.095632+0000","last_peered":"2024-02-02T11:49:33.095632+0000","last_clean":"2024-02-02T11:49:33.095632+0000","last_became_active":"2024-02-02T11:49:31.896863+0000","last_became_peered":"2024-02-02T11:49:31.896863+0000","last_unstale":"2024-02-02T11:49:33.095632+0000","last_undegraded":"2024-02-02T11:49:33.095632+0000","last_fullsized":"2024-02-02T11:49:33.095632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:00:34.774216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.098254+0000","last_change":"2024-02-02T11:49:31.499965+0000","last_active":"2024-02-02T11:49:33.098254+0000","last_peered":"2024-02-02T11:49:33.098254+0000","last_clean":"2024-02-02T11:49:33.098254+0000","last_became_active":"2024-02-02T11:49:31.499639+0000","last_became_peered":"2024-02-02T11:49:31.499639+0000","last_unstale":"2024-02-02T11:49:33.098254+0000","last_undegraded":"2024-02-02T11:49:33.098254+0000","last_fullsized":"2024-02-02T11:49:33.098254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:14:46.376015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.855473+0000","last_change":"2024-02-02T11:49:31.890503+0000","last_active":"2024-02-02T11:49:32.855473+0000","last_peered":"2024-02-02T11:49:32.855473+0000","last_clean":"2024-02-02T11:49:32.855473+0000","last_became_active":"2024-02-02T11:49:31.889260+0000","last_became_peered":"2024-02-02T11:49:31.889260+0000","last_unstale":"2024-02-02T11:49:32.855473+0000","last_undegraded":"2024-02-02T11:49:32.855473+0000","last_fullsized":"2024-02-02T11:49:32.855473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:14:47.389739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853564+0000","last_change":"2024-02-02T11:49:31.492284+0000","last_active":"2024-02-02T11:49:32.853564+0000","last_peered":"2024-02-02T11:49:32.853564+0000","last_clean":"2024-02-02T11:49:32.853564+0000","last_became_active":"2024-02-02T11:49:31.491689+0000","last_became_peered":"2024-02-02T11:49:31.491689+0000","last_unstale":"2024-02-02T11:49:32.853564+0000","last_undegraded":"2024-02-02T11:49:32.853564+0000","last_fullsized":"2024-02-02T11:49:32.853564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:51:34.520212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.854137+0000","last_change":"2024-02-02T11:49:31.891406+0000","last_active":"2024-02-02T11:49:32.854137+0000","last_peered":"2024-02-02T11:49:32.854137+0000","last_clean":"2024-02-02T11:49:32.854137+0000","last_became_active":"2024-02-02T11:49:31.891020+0000","last_became_peered":"2024-02-02T11:49:31.891020+0000","last_unstale":"2024-02-02T11:49:32.854137+0000","last_undegraded":"2024-02-02T11:49:32.854137+0000","last_fullsized":"2024-02-02T11:49:32.854137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:17:49.934776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.855469+0000","last_change":"2024-02-02T11:49:31.485340+0000","last_active":"2024-02-02T11:49:32.855469+0000","last_peered":"2024-02-02T11:49:32.855469+0000","last_clean":"2024-02-02T11:49:32.855469+0000","last_became_active":"2024-02-02T11:49:31.484754+0000","last_became_peered":"2024-02-02T11:49:31.484754+0000","last_unstale":"2024-02-02T11:49:32.855469+0000","last_undegraded":"2024-02-02T11:49:32.855469+0000","last_fullsized":"2024-02-02T11:49:32.855469+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:18:27.601836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852773+0000","last_change":"2024-02-02T11:49:31.890566+0000","last_active":"2024-02-02T11:49:32.852773+0000","last_peered":"2024-02-02T11:49:32.852773+0000","last_clean":"2024-02-02T11:49:32.852773+0000","last_became_active":"2024-02-02T11:49:31.890275+0000","last_became_peered":"2024-02-02T11:49:31.890275+0000","last_unstale":"2024-02-02T11:49:32.852773+0000","last_undegraded":"2024-02-02T11:49:32.852773+0000","last_fullsized":"2024-02-02T11:49:32.852773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:21:01.002002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.855482+0000","last_change":"2024-02-02T11:49:31.477934+0000","last_active":"2024-02-02T11:49:32.855482+0000","last_peered":"2024-02-02T11:49:32.855482+0000","last_clean":"2024-02-02T11:49:32.855482+0000","last_became_active":"2024-02-02T11:49:31.477117+0000","last_became_peered":"2024-02-02T11:49:31.477117+0000","last_unstale":"2024-02-02T11:49:32.855482+0000","last_undegraded":"2024-02-02T11:49:32.855482+0000","last_fullsized":"2024-02-02T11:49:32.855482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:10:43.049054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096696+0000","last_change":"2024-02-02T11:49:31.865887+0000","last_active":"2024-02-02T11:49:33.096696+0000","last_peered":"2024-02-02T11:49:33.096696+0000","last_clean":"2024-02-02T11:49:33.096696+0000","last_became_active":"2024-02-02T11:49:31.865600+0000","last_became_peered":"2024-02-02T11:49:31.865600+0000","last_unstale":"2024-02-02T11:49:33.096696+0000","last_undegraded":"2024-02-02T11:49:33.096696+0000","last_fullsized":"2024-02-02T11:49:33.096696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:25.962264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.854853+0000","last_change":"2024-02-02T11:49:31.487109+0000","last_active":"2024-02-02T11:49:32.854853+0000","last_peered":"2024-02-02T11:49:32.854853+0000","last_clean":"2024-02-02T11:49:32.854853+0000","last_became_active":"2024-02-02T11:49:31.486293+0000","last_became_peered":"2024-02-02T11:49:31.486293+0000","last_unstale":"2024-02-02T11:49:32.854853+0000","last_undegraded":"2024-02-02T11:49:32.854853+0000","last_fullsized":"2024-02-02T11:49:32.854853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:48:58.293203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096061+0000","last_change":"2024-02-02T11:49:31.878153+0000","last_active":"2024-02-02T11:49:33.096061+0000","last_peered":"2024-02-02T11:49:33.096061+0000","last_clean":"2024-02-02T11:49:33.096061+0000","last_became_active":"2024-02-02T11:49:31.877830+0000","last_became_peered":"2024-02-02T11:49:31.877830+0000","last_unstale":"2024-02-02T11:49:33.096061+0000","last_undegraded":"2024-02-02T11:49:33.096061+0000","last_fullsized":"2024-02-02T11:49:33.096061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:10:44.062778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097293+0000","last_change":"2024-02-02T11:49:31.488899+0000","last_active":"2024-02-02T11:49:33.097293+0000","last_peered":"2024-02-02T11:49:33.097293+0000","last_clean":"2024-02-02T11:49:33.097293+0000","last_became_active":"2024-02-02T11:49:31.488564+0000","last_became_peered":"2024-02-02T11:49:31.488564+0000","last_unstale":"2024-02-02T11:49:33.097293+0000","last_undegraded":"2024-02-02T11:49:33.097293+0000","last_fullsized":"2024-02-02T11:49:33.097293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:51:34.520212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096435+0000","last_change":"2024-02-02T11:49:31.857460+0000","last_active":"2024-02-02T11:49:33.096435+0000","last_peered":"2024-02-02T11:49:33.096435+0000","last_clean":"2024-02-02T11:49:33.096435+0000","last_became_active":"2024-02-02T11:49:31.857195+0000","last_became_peered":"2024-02-02T11:49:31.857195+0000","last_unstale":"2024-02-02T11:49:33.096435+0000","last_undegraded":"2024-02-02T11:49:33.096435+0000","last_fullsized":"2024-02-02T11:49:33.096435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:01:33.878358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.095732+0000","last_change":"2024-02-02T11:49:31.494211+0000","last_active":"2024-02-02T11:49:33.095732+0000","last_peered":"2024-02-02T11:49:33.095732+0000","last_clean":"2024-02-02T11:49:33.095732+0000","last_became_active":"2024-02-02T11:49:31.493617+0000","last_became_peered":"2024-02-02T11:49:31.493617+0000","last_unstale":"2024-02-02T11:49:33.095732+0000","last_undegraded":"2024-02-02T11:49:33.095732+0000","last_fullsized":"2024-02-02T11:49:33.095732+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:13:55.748956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096018+0000","last_change":"2024-02-02T11:49:31.857639+0000","last_active":"2024-02-02T11:49:33.096018+0000","last_peered":"2024-02-02T11:49:33.096018+0000","last_clean":"2024-02-02T11:49:33.096018+0000","last_became_active":"2024-02-02T11:49:31.856900+0000","last_became_peered":"2024-02-02T11:49:31.856900+0000","last_unstale":"2024-02-02T11:49:33.096018+0000","last_undegraded":"2024-02-02T11:49:33.096018+0000","last_fullsized":"2024-02-02T11:49:33.096018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:13:56.762680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852384+0000","last_change":"2024-02-02T11:49:31.487299+0000","last_active":"2024-02-02T11:49:32.852384+0000","last_peered":"2024-02-02T11:49:32.852384+0000","last_clean":"2024-02-02T11:49:32.852384+0000","last_became_active":"2024-02-02T11:49:31.486891+0000","last_became_peered":"2024-02-02T11:49:31.486891+0000","last_unstale":"2024-02-02T11:49:32.852384+0000","last_undegraded":"2024-02-02T11:49:32.852384+0000","last_fullsized":"2024-02-02T11:49:32.852384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:31:38.054283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.095965+0000","last_change":"2024-02-02T11:49:31.893596+0000","last_active":"2024-02-02T11:49:33.095965+0000","last_peered":"2024-02-02T11:49:33.095965+0000","last_clean":"2024-02-02T11:49:33.095965+0000","last_became_active":"2024-02-02T11:49:31.893015+0000","last_became_peered":"2024-02-02T11:49:31.893015+0000","last_unstale":"2024-02-02T11:49:33.095965+0000","last_undegraded":"2024-02-02T11:49:33.095965+0000","last_fullsized":"2024-02-02T11:49:33.095965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:43:26.139035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852991+0000","last_change":"2024-02-02T11:49:31.491467+0000","last_active":"2024-02-02T11:49:32.852991+0000","last_peered":"2024-02-02T11:49:32.852991+0000","last_clean":"2024-02-02T11:49:32.852991+0000","last_became_active":"2024-02-02T11:49:31.491125+0000","last_became_peered":"2024-02-02T11:49:31.491125+0000","last_unstale":"2024-02-02T11:49:32.852991+0000","last_undegraded":"2024-02-02T11:49:32.852991+0000","last_fullsized":"2024-02-02T11:49:32.852991+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:57:10.873418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096038+0000","last_change":"2024-02-02T11:49:31.858558+0000","last_active":"2024-02-02T11:49:33.096038+0000","last_peered":"2024-02-02T11:49:33.096038+0000","last_clean":"2024-02-02T11:49:33.096038+0000","last_became_active":"2024-02-02T11:49:31.858296+0000","last_became_peered":"2024-02-02T11:49:31.858296+0000","last_unstale":"2024-02-02T11:49:33.096038+0000","last_undegraded":"2024-02-02T11:49:33.096038+0000","last_fullsized":"2024-02-02T11:49:33.096038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:51:35.533935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853574+0000","last_change":"2024-02-02T11:49:31.492286+0000","last_active":"2024-02-02T11:49:32.853574+0000","last_peered":"2024-02-02T11:49:32.853574+0000","last_clean":"2024-02-02T11:49:32.853574+0000","last_became_active":"2024-02-02T11:49:31.491793+0000","last_became_peered":"2024-02-02T11:49:31.491793+0000","last_unstale":"2024-02-02T11:49:32.853574+0000","last_undegraded":"2024-02-02T11:49:32.853574+0000","last_fullsized":"2024-02-02T11:49:32.853574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:18:27.601836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.854257+0000","last_change":"2024-02-02T11:49:31.862368+0000","last_active":"2024-02-02T11:49:32.854257+0000","last_peered":"2024-02-02T11:49:32.854257+0000","last_clean":"2024-02-02T11:49:32.854257+0000","last_became_active":"2024-02-02T11:49:31.861625+0000","last_became_peered":"2024-02-02T11:49:31.861625+0000","last_unstale":"2024-02-02T11:49:32.854257+0000","last_undegraded":"2024-02-02T11:49:32.854257+0000","last_fullsized":"2024-02-02T11:49:32.854257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:15:24.940080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097359+0000","last_change":"2024-02-02T11:49:31.489000+0000","last_active":"2024-02-02T11:49:33.097359+0000","last_peered":"2024-02-02T11:49:33.097359+0000","last_clean":"2024-02-02T11:49:33.097359+0000","last_became_active":"2024-02-02T11:49:31.488645+0000","last_became_peered":"2024-02-02T11:49:31.488645+0000","last_unstale":"2024-02-02T11:49:33.097359+0000","last_undegraded":"2024-02-02T11:49:33.097359+0000","last_fullsized":"2024-02-02T11:49:33.097359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:24.948541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097638+0000","last_change":"2024-02-02T11:49:31.862624+0000","last_active":"2024-02-02T11:49:33.097638+0000","last_peered":"2024-02-02T11:49:33.097638+0000","last_clean":"2024-02-02T11:49:33.097638+0000","last_became_active":"2024-02-02T11:49:31.862365+0000","last_became_peered":"2024-02-02T11:49:31.862365+0000","last_unstale":"2024-02-02T11:49:33.097638+0000","last_undegraded":"2024-02-02T11:49:33.097638+0000","last_fullsized":"2024-02-02T11:49:33.097638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:00:34.774216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852984+0000","last_change":"2024-02-02T11:49:31.487896+0000","last_active":"2024-02-02T11:49:32.852984+0000","last_peered":"2024-02-02T11:49:32.852984+0000","last_clean":"2024-02-02T11:49:32.852984+0000","last_became_active":"2024-02-02T11:49:31.487489+0000","last_became_peered":"2024-02-02T11:49:31.487489+0000","last_unstale":"2024-02-02T11:49:32.852984+0000","last_undegraded":"2024-02-02T11:49:32.852984+0000","last_fullsized":"2024-02-02T11:49:32.852984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:13:32.595788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.095471+0000","last_change":"2024-02-02T11:49:31.878839+0000","last_active":"2024-02-02T11:49:33.095471+0000","last_peered":"2024-02-02T11:49:33.095471+0000","last_clean":"2024-02-02T11:49:33.095471+0000","last_became_active":"2024-02-02T11:49:31.878261+0000","last_became_peered":"2024-02-02T11:49:31.878261+0000","last_unstale":"2024-02-02T11:49:33.095471+0000","last_undegraded":"2024-02-02T11:49:33.095471+0000","last_fullsized":"2024-02-02T11:49:33.095471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:57:11.887142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097495+0000","last_change":"2024-02-02T11:49:31.482754+0000","last_active":"2024-02-02T11:49:33.097495+0000","last_peered":"2024-02-02T11:49:33.097495+0000","last_clean":"2024-02-02T11:49:33.097495+0000","last_became_active":"2024-02-02T11:49:31.482450+0000","last_became_peered":"2024-02-02T11:49:31.482450+0000","last_unstale":"2024-02-02T11:49:33.097495+0000","last_undegraded":"2024-02-02T11:49:33.097495+0000","last_fullsized":"2024-02-02T11:49:33.097495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:18:27.601836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097161+0000","last_change":"2024-02-02T11:49:31.879021+0000","last_active":"2024-02-02T11:49:33.097161+0000","last_peered":"2024-02-02T11:49:33.097161+0000","last_clean":"2024-02-02T11:49:33.097161+0000","last_became_active":"2024-02-02T11:49:31.878818+0000","last_became_peered":"2024-02-02T11:49:31.878818+0000","last_unstale":"2024-02-02T11:49:33.097161+0000","last_undegraded":"2024-02-02T11:49:33.097161+0000","last_fullsized":"2024-02-02T11:49:33.097161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:57:11.887142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852533+0000","last_change":"2024-02-02T11:49:31.491712+0000","last_active":"2024-02-02T11:49:32.852533+0000","last_peered":"2024-02-02T11:49:32.852533+0000","last_clean":"2024-02-02T11:49:32.852533+0000","last_became_active":"2024-02-02T11:49:31.491364+0000","last_became_peered":"2024-02-02T11:49:31.491364+0000","last_unstale":"2024-02-02T11:49:32.852533+0000","last_undegraded":"2024-02-02T11:49:32.852533+0000","last_fullsized":"2024-02-02T11:49:32.852533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:24.948541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.098196+0000","last_change":"2024-02-02T11:49:31.861134+0000","last_active":"2024-02-02T11:49:33.098196+0000","last_peered":"2024-02-02T11:49:33.098196+0000","last_clean":"2024-02-02T11:49:33.098196+0000","last_became_active":"2024-02-02T11:49:31.860831+0000","last_became_peered":"2024-02-02T11:49:31.860831+0000","last_unstale":"2024-02-02T11:49:33.098196+0000","last_undegraded":"2024-02-02T11:49:33.098196+0000","last_fullsized":"2024-02-02T11:49:33.098196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:38:09.761786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852423+0000","last_change":"2024-02-02T11:49:31.479795+0000","last_active":"2024-02-02T11:49:32.852423+0000","last_peered":"2024-02-02T11:49:32.852423+0000","last_clean":"2024-02-02T11:49:32.852423+0000","last_became_active":"2024-02-02T11:49:31.479419+0000","last_became_peered":"2024-02-02T11:49:31.479419+0000","last_unstale":"2024-02-02T11:49:32.852423+0000","last_undegraded":"2024-02-02T11:49:32.852423+0000","last_fullsized":"2024-02-02T11:49:32.852423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:00:51.340480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852216+0000","last_change":"2024-02-02T11:49:31.893588+0000","last_active":"2024-02-02T11:49:32.852216+0000","last_peered":"2024-02-02T11:49:32.852216+0000","last_clean":"2024-02-02T11:49:32.852216+0000","last_became_active":"2024-02-02T11:49:31.891150+0000","last_became_peered":"2024-02-02T11:49:31.891150+0000","last_unstale":"2024-02-02T11:49:32.852216+0000","last_undegraded":"2024-02-02T11:49:32.852216+0000","last_fullsized":"2024-02-02T11:49:32.852216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:35:07.707661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.098406+0000","last_change":"2024-02-02T11:49:31.495802+0000","last_active":"2024-02-02T11:49:33.098406+0000","last_peered":"2024-02-02T11:49:33.098406+0000","last_clean":"2024-02-02T11:49:33.098406+0000","last_became_active":"2024-02-02T11:49:31.495420+0000","last_became_peered":"2024-02-02T11:49:31.495420+0000","last_unstale":"2024-02-02T11:49:33.098406+0000","last_undegraded":"2024-02-02T11:49:33.098406+0000","last_fullsized":"2024-02-02T11:49:33.098406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:57:10.873418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096743+0000","last_change":"2024-02-02T11:49:31.891923+0000","last_active":"2024-02-02T11:49:33.096743+0000","last_peered":"2024-02-02T11:49:33.096743+0000","last_clean":"2024-02-02T11:49:33.096743+0000","last_became_active":"2024-02-02T11:49:31.882771+0000","last_became_peered":"2024-02-02T11:49:31.882771+0000","last_unstale":"2024-02-02T11:49:33.096743+0000","last_undegraded":"2024-02-02T11:49:33.096743+0000","last_fullsized":"2024-02-02T11:49:33.096743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:35:07.707661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.095505+0000","last_change":"2024-02-02T11:49:31.492084+0000","last_active":"2024-02-02T11:49:33.095505+0000","last_peered":"2024-02-02T11:49:33.095505+0000","last_clean":"2024-02-02T11:49:33.095505+0000","last_became_active":"2024-02-02T11:49:31.491455+0000","last_became_peered":"2024-02-02T11:49:31.491455+0000","last_unstale":"2024-02-02T11:49:33.095505+0000","last_undegraded":"2024-02-02T11:49:33.095505+0000","last_fullsized":"2024-02-02T11:49:33.095505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:01:32.864635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":171,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-02T11:49:31.869285+0000","last_change":"2024-02-02T11:48:41.563754+0000","last_active":"2024-02-02T11:49:31.869285+0000","last_peered":"2024-02-02T11:49:31.869285+0000","last_clean":"2024-02-02T11:49:31.869285+0000","last_became_active":"2024-02-02T11:48:41.562629+0000","last_became_peered":"2024-02-02T11:48:41.562629+0000","last_unstale":"2024-02-02T11:49:31.869285+0000","last_undegraded":"2024-02-02T11:49:31.869285+0000","last_fullsized":"2024-02-02T11:49:31.869285+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_clean_scrub_stamp":"2024-02-02T11:48:40.536978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:22:02.923582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":724720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":135848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":352256,"data_stored":134332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":135848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":724630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-02T11:49:39.866 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-02T11:49:39.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.991+0000 7f8e90df4640 1 Processor -- start 2024-02-02T11:49:39.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.991+0000 7f8e90df4640 1 -- start start 2024-02-02T11:49:39.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.995+0000 7f8e90df4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8e8c148d60 0x7f8e8c1491b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:39.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.995+0000 7f8e90df4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e8c151100 0x7f8e8c1534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:39.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.995+0000 7f8e90df4640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8c071770 con 0x7f8e8c0bc340 2024-02-02T11:49:39.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.995+0000 7f8e90df4640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8c1496f0 con 0x7f8e8c148d60 2024-02-02T11:49:39.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.995+0000 7f8e90df4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c142f20 con 0x7f8e8c151100 2024-02-02T11:49:39.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.995+0000 7f8e89d9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8e8c148d60 0x7f8e8c1491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:39.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.995+0000 7f8e8a59c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f8e8c0bc340 0x7f8e8c142810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:45052/0 (socket says 172.21.15.161:45052) 2024-02-02T11:49:39.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.995+0000 7f8e8a59c640 1 -- 172.21.15.161:0/2330320835 learned_addr learned my addr 172.21.15.161:0/2330320835 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:39.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.995+0000 7f8e8ad9d640 1 --2- 172.21.15.161:0/2330320835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e8c151100 0x7f8e8c1534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:39.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.995+0000 7f8e89d9b640 1 -- 172.21.15.161:0/2330320835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e8c151100 msgr2=0x7f8e8c1534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:39.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.995+0000 7f8e89d9b640 1 --2- 172.21.15.161:0/2330320835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e8c151100 0x7f8e8c1534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:39.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.995+0000 7f8e8959a640 1 -- 172.21.15.161:0/2330320835 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432561718 0 0) 0x7f8e8c071770 con 0x7f8e8c0bc340 2024-02-02T11:49:39.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.995+0000 7f8e89d9b640 1 -- 172.21.15.161:0/2330320835 >> v1:172.21.15.161:6789/0 conn(0x7f8e8c0bc340 legacy=0x7f8e8c142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:39.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.995+0000 7f8e89d9b640 1 -- 172.21.15.161:0/2330320835 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c0b37e0 con 0x7f8e8c148d60 2024-02-02T11:49:39.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.995+0000 7f8e8ad9d640 1 --2- 172.21.15.161:0/2330320835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e8c151100 0x7f8e8c1534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:40.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.995+0000 7f8e89d9b640 1 --2- 172.21.15.161:0/2330320835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e8c148d60 0x7f8e8c1491b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0097c0 tx=0x7f8e7c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7ae3af880b5e5e server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:40.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.995+0000 7f8e8959a640 1 -- 172.21.15.161:0/2330320835 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c0a8970 con 0x7f8e8c148d60 2024-02-02T11:49:40.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.995+0000 7f8e8959a640 1 -- 172.21.15.161:0/2330320835 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c0a8ad0 con 0x7f8e8c148d60 2024-02-02T11:49:40.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.995+0000 7f8e8959a640 1 -- 172.21.15.161:0/2330320835 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c0a8e60 con 0x7f8e8c148d60 2024-02-02T11:49:40.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e90df4640 1 -- 172.21.15.161:0/2330320835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e8c148d60 msgr2=0x7f8e8c1491b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:40.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e90df4640 1 --2- 172.21.15.161:0/2330320835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e8c148d60 0x7f8e8c1491b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0097c0 tx=0x7f8e7c01ec70 comp rx=0 tx=0).stop 2024-02-02T11:49:40.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e90df4640 1 -- 172.21.15.161:0/2330320835 shutdown_connections 2024-02-02T11:49:40.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e90df4640 1 --2- 172.21.15.161:0/2330320835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e8c151100 0x7f8e8c1534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e90df4640 1 --2- 172.21.15.161:0/2330320835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e8c148d60 0x7f8e8c1491b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e90df4640 1 -- 172.21.15.161:0/2330320835 >> 172.21.15.161:0/2330320835 conn(0x7f8e8c069ef0 msgr2=0x7f8e8c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:40.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e90df4640 1 -- 172.21.15.161:0/2330320835 shutdown_connections 2024-02-02T11:49:40.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e90df4640 1 -- 172.21.15.161:0/2330320835 wait complete. 2024-02-02T11:49:40.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e90df4640 1 Processor -- start 2024-02-02T11:49:40.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e90df4640 1 -- start start 2024-02-02T11:49:40.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e90df4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e8c0bc340 0x7f8e8c146e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:40.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e90df4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e8c148d60 0x7f8e8c0b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:40.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e90df4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e8c151100 0x7f8e8c06f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:40.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e90df4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c0b7310 con 0x7f8e8c151100 2024-02-02T11:49:40.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e90df4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c06fb60 con 0x7f8e8c0bc340 2024-02-02T11:49:40.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e90df4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c147eb0 con 0x7f8e8c148d60 2024-02-02T11:49:40.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e8ad9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e8c151100 0x7f8e8c06f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:40.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e8ad9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e8c151100 0x7f8e8c06f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35088/0 (socket says 172.21.15.161:35088) 2024-02-02T11:49:40.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e8ad9d640 1 -- 172.21.15.161:0/1652487278 learned_addr learned my addr 172.21.15.161:0/1652487278 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:40.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e8a59c640 1 --2- 172.21.15.161:0/1652487278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e8c0bc340 0x7f8e8c146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:40.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e89d9b640 1 --2- 172.21.15.161:0/1652487278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e8c148d60 0x7f8e8c0b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:40.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e8ad9d640 1 -- 172.21.15.161:0/1652487278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e8c148d60 msgr2=0x7f8e8c0b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:40.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e8ad9d640 1 --2- 172.21.15.161:0/1652487278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e8c148d60 0x7f8e8c0b6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e8ad9d640 1 -- 172.21.15.161:0/1652487278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e8c0bc340 msgr2=0x7f8e8c146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:40.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e8ad9d640 1 --2- 172.21.15.161:0/1652487278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e8c0bc340 0x7f8e8c146e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e8ad9d640 1 -- 172.21.15.161:0/1652487278 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c009420 con 0x7f8e8c151100 2024-02-02T11:49:40.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e8ad9d640 1 --2- 172.21.15.161:0/1652487278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e8c151100 0x7f8e8c06f620 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400cd80 tx=0x7f8e8400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:40.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e82ffd640 1 -- 172.21.15.161:0/1652487278 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84003ba0 con 0x7f8e8c151100 2024-02-02T11:49:40.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e82ffd640 1 -- 172.21.15.161:0/1652487278 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e84003d20 con 0x7f8e8c151100 2024-02-02T11:49:40.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e90df4640 1 -- 172.21.15.161:0/1652487278 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8c1474e0 con 0x7f8e8c151100 2024-02-02T11:49:40.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e82ffd640 1 -- 172.21.15.161:0/1652487278 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84004260 con 0x7f8e8c151100 2024-02-02T11:49:40.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e90df4640 1 -- 172.21.15.161:0/1652487278 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8c06ee20 con 0x7f8e8c151100 2024-02-02T11:49:40.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:39.999+0000 7f8e90df4640 1 -- 172.21.15.161:0/1652487278 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8c1483a0 con 0x7f8e8c151100 2024-02-02T11:49:40.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.003+0000 7f8e82ffd640 1 -- 172.21.15.161:0/1652487278 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8e8400b040 con 0x7f8e8c151100 2024-02-02T11:49:40.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.003+0000 7f8e82ffd640 1 --2- 172.21.15.161:0/1652487278 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8e6c065a90 0x7f8e6c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:40.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.003+0000 7f8e82ffd640 1 -- 172.21.15.161:0/1652487278 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e84083770 con 0x7f8e8c151100 2024-02-02T11:49:40.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.003+0000 7f8e8a59c640 1 --2- 172.21.15.161:0/1652487278 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8e6c065a90 0x7f8e6c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:40.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.003+0000 7f8e8a59c640 1 --2- 172.21.15.161:0/1652487278 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8e6c065a90 0x7f8e6c067f50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8e74000f70 tx=0x7f8e74007b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:40.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.007+0000 7f8e82ffd640 1 -- 172.21.15.161:0/1652487278 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8e8c1483a0 con 0x7f8e8c151100 2024-02-02T11:49:40.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.159+0000 7f8e90df4640 1 -- 172.21.15.161:0/1652487278 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e8c0b3da0 con 0x7f8e6c065a90 2024-02-02T11:49:40.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.179+0000 7f8e82ffd640 1 -- 172.21.15.161:0/1652487278 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264550 (secure 0 0 0) 0x7f8e740071f0 con 0x7f8e6c065a90 2024-02-02T11:49:40.185 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:40.188 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-02-02T11:49:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.183+0000 7f8e90df4640 1 -- 172.21.15.161:0/1652487278 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8e6c065a90 msgr2=0x7f8e6c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.183+0000 7f8e90df4640 1 --2- 172.21.15.161:0/1652487278 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8e6c065a90 0x7f8e6c067f50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8e74000f70 tx=0x7f8e74007b60 comp rx=0 tx=0).stop 2024-02-02T11:49:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.183+0000 7f8e90df4640 1 -- 172.21.15.161:0/1652487278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e8c151100 msgr2=0x7f8e8c06f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.183+0000 7f8e90df4640 1 --2- 172.21.15.161:0/1652487278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e8c151100 0x7f8e8c06f620 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400cd80 tx=0x7f8e8400a650 comp rx=0 tx=0).stop 2024-02-02T11:49:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.183+0000 7f8e90df4640 1 -- 172.21.15.161:0/1652487278 shutdown_connections 2024-02-02T11:49:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.183+0000 7f8e90df4640 1 --2- 172.21.15.161:0/1652487278 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8e6c065a90 0x7f8e6c067f50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.183+0000 7f8e90df4640 1 --2- 172.21.15.161:0/1652487278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e8c151100 0x7f8e8c06f620 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.183+0000 7f8e90df4640 1 --2- 172.21.15.161:0/1652487278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e8c148d60 0x7f8e8c0b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.183+0000 7f8e90df4640 1 --2- 172.21.15.161:0/1652487278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e8c0bc340 0x7f8e8c146e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.183+0000 7f8e90df4640 1 -- 172.21.15.161:0/1652487278 >> 172.21.15.161:0/1652487278 conn(0x7f8e8c069ef0 msgr2=0x7f8e8c13ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.183+0000 7f8e90df4640 1 -- 172.21.15.161:0/1652487278 shutdown_connections 2024-02-02T11:49:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.183+0000 7f8e90df4640 1 -- 172.21.15.161:0/1652487278 wait complete. 2024-02-02T11:49:40.206 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-02-02T11:49:38.265385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224232,"kb_used_data":3944,"kb_used_omap":13,"kb_used_meta":220146,"kb_avail":754750488,"statfs":{"total":773094113280,"available":772864499712,"internally_reserved":0,"allocated":4038656,"data_stored":2259556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225429592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.808880"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.095699+0000","last_change":"2024-02-02T11:49:31.883525+0000","last_active":"2024-02-02T11:49:33.095699+0000","last_peered":"2024-02-02T11:49:33.095699+0000","last_clean":"2024-02-02T11:49:33.095699+0000","last_became_active":"2024-02-02T11:49:31.882475+0000","last_became_peered":"2024-02-02T11:49:31.882475+0000","last_unstale":"2024-02-02T11:49:33.095699+0000","last_undegraded":"2024-02-02T11:49:33.095699+0000","last_fullsized":"2024-02-02T11:49:33.095699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:22:13.953661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097702+0000","last_change":"2024-02-02T11:49:31.857136+0000","last_active":"2024-02-02T11:49:33.097702+0000","last_peered":"2024-02-02T11:49:33.097702+0000","last_clean":"2024-02-02T11:49:33.097702+0000","last_became_active":"2024-02-02T11:49:31.856870+0000","last_became_peered":"2024-02-02T11:49:31.856870+0000","last_unstale":"2024-02-02T11:49:33.097702+0000","last_undegraded":"2024-02-02T11:49:33.097702+0000","last_fullsized":"2024-02-02T11:49:33.097702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:42:15.248499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853888+0000","last_change":"2024-02-02T11:49:31.852849+0000","last_active":"2024-02-02T11:49:32.853888+0000","last_peered":"2024-02-02T11:49:32.853888+0000","last_clean":"2024-02-02T11:49:32.853888+0000","last_became_active":"2024-02-02T11:49:31.851154+0000","last_became_peered":"2024-02-02T11:49:31.851154+0000","last_unstale":"2024-02-02T11:49:32.853888+0000","last_undegraded":"2024-02-02T11:49:32.853888+0000","last_fullsized":"2024-02-02T11:49:32.853888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:42:15.248499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852789+0000","last_change":"2024-02-02T11:49:31.890169+0000","last_active":"2024-02-02T11:49:32.852789+0000","last_peered":"2024-02-02T11:49:32.852789+0000","last_clean":"2024-02-02T11:49:32.852789+0000","last_became_active":"2024-02-02T11:49:31.889957+0000","last_became_peered":"2024-02-02T11:49:31.889957+0000","last_unstale":"2024-02-02T11:49:32.852789+0000","last_undegraded":"2024-02-02T11:49:32.852789+0000","last_fullsized":"2024-02-02T11:49:32.852789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:45:16.415767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.098012+0000","last_change":"2024-02-02T11:49:31.856621+0000","last_active":"2024-02-02T11:49:33.098012+0000","last_peered":"2024-02-02T11:49:33.098012+0000","last_clean":"2024-02-02T11:49:33.098012+0000","last_became_active":"2024-02-02T11:49:31.856336+0000","last_became_peered":"2024-02-02T11:49:31.856336+0000","last_unstale":"2024-02-02T11:49:33.098012+0000","last_undegraded":"2024-02-02T11:49:33.098012+0000","last_fullsized":"2024-02-02T11:49:33.098012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:25:20.340862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096843+0000","last_change":"2024-02-02T11:49:31.857165+0000","last_active":"2024-02-02T11:49:33.096843+0000","last_peered":"2024-02-02T11:49:33.096843+0000","last_clean":"2024-02-02T11:49:33.096843+0000","last_became_active":"2024-02-02T11:49:31.856820+0000","last_became_peered":"2024-02-02T11:49:31.856820+0000","last_unstale":"2024-02-02T11:49:33.096843+0000","last_undegraded":"2024-02-02T11:49:33.096843+0000","last_fullsized":"2024-02-02T11:49:33.096843+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:15:24.940080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096209+0000","last_change":"2024-02-02T11:49:31.893089+0000","last_active":"2024-02-02T11:49:33.096209+0000","last_peered":"2024-02-02T11:49:33.096209+0000","last_clean":"2024-02-02T11:49:33.096209+0000","last_became_active":"2024-02-02T11:49:31.892693+0000","last_became_peered":"2024-02-02T11:49:31.892693+0000","last_unstale":"2024-02-02T11:49:33.096209+0000","last_undegraded":"2024-02-02T11:49:33.096209+0000","last_fullsized":"2024-02-02T11:49:33.096209+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:07:37.247129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.095960+0000","last_change":"2024-02-02T11:49:31.882641+0000","last_active":"2024-02-02T11:49:33.095960+0000","last_peered":"2024-02-02T11:49:33.095960+0000","last_clean":"2024-02-02T11:49:33.095960+0000","last_became_active":"2024-02-02T11:49:31.882097+0000","last_became_peered":"2024-02-02T11:49:31.882097+0000","last_unstale":"2024-02-02T11:49:33.095960+0000","last_undegraded":"2024-02-02T11:49:33.095960+0000","last_fullsized":"2024-02-02T11:49:33.095960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:56:37.320994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.855571+0000","last_change":"2024-02-02T11:49:31.888576+0000","last_active":"2024-02-02T11:49:32.855571+0000","last_peered":"2024-02-02T11:49:32.855571+0000","last_clean":"2024-02-02T11:49:32.855571+0000","last_became_active":"2024-02-02T11:49:31.888051+0000","last_became_peered":"2024-02-02T11:49:31.888051+0000","last_unstale":"2024-02-02T11:49:32.855571+0000","last_undegraded":"2024-02-02T11:49:32.855571+0000","last_fullsized":"2024-02-02T11:49:32.855571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:37:23.792881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852980+0000","last_change":"2024-02-02T11:49:31.856618+0000","last_active":"2024-02-02T11:49:32.852980+0000","last_peered":"2024-02-02T11:49:32.852980+0000","last_clean":"2024-02-02T11:49:32.852980+0000","last_became_active":"2024-02-02T11:49:31.856333+0000","last_became_peered":"2024-02-02T11:49:31.856333+0000","last_unstale":"2024-02-02T11:49:32.852980+0000","last_undegraded":"2024-02-02T11:49:32.852980+0000","last_fullsized":"2024-02-02T11:49:32.852980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:35:07.707661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096866+0000","last_change":"2024-02-02T11:49:31.893089+0000","last_active":"2024-02-02T11:49:33.096866+0000","last_peered":"2024-02-02T11:49:33.096866+0000","last_clean":"2024-02-02T11:49:33.096866+0000","last_became_active":"2024-02-02T11:49:31.892515+0000","last_became_peered":"2024-02-02T11:49:31.892515+0000","last_unstale":"2024-02-02T11:49:33.096866+0000","last_undegraded":"2024-02-02T11:49:33.096866+0000","last_fullsized":"2024-02-02T11:49:33.096866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:03:54.652749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853924+0000","last_change":"2024-02-02T11:49:31.863642+0000","last_active":"2024-02-02T11:49:32.853924+0000","last_peered":"2024-02-02T11:49:32.853924+0000","last_clean":"2024-02-02T11:49:32.853924+0000","last_became_active":"2024-02-02T11:49:31.862833+0000","last_became_peered":"2024-02-02T11:49:31.862833+0000","last_unstale":"2024-02-02T11:49:32.853924+0000","last_undegraded":"2024-02-02T11:49:32.853924+0000","last_fullsized":"2024-02-02T11:49:32.853924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:56:37.320994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096215+0000","last_change":"2024-02-02T11:49:31.849297+0000","last_active":"2024-02-02T11:49:33.096215+0000","last_peered":"2024-02-02T11:49:33.096215+0000","last_clean":"2024-02-02T11:49:33.096215+0000","last_became_active":"2024-02-02T11:49:31.849003+0000","last_became_peered":"2024-02-02T11:49:31.849003+0000","last_unstale":"2024-02-02T11:49:33.096215+0000","last_undegraded":"2024-02-02T11:49:33.096215+0000","last_fullsized":"2024-02-02T11:49:33.096215+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:13:33.609511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097094+0000","last_change":"2024-02-02T11:49:31.855012+0000","last_active":"2024-02-02T11:49:33.097094+0000","last_peered":"2024-02-02T11:49:33.097094+0000","last_clean":"2024-02-02T11:49:33.097094+0000","last_became_active":"2024-02-02T11:49:31.854299+0000","last_became_peered":"2024-02-02T11:49:31.854299+0000","last_unstale":"2024-02-02T11:49:33.097094+0000","last_undegraded":"2024-02-02T11:49:33.097094+0000","last_fullsized":"2024-02-02T11:49:33.097094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:43:26.139035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853269+0000","last_change":"2024-02-02T11:49:31.885065+0000","last_active":"2024-02-02T11:49:32.853269+0000","last_peered":"2024-02-02T11:49:32.853269+0000","last_clean":"2024-02-02T11:49:32.853269+0000","last_became_active":"2024-02-02T11:49:31.884657+0000","last_became_peered":"2024-02-02T11:49:31.884657+0000","last_unstale":"2024-02-02T11:49:32.853269+0000","last_undegraded":"2024-02-02T11:49:32.853269+0000","last_fullsized":"2024-02-02T11:49:32.853269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:03:54.652749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096432+0000","last_change":"2024-02-02T11:49:31.894297+0000","last_active":"2024-02-02T11:49:33.096432+0000","last_peered":"2024-02-02T11:49:33.096432+0000","last_clean":"2024-02-02T11:49:33.096432+0000","last_became_active":"2024-02-02T11:49:31.883148+0000","last_became_peered":"2024-02-02T11:49:31.883148+0000","last_unstale":"2024-02-02T11:49:33.096432+0000","last_undegraded":"2024-02-02T11:49:33.096432+0000","last_fullsized":"2024-02-02T11:49:33.096432+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:40:24.432494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097092+0000","last_change":"2024-02-02T11:49:31.892239+0000","last_active":"2024-02-02T11:49:33.097092+0000","last_peered":"2024-02-02T11:49:33.097092+0000","last_clean":"2024-02-02T11:49:33.097092+0000","last_became_active":"2024-02-02T11:49:31.883124+0000","last_became_peered":"2024-02-02T11:49:31.883124+0000","last_unstale":"2024-02-02T11:49:33.097092+0000","last_undegraded":"2024-02-02T11:49:33.097092+0000","last_fullsized":"2024-02-02T11:49:33.097092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:01:34.013934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097826+0000","last_change":"2024-02-02T11:49:31.863784+0000","last_active":"2024-02-02T11:49:33.097826+0000","last_peered":"2024-02-02T11:49:33.097826+0000","last_clean":"2024-02-02T11:49:33.097826+0000","last_became_active":"2024-02-02T11:49:31.863527+0000","last_became_peered":"2024-02-02T11:49:31.863527+0000","last_unstale":"2024-02-02T11:49:33.097826+0000","last_undegraded":"2024-02-02T11:49:33.097826+0000","last_fullsized":"2024-02-02T11:49:33.097826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:17:29.025018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097978+0000","last_change":"2024-02-02T11:49:31.862884+0000","last_active":"2024-02-02T11:49:33.097978+0000","last_peered":"2024-02-02T11:49:33.097978+0000","last_clean":"2024-02-02T11:49:33.097978+0000","last_became_active":"2024-02-02T11:49:31.862525+0000","last_became_peered":"2024-02-02T11:49:31.862525+0000","last_unstale":"2024-02-02T11:49:33.097978+0000","last_undegraded":"2024-02-02T11:49:33.097978+0000","last_fullsized":"2024-02-02T11:49:33.097978+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:36:25.466132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096372+0000","last_change":"2024-02-02T11:49:31.854989+0000","last_active":"2024-02-02T11:49:33.096372+0000","last_peered":"2024-02-02T11:49:33.096372+0000","last_clean":"2024-02-02T11:49:33.096372+0000","last_became_active":"2024-02-02T11:49:31.854706+0000","last_became_peered":"2024-02-02T11:49:31.854706+0000","last_unstale":"2024-02-02T11:49:33.096372+0000","last_undegraded":"2024-02-02T11:49:33.096372+0000","last_fullsized":"2024-02-02T11:49:33.096372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:18:28.615559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853322+0000","last_change":"2024-02-02T11:49:31.887812+0000","last_active":"2024-02-02T11:49:32.853322+0000","last_peered":"2024-02-02T11:49:32.853322+0000","last_clean":"2024-02-02T11:49:32.853322+0000","last_became_active":"2024-02-02T11:49:31.886585+0000","last_became_peered":"2024-02-02T11:49:31.886585+0000","last_unstale":"2024-02-02T11:49:32.853322+0000","last_undegraded":"2024-02-02T11:49:32.853322+0000","last_fullsized":"2024-02-02T11:49:32.853322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:00:34.774216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852957+0000","last_change":"2024-02-02T11:49:31.856800+0000","last_active":"2024-02-02T11:49:32.852957+0000","last_peered":"2024-02-02T11:49:32.852957+0000","last_clean":"2024-02-02T11:49:32.852957+0000","last_became_active":"2024-02-02T11:49:31.856376+0000","last_became_peered":"2024-02-02T11:49:31.856376+0000","last_unstale":"2024-02-02T11:49:32.852957+0000","last_undegraded":"2024-02-02T11:49:32.852957+0000","last_fullsized":"2024-02-02T11:49:32.852957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T17:51:39.814213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096463+0000","last_change":"2024-02-02T11:49:31.876389+0000","last_active":"2024-02-02T11:49:33.096463+0000","last_peered":"2024-02-02T11:49:33.096463+0000","last_clean":"2024-02-02T11:49:33.096463+0000","last_became_active":"2024-02-02T11:49:31.876112+0000","last_became_peered":"2024-02-02T11:49:31.876112+0000","last_unstale":"2024-02-02T11:49:33.096463+0000","last_undegraded":"2024-02-02T11:49:33.096463+0000","last_fullsized":"2024-02-02T11:49:33.096463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:17:38.220781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853200+0000","last_change":"2024-02-02T11:49:31.860612+0000","last_active":"2024-02-02T11:49:32.853200+0000","last_peered":"2024-02-02T11:49:32.853200+0000","last_clean":"2024-02-02T11:49:32.853200+0000","last_became_active":"2024-02-02T11:49:31.860204+0000","last_became_peered":"2024-02-02T11:49:31.860204+0000","last_unstale":"2024-02-02T11:49:32.853200+0000","last_undegraded":"2024-02-02T11:49:32.853200+0000","last_fullsized":"2024-02-02T11:49:32.853200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:07:37.247129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853344+0000","last_change":"2024-02-02T11:49:31.875837+0000","last_active":"2024-02-02T11:49:32.853344+0000","last_peered":"2024-02-02T11:49:32.853344+0000","last_clean":"2024-02-02T11:49:32.853344+0000","last_became_active":"2024-02-02T11:49:31.875509+0000","last_became_peered":"2024-02-02T11:49:31.875509+0000","last_unstale":"2024-02-02T11:49:32.853344+0000","last_undegraded":"2024-02-02T11:49:32.853344+0000","last_fullsized":"2024-02-02T11:49:32.853344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:01:34.013934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097992+0000","last_change":"2024-02-02T11:49:31.866075+0000","last_active":"2024-02-02T11:49:33.097992+0000","last_peered":"2024-02-02T11:49:33.097992+0000","last_clean":"2024-02-02T11:49:33.097992+0000","last_became_active":"2024-02-02T11:49:31.865775+0000","last_became_peered":"2024-02-02T11:49:31.865775+0000","last_unstale":"2024-02-02T11:49:33.097992+0000","last_undegraded":"2024-02-02T11:49:33.097992+0000","last_fullsized":"2024-02-02T11:49:33.097992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:45:16.415767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853315+0000","last_change":"2024-02-02T11:49:31.888258+0000","last_active":"2024-02-02T11:49:32.853315+0000","last_peered":"2024-02-02T11:49:32.853315+0000","last_clean":"2024-02-02T11:49:32.853315+0000","last_became_active":"2024-02-02T11:49:31.888024+0000","last_became_peered":"2024-02-02T11:49:31.888024+0000","last_unstale":"2024-02-02T11:49:32.853315+0000","last_undegraded":"2024-02-02T11:49:32.853315+0000","last_fullsized":"2024-02-02T11:49:32.853315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:40:24.432494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.854171+0000","last_change":"2024-02-02T11:49:31.859800+0000","last_active":"2024-02-02T11:49:32.854171+0000","last_peered":"2024-02-02T11:49:32.854171+0000","last_clean":"2024-02-02T11:49:32.854171+0000","last_became_active":"2024-02-02T11:49:31.859045+0000","last_became_peered":"2024-02-02T11:49:31.859045+0000","last_unstale":"2024-02-02T11:49:32.854171+0000","last_undegraded":"2024-02-02T11:49:32.854171+0000","last_fullsized":"2024-02-02T11:49:32.854171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:43:26.139035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853556+0000","last_change":"2024-02-02T11:49:31.887110+0000","last_active":"2024-02-02T11:49:32.853556+0000","last_peered":"2024-02-02T11:49:32.853556+0000","last_clean":"2024-02-02T11:49:32.853556+0000","last_became_active":"2024-02-02T11:49:31.876962+0000","last_became_peered":"2024-02-02T11:49:31.876962+0000","last_unstale":"2024-02-02T11:49:32.853556+0000","last_undegraded":"2024-02-02T11:49:32.853556+0000","last_fullsized":"2024-02-02T11:49:32.853556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:47:19.733198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.095767+0000","last_change":"2024-02-02T11:49:31.883419+0000","last_active":"2024-02-02T11:49:33.095767+0000","last_peered":"2024-02-02T11:49:33.095767+0000","last_clean":"2024-02-02T11:49:33.095767+0000","last_became_active":"2024-02-02T11:49:31.882602+0000","last_became_peered":"2024-02-02T11:49:31.882602+0000","last_unstale":"2024-02-02T11:49:33.095767+0000","last_undegraded":"2024-02-02T11:49:33.095767+0000","last_fullsized":"2024-02-02T11:49:33.095767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:21:47.033719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.095369+0000","last_change":"2024-02-02T11:49:31.879185+0000","last_active":"2024-02-02T11:49:33.095369+0000","last_peered":"2024-02-02T11:49:33.095369+0000","last_clean":"2024-02-02T11:49:33.095369+0000","last_became_active":"2024-02-02T11:49:31.878494+0000","last_became_peered":"2024-02-02T11:49:31.878494+0000","last_unstale":"2024-02-02T11:49:33.095369+0000","last_undegraded":"2024-02-02T11:49:33.095369+0000","last_fullsized":"2024-02-02T11:49:33.095369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T11:59:44.183855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096007+0000","last_change":"2024-02-02T11:49:31.898339+0000","last_active":"2024-02-02T11:49:33.096007+0000","last_peered":"2024-02-02T11:49:33.096007+0000","last_clean":"2024-02-02T11:49:33.096007+0000","last_became_active":"2024-02-02T11:49:31.897907+0000","last_became_peered":"2024-02-02T11:49:31.897907+0000","last_unstale":"2024-02-02T11:49:33.096007+0000","last_undegraded":"2024-02-02T11:49:33.096007+0000","last_fullsized":"2024-02-02T11:49:33.096007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:03:22.510678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096918+0000","last_change":"2024-02-02T11:49:31.875854+0000","last_active":"2024-02-02T11:49:33.096918+0000","last_peered":"2024-02-02T11:49:33.096918+0000","last_clean":"2024-02-02T11:49:33.096918+0000","last_became_active":"2024-02-02T11:49:31.875537+0000","last_became_peered":"2024-02-02T11:49:31.875537+0000","last_unstale":"2024-02-02T11:49:33.096918+0000","last_undegraded":"2024-02-02T11:49:33.096918+0000","last_fullsized":"2024-02-02T11:49:33.096918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:14:47.389739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096038+0000","last_change":"2024-02-02T11:49:31.493146+0000","last_active":"2024-02-02T11:49:33.096038+0000","last_peered":"2024-02-02T11:49:33.096038+0000","last_clean":"2024-02-02T11:49:33.096038+0000","last_became_active":"2024-02-02T11:49:31.492487+0000","last_became_peered":"2024-02-02T11:49:31.492487+0000","last_unstale":"2024-02-02T11:49:33.096038+0000","last_undegraded":"2024-02-02T11:49:33.096038+0000","last_fullsized":"2024-02-02T11:49:33.096038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:18:27.601836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096004+0000","last_change":"2024-02-02T11:49:31.901256+0000","last_active":"2024-02-02T11:49:33.096004+0000","last_peered":"2024-02-02T11:49:33.096004+0000","last_clean":"2024-02-02T11:49:33.096004+0000","last_became_active":"2024-02-02T11:49:31.900570+0000","last_became_peered":"2024-02-02T11:49:31.900570+0000","last_unstale":"2024-02-02T11:49:33.096004+0000","last_undegraded":"2024-02-02T11:49:33.096004+0000","last_fullsized":"2024-02-02T11:49:33.096004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:06:26.302040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097146+0000","last_change":"2024-02-02T11:49:31.494826+0000","last_active":"2024-02-02T11:49:33.097146+0000","last_peered":"2024-02-02T11:49:33.097146+0000","last_clean":"2024-02-02T11:49:33.097146+0000","last_became_active":"2024-02-02T11:49:31.494294+0000","last_became_peered":"2024-02-02T11:49:31.494294+0000","last_unstale":"2024-02-02T11:49:33.097146+0000","last_undegraded":"2024-02-02T11:49:33.097146+0000","last_fullsized":"2024-02-02T11:49:33.097146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:13:32.595788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.854611+0000","last_change":"2024-02-02T11:49:31.886801+0000","last_active":"2024-02-02T11:49:32.854611+0000","last_peered":"2024-02-02T11:49:32.854611+0000","last_clean":"2024-02-02T11:49:32.854611+0000","last_became_active":"2024-02-02T11:49:31.876810+0000","last_became_peered":"2024-02-02T11:49:31.876810+0000","last_unstale":"2024-02-02T11:49:32.854611+0000","last_undegraded":"2024-02-02T11:49:32.854611+0000","last_fullsized":"2024-02-02T11:49:32.854611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:21:01.002002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.098211+0000","last_change":"2024-02-02T11:49:31.500209+0000","last_active":"2024-02-02T11:49:33.098211+0000","last_peered":"2024-02-02T11:49:33.098211+0000","last_clean":"2024-02-02T11:49:33.098211+0000","last_became_active":"2024-02-02T11:49:31.499878+0000","last_became_peered":"2024-02-02T11:49:31.499878+0000","last_unstale":"2024-02-02T11:49:33.098211+0000","last_undegraded":"2024-02-02T11:49:33.098211+0000","last_fullsized":"2024-02-02T11:49:33.098211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:00:33.760493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853327+0000","last_change":"2024-02-02T11:49:31.888257+0000","last_active":"2024-02-02T11:49:32.853327+0000","last_peered":"2024-02-02T11:49:32.853327+0000","last_clean":"2024-02-02T11:49:32.853327+0000","last_became_active":"2024-02-02T11:49:31.888035+0000","last_became_peered":"2024-02-02T11:49:31.888035+0000","last_unstale":"2024-02-02T11:49:32.853327+0000","last_undegraded":"2024-02-02T11:49:32.853327+0000","last_fullsized":"2024-02-02T11:49:32.853327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T21:47:19.733198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096588+0000","last_change":"2024-02-02T11:49:31.484809+0000","last_active":"2024-02-02T11:49:33.096588+0000","last_peered":"2024-02-02T11:49:33.096588+0000","last_clean":"2024-02-02T11:49:33.096588+0000","last_became_active":"2024-02-02T11:49:31.484465+0000","last_became_peered":"2024-02-02T11:49:31.484465+0000","last_unstale":"2024-02-02T11:49:33.096588+0000","last_undegraded":"2024-02-02T11:49:33.096588+0000","last_fullsized":"2024-02-02T11:49:33.096588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:19:11.947691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096627+0000","last_change":"2024-02-02T11:49:31.898115+0000","last_active":"2024-02-02T11:49:33.096627+0000","last_peered":"2024-02-02T11:49:33.096627+0000","last_clean":"2024-02-02T11:49:33.096627+0000","last_became_active":"2024-02-02T11:49:31.897616+0000","last_became_peered":"2024-02-02T11:49:31.897616+0000","last_unstale":"2024-02-02T11:49:33.096627+0000","last_undegraded":"2024-02-02T11:49:33.096627+0000","last_fullsized":"2024-02-02T11:49:33.096627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:45:16.415767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853766+0000","last_change":"2024-02-02T11:49:31.487806+0000","last_active":"2024-02-02T11:49:32.853766+0000","last_peered":"2024-02-02T11:49:32.853766+0000","last_clean":"2024-02-02T11:49:32.853766+0000","last_became_active":"2024-02-02T11:49:31.486771+0000","last_became_peered":"2024-02-02T11:49:31.486771+0000","last_unstale":"2024-02-02T11:49:32.853766+0000","last_undegraded":"2024-02-02T11:49:32.853766+0000","last_fullsized":"2024-02-02T11:49:32.853766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:25:19.327139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853482+0000","last_change":"2024-02-02T11:49:31.858253+0000","last_active":"2024-02-02T11:49:32.853482+0000","last_peered":"2024-02-02T11:49:32.853482+0000","last_clean":"2024-02-02T11:49:32.853482+0000","last_became_active":"2024-02-02T11:49:31.857435+0000","last_became_peered":"2024-02-02T11:49:31.857435+0000","last_unstale":"2024-02-02T11:49:32.853482+0000","last_undegraded":"2024-02-02T11:49:32.853482+0000","last_fullsized":"2024-02-02T11:49:32.853482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:03:22.510678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853054+0000","last_change":"2024-02-02T11:49:31.486881+0000","last_active":"2024-02-02T11:49:32.853054+0000","last_peered":"2024-02-02T11:49:32.853054+0000","last_clean":"2024-02-02T11:49:32.853054+0000","last_became_active":"2024-02-02T11:49:31.486234+0000","last_became_peered":"2024-02-02T11:49:31.486234+0000","last_unstale":"2024-02-02T11:49:32.853054+0000","last_undegraded":"2024-02-02T11:49:32.853054+0000","last_fullsized":"2024-02-02T11:49:32.853054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:24.948541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852400+0000","last_change":"2024-02-02T11:49:31.890190+0000","last_active":"2024-02-02T11:49:32.852400+0000","last_peered":"2024-02-02T11:49:32.852400+0000","last_clean":"2024-02-02T11:49:32.852400+0000","last_became_active":"2024-02-02T11:49:31.889677+0000","last_became_peered":"2024-02-02T11:49:31.889677+0000","last_unstale":"2024-02-02T11:49:32.852400+0000","last_undegraded":"2024-02-02T11:49:32.852400+0000","last_fullsized":"2024-02-02T11:49:32.852400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:17:38.220781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097210+0000","last_change":"2024-02-02T11:49:31.478538+0000","last_active":"2024-02-02T11:49:33.097210+0000","last_peered":"2024-02-02T11:49:33.097210+0000","last_clean":"2024-02-02T11:49:33.097210+0000","last_became_active":"2024-02-02T11:49:31.478161+0000","last_became_peered":"2024-02-02T11:49:31.478161+0000","last_unstale":"2024-02-02T11:49:33.097210+0000","last_undegraded":"2024-02-02T11:49:33.097210+0000","last_fullsized":"2024-02-02T11:49:33.097210+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:17:37.207058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852268+0000","last_change":"2024-02-02T11:49:31.857954+0000","last_active":"2024-02-02T11:49:32.852268+0000","last_peered":"2024-02-02T11:49:32.852268+0000","last_clean":"2024-02-02T11:49:32.852268+0000","last_became_active":"2024-02-02T11:49:31.857709+0000","last_became_peered":"2024-02-02T11:49:31.857709+0000","last_unstale":"2024-02-02T11:49:32.852268+0000","last_undegraded":"2024-02-02T11:49:32.852268+0000","last_fullsized":"2024-02-02T11:49:32.852268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T17:51:39.814213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852269+0000","last_change":"2024-02-02T11:49:31.485129+0000","last_active":"2024-02-02T11:49:32.852269+0000","last_peered":"2024-02-02T11:49:32.852269+0000","last_clean":"2024-02-02T11:49:32.852269+0000","last_became_active":"2024-02-02T11:49:31.484812+0000","last_became_peered":"2024-02-02T11:49:31.484812+0000","last_unstale":"2024-02-02T11:49:32.852269+0000","last_undegraded":"2024-02-02T11:49:32.852269+0000","last_fullsized":"2024-02-02T11:49:32.852269+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:01:32.864635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853712+0000","last_change":"2024-02-02T11:49:31.855061+0000","last_active":"2024-02-02T11:49:32.853712+0000","last_peered":"2024-02-02T11:49:32.853712+0000","last_clean":"2024-02-02T11:49:32.853712+0000","last_became_active":"2024-02-02T11:49:31.854223+0000","last_became_peered":"2024-02-02T11:49:31.854223+0000","last_unstale":"2024-02-02T11:49:32.853712+0000","last_undegraded":"2024-02-02T11:49:32.853712+0000","last_fullsized":"2024-02-02T11:49:32.853712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:01:34.013934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.098659+0000","last_change":"2024-02-02T11:49:31.495967+0000","last_active":"2024-02-02T11:49:33.098659+0000","last_peered":"2024-02-02T11:49:33.098659+0000","last_clean":"2024-02-02T11:49:33.098659+0000","last_became_active":"2024-02-02T11:49:31.495534+0000","last_became_peered":"2024-02-02T11:49:31.495534+0000","last_unstale":"2024-02-02T11:49:33.098659+0000","last_undegraded":"2024-02-02T11:49:33.098659+0000","last_fullsized":"2024-02-02T11:49:33.098659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:22:12.939938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.098558+0000","last_change":"2024-02-02T11:49:31.863123+0000","last_active":"2024-02-02T11:49:33.098558+0000","last_peered":"2024-02-02T11:49:33.098558+0000","last_clean":"2024-02-02T11:49:33.098558+0000","last_became_active":"2024-02-02T11:49:31.862684+0000","last_became_peered":"2024-02-02T11:49:31.862684+0000","last_unstale":"2024-02-02T11:49:33.098558+0000","last_undegraded":"2024-02-02T11:49:33.098558+0000","last_fullsized":"2024-02-02T11:49:33.098558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:12:23.305598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097568+0000","last_change":"2024-02-02T11:49:31.489655+0000","last_active":"2024-02-02T11:49:33.097568+0000","last_peered":"2024-02-02T11:49:33.097568+0000","last_clean":"2024-02-02T11:49:33.097568+0000","last_became_active":"2024-02-02T11:49:31.489344+0000","last_became_peered":"2024-02-02T11:49:31.489344+0000","last_unstale":"2024-02-02T11:49:33.097568+0000","last_undegraded":"2024-02-02T11:49:33.097568+0000","last_fullsized":"2024-02-02T11:49:33.097568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T11:59:43.170131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097689+0000","last_change":"2024-02-02T11:49:31.866680+0000","last_active":"2024-02-02T11:49:33.097689+0000","last_peered":"2024-02-02T11:49:33.097689+0000","last_clean":"2024-02-02T11:49:33.097689+0000","last_became_active":"2024-02-02T11:49:31.866402+0000","last_became_peered":"2024-02-02T11:49:31.866402+0000","last_unstale":"2024-02-02T11:49:33.097689+0000","last_undegraded":"2024-02-02T11:49:33.097689+0000","last_fullsized":"2024-02-02T11:49:33.097689+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:01:34.013934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.854135+0000","last_change":"2024-02-02T11:49:31.492974+0000","last_active":"2024-02-02T11:49:32.854135+0000","last_peered":"2024-02-02T11:49:32.854135+0000","last_clean":"2024-02-02T11:49:32.854135+0000","last_became_active":"2024-02-02T11:49:31.491517+0000","last_became_peered":"2024-02-02T11:49:31.491517+0000","last_unstale":"2024-02-02T11:49:32.854135+0000","last_undegraded":"2024-02-02T11:49:32.854135+0000","last_fullsized":"2024-02-02T11:49:32.854135+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:22:12.939938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853652+0000","last_change":"2024-02-02T11:49:31.853448+0000","last_active":"2024-02-02T11:49:32.853652+0000","last_peered":"2024-02-02T11:49:32.853652+0000","last_clean":"2024-02-02T11:49:32.853652+0000","last_became_active":"2024-02-02T11:49:31.852077+0000","last_became_peered":"2024-02-02T11:49:31.852077+0000","last_unstale":"2024-02-02T11:49:32.853652+0000","last_undegraded":"2024-02-02T11:49:32.853652+0000","last_fullsized":"2024-02-02T11:49:32.853652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:12:23.305598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.098240+0000","last_change":"2024-02-02T11:49:31.499503+0000","last_active":"2024-02-02T11:49:33.098240+0000","last_peered":"2024-02-02T11:49:33.098240+0000","last_clean":"2024-02-02T11:49:33.098240+0000","last_became_active":"2024-02-02T11:49:31.499234+0000","last_became_peered":"2024-02-02T11:49:31.499234+0000","last_unstale":"2024-02-02T11:49:33.098240+0000","last_undegraded":"2024-02-02T11:49:33.098240+0000","last_fullsized":"2024-02-02T11:49:33.098240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T14:56:34.943416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852330+0000","last_change":"2024-02-02T11:49:31.850910+0000","last_active":"2024-02-02T11:49:32.852330+0000","last_peered":"2024-02-02T11:49:32.852330+0000","last_clean":"2024-02-02T11:49:32.852330+0000","last_became_active":"2024-02-02T11:49:31.850653+0000","last_became_peered":"2024-02-02T11:49:31.850653+0000","last_unstale":"2024-02-02T11:49:32.852330+0000","last_undegraded":"2024-02-02T11:49:32.852330+0000","last_fullsized":"2024-02-02T11:49:32.852330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:21:47.033719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853987+0000","last_change":"2024-02-02T11:49:31.487326+0000","last_active":"2024-02-02T11:49:32.853987+0000","last_peered":"2024-02-02T11:49:32.853987+0000","last_clean":"2024-02-02T11:49:32.853987+0000","last_became_active":"2024-02-02T11:49:31.486083+0000","last_became_peered":"2024-02-02T11:49:31.486083+0000","last_unstale":"2024-02-02T11:49:32.853987+0000","last_undegraded":"2024-02-02T11:49:32.853987+0000","last_fullsized":"2024-02-02T11:49:32.853987+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:13:55.748956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097001+0000","last_change":"2024-02-02T11:49:31.861331+0000","last_active":"2024-02-02T11:49:33.097001+0000","last_peered":"2024-02-02T11:49:33.097001+0000","last_clean":"2024-02-02T11:49:33.097001+0000","last_became_active":"2024-02-02T11:49:31.861079+0000","last_became_peered":"2024-02-02T11:49:31.861079+0000","last_unstale":"2024-02-02T11:49:33.097001+0000","last_undegraded":"2024-02-02T11:49:33.097001+0000","last_fullsized":"2024-02-02T11:49:33.097001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:03:22.510678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852491+0000","last_change":"2024-02-02T11:49:31.487348+0000","last_active":"2024-02-02T11:49:32.852491+0000","last_peered":"2024-02-02T11:49:32.852491+0000","last_clean":"2024-02-02T11:49:32.852491+0000","last_became_active":"2024-02-02T11:49:31.486943+0000","last_became_peered":"2024-02-02T11:49:31.486943+0000","last_unstale":"2024-02-02T11:49:32.852491+0000","last_undegraded":"2024-02-02T11:49:32.852491+0000","last_fullsized":"2024-02-02T11:49:32.852491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T11:59:43.170131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096237+0000","last_change":"2024-02-02T11:49:31.900436+0000","last_active":"2024-02-02T11:49:33.096237+0000","last_peered":"2024-02-02T11:49:33.096237+0000","last_clean":"2024-02-02T11:49:33.096237+0000","last_became_active":"2024-02-02T11:49:31.900089+0000","last_became_peered":"2024-02-02T11:49:31.900089+0000","last_unstale":"2024-02-02T11:49:33.096237+0000","last_undegraded":"2024-02-02T11:49:33.096237+0000","last_fullsized":"2024-02-02T11:49:33.096237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:17:49.934776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097392+0000","last_change":"2024-02-02T11:49:31.495975+0000","last_active":"2024-02-02T11:49:33.097392+0000","last_peered":"2024-02-02T11:49:33.097392+0000","last_clean":"2024-02-02T11:49:33.097392+0000","last_became_active":"2024-02-02T11:49:31.495446+0000","last_became_peered":"2024-02-02T11:49:31.495446+0000","last_unstale":"2024-02-02T11:49:33.097392+0000","last_undegraded":"2024-02-02T11:49:33.097392+0000","last_fullsized":"2024-02-02T11:49:33.097392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:06:25.288317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.095632+0000","last_change":"2024-02-02T11:49:31.897290+0000","last_active":"2024-02-02T11:49:33.095632+0000","last_peered":"2024-02-02T11:49:33.095632+0000","last_clean":"2024-02-02T11:49:33.095632+0000","last_became_active":"2024-02-02T11:49:31.896863+0000","last_became_peered":"2024-02-02T11:49:31.896863+0000","last_unstale":"2024-02-02T11:49:33.095632+0000","last_undegraded":"2024-02-02T11:49:33.095632+0000","last_fullsized":"2024-02-02T11:49:33.095632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:00:34.774216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.098254+0000","last_change":"2024-02-02T11:49:31.499965+0000","last_active":"2024-02-02T11:49:33.098254+0000","last_peered":"2024-02-02T11:49:33.098254+0000","last_clean":"2024-02-02T11:49:33.098254+0000","last_became_active":"2024-02-02T11:49:31.499639+0000","last_became_peered":"2024-02-02T11:49:31.499639+0000","last_unstale":"2024-02-02T11:49:33.098254+0000","last_undegraded":"2024-02-02T11:49:33.098254+0000","last_fullsized":"2024-02-02T11:49:33.098254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:14:46.376015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.855473+0000","last_change":"2024-02-02T11:49:31.890503+0000","last_active":"2024-02-02T11:49:32.855473+0000","last_peered":"2024-02-02T11:49:32.855473+0000","last_clean":"2024-02-02T11:49:32.855473+0000","last_became_active":"2024-02-02T11:49:31.889260+0000","last_became_peered":"2024-02-02T11:49:31.889260+0000","last_unstale":"2024-02-02T11:49:32.855473+0000","last_undegraded":"2024-02-02T11:49:32.855473+0000","last_fullsized":"2024-02-02T11:49:32.855473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:14:47.389739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853564+0000","last_change":"2024-02-02T11:49:31.492284+0000","last_active":"2024-02-02T11:49:32.853564+0000","last_peered":"2024-02-02T11:49:32.853564+0000","last_clean":"2024-02-02T11:49:32.853564+0000","last_became_active":"2024-02-02T11:49:31.491689+0000","last_became_peered":"2024-02-02T11:49:31.491689+0000","last_unstale":"2024-02-02T11:49:32.853564+0000","last_undegraded":"2024-02-02T11:49:32.853564+0000","last_fullsized":"2024-02-02T11:49:32.853564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:51:34.520212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.854137+0000","last_change":"2024-02-02T11:49:31.891406+0000","last_active":"2024-02-02T11:49:32.854137+0000","last_peered":"2024-02-02T11:49:32.854137+0000","last_clean":"2024-02-02T11:49:32.854137+0000","last_became_active":"2024-02-02T11:49:31.891020+0000","last_became_peered":"2024-02-02T11:49:31.891020+0000","last_unstale":"2024-02-02T11:49:32.854137+0000","last_undegraded":"2024-02-02T11:49:32.854137+0000","last_fullsized":"2024-02-02T11:49:32.854137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:17:49.934776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.855469+0000","last_change":"2024-02-02T11:49:31.485340+0000","last_active":"2024-02-02T11:49:32.855469+0000","last_peered":"2024-02-02T11:49:32.855469+0000","last_clean":"2024-02-02T11:49:32.855469+0000","last_became_active":"2024-02-02T11:49:31.484754+0000","last_became_peered":"2024-02-02T11:49:31.484754+0000","last_unstale":"2024-02-02T11:49:32.855469+0000","last_undegraded":"2024-02-02T11:49:32.855469+0000","last_fullsized":"2024-02-02T11:49:32.855469+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:18:27.601836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852773+0000","last_change":"2024-02-02T11:49:31.890566+0000","last_active":"2024-02-02T11:49:32.852773+0000","last_peered":"2024-02-02T11:49:32.852773+0000","last_clean":"2024-02-02T11:49:32.852773+0000","last_became_active":"2024-02-02T11:49:31.890275+0000","last_became_peered":"2024-02-02T11:49:31.890275+0000","last_unstale":"2024-02-02T11:49:32.852773+0000","last_undegraded":"2024-02-02T11:49:32.852773+0000","last_fullsized":"2024-02-02T11:49:32.852773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:21:01.002002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.855482+0000","last_change":"2024-02-02T11:49:31.477934+0000","last_active":"2024-02-02T11:49:32.855482+0000","last_peered":"2024-02-02T11:49:32.855482+0000","last_clean":"2024-02-02T11:49:32.855482+0000","last_became_active":"2024-02-02T11:49:31.477117+0000","last_became_peered":"2024-02-02T11:49:31.477117+0000","last_unstale":"2024-02-02T11:49:32.855482+0000","last_undegraded":"2024-02-02T11:49:32.855482+0000","last_fullsized":"2024-02-02T11:49:32.855482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:10:43.049054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096696+0000","last_change":"2024-02-02T11:49:31.865887+0000","last_active":"2024-02-02T11:49:33.096696+0000","last_peered":"2024-02-02T11:49:33.096696+0000","last_clean":"2024-02-02T11:49:33.096696+0000","last_became_active":"2024-02-02T11:49:31.865600+0000","last_became_peered":"2024-02-02T11:49:31.865600+0000","last_unstale":"2024-02-02T11:49:33.096696+0000","last_undegraded":"2024-02-02T11:49:33.096696+0000","last_fullsized":"2024-02-02T11:49:33.096696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:25.962264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.854853+0000","last_change":"2024-02-02T11:49:31.487109+0000","last_active":"2024-02-02T11:49:32.854853+0000","last_peered":"2024-02-02T11:49:32.854853+0000","last_clean":"2024-02-02T11:49:32.854853+0000","last_became_active":"2024-02-02T11:49:31.486293+0000","last_became_peered":"2024-02-02T11:49:31.486293+0000","last_unstale":"2024-02-02T11:49:32.854853+0000","last_undegraded":"2024-02-02T11:49:32.854853+0000","last_fullsized":"2024-02-02T11:49:32.854853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:48:58.293203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096061+0000","last_change":"2024-02-02T11:49:31.878153+0000","last_active":"2024-02-02T11:49:33.096061+0000","last_peered":"2024-02-02T11:49:33.096061+0000","last_clean":"2024-02-02T11:49:33.096061+0000","last_became_active":"2024-02-02T11:49:31.877830+0000","last_became_peered":"2024-02-02T11:49:31.877830+0000","last_unstale":"2024-02-02T11:49:33.096061+0000","last_undegraded":"2024-02-02T11:49:33.096061+0000","last_fullsized":"2024-02-02T11:49:33.096061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:10:44.062778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097293+0000","last_change":"2024-02-02T11:49:31.488899+0000","last_active":"2024-02-02T11:49:33.097293+0000","last_peered":"2024-02-02T11:49:33.097293+0000","last_clean":"2024-02-02T11:49:33.097293+0000","last_became_active":"2024-02-02T11:49:31.488564+0000","last_became_peered":"2024-02-02T11:49:31.488564+0000","last_unstale":"2024-02-02T11:49:33.097293+0000","last_undegraded":"2024-02-02T11:49:33.097293+0000","last_fullsized":"2024-02-02T11:49:33.097293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:51:34.520212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096435+0000","last_change":"2024-02-02T11:49:31.857460+0000","last_active":"2024-02-02T11:49:33.096435+0000","last_peered":"2024-02-02T11:49:33.096435+0000","last_clean":"2024-02-02T11:49:33.096435+0000","last_became_active":"2024-02-02T11:49:31.857195+0000","last_became_peered":"2024-02-02T11:49:31.857195+0000","last_unstale":"2024-02-02T11:49:33.096435+0000","last_undegraded":"2024-02-02T11:49:33.096435+0000","last_fullsized":"2024-02-02T11:49:33.096435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:01:33.878358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.095732+0000","last_change":"2024-02-02T11:49:31.494211+0000","last_active":"2024-02-02T11:49:33.095732+0000","last_peered":"2024-02-02T11:49:33.095732+0000","last_clean":"2024-02-02T11:49:33.095732+0000","last_became_active":"2024-02-02T11:49:31.493617+0000","last_became_peered":"2024-02-02T11:49:31.493617+0000","last_unstale":"2024-02-02T11:49:33.095732+0000","last_undegraded":"2024-02-02T11:49:33.095732+0000","last_fullsized":"2024-02-02T11:49:33.095732+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:13:55.748956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096018+0000","last_change":"2024-02-02T11:49:31.857639+0000","last_active":"2024-02-02T11:49:33.096018+0000","last_peered":"2024-02-02T11:49:33.096018+0000","last_clean":"2024-02-02T11:49:33.096018+0000","last_became_active":"2024-02-02T11:49:31.856900+0000","last_became_peered":"2024-02-02T11:49:31.856900+0000","last_unstale":"2024-02-02T11:49:33.096018+0000","last_undegraded":"2024-02-02T11:49:33.096018+0000","last_fullsized":"2024-02-02T11:49:33.096018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:13:56.762680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852384+0000","last_change":"2024-02-02T11:49:31.487299+0000","last_active":"2024-02-02T11:49:32.852384+0000","last_peered":"2024-02-02T11:49:32.852384+0000","last_clean":"2024-02-02T11:49:32.852384+0000","last_became_active":"2024-02-02T11:49:31.486891+0000","last_became_peered":"2024-02-02T11:49:31.486891+0000","last_unstale":"2024-02-02T11:49:32.852384+0000","last_undegraded":"2024-02-02T11:49:32.852384+0000","last_fullsized":"2024-02-02T11:49:32.852384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:31:38.054283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.095965+0000","last_change":"2024-02-02T11:49:31.893596+0000","last_active":"2024-02-02T11:49:33.095965+0000","last_peered":"2024-02-02T11:49:33.095965+0000","last_clean":"2024-02-02T11:49:33.095965+0000","last_became_active":"2024-02-02T11:49:31.893015+0000","last_became_peered":"2024-02-02T11:49:31.893015+0000","last_unstale":"2024-02-02T11:49:33.095965+0000","last_undegraded":"2024-02-02T11:49:33.095965+0000","last_fullsized":"2024-02-02T11:49:33.095965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:43:26.139035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852991+0000","last_change":"2024-02-02T11:49:31.491467+0000","last_active":"2024-02-02T11:49:32.852991+0000","last_peered":"2024-02-02T11:49:32.852991+0000","last_clean":"2024-02-02T11:49:32.852991+0000","last_became_active":"2024-02-02T11:49:31.491125+0000","last_became_peered":"2024-02-02T11:49:31.491125+0000","last_unstale":"2024-02-02T11:49:32.852991+0000","last_undegraded":"2024-02-02T11:49:32.852991+0000","last_fullsized":"2024-02-02T11:49:32.852991+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:57:10.873418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096038+0000","last_change":"2024-02-02T11:49:31.858558+0000","last_active":"2024-02-02T11:49:33.096038+0000","last_peered":"2024-02-02T11:49:33.096038+0000","last_clean":"2024-02-02T11:49:33.096038+0000","last_became_active":"2024-02-02T11:49:31.858296+0000","last_became_peered":"2024-02-02T11:49:31.858296+0000","last_unstale":"2024-02-02T11:49:33.096038+0000","last_undegraded":"2024-02-02T11:49:33.096038+0000","last_fullsized":"2024-02-02T11:49:33.096038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:51:35.533935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.853574+0000","last_change":"2024-02-02T11:49:31.492286+0000","last_active":"2024-02-02T11:49:32.853574+0000","last_peered":"2024-02-02T11:49:32.853574+0000","last_clean":"2024-02-02T11:49:32.853574+0000","last_became_active":"2024-02-02T11:49:31.491793+0000","last_became_peered":"2024-02-02T11:49:31.491793+0000","last_unstale":"2024-02-02T11:49:32.853574+0000","last_undegraded":"2024-02-02T11:49:32.853574+0000","last_fullsized":"2024-02-02T11:49:32.853574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:18:27.601836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.854257+0000","last_change":"2024-02-02T11:49:31.862368+0000","last_active":"2024-02-02T11:49:32.854257+0000","last_peered":"2024-02-02T11:49:32.854257+0000","last_clean":"2024-02-02T11:49:32.854257+0000","last_became_active":"2024-02-02T11:49:31.861625+0000","last_became_peered":"2024-02-02T11:49:31.861625+0000","last_unstale":"2024-02-02T11:49:32.854257+0000","last_undegraded":"2024-02-02T11:49:32.854257+0000","last_fullsized":"2024-02-02T11:49:32.854257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:15:24.940080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097359+0000","last_change":"2024-02-02T11:49:31.489000+0000","last_active":"2024-02-02T11:49:33.097359+0000","last_peered":"2024-02-02T11:49:33.097359+0000","last_clean":"2024-02-02T11:49:33.097359+0000","last_became_active":"2024-02-02T11:49:31.488645+0000","last_became_peered":"2024-02-02T11:49:31.488645+0000","last_unstale":"2024-02-02T11:49:33.097359+0000","last_undegraded":"2024-02-02T11:49:33.097359+0000","last_fullsized":"2024-02-02T11:49:33.097359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:24.948541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097638+0000","last_change":"2024-02-02T11:49:31.862624+0000","last_active":"2024-02-02T11:49:33.097638+0000","last_peered":"2024-02-02T11:49:33.097638+0000","last_clean":"2024-02-02T11:49:33.097638+0000","last_became_active":"2024-02-02T11:49:31.862365+0000","last_became_peered":"2024-02-02T11:49:31.862365+0000","last_unstale":"2024-02-02T11:49:33.097638+0000","last_undegraded":"2024-02-02T11:49:33.097638+0000","last_fullsized":"2024-02-02T11:49:33.097638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T18:00:34.774216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852984+0000","last_change":"2024-02-02T11:49:31.487896+0000","last_active":"2024-02-02T11:49:32.852984+0000","last_peered":"2024-02-02T11:49:32.852984+0000","last_clean":"2024-02-02T11:49:32.852984+0000","last_became_active":"2024-02-02T11:49:31.487489+0000","last_became_peered":"2024-02-02T11:49:31.487489+0000","last_unstale":"2024-02-02T11:49:32.852984+0000","last_undegraded":"2024-02-02T11:49:32.852984+0000","last_fullsized":"2024-02-02T11:49:32.852984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T12:13:32.595788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.095471+0000","last_change":"2024-02-02T11:49:31.878839+0000","last_active":"2024-02-02T11:49:33.095471+0000","last_peered":"2024-02-02T11:49:33.095471+0000","last_clean":"2024-02-02T11:49:33.095471+0000","last_became_active":"2024-02-02T11:49:31.878261+0000","last_became_peered":"2024-02-02T11:49:31.878261+0000","last_unstale":"2024-02-02T11:49:33.095471+0000","last_undegraded":"2024-02-02T11:49:33.095471+0000","last_fullsized":"2024-02-02T11:49:33.095471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:57:11.887142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097495+0000","last_change":"2024-02-02T11:49:31.482754+0000","last_active":"2024-02-02T11:49:33.097495+0000","last_peered":"2024-02-02T11:49:33.097495+0000","last_clean":"2024-02-02T11:49:33.097495+0000","last_became_active":"2024-02-02T11:49:31.482450+0000","last_became_peered":"2024-02-02T11:49:31.482450+0000","last_unstale":"2024-02-02T11:49:33.097495+0000","last_undegraded":"2024-02-02T11:49:33.097495+0000","last_fullsized":"2024-02-02T11:49:33.097495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T22:18:27.601836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.097161+0000","last_change":"2024-02-02T11:49:31.879021+0000","last_active":"2024-02-02T11:49:33.097161+0000","last_peered":"2024-02-02T11:49:33.097161+0000","last_clean":"2024-02-02T11:49:33.097161+0000","last_became_active":"2024-02-02T11:49:31.878818+0000","last_became_peered":"2024-02-02T11:49:31.878818+0000","last_unstale":"2024-02-02T11:49:33.097161+0000","last_undegraded":"2024-02-02T11:49:33.097161+0000","last_fullsized":"2024-02-02T11:49:33.097161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:57:11.887142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852533+0000","last_change":"2024-02-02T11:49:31.491712+0000","last_active":"2024-02-02T11:49:32.852533+0000","last_peered":"2024-02-02T11:49:32.852533+0000","last_clean":"2024-02-02T11:49:32.852533+0000","last_became_active":"2024-02-02T11:49:31.491364+0000","last_became_peered":"2024-02-02T11:49:31.491364+0000","last_unstale":"2024-02-02T11:49:32.852533+0000","last_undegraded":"2024-02-02T11:49:32.852533+0000","last_fullsized":"2024-02-02T11:49:32.852533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:45:24.948541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.098196+0000","last_change":"2024-02-02T11:49:31.861134+0000","last_active":"2024-02-02T11:49:33.098196+0000","last_peered":"2024-02-02T11:49:33.098196+0000","last_clean":"2024-02-02T11:49:33.098196+0000","last_became_active":"2024-02-02T11:49:31.860831+0000","last_became_peered":"2024-02-02T11:49:31.860831+0000","last_unstale":"2024-02-02T11:49:33.098196+0000","last_undegraded":"2024-02-02T11:49:33.098196+0000","last_fullsized":"2024-02-02T11:49:33.098196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T23:38:09.761786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852423+0000","last_change":"2024-02-02T11:49:31.479795+0000","last_active":"2024-02-02T11:49:32.852423+0000","last_peered":"2024-02-02T11:49:32.852423+0000","last_clean":"2024-02-02T11:49:32.852423+0000","last_became_active":"2024-02-02T11:49:31.479419+0000","last_became_peered":"2024-02-02T11:49:31.479419+0000","last_unstale":"2024-02-02T11:49:32.852423+0000","last_undegraded":"2024-02-02T11:49:32.852423+0000","last_fullsized":"2024-02-02T11:49:32.852423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T13:00:51.340480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:32.852216+0000","last_change":"2024-02-02T11:49:31.893588+0000","last_active":"2024-02-02T11:49:32.852216+0000","last_peered":"2024-02-02T11:49:32.852216+0000","last_clean":"2024-02-02T11:49:32.852216+0000","last_became_active":"2024-02-02T11:49:31.891150+0000","last_became_peered":"2024-02-02T11:49:31.891150+0000","last_unstale":"2024-02-02T11:49:32.852216+0000","last_undegraded":"2024-02-02T11:49:32.852216+0000","last_fullsized":"2024-02-02T11:49:32.852216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:35:07.707661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.098406+0000","last_change":"2024-02-02T11:49:31.495802+0000","last_active":"2024-02-02T11:49:33.098406+0000","last_peered":"2024-02-02T11:49:33.098406+0000","last_clean":"2024-02-02T11:49:33.098406+0000","last_became_active":"2024-02-02T11:49:31.495420+0000","last_became_peered":"2024-02-02T11:49:31.495420+0000","last_unstale":"2024-02-02T11:49:33.098406+0000","last_undegraded":"2024-02-02T11:49:33.098406+0000","last_fullsized":"2024-02-02T11:49:33.098406+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:57:10.873418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.096743+0000","last_change":"2024-02-02T11:49:31.891923+0000","last_active":"2024-02-02T11:49:33.096743+0000","last_peered":"2024-02-02T11:49:33.096743+0000","last_clean":"2024-02-02T11:49:33.096743+0000","last_became_active":"2024-02-02T11:49:31.882771+0000","last_became_peered":"2024-02-02T11:49:31.882771+0000","last_unstale":"2024-02-02T11:49:33.096743+0000","last_undegraded":"2024-02-02T11:49:33.096743+0000","last_fullsized":"2024-02-02T11:49:33.096743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:31.448976+0000","last_clean_scrub_stamp":"2024-02-02T11:49:31.448976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:35:07.707661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T11:49:33.095505+0000","last_change":"2024-02-02T11:49:31.492084+0000","last_active":"2024-02-02T11:49:33.095505+0000","last_peered":"2024-02-02T11:49:33.095505+0000","last_clean":"2024-02-02T11:49:33.095505+0000","last_became_active":"2024-02-02T11:49:31.491455+0000","last_became_peered":"2024-02-02T11:49:31.491455+0000","last_unstale":"2024-02-02T11:49:33.095505+0000","last_undegraded":"2024-02-02T11:49:33.095505+0000","last_fullsized":"2024-02-02T11:49:33.095505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:49:30.435253+0000","last_clean_scrub_stamp":"2024-02-02T11:49:30.435253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T20:01:32.864635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":171,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-02T11:49:31.869285+0000","last_change":"2024-02-02T11:48:41.563754+0000","last_active":"2024-02-02T11:49:31.869285+0000","last_peered":"2024-02-02T11:49:31.869285+0000","last_clean":"2024-02-02T11:49:31.869285+0000","last_became_active":"2024-02-02T11:48:41.562629+0000","last_became_peered":"2024-02-02T11:48:41.562629+0000","last_unstale":"2024-02-02T11:49:31.869285+0000","last_undegraded":"2024-02-02T11:49:31.869285+0000","last_fullsized":"2024-02-02T11:49:31.869285+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_clean_scrub_stamp":"2024-02-02T11:48:40.536978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:22:02.923582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":724720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":135848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":352256,"data_stored":134332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":135848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":724630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-02T11:49:40.210 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-02T11:49:40.210 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-02-02T11:49:40.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.367+0000 7f681060f640 1 Processor -- start 2024-02-02T11:49:40.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.367+0000 7f681060f640 1 -- start start 2024-02-02T11:49:40.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.367+0000 7f681060f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f68080b2b80 0x7f680814df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:40.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.367+0000 7f681060f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f68080b6bd0 0x7f68080b6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:40.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.367+0000 7f681060f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680814e5c0 con 0x7f68080b8df0 2024-02-02T11:49:40.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.367+0000 7f681060f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68080b8800 con 0x7f68080b6bd0 2024-02-02T11:49:40.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.367+0000 7f681060f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680814e8a0 con 0x7f68080b2b80 2024-02-02T11:49:40.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.367+0000 7f680ebac640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f68080b6bd0 0x7f68080b6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:40.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.367+0000 7f680ebac640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f68080b6bd0 0x7f68080b6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35102/0 (socket says 172.21.15.161:35102) 2024-02-02T11:49:40.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.367+0000 7f680ebac640 1 -- 172.21.15.161:0/2878496415 learned_addr learned my addr 172.21.15.161:0/2878496415 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:40.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.367+0000 7f680dbaa640 1 --2- 172.21.15.161:0/2878496415 >> v2:172.21.15.162:3300/0 conn(0x7f68080b2b80 0x7f680814df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:40.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.367+0000 7f680ebac640 1 -- 172.21.15.161:0/2878496415 >> v2:172.21.15.162:3300/0 conn(0x7f68080b2b80 msgr2=0x7f680814df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:40.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.367+0000 7f680ebac640 1 --2- 172.21.15.161:0/2878496415 >> v2:172.21.15.162:3300/0 conn(0x7f68080b2b80 0x7f680814df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.367+0000 7f680ebac640 1 -- 172.21.15.161:0/2878496415 >> v1:172.21.15.162:6789/0 conn(0x7f68080b8df0 legacy=0x7f6808144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:40.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.367+0000 7f680ebac640 1 -- 172.21.15.161:0/2878496415 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680814eb80 con 0x7f68080b6bd0 2024-02-02T11:49:40.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f680ebac640 1 --2- 172.21.15.161:0/2878496415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68080b6bd0 0x7f68080b6fe0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f68080b7b90 tx=0x7f680001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84d5a7abbab90bc server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:40.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f680d3a9640 1 -- 172.21.15.161:0/2878496415 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000a57a0 con 0x7f68080b6bd0 2024-02-02T11:49:40.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f680d3a9640 1 -- 172.21.15.161:0/2878496415 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68000a5900 con 0x7f68080b6bd0 2024-02-02T11:49:40.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f680d3a9640 1 -- 172.21.15.161:0/2878496415 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000a5c90 con 0x7f68080b6bd0 2024-02-02T11:49:40.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f681060f640 1 -- 172.21.15.161:0/2878496415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68080b6bd0 msgr2=0x7f68080b6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:40.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f681060f640 1 --2- 172.21.15.161:0/2878496415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68080b6bd0 0x7f68080b6fe0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f68080b7b90 tx=0x7f680001c9d0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f681060f640 1 -- 172.21.15.161:0/2878496415 shutdown_connections 2024-02-02T11:49:40.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f681060f640 1 --2- 172.21.15.161:0/2878496415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68080b6bd0 0x7f68080b6fe0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f681060f640 1 --2- 172.21.15.161:0/2878496415 >> v2:172.21.15.162:3300/0 conn(0x7f68080b2b80 0x7f680814df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f681060f640 1 -- 172.21.15.161:0/2878496415 >> 172.21.15.161:0/2878496415 conn(0x7f680806a120 msgr2=0x7f680806a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:40.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f681060f640 1 -- 172.21.15.161:0/2878496415 shutdown_connections 2024-02-02T11:49:40.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f681060f640 1 -- 172.21.15.161:0/2878496415 wait complete. 2024-02-02T11:49:40.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f681060f640 1 Processor -- start 2024-02-02T11:49:40.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f681060f640 1 -- start start 2024-02-02T11:49:40.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f681060f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68080b2b80 0x7f68081360f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:40.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f681060f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68080b6bd0 0x7f6808139760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:40.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f681060f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68080b8df0 0x7f6808131f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:40.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f681060f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680814d660 con 0x7f68080b8df0 2024-02-02T11:49:40.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f681060f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680814bba0 con 0x7f68080b6bd0 2024-02-02T11:49:40.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f681060f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680814be80 con 0x7f68080b2b80 2024-02-02T11:49:40.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f680ebac640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68080b8df0 0x7f6808131f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:40.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f680ebac640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68080b8df0 0x7f6808131f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35106/0 (socket says 172.21.15.161:35106) 2024-02-02T11:49:40.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.371+0000 7f680ebac640 1 -- 172.21.15.161:0/3826095453 learned_addr learned my addr 172.21.15.161:0/3826095453 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:40.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f680e3ab640 1 --2- 172.21.15.161:0/3826095453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68080b2b80 0x7f68081360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:40.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f680dbaa640 1 --2- 172.21.15.161:0/3826095453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68080b6bd0 0x7f6808139760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:40.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f680ebac640 1 -- 172.21.15.161:0/3826095453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68080b2b80 msgr2=0x7f68081360f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:40.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f680ebac640 1 --2- 172.21.15.161:0/3826095453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68080b2b80 0x7f68081360f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f680ebac640 1 -- 172.21.15.161:0/3826095453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68080b6bd0 msgr2=0x7f6808139760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:40.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f680ebac640 1 --2- 172.21.15.161:0/3826095453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68080b6bd0 0x7f6808139760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f680ebac640 1 -- 172.21.15.161:0/3826095453 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6800009b30 con 0x7f68080b8df0 2024-02-02T11:49:40.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f680dbaa640 1 --2- 172.21.15.161:0/3826095453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68080b6bd0 0x7f6808139760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:40.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f680ebac640 1 --2- 172.21.15.161:0/3826095453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68080b8df0 0x7f6808131f50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f68000af040 tx=0x7f6800019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:40.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f67feffd640 1 -- 172.21.15.161:0/3826095453 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000b8670 con 0x7f68080b8df0 2024-02-02T11:49:40.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f67feffd640 1 -- 172.21.15.161:0/3826095453 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68000b87d0 con 0x7f68080b8df0 2024-02-02T11:49:40.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f681060f640 1 -- 172.21.15.161:0/3826095453 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6808143a50 con 0x7f68080b8df0 2024-02-02T11:49:40.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f67feffd640 1 -- 172.21.15.161:0/3826095453 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000b8b80 con 0x7f68080b8df0 2024-02-02T11:49:40.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f681060f640 1 -- 172.21.15.161:0/3826095453 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680814c3a0 con 0x7f68080b8df0 2024-02-02T11:49:40.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f681060f640 1 -- 172.21.15.161:0/3826095453 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680804e000 con 0x7f68080b8df0 2024-02-02T11:49:40.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f67feffd640 1 -- 172.21.15.161:0/3826095453 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f68000b8ce0 con 0x7f68080b8df0 2024-02-02T11:49:40.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f67feffd640 1 --2- 172.21.15.161:0/3826095453 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f67ec065a30 0x7f67ec067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:40.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f680e3ab640 1 --2- 172.21.15.161:0/3826095453 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f67ec065a30 0x7f67ec067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:40.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f67feffd640 1 -- 172.21.15.161:0/3826095453 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f680011e690 con 0x7f68080b8df0 2024-02-02T11:49:40.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.375+0000 7f680e3ab640 1 --2- 172.21.15.161:0/3826095453 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f67ec065a30 0x7f67ec067ef0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6804000f70 tx=0x7f6804009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:40.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.379+0000 7f67feffd640 1 -- 172.21.15.161:0/3826095453 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f68000ec120 con 0x7f68080b8df0 2024-02-02T11:49:40.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.571+0000 7f681060f640 1 -- 172.21.15.161:0/3826095453 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6808137700 con 0x7f68080b8df0 2024-02-02T11:49:40.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.579+0000 7f67feffd640 1 -- 172.21.15.161:0/3826095453 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f68000ef740 con 0x7f68080b8df0 2024-02-02T11:49:40.584 INFO:teuthology.orchestra.run.smithi161.stderr:updated caps for client.0 2024-02-02T11:49:40.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.583+0000 7f681060f640 1 -- 172.21.15.161:0/3826095453 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f67ec065a30 msgr2=0x7f67ec067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:40.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.583+0000 7f681060f640 1 --2- 172.21.15.161:0/3826095453 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f67ec065a30 0x7f67ec067ef0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6804000f70 tx=0x7f6804009040 comp rx=0 tx=0).stop 2024-02-02T11:49:40.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.583+0000 7f681060f640 1 -- 172.21.15.161:0/3826095453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68080b8df0 msgr2=0x7f6808131f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:40.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.583+0000 7f681060f640 1 --2- 172.21.15.161:0/3826095453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68080b8df0 0x7f6808131f50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f68000af040 tx=0x7f6800019770 comp rx=0 tx=0).stop 2024-02-02T11:49:40.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.583+0000 7f681060f640 1 -- 172.21.15.161:0/3826095453 shutdown_connections 2024-02-02T11:49:40.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.583+0000 7f681060f640 1 --2- 172.21.15.161:0/3826095453 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f67ec065a30 0x7f67ec067ef0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.583+0000 7f681060f640 1 --2- 172.21.15.161:0/3826095453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68080b8df0 0x7f6808131f50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.583+0000 7f681060f640 1 --2- 172.21.15.161:0/3826095453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68080b6bd0 0x7f6808139760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.583+0000 7f681060f640 1 --2- 172.21.15.161:0/3826095453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68080b2b80 0x7f68081360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.583+0000 7f681060f640 1 -- 172.21.15.161:0/3826095453 >> 172.21.15.161:0/3826095453 conn(0x7f680806a120 msgr2=0x7f680806fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:40.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.583+0000 7f681060f640 1 -- 172.21.15.161:0/3826095453 shutdown_connections 2024-02-02T11:49:40.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.583+0000 7f681060f640 1 -- 172.21.15.161:0/3826095453 wait complete. 2024-02-02T11:49:40.601 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-02T11:49:40.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.715+0000 7f216ddab640 1 Processor -- start 2024-02-02T11:49:40.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.715+0000 7f216ddab640 1 -- start start 2024-02-02T11:49:40.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.719+0000 7f216ddab640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2168148d60 0x7f21681491b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:40.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.719+0000 7f216ddab640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2168151100 0x7f21681534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:40.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.719+0000 7f216ddab640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2168071770 con 0x7f21680bc340 2024-02-02T11:49:40.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.719+0000 7f216ddab640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21681496f0 con 0x7f2168151100 2024-02-02T11:49:40.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.719+0000 7f216ddab640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2168142f20 con 0x7f2168148d60 2024-02-02T11:49:40.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.719+0000 7f2167fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2168151100 0x7f21681534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:40.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.719+0000 7f2167fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2168151100 0x7f21681534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35116/0 (socket says 172.21.15.161:35116) 2024-02-02T11:49:40.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.719+0000 7f2167fff640 1 -- 172.21.15.161:0/3366119097 learned_addr learned my addr 172.21.15.161:0/3366119097 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:40.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.719+0000 7f2166ffd640 1 --2- 172.21.15.161:0/3366119097 >> v2:172.21.15.162:3300/0 conn(0x7f2168148d60 0x7f21681491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:40.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.719+0000 7f2167fff640 1 -- 172.21.15.161:0/3366119097 >> v2:172.21.15.162:3300/0 conn(0x7f2168148d60 msgr2=0x7f21681491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:40.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.719+0000 7f2167fff640 1 --2- 172.21.15.161:0/3366119097 >> v2:172.21.15.162:3300/0 conn(0x7f2168148d60 0x7f21681491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.719+0000 7f2167fff640 1 -- 172.21.15.161:0/3366119097 >> v1:172.21.15.161:6789/0 conn(0x7f21680bc340 legacy=0x7f2168142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:40.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.719+0000 7f2167fff640 1 -- 172.21.15.161:0/3366119097 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21680b37e0 con 0x7f2168151100 2024-02-02T11:49:40.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.719+0000 7f21667fc640 1 -- 172.21.15.161:0/3366119097 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483669990 0 0) 0x7f2168071770 con 0x7f21680bc340 2024-02-02T11:49:40.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f2167fff640 1 --2- 172.21.15.161:0/3366119097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2168151100 0x7f21681534f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f216806d0c0 tx=0x7f215801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d57c47d85231ab server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:40.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f21667fc640 1 -- 172.21.15.161:0/3366119097 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21580a89f0 con 0x7f2168151100 2024-02-02T11:49:40.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f21667fc640 1 -- 172.21.15.161:0/3366119097 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21580a8b50 con 0x7f2168151100 2024-02-02T11:49:40.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f21667fc640 1 -- 172.21.15.161:0/3366119097 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21580b0440 con 0x7f2168151100 2024-02-02T11:49:40.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f216ddab640 1 -- 172.21.15.161:0/3366119097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2168151100 msgr2=0x7f21681534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:40.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f216ddab640 1 --2- 172.21.15.161:0/3366119097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2168151100 0x7f21681534f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f216806d0c0 tx=0x7f215801ecf0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f216ddab640 1 -- 172.21.15.161:0/3366119097 shutdown_connections 2024-02-02T11:49:40.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f216ddab640 1 --2- 172.21.15.161:0/3366119097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2168151100 0x7f21681534f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f216ddab640 1 --2- 172.21.15.161:0/3366119097 >> v2:172.21.15.162:3300/0 conn(0x7f2168148d60 0x7f21681491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f216ddab640 1 -- 172.21.15.161:0/3366119097 >> 172.21.15.161:0/3366119097 conn(0x7f2168069ef0 msgr2=0x7f216806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:40.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f216ddab640 1 -- 172.21.15.161:0/3366119097 shutdown_connections 2024-02-02T11:49:40.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f216ddab640 1 -- 172.21.15.161:0/3366119097 wait complete. 2024-02-02T11:49:40.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f216ddab640 1 Processor -- start 2024-02-02T11:49:40.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f216ddab640 1 -- start start 2024-02-02T11:49:40.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f216ddab640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21680bc340 0x7f21681477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:40.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f216ddab640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2168148d60 0x7f21681e3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:40.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f216ddab640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2168151100 0x7f21681e4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:40.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f216ddab640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2168147d20 con 0x7f2168151100 2024-02-02T11:49:40.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f216ddab640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2168070380 con 0x7f2168148d60 2024-02-02T11:49:40.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f216ddab640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2168141220 con 0x7f21680bc340 2024-02-02T11:49:40.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f2167fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2168151100 0x7f21681e4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:40.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f2167fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2168151100 0x7f21681e4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35132/0 (socket says 172.21.15.161:35132) 2024-02-02T11:49:40.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.723+0000 7f2167fff640 1 -- 172.21.15.161:0/3893641292 learned_addr learned my addr 172.21.15.161:0/3893641292 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:40.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.727+0000 7f2166ffd640 1 --2- 172.21.15.161:0/3893641292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2168148d60 0x7f21681e3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:40.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.727+0000 7f21677fe640 1 --2- 172.21.15.161:0/3893641292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21680bc340 0x7f21681477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:40.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.727+0000 7f2167fff640 1 -- 172.21.15.161:0/3893641292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21680bc340 msgr2=0x7f21681477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:40.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.727+0000 7f2167fff640 1 --2- 172.21.15.161:0/3893641292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21680bc340 0x7f21681477e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.727+0000 7f2167fff640 1 -- 172.21.15.161:0/3893641292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2168148d60 msgr2=0x7f21681e3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:40.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.727+0000 7f2167fff640 1 --2- 172.21.15.161:0/3893641292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2168148d60 0x7f21681e3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.727+0000 7f2167fff640 1 -- 172.21.15.161:0/3893641292 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21580094d0 con 0x7f2168151100 2024-02-02T11:49:40.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.727+0000 7f2167fff640 1 --2- 172.21.15.161:0/3893641292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2168151100 0x7f21681e4040 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f215801c920 tx=0x7f215801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:40.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.727+0000 7f215ffff640 1 -- 172.21.15.161:0/3893641292 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21580b0de0 con 0x7f2168151100 2024-02-02T11:49:40.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.727+0000 7f215ffff640 1 -- 172.21.15.161:0/3893641292 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21580bb460 con 0x7f2168151100 2024-02-02T11:49:40.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.727+0000 7f216ddab640 1 -- 172.21.15.161:0/3893641292 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21680705d0 con 0x7f2168151100 2024-02-02T11:49:40.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.727+0000 7f215ffff640 1 -- 172.21.15.161:0/3893641292 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21580bb810 con 0x7f2168151100 2024-02-02T11:49:40.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.727+0000 7f216ddab640 1 -- 172.21.15.161:0/3893641292 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2168070b90 con 0x7f2168151100 2024-02-02T11:49:40.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.727+0000 7f216ddab640 1 -- 172.21.15.161:0/3893641292 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216804e000 con 0x7f2168151100 2024-02-02T11:49:40.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.727+0000 7f215ffff640 1 -- 172.21.15.161:0/3893641292 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f21580b83f0 con 0x7f2168151100 2024-02-02T11:49:40.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.727+0000 7f215ffff640 1 --2- 172.21.15.161:0/3893641292 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2148065a60 0x7f2148067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:40.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.727+0000 7f215ffff640 1 -- 172.21.15.161:0/3893641292 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2158120c90 con 0x7f2168151100 2024-02-02T11:49:40.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.727+0000 7f21677fe640 1 --2- 172.21.15.161:0/3893641292 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2148065a60 0x7f2148067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:40.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.727+0000 7f21677fe640 1 --2- 172.21.15.161:0/3893641292 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2148065a60 0x7f2148067f20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2150000f70 tx=0x7f2150009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:40.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.731+0000 7f215ffff640 1 -- 172.21.15.161:0/3893641292 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f21580ee6e0 con 0x7f2168151100 2024-02-02T11:49:40.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.910+0000 7f216ddab640 1 -- 172.21.15.161:0/3893641292 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21680b4cb0 con 0x7f2168151100 2024-02-02T11:49:40.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.910+0000 7f215ffff640 1 -- 172.21.15.161:0/3893641292 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3958 (secure 0 0 0) 0x7f21580f1d00 con 0x7f2168151100 2024-02-02T11:49:40.916 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:49:40.917 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4535,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/236294405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":236294405},{"type":"v1","addr":"172.21.15.162:6833","nonce":236294405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3772183556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3772183556},{"type":"v1","addr":"172.21.15.161:6835","nonce":3772183556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-02T11:49:31.833135+0000","modified":"2024-02-02T11:49:34.491389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/1621598548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1621598548},{"type":"v1","addr":"172.21.15.161:6837","nonce":1621598548}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-02T11:49:40.917 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 14 2024-02-02T11:49:40.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.914+0000 7f216ddab640 1 -- 172.21.15.161:0/3893641292 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2148065a60 msgr2=0x7f2148067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:40.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.914+0000 7f216ddab640 1 --2- 172.21.15.161:0/3893641292 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2148065a60 0x7f2148067f20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2150000f70 tx=0x7f2150009040 comp rx=0 tx=0).stop 2024-02-02T11:49:40.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.914+0000 7f216ddab640 1 -- 172.21.15.161:0/3893641292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2168151100 msgr2=0x7f21681e4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:40.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.914+0000 7f216ddab640 1 --2- 172.21.15.161:0/3893641292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2168151100 0x7f21681e4040 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f215801c920 tx=0x7f215801ba90 comp rx=0 tx=0).stop 2024-02-02T11:49:40.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.914+0000 7f216ddab640 1 -- 172.21.15.161:0/3893641292 shutdown_connections 2024-02-02T11:49:40.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.914+0000 7f216ddab640 1 --2- 172.21.15.161:0/3893641292 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2148065a60 0x7f2148067f20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.914+0000 7f216ddab640 1 --2- 172.21.15.161:0/3893641292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2168151100 0x7f21681e4040 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.914+0000 7f216ddab640 1 --2- 172.21.15.161:0/3893641292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2168148d60 0x7f21681e3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.914+0000 7f216ddab640 1 --2- 172.21.15.161:0/3893641292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21680bc340 0x7f21681477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:40.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.914+0000 7f216ddab640 1 -- 172.21.15.161:0/3893641292 >> 172.21.15.161:0/3893641292 conn(0x7f2168069ef0 msgr2=0x7f2168138ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:40.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.914+0000 7f216ddab640 1 -- 172.21.15.161:0/3893641292 shutdown_connections 2024-02-02T11:49:40.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:40.914+0000 7f216ddab640 1 -- 172.21.15.161:0/3893641292 wait complete. 2024-02-02T11:49:41.236 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-02T11:49:31.833135+0000', 'modified': '2024-02-02T11:49:34.491389+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4932}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4932': {'gid': 4932, 'name': 'c', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.161:6837/1621598548', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6836', 'nonce': 1621598548}, {'type': 'v1', 'addr': '172.21.15.161:6837', 'nonce': 1621598548}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-02T11:49:41.237 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-02T11:49:41.237 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-02-02T11:49:41.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.362+0000 7f66406d7640 1 Processor -- start 2024-02-02T11:49:41.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.362+0000 7f66406d7640 1 -- start start 2024-02-02T11:49:41.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.362+0000 7f66406d7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f66380bc340 0x7f6638142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.362+0000 7f66406d7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6638142d50 0x7f6638148d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.362+0000 7f66406d7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66381492a0 0x7f66380b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.362+0000 7f66406d7640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6638149710 con 0x7f6638142d50 2024-02-02T11:49:41.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.362+0000 7f66406d7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6638071770 con 0x7f66380bc340 2024-02-02T11:49:41.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.362+0000 7f66406d7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66380b37e0 con 0x7f66381492a0 2024-02-02T11:49:41.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.362+0000 7f663dc72640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6638142d50 0x7f6638148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.362+0000 7f663dc72640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6638142d50 0x7f6638148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35144/0 (socket says 172.21.15.161:35144) 2024-02-02T11:49:41.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.362+0000 7f663dc72640 1 -- 172.21.15.161:0/532946186 learned_addr learned my addr 172.21.15.161:0/532946186 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:41.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.362+0000 7f663e473640 1 --2- 172.21.15.161:0/532946186 >> v2:172.21.15.162:3300/0 conn(0x7f66380bc340 0x7f6638142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.362+0000 7f663ec74640 1 --2- 172.21.15.161:0/532946186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66381492a0 0x7f66380b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.362+0000 7f663dc72640 1 -- 172.21.15.161:0/532946186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66381492a0 msgr2=0x7f66380b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:41.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.362+0000 7f663dc72640 1 --2- 172.21.15.161:0/532946186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66381492a0 0x7f66380b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.362+0000 7f663dc72640 1 -- 172.21.15.161:0/532946186 >> v2:172.21.15.162:3300/0 conn(0x7f66380bc340 msgr2=0x7f6638142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:41.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.362+0000 7f663dc72640 1 --2- 172.21.15.161:0/532946186 >> v2:172.21.15.162:3300/0 conn(0x7f66380bc340 0x7f6638142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.362+0000 7f663dc72640 1 -- 172.21.15.161:0/532946186 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66380b3ac0 con 0x7f6638142d50 2024-02-02T11:49:41.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.362+0000 7f663e473640 1 --2- 172.21.15.161:0/532946186 >> v2:172.21.15.162:3300/0 conn(0x7f66380bc340 0x7f6638142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T11:49:41.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f663dc72640 1 --2- 172.21.15.161:0/532946186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6638142d50 0x7f6638148d60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f663806d110 tx=0x7f662801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6c4710ebad9e0a server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:41.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f663d471640 1 -- 172.21.15.161:0/532946186 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66280a89b0 con 0x7f6638142d50 2024-02-02T11:49:41.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f663d471640 1 -- 172.21.15.161:0/532946186 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66280a8b10 con 0x7f6638142d50 2024-02-02T11:49:41.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f663d471640 1 -- 172.21.15.161:0/532946186 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66280a8ea0 con 0x7f6638142d50 2024-02-02T11:49:41.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f66406d7640 1 -- 172.21.15.161:0/532946186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6638142d50 msgr2=0x7f6638148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:41.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f66406d7640 1 --2- 172.21.15.161:0/532946186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6638142d50 0x7f6638148d60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f663806d110 tx=0x7f662801ecf0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f66406d7640 1 -- 172.21.15.161:0/532946186 shutdown_connections 2024-02-02T11:49:41.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f66406d7640 1 --2- 172.21.15.161:0/532946186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66381492a0 0x7f66380b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f66406d7640 1 --2- 172.21.15.161:0/532946186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6638142d50 0x7f6638148d60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f66406d7640 1 --2- 172.21.15.161:0/532946186 >> v2:172.21.15.162:3300/0 conn(0x7f66380bc340 0x7f6638142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f66406d7640 1 -- 172.21.15.161:0/532946186 >> 172.21.15.161:0/532946186 conn(0x7f6638069ef0 msgr2=0x7f663806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:41.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f66406d7640 1 -- 172.21.15.161:0/532946186 shutdown_connections 2024-02-02T11:49:41.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f66406d7640 1 -- 172.21.15.161:0/532946186 wait complete. 2024-02-02T11:49:41.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f66406d7640 1 Processor -- start 2024-02-02T11:49:41.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f66406d7640 1 -- start start 2024-02-02T11:49:41.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f66406d7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66380bc340 0x7f66381cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f66406d7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66381492a0 0x7f66381d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f66406d7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66381d07f0 0x7f66381ddf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f66406d7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66381cfaf0 con 0x7f66381492a0 2024-02-02T11:49:41.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f66406d7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66381ceec0 con 0x7f66381d07f0 2024-02-02T11:49:41.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f66406d7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66381d0c70 con 0x7f66380bc340 2024-02-02T11:49:41.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f663dc72640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66381492a0 0x7f66381d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f663dc72640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66381492a0 0x7f66381d02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35146/0 (socket says 172.21.15.161:35146) 2024-02-02T11:49:41.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f663dc72640 1 -- 172.21.15.161:0/2306254563 learned_addr learned my addr 172.21.15.161:0/2306254563 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f663e473640 1 --2- 172.21.15.161:0/2306254563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66380bc340 0x7f66381cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f663ec74640 1 --2- 172.21.15.161:0/2306254563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66381d07f0 0x7f66381ddf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f663dc72640 1 -- 172.21.15.161:0/2306254563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66380bc340 msgr2=0x7f66381cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f663dc72640 1 --2- 172.21.15.161:0/2306254563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66380bc340 0x7f66381cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f663dc72640 1 -- 172.21.15.161:0/2306254563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66381d07f0 msgr2=0x7f66381ddf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f663dc72640 1 --2- 172.21.15.161:0/2306254563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66381d07f0 0x7f66381ddf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f663dc72640 1 -- 172.21.15.161:0/2306254563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66280094d0 con 0x7f66381492a0 2024-02-02T11:49:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.366+0000 7f663dc72640 1 --2- 172.21.15.161:0/2306254563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66381492a0 0x7f66381d02b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f662801d3a0 tx=0x7f662801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f662effd640 1 -- 172.21.15.161:0/2306254563 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66280ba600 con 0x7f66381492a0 2024-02-02T11:49:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f662effd640 1 -- 172.21.15.161:0/2306254563 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66280ba760 con 0x7f66381492a0 2024-02-02T11:49:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f66406d7640 1 -- 172.21.15.161:0/2306254563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6638148e70 con 0x7f66381492a0 2024-02-02T11:49:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f662effd640 1 -- 172.21.15.161:0/2306254563 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66280bab10 con 0x7f66381492a0 2024-02-02T11:49:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f66406d7640 1 -- 172.21.15.161:0/2306254563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66381ceb50 con 0x7f66381492a0 2024-02-02T11:49:41.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f662effd640 1 -- 172.21.15.161:0/2306254563 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f66280bac70 con 0x7f66381492a0 2024-02-02T11:49:41.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f662effd640 1 --2- 172.21.15.161:0/2306254563 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f661c065a90 0x7f661c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f662effd640 1 -- 172.21.15.161:0/2306254563 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6628121730 con 0x7f66381492a0 2024-02-02T11:49:41.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f663e473640 1 --2- 172.21.15.161:0/2306254563 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f661c065a90 0x7f661c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f663e473640 1 --2- 172.21.15.161:0/2306254563 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f661c065a90 0x7f661c067f50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f66340098b0 tx=0x7f6634008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:41.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f6643800000 1 Processor -- start 2024-02-02T11:49:41.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f6643800000 1 -- start start 2024-02-02T11:49:41.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f6643800000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6d6b996e0 0x55f6d6b99ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f6643800000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a000 0x55f6d6b9a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f6643800000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f6d6b9a920 0x55f6d6ba4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f6643800000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6d6988c90 con 0x55f6d6b9a000 2024-02-02T11:49:41.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f6643800000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6d69ba220 con 0x55f6d6b996e0 2024-02-02T11:49:41.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f6643800000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f6d69b77f0 con 0x55f6d6b9a920 2024-02-02T11:49:41.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f663dc72640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a000 0x55f6d6b9a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f663dc72640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a000 0x55f6d6b9a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35154/0 (socket says 172.21.15.161:35154) 2024-02-02T11:49:41.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f663dc72640 1 -- 172.21.15.161:0/2068576183 learned_addr learned my addr 172.21.15.161:0/2068576183 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:41.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f663e473640 1 --2- 172.21.15.161:0/2068576183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6d6b996e0 0x55f6d6b99ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f663ec74640 1 --2- 172.21.15.161:0/2068576183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f6d6b9a920 0x55f6d6ba4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f663dc72640 1 -- 172.21.15.161:0/2068576183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f6d6b9a920 msgr2=0x55f6d6ba4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:41.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f663dc72640 1 --2- 172.21.15.161:0/2068576183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f6d6b9a920 0x55f6d6ba4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f663dc72640 1 -- 172.21.15.161:0/2068576183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6d6b996e0 msgr2=0x55f6d6b99ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:41.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f663dc72640 1 --2- 172.21.15.161:0/2068576183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6d6b996e0 0x55f6d6b99ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f663dc72640 1 -- 172.21.15.161:0/2068576183 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6d66af890 con 0x55f6d6b9a000 2024-02-02T11:49:41.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.370+0000 7f663e473640 1 --2- 172.21.15.161:0/2068576183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6d6b996e0 0x55f6d6b99ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:41.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f663dc72640 1 --2- 172.21.15.161:0/2068576183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a000 0x55f6d6b9a3e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f662801e760 tx=0x7f66280f2700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0474314cc04dbe server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:41.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f661bfff640 1 -- 172.21.15.161:0/2068576183 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66280f2da0 con 0x55f6d6b9a000 2024-02-02T11:49:41.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f661bfff640 1 -- 172.21.15.161:0/2068576183 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66280f6bd0 con 0x55f6d6b9a000 2024-02-02T11:49:41.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f661bfff640 1 -- 172.21.15.161:0/2068576183 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66280fad80 con 0x55f6d6b9a000 2024-02-02T11:49:41.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 -- 172.21.15.161:0/2068576183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a000 msgr2=0x55f6d6b9a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:41.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 --2- 172.21.15.161:0/2068576183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a000 0x55f6d6b9a3e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f662801e760 tx=0x7f66280f2700 comp rx=0 tx=0).stop 2024-02-02T11:49:41.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 -- 172.21.15.161:0/2068576183 shutdown_connections 2024-02-02T11:49:41.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 --2- 172.21.15.161:0/2068576183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f6d6b9a920 0x55f6d6ba4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 --2- 172.21.15.161:0/2068576183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a000 0x55f6d6b9a3e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 --2- 172.21.15.161:0/2068576183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6d6b996e0 0x55f6d6b99ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 -- 172.21.15.161:0/2068576183 >> 172.21.15.161:0/2068576183 conn(0x55f6d6b95490 msgr2=0x55f6d6b97880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:41.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 -- 172.21.15.161:0/2068576183 shutdown_connections 2024-02-02T11:49:41.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 -- 172.21.15.161:0/2068576183 wait complete. 2024-02-02T11:49:41.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 -- start start 2024-02-02T11:49:41.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 Processor -- start 2024-02-02T11:49:41.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f6d6b996e0 0x55f6d6b94660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6d6b9a000 0x55f6d6b94ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a920 0x55f6d6b66a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6d69b30e0 con 0x55f6d6b9a920 2024-02-02T11:49:41.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6d6952310 con 0x55f6d6b9a000 2024-02-02T11:49:41.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f6d6970770 con 0x55f6d6b996e0 2024-02-02T11:49:41.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 10 client.0 _ll_register_callbacks cb 0x55f6d6b50b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-02T11:49:41.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f663ec74640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a920 0x55f6d6b66a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f663ec74640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a920 0x55f6d6b66a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35164/0 (socket says 172.21.15.161:35164) 2024-02-02T11:49:41.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f663ec74640 1 -- 172.21.15.161:0/2091372160 learned_addr learned my addr 172.21.15.161:0/2091372160 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:41.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f663e473640 1 --2- 172.21.15.161:0/2091372160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f6d6b996e0 0x55f6d6b94660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f663dc72640 1 --2- 172.21.15.161:0/2091372160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6d6b9a000 0x55f6d6b94ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f663ec74640 1 -- 172.21.15.161:0/2091372160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f6d6b996e0 msgr2=0x55f6d6b94660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:41.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f663ec74640 1 --2- 172.21.15.161:0/2091372160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f6d6b996e0 0x55f6d6b94660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f663ec74640 1 -- 172.21.15.161:0/2091372160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6d6b9a000 msgr2=0x55f6d6b94ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:41.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f663ec74640 1 --2- 172.21.15.161:0/2091372160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6d6b9a000 0x55f6d6b94ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f663ec74640 1 -- 172.21.15.161:0/2091372160 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66381ceb50 con 0x55f6d6b9a920 2024-02-02T11:49:41.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f663ec74640 1 --2- 172.21.15.161:0/2091372160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a920 0x55f6d6b66a80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f66300079d0 tx=0x7f6630007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d70d276be501b40 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:41.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f66197fa640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2024-02-02T11:49:41.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f66197fa640 1 -- 172.21.15.161:0/2091372160 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6630010950 con 0x55f6d6b9a920 2024-02-02T11:49:41.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f66197fa640 1 -- 172.21.15.161:0/2091372160 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6630010ab0 con 0x55f6d6b9a920 2024-02-02T11:49:41.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 -- 172.21.15.161:0/2091372160 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f6d6982c10 con 0x55f6d6b9a920 2024-02-02T11:49:41.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f66197fa640 1 -- 172.21.15.161:0/2091372160 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6630010c70 con 0x55f6d6b9a920 2024-02-02T11:49:41.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 10 client.5142 fetch_fsmap learned FSMap version 14 2024-02-02T11:49:41.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 -- 172.21.15.161:0/2091372160 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55f6d6978260 con 0x55f6d6b9a920 2024-02-02T11:49:41.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f66197fa640 1 -- 172.21.15.161:0/2091372160 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f6d6982c10 con 0x55f6d6b9a920 2024-02-02T11:49:41.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f66197fa640 1 -- 172.21.15.161:0/2091372160 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 14) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f66300153e0 con 0x55f6d6b9a920 2024-02-02T11:49:41.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 10 client.5142 fetch_fsmap finished waiting for FSMap version 14 2024-02-02T11:49:41.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 10 client.5142 resolve_mds: resolved name 'c' to daemon mds.c 2024-02-02T11:49:41.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 20 client.5142 populate_metadata read hostname 'smithi161' 2024-02-02T11:49:41.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 --2- 172.21.15.161:0/2091372160 >> [v2:172.21.15.161:6836/1621598548,v1:172.21.15.161:6837/1621598548] conn(0x55f6d6b677f0 0x55f6d6b67bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 4 client.5142 mds_command: new command op to 4932 tid=0[{"prefix": "get_command_descriptions"}] 2024-02-02T11:49:41.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f6643800000 1 -- 172.21.15.161:0/2091372160 --> [v2:172.21.15.161:6836/1621598548,v1:172.21.15.161:6837/1621598548] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f6d69b1a30 con 0x55f6d6b677f0 2024-02-02T11:49:41.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f663e473640 1 --2- 172.21.15.161:0/2091372160 >> [v2:172.21.15.161:6836/1621598548,v1:172.21.15.161:6837/1621598548] conn(0x55f6d6b677f0 0x55f6d6b67bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f66197fa640 10 client.5142 ms_handle_connect on v2:172.21.15.161:6836/1621598548 2024-02-02T11:49:41.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.374+0000 7f663e473640 1 --2- 172.21.15.161:0/2091372160 >> [v2:172.21.15.161:6836/1621598548,v1:172.21.15.161:6837/1621598548] conn(0x55f6d6b677f0 0x55f6d6b67bd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=395898c4e9c9b611 server_cookie=ca8b59b9db357e04 in_seq=0 out_seq=0 2024-02-02T11:49:41.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.378+0000 7f66197fa640 1 -- 172.21.15.161:0/2091372160 <== mds.0 v2:172.21.15.161:6836/1621598548 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55f6d69b1a30 con 0x55f6d6b677f0 2024-02-02T11:49:41.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.378+0000 7f66197fa640 10 client.5142 handle_command_reply: tid=0 2024-02-02T11:49:41.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.378+0000 7f6643800000 1 client.5142 shutdown 2024-02-02T11:49:41.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.378+0000 7f6643800000 1 -- 172.21.15.161:0/2091372160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a920 msgr2=0x55f6d6b66a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:41.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.378+0000 7f6643800000 1 --2- 172.21.15.161:0/2091372160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a920 0x55f6d6b66a80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f66300079d0 tx=0x7f6630007e90 comp rx=0 tx=0).stop 2024-02-02T11:49:41.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.378+0000 7f6643800000 1 -- 172.21.15.161:0/2091372160 shutdown_connections 2024-02-02T11:49:41.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.378+0000 7f6643800000 1 --2- 172.21.15.161:0/2091372160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a920 0x55f6d6b66a80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.378+0000 7f6643800000 1 --2- 172.21.15.161:0/2091372160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6d6b9a000 0x55f6d6b94ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.378+0000 7f6643800000 1 --2- 172.21.15.161:0/2091372160 >> [v2:172.21.15.161:6836/1621598548,v1:172.21.15.161:6837/1621598548] conn(0x55f6d6b677f0 0x55f6d6b67bd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.378+0000 7f6643800000 1 --2- 172.21.15.161:0/2091372160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f6d6b996e0 0x55f6d6b94660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.378+0000 7f6643800000 1 -- 172.21.15.161:0/2091372160 >> 172.21.15.161:0/2091372160 conn(0x55f6d6b95490 msgr2=0x55f6d6b97880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:41.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.378+0000 7f66197fa640 0 client.5142 ms_handle_reset on v2:172.21.15.161:6836/1621598548 2024-02-02T11:49:41.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.378+0000 7f6643800000 1 -- 172.21.15.161:0/2091372160 shutdown_connections 2024-02-02T11:49:41.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.378+0000 7f6643800000 1 -- 172.21.15.161:0/2091372160 wait complete. 2024-02-02T11:49:41.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.378+0000 7f6643800000 20 client.5142 trim_cache size 0 max 16384 2024-02-02T11:49:41.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.390+0000 7f6643800000 1 Processor -- start 2024-02-02T11:49:41.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.390+0000 7f6643800000 1 -- start start 2024-02-02T11:49:41.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.390+0000 7f6643800000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f6d6b996e0 0x55f6d6b990d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.390+0000 7f6643800000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a000 0x55f6d6b65ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.390+0000 7f6643800000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6d6b9a920 0x55f6d6bb07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.390+0000 7f6643800000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6d6670940 con 0x55f6d6b9a000 2024-02-02T11:49:41.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.390+0000 7f6643800000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6d6980a80 con 0x55f6d6b9a920 2024-02-02T11:49:41.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.390+0000 7f6643800000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f6d695b860 con 0x55f6d6b996e0 2024-02-02T11:49:41.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.390+0000 7f663dc72640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a000 0x55f6d6b65ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.390+0000 7f663dc72640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a000 0x55f6d6b65ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35170/0 (socket says 172.21.15.161:35170) 2024-02-02T11:49:41.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.390+0000 7f663dc72640 1 -- 172.21.15.161:0/3771515541 learned_addr learned my addr 172.21.15.161:0/3771515541 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:41.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.390+0000 7f663dc72640 1 -- 172.21.15.161:0/3771515541 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f6d6b996e0 msgr2=0x55f6d6b990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:41.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.390+0000 7f663dc72640 1 --2- 172.21.15.161:0/3771515541 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f6d6b996e0 0x55f6d6b990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.390+0000 7f663dc72640 1 -- 172.21.15.161:0/3771515541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6d6b9a920 msgr2=0x55f6d6bb07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:41.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.390+0000 7f663dc72640 1 --2- 172.21.15.161:0/3771515541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6d6b9a920 0x55f6d6bb07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.390+0000 7f663dc72640 1 -- 172.21.15.161:0/3771515541 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6d695e3b0 con 0x55f6d6b9a000 2024-02-02T11:49:41.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.390+0000 7f663dc72640 1 --2- 172.21.15.161:0/3771515541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a000 0x55f6d6b65ed0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6628009930 tx=0x7f66280b5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d596eb89f82ba2d server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:41.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f662cff9640 1 -- 172.21.15.161:0/3771515541 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66280f6bd0 con 0x55f6d6b9a000 2024-02-02T11:49:41.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f662cff9640 1 -- 172.21.15.161:0/3771515541 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66280f2da0 con 0x55f6d6b9a000 2024-02-02T11:49:41.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f662cff9640 1 -- 172.21.15.161:0/3771515541 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66280fad80 con 0x55f6d6b9a000 2024-02-02T11:49:41.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 -- 172.21.15.161:0/3771515541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a000 msgr2=0x55f6d6b65ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:41.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 --2- 172.21.15.161:0/3771515541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a000 0x55f6d6b65ed0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6628009930 tx=0x7f66280b5000 comp rx=0 tx=0).stop 2024-02-02T11:49:41.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 -- 172.21.15.161:0/3771515541 shutdown_connections 2024-02-02T11:49:41.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 --2- 172.21.15.161:0/3771515541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6d6b9a920 0x55f6d6bb07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 --2- 172.21.15.161:0/3771515541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b9a000 0x55f6d6b65ed0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 --2- 172.21.15.161:0/3771515541 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f6d6b996e0 0x55f6d6b990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 -- 172.21.15.161:0/3771515541 >> 172.21.15.161:0/3771515541 conn(0x55f6d6b95490 msgr2=0x55f6d6b669d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:41.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 -- 172.21.15.161:0/3771515541 shutdown_connections 2024-02-02T11:49:41.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 -- 172.21.15.161:0/3771515541 wait complete. 2024-02-02T11:49:41.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 -- start start 2024-02-02T11:49:41.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 Processor -- start 2024-02-02T11:49:41.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b996e0 0x55f6d6bb34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f6d6b9a000 0x55f6d6bc73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6d6b9a920 0x55f6d6bc7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6d69b70e0 con 0x55f6d6b996e0 2024-02-02T11:49:41.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6d69b4670 con 0x55f6d6b9a920 2024-02-02T11:49:41.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f6d6958770 con 0x55f6d6b9a000 2024-02-02T11:49:41.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 10 client.0 _ll_register_callbacks cb 0x55f6d6971540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-02T11:49:41.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f663e473640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b996e0 0x55f6d6bb34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f663e473640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b996e0 0x55f6d6bb34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35176/0 (socket says 172.21.15.161:35176) 2024-02-02T11:49:41.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f663e473640 1 -- 172.21.15.161:0/3169766348 learned_addr learned my addr 172.21.15.161:0/3169766348 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:41.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f663e473640 1 -- 172.21.15.161:0/3169766348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f6d6b9a000 msgr2=0x55f6d6bc73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:41.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f663e473640 1 --2- 172.21.15.161:0/3169766348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f6d6b9a000 0x55f6d6bc73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f663e473640 1 -- 172.21.15.161:0/3169766348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6d6b9a920 msgr2=0x55f6d6bc7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:41.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f663e473640 1 --2- 172.21.15.161:0/3169766348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6d6b9a920 0x55f6d6bc7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f663e473640 1 -- 172.21.15.161:0/3169766348 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f6d66af890 con 0x55f6d6b996e0 2024-02-02T11:49:41.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f663e473640 1 --2- 172.21.15.161:0/3169766348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b996e0 0x55f6d6bb34c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6634010d70 tx=0x7f66340046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8826a40b215164e server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:41.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f66197fa640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2024-02-02T11:49:41.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f66197fa640 1 -- 172.21.15.161:0/3169766348 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6634028150 con 0x55f6d6b996e0 2024-02-02T11:49:41.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f66197fa640 1 -- 172.21.15.161:0/3169766348 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66340282b0 con 0x55f6d6b996e0 2024-02-02T11:49:41.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 -- 172.21.15.161:0/3169766348 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f6d6978e00 con 0x55f6d6b996e0 2024-02-02T11:49:41.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f66197fa640 1 -- 172.21.15.161:0/3169766348 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6634015970 con 0x55f6d6b996e0 2024-02-02T11:49:41.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 10 client.5148 fetch_fsmap learned FSMap version 14 2024-02-02T11:49:41.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 -- 172.21.15.161:0/3169766348 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55f6d66afcc0 con 0x55f6d6b996e0 2024-02-02T11:49:41.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f66197fa640 1 -- 172.21.15.161:0/3169766348 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f6d6978e00 con 0x55f6d6b996e0 2024-02-02T11:49:41.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f66197fa640 1 -- 172.21.15.161:0/3169766348 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 14) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f6634022040 con 0x55f6d6b996e0 2024-02-02T11:49:41.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 10 client.5148 fetch_fsmap finished waiting for FSMap version 14 2024-02-02T11:49:41.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 10 client.5148 resolve_mds: resolved name 'c' to daemon mds.c 2024-02-02T11:49:41.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 20 client.5148 populate_metadata read hostname 'smithi161' 2024-02-02T11:49:41.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 --2- 172.21.15.161:0/3169766348 >> [v2:172.21.15.161:6836/1621598548,v1:172.21.15.161:6837/1621598548] conn(0x55f6d6bc7e60 0x55f6d6c02750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 4 client.5148 mds_command: new command op to 4932 tid=0[{"prefix": "status"}] 2024-02-02T11:49:41.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 -- 172.21.15.161:0/3169766348 --> [v2:172.21.15.161:6836/1621598548,v1:172.21.15.161:6837/1621598548] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f6d69ac160 con 0x55f6d6bc7e60 2024-02-02T11:49:41.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f663dc72640 1 --2- 172.21.15.161:0/3169766348 >> [v2:172.21.15.161:6836/1621598548,v1:172.21.15.161:6837/1621598548] conn(0x55f6d6bc7e60 0x55f6d6c02750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f66197fa640 10 client.5148 ms_handle_connect on v2:172.21.15.161:6836/1621598548 2024-02-02T11:49:41.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f663dc72640 1 --2- 172.21.15.161:0/3169766348 >> [v2:172.21.15.161:6836/1621598548,v1:172.21.15.161:6837/1621598548] conn(0x55f6d6bc7e60 0x55f6d6c02750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92162b1f927bf6ff server_cookie=70ff8ef0f00660d1 in_seq=0 out_seq=0 2024-02-02T11:49:41.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f66197fa640 1 -- 172.21.15.161:0/3169766348 <== mds.0 v2:172.21.15.161:6836/1621598548 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55f6d69ac160 con 0x55f6d6bc7e60 2024-02-02T11:49:41.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f66197fa640 10 client.5148 handle_command_reply: tid=0 2024-02-02T11:49:41.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 client.5148 shutdown 2024-02-02T11:49:41.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 -- 172.21.15.161:0/3169766348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b996e0 msgr2=0x55f6d6bb34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:41.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 --2- 172.21.15.161:0/3169766348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b996e0 0x55f6d6bb34c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6634010d70 tx=0x7f66340046d0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 -- 172.21.15.161:0/3169766348 shutdown_connections 2024-02-02T11:49:41.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 --2- 172.21.15.161:0/3169766348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f6d6b9a920 0x55f6d6bc7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 --2- 172.21.15.161:0/3169766348 >> [v2:172.21.15.161:6836/1621598548,v1:172.21.15.161:6837/1621598548] conn(0x55f6d6bc7e60 0x55f6d6c02750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 --2- 172.21.15.161:0/3169766348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55f6d6b9a000 0x55f6d6bc73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 --2- 172.21.15.161:0/3169766348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55f6d6b996e0 0x55f6d6bb34c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 -- 172.21.15.161:0/3169766348 >> 172.21.15.161:0/3169766348 conn(0x55f6d6b95490 msgr2=0x55f6d6b98810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:41.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f66197fa640 0 client.5148 ms_handle_reset on v2:172.21.15.161:6836/1621598548 2024-02-02T11:49:41.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 -- 172.21.15.161:0/3169766348 shutdown_connections 2024-02-02T11:49:41.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.394+0000 7f6643800000 1 -- 172.21.15.161:0/3169766348 wait complete. 2024-02-02T11:49:41.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.398+0000 7f6643800000 20 client.5148 trim_cache size 0 max 16384 2024-02-02T11:49:41.407 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-02-02T11:49:41.407 INFO:teuthology.orchestra.run.smithi161.stdout: "cluster_fsid": "6072f293-dbe3-404b-82f1-eb0e17d96787", 2024-02-02T11:49:41.407 INFO:teuthology.orchestra.run.smithi161.stdout: "whoami": 0, 2024-02-02T11:49:41.407 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 4932, 2024-02-02T11:49:41.407 INFO:teuthology.orchestra.run.smithi161.stdout: "want_state": "up:active", 2024-02-02T11:49:41.407 INFO:teuthology.orchestra.run.smithi161.stdout: "state": "up:active", 2024-02-02T11:49:41.407 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs", 2024-02-02T11:49:41.407 INFO:teuthology.orchestra.run.smithi161.stdout: "rank_uptime": 9.5644410579999999, 2024-02-02T11:49:41.407 INFO:teuthology.orchestra.run.smithi161.stdout: "mdsmap_epoch": 14, 2024-02-02T11:49:41.408 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch": 31, 2024-02-02T11:49:41.408 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch_barrier": 31, 2024-02-02T11:49:41.408 INFO:teuthology.orchestra.run.smithi161.stdout: "uptime": 15.955803076 2024-02-02T11:49:41.408 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-02-02T11:49:41.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.398+0000 7f66406d7640 1 -- 172.21.15.161:0/2306254563 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f661c065a90 msgr2=0x7f661c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:41.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.398+0000 7f66406d7640 1 --2- 172.21.15.161:0/2306254563 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f661c065a90 0x7f661c067f50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f66340098b0 tx=0x7f6634008040 comp rx=0 tx=0).stop 2024-02-02T11:49:41.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.398+0000 7f66406d7640 1 -- 172.21.15.161:0/2306254563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66381492a0 msgr2=0x7f66381d02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:41.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.398+0000 7f66406d7640 1 --2- 172.21.15.161:0/2306254563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66381492a0 0x7f66381d02b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f662801d3a0 tx=0x7f662801ba90 comp rx=0 tx=0).stop 2024-02-02T11:49:41.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.398+0000 7f66406d7640 1 -- 172.21.15.161:0/2306254563 shutdown_connections 2024-02-02T11:49:41.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.398+0000 7f66406d7640 1 --2- 172.21.15.161:0/2306254563 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f661c065a90 0x7f661c067f50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.398+0000 7f66406d7640 1 --2- 172.21.15.161:0/2306254563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66381d07f0 0x7f66381ddf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.398+0000 7f66406d7640 1 --2- 172.21.15.161:0/2306254563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66381492a0 0x7f66381d02b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.398+0000 7f66406d7640 1 --2- 172.21.15.161:0/2306254563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66380bc340 0x7f66381cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.398+0000 7f66406d7640 1 -- 172.21.15.161:0/2306254563 >> 172.21.15.161:0/2306254563 conn(0x7f6638069ef0 msgr2=0x7f663813e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:41.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.398+0000 7f66406d7640 1 -- 172.21.15.161:0/2306254563 shutdown_connections 2024-02-02T11:49:41.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.398+0000 7f66406d7640 1 -- 172.21.15.161:0/2306254563 wait complete. 2024-02-02T11:49:41.416 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-02T11:49:41.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7f2bbe640 1 Processor -- start 2024-02-02T11:49:41.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7f2bbe640 1 -- start start 2024-02-02T11:49:41.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7f2bbe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd7ec0b8020 0x7fd7ec147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7f2bbe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd7ec070980 0x7fd7ec1481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7f2bbe640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ec071550 con 0x7fd7ec0bc340 2024-02-02T11:49:41.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7f2bbe640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ec141d00 con 0x7fd7ec070980 2024-02-02T11:49:41.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7f2bbe640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ec071810 con 0x7fd7ec0b8020 2024-02-02T11:49:41.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7f095a640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd7ec0bc340 0x7fd7ec1415f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:45062/0 (socket says 172.21.15.161:45062) 2024-02-02T11:49:41.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7f115b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd7ec070980 0x7fd7ec1481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7f095a640 1 -- 172.21.15.161:0/575351418 learned_addr learned my addr 172.21.15.161:0/575351418 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:49:41.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7ebfff640 1 --2- 172.21.15.161:0/575351418 >> v2:172.21.15.162:3300/0 conn(0x7fd7ec0b8020 0x7fd7ec147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7eb7fe640 1 -- 172.21.15.161:0/575351418 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493958224 0 0) 0x7fd7ec071550 con 0x7fd7ec0bc340 2024-02-02T11:49:41.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7eb7fe640 1 -- 172.21.15.161:0/575351418 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7dc003530 con 0x7fd7ec0bc340 2024-02-02T11:49:41.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7f115b640 1 -- 172.21.15.161:0/575351418 >> v2:172.21.15.162:3300/0 conn(0x7fd7ec0b8020 msgr2=0x7fd7ec147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:49:41.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7f115b640 1 --2- 172.21.15.161:0/575351418 >> v2:172.21.15.162:3300/0 conn(0x7fd7ec0b8020 0x7fd7ec147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7f115b640 1 -- 172.21.15.161:0/575351418 >> v1:172.21.15.161:6789/0 conn(0x7fd7ec0bc340 legacy=0x7fd7ec1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:41.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7f115b640 1 -- 172.21.15.161:0/575351418 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec0bc720 con 0x7fd7ec070980 2024-02-02T11:49:41.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7f115b640 1 --2- 172.21.15.161:0/575351418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7ec070980 0x7fd7ec1481a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec06b260 tx=0x7fd7e401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f87bbfb326e7b9b server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:41.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7eb7fe640 1 -- 172.21.15.161:0/575351418 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40a6640 con 0x7fd7ec070980 2024-02-02T11:49:41.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7eb7fe640 1 -- 172.21.15.161:0/575351418 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e40a67a0 con 0x7fd7ec070980 2024-02-02T11:49:41.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.526+0000 7fd7eb7fe640 1 -- 172.21.15.161:0/575351418 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40a6b30 con 0x7fd7ec070980 2024-02-02T11:49:41.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f2bbe640 1 -- 172.21.15.161:0/575351418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7ec070980 msgr2=0x7fd7ec1481a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:41.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f2bbe640 1 --2- 172.21.15.161:0/575351418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7ec070980 0x7fd7ec1481a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec06b260 tx=0x7fd7e401c880 comp rx=0 tx=0).stop 2024-02-02T11:49:41.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f2bbe640 1 -- 172.21.15.161:0/575351418 shutdown_connections 2024-02-02T11:49:41.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f2bbe640 1 --2- 172.21.15.161:0/575351418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7ec070980 0x7fd7ec1481a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f2bbe640 1 --2- 172.21.15.161:0/575351418 >> v2:172.21.15.162:3300/0 conn(0x7fd7ec0b8020 0x7fd7ec147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f2bbe640 1 -- 172.21.15.161:0/575351418 >> 172.21.15.161:0/575351418 conn(0x7fd7ec069ef0 msgr2=0x7fd7ec06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:41.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f2bbe640 1 -- 172.21.15.161:0/575351418 shutdown_connections 2024-02-02T11:49:41.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f2bbe640 1 -- 172.21.15.161:0/575351418 wait complete. 2024-02-02T11:49:41.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f2bbe640 1 Processor -- start 2024-02-02T11:49:41.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f2bbe640 1 -- start start 2024-02-02T11:49:41.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f2bbe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7ec070980 0x7fd7ec13d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f2bbe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7ec0b8020 0x7fd7ec1e6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f2bbe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7ec0bc340 0x7fd7ec135150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f2bbe640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec13dee0 con 0x7fd7ec070980 2024-02-02T11:49:41.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f2bbe640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec0b9cb0 con 0x7fd7ec0bc340 2024-02-02T11:49:41.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f2bbe640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec139980 con 0x7fd7ec0b8020 2024-02-02T11:49:41.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f095a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7ec070980 0x7fd7ec13d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f095a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7ec070980 0x7fd7ec13d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35200/0 (socket says 172.21.15.161:35200) 2024-02-02T11:49:41.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f095a640 1 -- 172.21.15.161:0/85099006 learned_addr learned my addr 172.21.15.161:0/85099006 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:49:41.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f115b640 1 --2- 172.21.15.161:0/85099006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7ec0bc340 0x7fd7ec135150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7ebfff640 1 --2- 172.21.15.161:0/85099006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7ec0b8020 0x7fd7ec1e6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f095a640 1 -- 172.21.15.161:0/85099006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7ec0b8020 msgr2=0x7fd7ec1e6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:41.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f095a640 1 --2- 172.21.15.161:0/85099006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7ec0b8020 0x7fd7ec1e6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f095a640 1 -- 172.21.15.161:0/85099006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7ec0bc340 msgr2=0x7fd7ec135150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:41.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f095a640 1 --2- 172.21.15.161:0/85099006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7ec0bc340 0x7fd7ec135150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f095a640 1 -- 172.21.15.161:0/85099006 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e4009a70 con 0x7fd7ec070980 2024-02-02T11:49:41.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7ebfff640 1 --2- 172.21.15.161:0/85099006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7ec0b8020 0x7fd7ec1e6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:41.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f115b640 1 --2- 172.21.15.161:0/85099006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7ec0bc340 0x7fd7ec135150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:49:41.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.530+0000 7fd7f095a640 1 --2- 172.21.15.161:0/85099006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7ec070980 0x7fd7ec13d9a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800c3c0 tx=0x7fd7d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:41.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.534+0000 7fd7e97fa640 1 -- 172.21.15.161:0/85099006 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8005cf0 con 0x7fd7ec070980 2024-02-02T11:49:41.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.534+0000 7fd7f2bbe640 1 -- 172.21.15.161:0/85099006 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ec139c60 con 0x7fd7ec070980 2024-02-02T11:49:41.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.534+0000 7fd7f2bbe640 1 -- 172.21.15.161:0/85099006 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ec139f40 con 0x7fd7ec070980 2024-02-02T11:49:41.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.534+0000 7fd7e97fa640 1 -- 172.21.15.161:0/85099006 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d8005e50 con 0x7fd7ec070980 2024-02-02T11:49:41.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.534+0000 7fd7e97fa640 1 -- 172.21.15.161:0/85099006 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80072d0 con 0x7fd7ec070980 2024-02-02T11:49:41.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.534+0000 7fd7f2bbe640 1 -- 172.21.15.161:0/85099006 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7cc005260 con 0x7fd7ec070980 2024-02-02T11:49:41.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.534+0000 7fd7e97fa640 1 -- 172.21.15.161:0/85099006 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd7d8007430 con 0x7fd7ec070980 2024-02-02T11:49:41.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.534+0000 7fd7e97fa640 1 --2- 172.21.15.161:0/85099006 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd7d0065a60 0x7fd7d0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:49:41.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.534+0000 7fd7ebfff640 1 --2- 172.21.15.161:0/85099006 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd7d0065a60 0x7fd7d0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:49:41.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.534+0000 7fd7e97fa640 1 -- 172.21.15.161:0/85099006 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7d8082650 con 0x7fd7ec070980 2024-02-02T11:49:41.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.534+0000 7fd7ebfff640 1 --2- 172.21.15.161:0/85099006 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd7d0065a60 0x7fd7d0067f20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec146fa0 tx=0x7fd7e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:49:41.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.538+0000 7fd7e97fa640 1 -- 172.21.15.161:0/85099006 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd7d8050040 con 0x7fd7ec070980 2024-02-02T11:49:41.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.726+0000 7fd7f2bbe640 1 -- 172.21.15.161:0/85099006 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd7cc0057e0 con 0x7fd7ec070980 2024-02-02T11:49:41.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.730+0000 7fd7e97fa640 1 -- 172.21.15.161:0/85099006 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd7d8053660 con 0x7fd7ec070980 2024-02-02T11:49:41.733 INFO:teuthology.orchestra.run.smithi161.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-02T11:49:41.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.730+0000 7fd7f2bbe640 1 -- 172.21.15.161:0/85099006 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd7d0065a60 msgr2=0x7fd7d0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:41.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.730+0000 7fd7f2bbe640 1 --2- 172.21.15.161:0/85099006 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd7d0065a60 0x7fd7d0067f20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec146fa0 tx=0x7fd7e0008040 comp rx=0 tx=0).stop 2024-02-02T11:49:41.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.730+0000 7fd7f2bbe640 1 -- 172.21.15.161:0/85099006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7ec070980 msgr2=0x7fd7ec13d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:49:41.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.730+0000 7fd7f2bbe640 1 --2- 172.21.15.161:0/85099006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7ec070980 0x7fd7ec13d9a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800c3c0 tx=0x7fd7d800c880 comp rx=0 tx=0).stop 2024-02-02T11:49:41.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.730+0000 7fd7f2bbe640 1 -- 172.21.15.161:0/85099006 shutdown_connections 2024-02-02T11:49:41.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.730+0000 7fd7f2bbe640 1 --2- 172.21.15.161:0/85099006 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd7d0065a60 0x7fd7d0067f20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.730+0000 7fd7f2bbe640 1 --2- 172.21.15.161:0/85099006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7ec0bc340 0x7fd7ec135150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.730+0000 7fd7f2bbe640 1 --2- 172.21.15.161:0/85099006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7ec0b8020 0x7fd7ec1e6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.730+0000 7fd7f2bbe640 1 --2- 172.21.15.161:0/85099006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7ec070980 0x7fd7ec13d9a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:49:41.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.730+0000 7fd7f2bbe640 1 -- 172.21.15.161:0/85099006 >> 172.21.15.161:0/85099006 conn(0x7fd7ec069ef0 msgr2=0x7fd7ec137e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:49:41.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.730+0000 7fd7f2bbe640 1 -- 172.21.15.161:0/85099006 shutdown_connections 2024-02-02T11:49:41.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:49:41.730+0000 7fd7f2bbe640 1 -- 172.21.15.161:0/85099006 wait complete. 2024-02-02T11:49:41.751 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-02-02T11:49:41.751 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-02T11:49:41.751 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-02-02T11:49:41.752 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-02T11:49:41.752 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-02T11:49:41.752 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-02-02T11:49:41.752 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-02-02T11:49:41.752 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-02T11:49:41.752 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-02T11:49:41.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:41.752 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-02-02T11:49:41.762 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-02T11:49:41.762 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-02T11:49:41.762 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-02-02T11:49:41.762 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-02-02T11:49:41.762 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-02-02T11:49:41.762 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-02-02T11:49:41.762 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-02T11:49:41.762 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-02-02T11:49:41.762 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-02-02T11:49:41.763 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-02T11:49:41.763 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-02-02T11:49:41.763 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-02-02T11:49:41.763 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-02T11:49:41.763 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-02-02T11:49:41.763 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-02T11:49:41.763 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-02-02T11:49:41.763 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-02-02T11:49:41.763 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42454sec preferred_lft 42454sec 2024-02-02T11:49:41.763 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2024-02-02T11:49:41.763 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-02-02T11:49:41.763 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-02-02T11:49:41.763 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:6d:e4:25:4d brd ff:ff:ff:ff:ff:ff 2024-02-02T11:49:41.763 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-02-02T11:49:41.763 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-02-02T11:49:41.763 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-02T11:49:41.764 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-02-02T11:49:41.764 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-02T11:49:41.764 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-02-02T11:49:41.764 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-02-02T11:49:41.764 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-02-02T11:49:41.764 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-02T11:49:41.764 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-02T11:49:41.764 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-02-02T11:49:41.764 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-02-02T11:49:41.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:41.765 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-02T11:49:41.828 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-02-02T11:49:41.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:41.831 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-02-02T11:49:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-02-02T11:49:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-02T11:49:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-02-02T11:49:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-02T11:49:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-02-02T11:49:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-02T11:49:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-02T11:49:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-02T11:49:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-02T11:49:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-02T11:49:41.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:41.885 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-02-02T11:49:41.885 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-02-02T11:49:41.885 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-02T11:49:41.885 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-02T11:49:41.885 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-02T11:49:41.885 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-02-02T11:49:41.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:41.977 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-02-02T11:49:41.986 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-02T11:49:41.987 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-02T11:49:41.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:41.987 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2024-02-02T11:49:42.053 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-02T11:49:42.054 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-02T11:49:42.105 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-02T11:49:42.105 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-02T11:49:42.105 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-02T11:49:42.156 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-02T11:49:42.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:42.157 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-02T11:49:42.247 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-02T11:49:42.247 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-02T11:49:42.248 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-02-02T11:49:42.263 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-02T11:49:42.263 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-02T11:49:42.263 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-02-02T11:49:42.264 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.161:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-02-02T11:49:42.264 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-02T11:49:42.277 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-02T11:49:42.277 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-02T11:49:42.277 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-02-02T11:49:42.277 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.161:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-02-02T11:49:42.277 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-02T11:49:42.277 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.161:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-02-02T11:49:42.277 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.161:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-02-02T11:49:42.277 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=6072f293-dbe3-404b-82f1-eb0e17d96787" will pass to kernel 2024-02-02T11:49:42.281 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-02T11:49:42.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:42.281 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-02T11:49:42.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:42.302 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-02T11:49:42.373 INFO:teuthology.orchestra.run.smithi177.stdout:client4628 2024-02-02T11:49:42.374 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T11:49:42.374 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-02T11:49:42.429 DEBUG:teuthology.orchestra.run.smithi177:> mktemp -d --suffix=xfstests-dev 2024-02-02T11:49:42.484 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.ByhSz7TqB0xfstests-dev 2024-02-02T11:49:42.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:42.485 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.ByhSz7TqB0xfstests-dev) 2024-02-02T11:49:42.543 INFO:teuthology.orchestra.run.smithi177.stderr:Cloning into '/tmp/tmp.ByhSz7TqB0xfstests-dev'... 2024-02-02T11:49:43.394 DEBUG:teuthology.orchestra.run.smithi177:> mktemp -d --suffix=xfsprogs-dev 2024-02-02T11:49:43.449 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.mSCij3RKBAxfsprogs-dev 2024-02-02T11:49:43.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:43.449 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.mSCij3RKBAxfsprogs-dev) 2024-02-02T11:49:43.511 INFO:teuthology.orchestra.run.smithi177.stderr:Cloning into '/tmp/tmp.mSCij3RKBAxfsprogs-dev'... 2024-02-02T11:49:44.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:44.047 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-02-02T11:49:44.112 DEBUG:teuthology.orchestra.run.smithi177:> mktemp -d --suffix=test 2024-02-02T11:49:44.160 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.R1pG371raPtest 2024-02-02T11:49:44.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T11:49:44.161 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-02-02T11:49:44.213 DEBUG:teuthology.orchestra.run.smithi177:> mktemp -d --suffix=scratch 2024-02-02T11:49:44.264 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.jtqH6Jn1Mhscratch 2024-02-02T11:49:44.264 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2024-02-02T11:49:44.264 DEBUG:teuthology.orchestra.run.smithi177:> sudo apt-get install -y xfslibs-dev uuid-dev libtool-bin e2fsprogs automake gcc libuuid1 quota attr libattr1-dev make libacl1-dev libaio-dev xfsprogs libgdbm-dev gawk fio dbench uuid-runtime python2 sqlite3 libinih-dev liburcu-dev libblkid-dev gettext libedit-dev libattr1-dev libdevmapper-dev libicu-dev pkg-config 2024-02-02T11:49:44.377 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2024-02-02T11:49:44.543 INFO:teuthology.orchestra.run.smithi177.stdout:Building dependency tree... 2024-02-02T11:49:44.544 INFO:teuthology.orchestra.run.smithi177.stdout:Reading state information... 2024-02-02T11:49:44.697 INFO:teuthology.orchestra.run.smithi177.stdout:attr is already the newest version (1:2.5.1-1build1). 2024-02-02T11:49:44.698 INFO:teuthology.orchestra.run.smithi177.stdout:automake is already the newest version (1:1.16.5-1.3). 2024-02-02T11:49:44.698 INFO:teuthology.orchestra.run.smithi177.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2024-02-02T11:49:44.698 INFO:teuthology.orchestra.run.smithi177.stdout:gcc set to manually installed. 2024-02-02T11:49:44.698 INFO:teuthology.orchestra.run.smithi177.stdout:gettext is already the newest version (0.21-4ubuntu4). 2024-02-02T11:49:44.698 INFO:teuthology.orchestra.run.smithi177.stdout:libacl1-dev is already the newest version (2.3.1-1). 2024-02-02T11:49:44.698 INFO:teuthology.orchestra.run.smithi177.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2024-02-02T11:49:44.698 INFO:teuthology.orchestra.run.smithi177.stdout:libattr1-dev is already the newest version (1:2.5.1-1build1). 2024-02-02T11:49:44.698 INFO:teuthology.orchestra.run.smithi177.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-02-02T11:49:44.698 INFO:teuthology.orchestra.run.smithi177.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3). 2024-02-02T11:49:44.698 INFO:teuthology.orchestra.run.smithi177.stdout:make is already the newest version (4.3-4.1build1). 2024-02-02T11:49:44.698 INFO:teuthology.orchestra.run.smithi177.stdout:make set to manually installed. 2024-02-02T11:49:44.698 INFO:teuthology.orchestra.run.smithi177.stdout:quota is already the newest version (4.06-1build2). 2024-02-02T11:49:44.699 INFO:teuthology.orchestra.run.smithi177.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-02-02T11:49:44.699 INFO:teuthology.orchestra.run.smithi177.stdout:uuid-runtime is already the newest version (2.37.2-4ubuntu3). 2024-02-02T11:49:44.699 INFO:teuthology.orchestra.run.smithi177.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-02-02T11:49:44.699 INFO:teuthology.orchestra.run.smithi177.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2024-02-02T11:49:44.699 INFO:teuthology.orchestra.run.smithi177.stdout:dbench is already the newest version (4.0-2build1). 2024-02-02T11:49:44.699 INFO:teuthology.orchestra.run.smithi177.stdout:python2 is already the newest version (2.7.18-3). 2024-02-02T11:49:44.699 INFO:teuthology.orchestra.run.smithi177.stdout:python2 set to manually installed. 2024-02-02T11:49:44.699 INFO:teuthology.orchestra.run.smithi177.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2024-02-02T11:49:44.699 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages were automatically installed and are no longer required: 2024-02-02T11:49:44.699 INFO:teuthology.orchestra.run.smithi177.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2024-02-02T11:49:44.699 INFO:teuthology.orchestra.run.smithi177.stdout: libpython2-dev libpython2.7 libpython2.7-dev linux-image-5.4.0-135-generic 2024-02-02T11:49:44.700 INFO:teuthology.orchestra.run.smithi177.stdout: linux-modules-5.4.0-135-generic python2-dev python2.7-dev 2024-02-02T11:49:44.700 INFO:teuthology.orchestra.run.smithi177.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-02T11:49:44.700 INFO:teuthology.orchestra.run.smithi177.stdout:The following additional packages will be installed: 2024-02-02T11:49:44.700 INFO:teuthology.orchestra.run.smithi177.stdout: icu-devtools libbsd-dev libinireader0 libmd-dev libnss-systemd 2024-02-02T11:49:44.700 INFO:teuthology.orchestra.run.smithi177.stdout: libpam-systemd libpcre2-32-0 libpcre2-dev libpcre2-posix3 libpmemblk1 2024-02-02T11:49:44.700 INFO:teuthology.orchestra.run.smithi177.stdout: libselinux1-dev libsepol-dev libsqlite3-0 libsystemd0 libudev-dev libudev1 2024-02-02T11:49:44.701 INFO:teuthology.orchestra.run.smithi177.stdout: systemd systemd-sysv udev 2024-02-02T11:49:44.701 INFO:teuthology.orchestra.run.smithi177.stdout:Suggested packages: 2024-02-02T11:49:44.701 INFO:teuthology.orchestra.run.smithi177.stdout: gnuplot gfio python-scipy gawk-doc icu-doc sqlite3-doc systemd-container 2024-02-02T11:49:44.701 INFO:teuthology.orchestra.run.smithi177.stdout: libtss2-esys-3.0.2-0 libtss2-mu0 libtss2-rc0 2024-02-02T11:49:44.747 INFO:teuthology.orchestra.run.smithi177.stdout:The following NEW packages will be installed: 2024-02-02T11:49:44.747 INFO:teuthology.orchestra.run.smithi177.stdout: fio icu-devtools libblkid-dev libbsd-dev libdevmapper-dev libedit-dev 2024-02-02T11:49:44.748 INFO:teuthology.orchestra.run.smithi177.stdout: libgdbm-dev libicu-dev libinih-dev libinireader0 libmd-dev libpcre2-32-0 2024-02-02T11:49:44.748 INFO:teuthology.orchestra.run.smithi177.stdout: libpcre2-dev libpcre2-posix3 libpmemblk1 libselinux1-dev libsepol-dev 2024-02-02T11:49:44.748 INFO:teuthology.orchestra.run.smithi177.stdout: libudev-dev liburcu-dev pkg-config sqlite3 2024-02-02T11:49:44.749 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages will be upgraded: 2024-02-02T11:49:44.750 INFO:teuthology.orchestra.run.smithi177.stdout: gawk libnss-systemd libpam-systemd libsqlite3-0 libsystemd0 libudev1 systemd 2024-02-02T11:49:44.750 INFO:teuthology.orchestra.run.smithi177.stdout: systemd-sysv udev 2024-02-02T11:49:44.833 INFO:teuthology.orchestra.run.smithi177.stdout:9 upgraded, 21 newly installed, 0 to remove and 262 not upgraded. 2024-02-02T11:49:44.834 INFO:teuthology.orchestra.run.smithi177.stdout:Need to get 27.0 MB of archives. 2024-02-02T11:49:44.834 INFO:teuthology.orchestra.run.smithi177.stdout:After this operation, 67.5 MB of additional disk space will be used. 2024-02-02T11:49:44.834 INFO:teuthology.orchestra.run.smithi177.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsystemd0 amd64 249.11-0ubuntu3.12 [319 kB] 2024-02-02T11:49:44.962 INFO:teuthology.orchestra.run.smithi177.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 systemd-sysv amd64 249.11-0ubuntu3.12 [10.5 kB] 2024-02-02T11:49:44.962 INFO:teuthology.orchestra.run.smithi177.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnss-systemd amd64 249.11-0ubuntu3.12 [133 kB] 2024-02-02T11:49:44.968 INFO:teuthology.orchestra.run.smithi177.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpam-systemd amd64 249.11-0ubuntu3.12 [203 kB] 2024-02-02T11:49:44.983 INFO:teuthology.orchestra.run.smithi177.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 systemd amd64 249.11-0ubuntu3.12 [4,581 kB] 2024-02-02T11:49:45.076 INFO:teuthology.orchestra.run.smithi177.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 udev amd64 249.11-0ubuntu3.12 [1,557 kB] 2024-02-02T11:49:45.095 INFO:teuthology.orchestra.run.smithi177.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libudev1 amd64 249.11-0ubuntu3.12 [78.2 kB] 2024-02-02T11:49:45.096 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 gawk amd64 1:5.1.0-1ubuntu0.1 [447 kB] 2024-02-02T11:49:45.100 INFO:teuthology.orchestra.run.smithi177.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsqlite3-0 amd64 3.37.2-2ubuntu0.3 [641 kB] 2024-02-02T11:49:45.106 INFO:teuthology.orchestra.run.smithi177.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2024-02-02T11:49:45.107 INFO:teuthology.orchestra.run.smithi177.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2024-02-02T11:49:45.166 INFO:teuthology.orchestra.run.smithi177.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 icu-devtools amd64 70.1-2 [197 kB] 2024-02-02T11:49:45.168 INFO:teuthology.orchestra.run.smithi177.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libmd-dev amd64 1.0.4-1build1 [40.0 kB] 2024-02-02T11:49:45.168 INFO:teuthology.orchestra.run.smithi177.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbsd-dev amd64 0.11.5-1 [168 kB] 2024-02-02T11:49:45.172 INFO:teuthology.orchestra.run.smithi177.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libudev-dev amd64 249.11-0ubuntu3.12 [20.7 kB] 2024-02-02T11:49:45.173 INFO:teuthology.orchestra.run.smithi177.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 libsepol-dev amd64 3.3-1build1 [378 kB] 2024-02-02T11:49:45.177 INFO:teuthology.orchestra.run.smithi177.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-32-0 amd64 10.39-3ubuntu0.1 [194 kB] 2024-02-02T11:49:45.179 INFO:teuthology.orchestra.run.smithi177.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-posix3 amd64 10.39-3ubuntu0.1 [6,130 B] 2024-02-02T11:49:45.179 INFO:teuthology.orchestra.run.smithi177.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-dev amd64 10.39-3ubuntu0.1 [730 kB] 2024-02-02T11:49:45.186 INFO:teuthology.orchestra.run.smithi177.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libselinux1-dev amd64 3.3-1build2 [158 kB] 2024-02-02T11:49:45.198 INFO:teuthology.orchestra.run.smithi177.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 libdevmapper-dev amd64 2:1.02.175-2.1ubuntu4 [36.6 kB] 2024-02-02T11:49:45.214 INFO:teuthology.orchestra.run.smithi177.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libedit-dev amd64 3.1-20210910-1build1 [118 kB] 2024-02-02T11:49:45.216 INFO:teuthology.orchestra.run.smithi177.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2024-02-02T11:49:45.217 INFO:teuthology.orchestra.run.smithi177.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libicu-dev amd64 70.1-2 [11.6 MB] 2024-02-02T11:49:45.369 INFO:teuthology.orchestra.run.smithi177.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libinireader0 amd64 53-1ubuntu3 [9,636 B] 2024-02-02T11:49:45.369 INFO:teuthology.orchestra.run.smithi177.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libinih-dev amd64 53-1ubuntu3 [20.6 kB] 2024-02-02T11:49:45.370 INFO:teuthology.orchestra.run.smithi177.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-02-02T11:49:45.370 INFO:teuthology.orchestra.run.smithi177.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.3 [768 kB] 2024-02-02T11:49:45.377 INFO:teuthology.orchestra.run.smithi177.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 libblkid-dev amd64 2.37.2-4ubuntu3 [185 kB] 2024-02-02T11:49:45.379 INFO:teuthology.orchestra.run.smithi177.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liburcu-dev amd64 0.13.1-1 [125 kB] 2024-02-02T11:49:45.629 INFO:teuthology.orchestra.run.smithi177.stderr:debconf: unable to initialize frontend: Dialog 2024-02-02T11:49:45.629 INFO:teuthology.orchestra.run.smithi177.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-02-02T11:49:45.629 INFO:teuthology.orchestra.run.smithi177.stderr:debconf: falling back to frontend: Readline 2024-02-02T11:49:45.643 INFO:teuthology.orchestra.run.smithi177.stderr:debconf: unable to initialize frontend: Readline 2024-02-02T11:49:45.643 INFO:teuthology.orchestra.run.smithi177.stderr:debconf: (This frontend requires a controlling tty.) 2024-02-02T11:49:45.643 INFO:teuthology.orchestra.run.smithi177.stderr:debconf: falling back to frontend: Teletype 2024-02-02T11:49:45.650 INFO:teuthology.orchestra.run.smithi177.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-02-02T11:49:45.686 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 27.0 MB in 1s (43.4 MB/s) 2024-02-02T11:49:45.934 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142648 files and directories currently installed.) 2024-02-02T11:49:45.937 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../libsystemd0_249.11-0ubuntu3.12_amd64.deb ... 2024-02-02T11:49:46.103 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libsystemd0:amd64 (249.11-0ubuntu3.12) over (249.11-0ubuntu3.6) ... 2024-02-02T11:49:46.440 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libsystemd0:amd64 (249.11-0ubuntu3.12) ... 2024-02-02T11:49:46.798 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142648 files and directories currently installed.) 2024-02-02T11:49:46.802 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../0-systemd-sysv_249.11-0ubuntu3.12_amd64.deb ... 2024-02-02T11:49:47.068 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking systemd-sysv (249.11-0ubuntu3.12) over (249.11-0ubuntu3.6) ... 2024-02-02T11:49:47.555 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../1-libnss-systemd_249.11-0ubuntu3.12_amd64.deb ... 2024-02-02T11:49:47.690 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libnss-systemd:amd64 (249.11-0ubuntu3.12) over (249.11-0ubuntu3.6) ... 2024-02-02T11:49:48.044 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../2-libpam-systemd_249.11-0ubuntu3.12_amd64.deb ... 2024-02-02T11:49:48.161 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libpam-systemd:amd64 (249.11-0ubuntu3.12) over (249.11-0ubuntu3.6) ... 2024-02-02T11:49:48.615 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../3-systemd_249.11-0ubuntu3.12_amd64.deb ... 2024-02-02T11:49:48.822 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking systemd (249.11-0ubuntu3.12) over (249.11-0ubuntu3.6) ... 2024-02-02T11:49:49.870 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../4-udev_249.11-0ubuntu3.12_amd64.deb ... 2024-02-02T11:49:50.081 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking udev (249.11-0ubuntu3.12) over (249.11-0ubuntu3.6) ... 2024-02-02T11:49:50.638 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../5-libudev1_249.11-0ubuntu3.12_amd64.deb ... 2024-02-02T11:49:50.773 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libudev1:amd64 (249.11-0ubuntu3.12) over (249.11-0ubuntu3.6) ... 2024-02-02T11:49:51.105 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libudev1:amd64 (249.11-0ubuntu3.12) ... 2024-02-02T11:49:51.412 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:49:51.415 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:49:51.418 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:49:51.573 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142648 files and directories currently installed.) 2024-02-02T11:49:51.577 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../00-gawk_1%3a5.1.0-1ubuntu0.1_amd64.deb ... 2024-02-02T11:49:51.715 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking gawk (1:5.1.0-1ubuntu0.1) over (1:5.1.0-1build3) ... 2024-02-02T11:49:52.158 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../01-libsqlite3-0_3.37.2-2ubuntu0.3_amd64.deb ... 2024-02-02T11:49:52.585 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) over (3.37.2-2ubuntu0.1) ... 2024-02-02T11:49:52.980 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libpmemblk1:amd64. 2024-02-02T11:49:52.997 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../02-libpmemblk1_1.11.1-3build1_amd64.deb ... 2024-02-02T11:49:53.039 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2024-02-02T11:49:53.350 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package fio. 2024-02-02T11:49:53.366 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../03-fio_3.28-1_amd64.deb ... 2024-02-02T11:49:53.400 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking fio (3.28-1) ... 2024-02-02T11:49:53.846 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package icu-devtools. 2024-02-02T11:49:53.861 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../04-icu-devtools_70.1-2_amd64.deb ... 2024-02-02T11:49:53.904 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking icu-devtools (70.1-2) ... 2024-02-02T11:49:54.183 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libmd-dev:amd64. 2024-02-02T11:49:54.199 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../05-libmd-dev_1.0.4-1build1_amd64.deb ... 2024-02-02T11:49:54.241 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libmd-dev:amd64 (1.0.4-1build1) ... 2024-02-02T11:49:54.639 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libbsd-dev:amd64. 2024-02-02T11:49:54.655 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../06-libbsd-dev_0.11.5-1_amd64.deb ... 2024-02-02T11:49:54.697 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libbsd-dev:amd64 (0.11.5-1) ... 2024-02-02T11:49:55.012 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libudev-dev:amd64. 2024-02-02T11:49:55.027 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../07-libudev-dev_249.11-0ubuntu3.12_amd64.deb ... 2024-02-02T11:49:55.103 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libudev-dev:amd64 (249.11-0ubuntu3.12) ... 2024-02-02T11:49:55.342 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libsepol-dev:amd64. 2024-02-02T11:49:55.357 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../08-libsepol-dev_3.3-1build1_amd64.deb ... 2024-02-02T11:49:55.400 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libsepol-dev:amd64 (3.3-1build1) ... 2024-02-02T11:49:55.770 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libpcre2-32-0:amd64. 2024-02-02T11:49:55.785 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../09-libpcre2-32-0_10.39-3ubuntu0.1_amd64.deb ... 2024-02-02T11:49:55.828 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libpcre2-32-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-02T11:49:56.181 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libpcre2-posix3:amd64. 2024-02-02T11:49:56.196 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../10-libpcre2-posix3_10.39-3ubuntu0.1_amd64.deb ... 2024-02-02T11:49:56.239 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libpcre2-posix3:amd64 (10.39-3ubuntu0.1) ... 2024-02-02T11:49:56.517 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libpcre2-dev:amd64. 2024-02-02T11:49:56.532 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../11-libpcre2-dev_10.39-3ubuntu0.1_amd64.deb ... 2024-02-02T11:49:56.566 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libpcre2-dev:amd64 (10.39-3ubuntu0.1) ... 2024-02-02T11:49:56.897 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libselinux1-dev:amd64. 2024-02-02T11:49:56.912 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../12-libselinux1-dev_3.3-1build2_amd64.deb ... 2024-02-02T11:49:56.955 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libselinux1-dev:amd64 (3.3-1build2) ... 2024-02-02T11:49:57.270 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libdevmapper-dev:amd64. 2024-02-02T11:49:57.285 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../13-libdevmapper-dev_2%3a1.02.175-2.1ubuntu4_amd64.deb ... 2024-02-02T11:49:57.328 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libdevmapper-dev:amd64 (2:1.02.175-2.1ubuntu4) ... 2024-02-02T11:49:57.581 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libedit-dev:amd64. 2024-02-02T11:49:57.596 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../14-libedit-dev_3.1-20210910-1build1_amd64.deb ... 2024-02-02T11:49:57.630 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libedit-dev:amd64 (3.1-20210910-1build1) ... 2024-02-02T11:49:57.893 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2024-02-02T11:49:57.908 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../15-libgdbm-dev_1.23-1_amd64.deb ... 2024-02-02T11:49:57.952 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2024-02-02T11:49:58.230 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libicu-dev:amd64. 2024-02-02T11:49:58.245 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../16-libicu-dev_70.1-2_amd64.deb ... 2024-02-02T11:49:58.288 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libicu-dev:amd64 (70.1-2) ... 2024-02-02T11:49:59.050 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libinireader0:amd64. 2024-02-02T11:49:59.065 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../17-libinireader0_53-1ubuntu3_amd64.deb ... 2024-02-02T11:49:59.100 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libinireader0:amd64 (53-1ubuntu3) ... 2024-02-02T11:49:59.303 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libinih-dev:amd64. 2024-02-02T11:49:59.318 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../18-libinih-dev_53-1ubuntu3_amd64.deb ... 2024-02-02T11:49:59.361 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libinih-dev:amd64 (53-1ubuntu3) ... 2024-02-02T11:49:59.689 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package pkg-config. 2024-02-02T11:49:59.704 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../19-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-02-02T11:49:59.747 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-02-02T11:49:59.999 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package sqlite3. 2024-02-02T11:50:00.016 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../20-sqlite3_3.37.2-2ubuntu0.3_amd64.deb ... 2024-02-02T11:50:00.074 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.3) ... 2024-02-02T11:50:00.343 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libblkid-dev:amd64. 2024-02-02T11:50:00.359 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../21-libblkid-dev_2.37.2-4ubuntu3_amd64.deb ... 2024-02-02T11:50:00.393 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libblkid-dev:amd64 (2.37.2-4ubuntu3) ... 2024-02-02T11:50:00.629 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liburcu-dev:amd64. 2024-02-02T11:50:00.645 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../22-liburcu-dev_0.13.1-1_amd64.deb ... 2024-02-02T11:50:00.688 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liburcu-dev:amd64 (0.13.1-1) ... 2024-02-02T11:50:01.020 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liburcu-dev:amd64 (0.13.1-1) ... 2024-02-02T11:50:01.118 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libblkid-dev:amd64 (2.37.2-4ubuntu3) ... 2024-02-02T11:50:01.244 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libinireader0:amd64 (53-1ubuntu3) ... 2024-02-02T11:50:01.396 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up gawk (1:5.1.0-1ubuntu0.1) ... 2024-02-02T11:50:01.614 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) ... 2024-02-02T11:50:01.740 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up systemd (249.11-0ubuntu3.12) ... 2024-02-02T11:50:03.230 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libpcre2-32-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-02T11:50:03.339 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up udev (249.11-0ubuntu3.12) ... 2024-02-02T11:50:04.759 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up icu-devtools (70.1-2) ... 2024-02-02T11:50:04.859 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-02-02T11:50:05.095 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libudev-dev:amd64 (249.11-0ubuntu3.12) ... 2024-02-02T11:50:05.221 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libsepol-dev:amd64 (3.3-1build1) ... 2024-02-02T11:50:05.347 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2024-02-02T11:50:05.472 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libinih-dev:amd64 (53-1ubuntu3) ... 2024-02-02T11:50:05.599 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libpcre2-posix3:amd64 (10.39-3ubuntu0.1) ... 2024-02-02T11:50:05.725 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libmd-dev:amd64 (1.0.4-1build1) ... 2024-02-02T11:50:05.867 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2024-02-02T11:50:05.976 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libicu-dev:amd64 (70.1-2) ... 2024-02-02T11:50:06.089 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libbsd-dev:amd64 (0.11.5-1) ... 2024-02-02T11:50:06.214 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.3) ... 2024-02-02T11:50:06.365 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up systemd-sysv (249.11-0ubuntu3.12) ... 2024-02-02T11:50:06.491 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libpcre2-dev:amd64 (10.39-3ubuntu0.1) ... 2024-02-02T11:50:06.617 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libselinux1-dev:amd64 (3.3-1build2) ... 2024-02-02T11:50:06.742 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libnss-systemd:amd64 (249.11-0ubuntu3.12) ... 2024-02-02T11:50:06.844 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up fio (3.28-1) ... 2024-02-02T11:50:07.354 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libedit-dev:amd64 (3.1-20210910-1build1) ... 2024-02-02T11:50:07.463 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libdevmapper-dev:amd64 (2:1.02.175-2.1ubuntu4) ... 2024-02-02T11:50:07.598 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libpam-systemd:amd64 (249.11-0ubuntu3.12) ... 2024-02-02T11:50:07.812 INFO:teuthology.orchestra.run.smithi177.stdout:debconf: unable to initialize frontend: Dialog 2024-02-02T11:50:07.812 INFO:teuthology.orchestra.run.smithi177.stdout:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-02-02T11:50:07.812 INFO:teuthology.orchestra.run.smithi177.stdout:debconf: falling back to frontend: Readline 2024-02-02T11:50:08.117 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for initramfs-tools (0.140ubuntu13.1) ... 2024-02-02T11:50:08.216 INFO:teuthology.orchestra.run.smithi177.stdout:update-initramfs: Generating /boot/initrd.img-6.7.0-gcd42140e6285 2024-02-02T11:50:21.560 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:50:21.563 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:50:21.566 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:50:21.975 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-02T11:50:22.124 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-02T11:50:23.560 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-02-02T11:50:23.652 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-02-02T11:50:24.199 DEBUG:teuthology.orchestra.run.smithi177:> sudo useradd -m fsgqa 2024-02-02T11:50:24.217 INFO:teuthology.orchestra.run.smithi177.stderr:useradd: user 'fsgqa' already exists 2024-02-02T11:50:24.219 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-02-02T11:50:24.219 DEBUG:teuthology.orchestra.run.smithi177:> sudo groupadd fsgqa 2024-02-02T11:50:24.277 INFO:teuthology.orchestra.run.smithi177.stderr:groupadd: group 'fsgqa' already exists 2024-02-02T11:50:24.279 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-02-02T11:50:24.280 DEBUG:teuthology.orchestra.run.smithi177:> sudo useradd fsgqa2 2024-02-02T11:50:24.692 DEBUG:teuthology.orchestra.run.smithi177:> sudo useradd 123456-fsgqa 2024-02-02T11:50:25.054 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-02-02T11:50:25.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.178+0000 7f2aa5124640 1 Processor -- start 2024-02-02T11:50:25.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2aa5124640 1 -- start start 2024-02-02T11:50:25.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2aa5124640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2aa014b540 0x7f2aa00bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:50:25.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2aa5124640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2aa006a4c0 0x7f2aa006a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:50:25.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2aa5124640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa00bc590 con 0x7f2aa014dfd0 2024-02-02T11:50:25.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2aa5124640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa006ae40 con 0x7f2aa014b540 2024-02-02T11:50:25.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2aa5124640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00bc320 con 0x7f2aa006a4c0 2024-02-02T11:50:25.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9f59e640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f2aa014dfd0 0x7f2aa014e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:36018/0 (socket says 172.21.15.161:36018) 2024-02-02T11:50:25.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9f59e640 1 -- 172.21.15.161:0/912265089 learned_addr learned my addr 172.21.15.161:0/912265089 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:50:25.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9e59c640 1 --2- 172.21.15.161:0/912265089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2aa006a4c0 0x7f2aa006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:50:25.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9ed9d640 1 --2- 172.21.15.161:0/912265089 >> v2:172.21.15.162:3300/0 conn(0x7f2aa014b540 0x7f2aa00bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:50:25.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9dd9b640 1 -- 172.21.15.161:0/912265089 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705267261 0 0) 0x7f2aa00bc590 con 0x7f2aa014dfd0 2024-02-02T11:50:25.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9dd9b640 1 -- 172.21.15.161:0/912265089 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a88003530 con 0x7f2aa014dfd0 2024-02-02T11:50:25.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9dd9b640 1 -- 172.21.15.161:0/912265089 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 130446468 0 0) 0x7f2a88003530 con 0x7f2aa014dfd0 2024-02-02T11:50:25.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9dd9b640 1 -- 172.21.15.161:0/912265089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2aa006a4c0 msgr2=0x7f2aa006a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:50:25.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9dd9b640 1 --2- 172.21.15.161:0/912265089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2aa006a4c0 0x7f2aa006a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9dd9b640 1 -- 172.21.15.161:0/912265089 >> v2:172.21.15.162:3300/0 conn(0x7f2aa014b540 msgr2=0x7f2aa00bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:50:25.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9dd9b640 1 --2- 172.21.15.161:0/912265089 >> v2:172.21.15.162:3300/0 conn(0x7f2aa014b540 0x7f2aa00bac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9dd9b640 1 -- 172.21.15.161:0/912265089 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa00b3a10 con 0x7f2aa014dfd0 2024-02-02T11:50:25.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9dd9b640 1 -- 172.21.15.161:0/912265089 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f2a98001a00 con 0x7f2aa014dfd0 2024-02-02T11:50:25.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9dd9b640 1 -- 172.21.15.161:0/912265089 >> v1:172.21.15.161:6789/0 conn(0x7f2aa014dfd0 legacy=0x7f2aa014e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:50:25.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9dd9b640 1 --2- 172.21.15.161:0/912265089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a88003980 0x7f2a88003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:50:25.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9dd9b640 1 --2- 172.21.15.161:0/912265089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a880047d0 0x7f2a88004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:50:25.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9dd9b640 1 --2- 172.21.15.161:0/912265089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2aa006a4c0 0x7f2a88005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:50:25.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9dd9b640 1 -- 172.21.15.161:0/912265089 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa006ae40 con 0x7f2a880047d0 2024-02-02T11:50:25.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9dd9b640 1 -- 172.21.15.161:0/912265089 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8800b990 con 0x7f2a88003980 2024-02-02T11:50:25.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9dd9b640 1 -- 172.21.15.161:0/912265089 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8800bad0 con 0x7f2aa006a4c0 2024-02-02T11:50:25.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9e59c640 1 --2- 172.21.15.161:0/912265089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a880047d0 0x7f2a88004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:50:25.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9ed9d640 1 --2- 172.21.15.161:0/912265089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a88003980 0x7f2a88003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:50:25.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9e59c640 1 -- 172.21.15.161:0/912265089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2aa006a4c0 msgr2=0x7f2a88005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:50:25.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9e59c640 1 --2- 172.21.15.161:0/912265089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2aa006a4c0 0x7f2a88005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9e59c640 1 -- 172.21.15.161:0/912265089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a88003980 msgr2=0x7f2a88003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:50:25.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9e59c640 1 --2- 172.21.15.161:0/912265089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a88003980 0x7f2a88003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9e59c640 1 -- 172.21.15.161:0/912265089 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a88003530 con 0x7f2a880047d0 2024-02-02T11:50:25.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.182+0000 7f2a9ed9d640 1 --2- 172.21.15.161:0/912265089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a88003980 0x7f2a88003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:50:25.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2a9e59c640 1 --2- 172.21.15.161:0/912265089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a880047d0 0x7f2a88004c50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2a94009ae0 tx=0x7f2a9401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311aff108253e1f0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:50:25.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2a9dd9b640 1 -- 172.21.15.161:0/912265089 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a940a55a0 con 0x7f2a880047d0 2024-02-02T11:50:25.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2a9dd9b640 1 -- 172.21.15.161:0/912265089 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a940a5700 con 0x7f2a880047d0 2024-02-02T11:50:25.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2a9dd9b640 1 -- 172.21.15.161:0/912265089 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a940a5ab0 con 0x7f2a880047d0 2024-02-02T11:50:25.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2aa5124640 1 -- 172.21.15.161:0/912265089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a880047d0 msgr2=0x7f2a88004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:50:25.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2aa5124640 1 --2- 172.21.15.161:0/912265089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a880047d0 0x7f2a88004c50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2a94009ae0 tx=0x7f2a9401ca90 comp rx=0 tx=0).stop 2024-02-02T11:50:25.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2a9f59e640 1 -- 172.21.15.161:0/912265089 reap_dead start 2024-02-02T11:50:25.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2aa5124640 1 -- 172.21.15.161:0/912265089 shutdown_connections 2024-02-02T11:50:25.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2aa5124640 1 -- 172.21.15.161:0/912265089 >> 172.21.15.161:0/912265089 conn(0x7f2aa00c02e0 msgr2=0x7f2aa00c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:50:25.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2aa5124640 1 -- 172.21.15.161:0/912265089 shutdown_connections 2024-02-02T11:50:25.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2aa5124640 1 -- 172.21.15.161:0/912265089 wait complete. 2024-02-02T11:50:25.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2aa5124640 1 Processor -- start 2024-02-02T11:50:25.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2aa5124640 1 -- start start 2024-02-02T11:50:25.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2aa5124640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a880047d0 0x7f2aa01d4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:50:25.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2aa5124640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2aa01d5b00 0x7f2aa01e30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:50:25.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2aa5124640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2aa0145dd0 0x7f2aa0146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:50:25.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2aa5124640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa01d4d70 con 0x7f2aa01d5b00 2024-02-02T11:50:25.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2aa5124640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00b7df0 con 0x7f2aa0145dd0 2024-02-02T11:50:25.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2aa5124640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa014bbc0 con 0x7f2a880047d0 2024-02-02T11:50:25.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2a9e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2aa01d5b00 0x7f2aa01e30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:50:25.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2a9e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2aa01d5b00 0x7f2aa01e30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35644/0 (socket says 172.21.15.161:35644) 2024-02-02T11:50:25.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2a9e59c640 1 -- 172.21.15.161:0/1504694048 learned_addr learned my addr 172.21.15.161:0/1504694048 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:50:25.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2a9ed9d640 1 --2- 172.21.15.161:0/1504694048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a880047d0 0x7f2aa01d4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:50:25.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2a9f59e640 1 --2- 172.21.15.161:0/1504694048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2aa0145dd0 0x7f2aa0146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:50:25.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2a9e59c640 1 -- 172.21.15.161:0/1504694048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a880047d0 msgr2=0x7f2aa01d4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:50:25.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2a9e59c640 1 --2- 172.21.15.161:0/1504694048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a880047d0 0x7f2aa01d4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2a9e59c640 1 -- 172.21.15.161:0/1504694048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2aa0145dd0 msgr2=0x7f2aa0146250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:50:25.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2a9e59c640 1 --2- 172.21.15.161:0/1504694048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2aa0145dd0 0x7f2aa0146250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2a9e59c640 1 -- 172.21.15.161:0/1504694048 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa00b75e0 con 0x7f2aa01d5b00 2024-02-02T11:50:25.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2a9e59c640 1 --2- 172.21.15.161:0/1504694048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2aa01d5b00 0x7f2aa01e30e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2a940b0040 tx=0x7f2a88005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:50:25.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2a877fe640 1 -- 172.21.15.161:0/1504694048 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a940be070 con 0x7f2aa01d5b00 2024-02-02T11:50:25.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2a877fe640 1 -- 172.21.15.161:0/1504694048 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a94004020 con 0x7f2aa01d5b00 2024-02-02T11:50:25.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2aa5124640 1 -- 172.21.15.161:0/1504694048 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa014be60 con 0x7f2aa01d5b00 2024-02-02T11:50:25.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2a877fe640 1 -- 172.21.15.161:0/1504694048 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a940043d0 con 0x7f2aa01d5b00 2024-02-02T11:50:25.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.186+0000 7f2aa5124640 1 -- 172.21.15.161:0/1504694048 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa00b7b10 con 0x7f2aa01d5b00 2024-02-02T11:50:25.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.190+0000 7f2aa5124640 1 -- 172.21.15.161:0/1504694048 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa004e000 con 0x7f2aa01d5b00 2024-02-02T11:50:25.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.190+0000 7f2a877fe640 1 -- 172.21.15.161:0/1504694048 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2a940b4040 con 0x7f2aa01d5b00 2024-02-02T11:50:25.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.190+0000 7f2a877fe640 1 --2- 172.21.15.161:0/1504694048 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2a8c065a60 0x7f2a8c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:50:25.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.190+0000 7f2a877fe640 1 -- 172.21.15.161:0/1504694048 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a9411d1a0 con 0x7f2aa01d5b00 2024-02-02T11:50:25.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.190+0000 7f2a9ed9d640 1 --2- 172.21.15.161:0/1504694048 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2a8c065a60 0x7f2a8c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:50:25.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.190+0000 7f2a9ed9d640 1 --2- 172.21.15.161:0/1504694048 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2a8c065a60 0x7f2a8c067f20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009b40 tx=0x7f2a90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:50:25.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.194+0000 7f2a877fe640 1 -- 172.21.15.161:0/1504694048 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2a940eab60 con 0x7f2aa01d5b00 2024-02-02T11:50:25.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.410+0000 7f2aa5124640 1 -- 172.21.15.161:0/1504694048 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2aa00a1c10 con 0x7f2aa01d5b00 2024-02-02T11:50:25.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.410+0000 7f2a877fe640 1 -- 172.21.15.161:0/1504694048 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7f2a940ee180 con 0x7f2aa01d5b00 2024-02-02T11:50:25.414 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:50:25.414 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","modified":"2024-02-02T11:47:52.887531Z","created":"2024-02-02T11:47:52.887531Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:3300","nonce":0},{"type":"v1","addr":"172.21.15.161:6789","nonce":0}]},"addr":"172.21.15.161:6789/0","public_addr":"172.21.15.161:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3301","nonce":0},{"type":"v1","addr":"172.21.15.162:6790","nonce":0}]},"addr":"172.21.15.162:6790/0","public_addr":"172.21.15.162:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-02-02T11:50:25.414 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-02-02T11:50:25.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.410+0000 7f2aa5124640 1 -- 172.21.15.161:0/1504694048 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2a8c065a60 msgr2=0x7f2a8c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:50:25.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.410+0000 7f2aa5124640 1 --2- 172.21.15.161:0/1504694048 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2a8c065a60 0x7f2a8c067f20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009b40 tx=0x7f2a90008040 comp rx=0 tx=0).stop 2024-02-02T11:50:25.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.410+0000 7f2aa5124640 1 -- 172.21.15.161:0/1504694048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2aa01d5b00 msgr2=0x7f2aa01e30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:50:25.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.410+0000 7f2aa5124640 1 --2- 172.21.15.161:0/1504694048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2aa01d5b00 0x7f2aa01e30e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2a940b0040 tx=0x7f2a88005800 comp rx=0 tx=0).stop 2024-02-02T11:50:25.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.410+0000 7f2aa5124640 1 -- 172.21.15.161:0/1504694048 shutdown_connections 2024-02-02T11:50:25.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.410+0000 7f2aa5124640 1 --2- 172.21.15.161:0/1504694048 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2a8c065a60 0x7f2a8c067f20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.410+0000 7f2aa5124640 1 --2- 172.21.15.161:0/1504694048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2aa0145dd0 0x7f2aa0146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.410+0000 7f2aa5124640 1 --2- 172.21.15.161:0/1504694048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2aa01d5b00 0x7f2aa01e30e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.410+0000 7f2aa5124640 1 --2- 172.21.15.161:0/1504694048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a880047d0 0x7f2aa01d4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.410+0000 7f2aa5124640 1 -- 172.21.15.161:0/1504694048 >> 172.21.15.161:0/1504694048 conn(0x7f2aa00c02e0 msgr2=0x7f2aa0148cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:50:25.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.410+0000 7f2aa5124640 1 -- 172.21.15.161:0/1504694048 shutdown_connections 2024-02-02T11:50:25.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.410+0000 7f2aa5124640 1 -- 172.21.15.161:0/1504694048 wait complete. 2024-02-02T11:50:25.434 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-02-02T11:50:25.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.554+0000 7f22c4340640 1 Processor -- start 2024-02-02T11:50:25.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.554+0000 7f22c4340640 1 -- start start 2024-02-02T11:50:25.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.554+0000 7f22c4340640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22bc06a4c0 0x7f22bc06a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:50:25.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.554+0000 7f22c4340640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f22bc1532f0 0x7f22bc1556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:50:25.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.554+0000 7f22c4340640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22bc0bb370 con 0x7f22bc14b540 2024-02-02T11:50:25.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.554+0000 7f22c4340640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22bc06ae40 con 0x7f22bc1532f0 2024-02-02T11:50:25.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.554+0000 7f22c4340640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0bc320 con 0x7f22bc06a4c0 2024-02-02T11:50:25.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.554+0000 7f22c28dd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f22bc1532f0 0x7f22bc1556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:50:25.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.554+0000 7f22c28dd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f22bc1532f0 0x7f22bc1556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35654/0 (socket says 172.21.15.161:35654) 2024-02-02T11:50:25.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.554+0000 7f22c28dd640 1 -- 172.21.15.161:0/1279588059 learned_addr learned my addr 172.21.15.161:0/1279588059 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:50:25.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.554+0000 7f22c18db640 1 --2- 172.21.15.161:0/1279588059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22bc06a4c0 0x7f22bc06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:50:25.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.554+0000 7f22c28dd640 1 -- 172.21.15.161:0/1279588059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22bc06a4c0 msgr2=0x7f22bc06a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:50:25.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.554+0000 7f22c28dd640 1 --2- 172.21.15.161:0/1279588059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22bc06a4c0 0x7f22bc06a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.554+0000 7f22c28dd640 1 -- 172.21.15.161:0/1279588059 >> v1:172.21.15.162:6789/0 conn(0x7f22bc14b540 legacy=0x7f22bc0bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:50:25.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.554+0000 7f22c28dd640 1 -- 172.21.15.161:0/1279588059 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc0bc590 con 0x7f22bc1532f0 2024-02-02T11:50:25.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c28dd640 1 --2- 172.21.15.161:0/1279588059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22bc1532f0 0x7f22bc1556e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009870 tx=0x7f22b401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d91b45adb6a7c5a server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:50:25.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c10da640 1 -- 172.21.15.161:0/1279588059 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b40a8a30 con 0x7f22bc1532f0 2024-02-02T11:50:25.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c10da640 1 -- 172.21.15.161:0/1279588059 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b40a8b90 con 0x7f22bc1532f0 2024-02-02T11:50:25.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c10da640 1 -- 172.21.15.161:0/1279588059 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b40b0440 con 0x7f22bc1532f0 2024-02-02T11:50:25.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c4340640 1 -- 172.21.15.161:0/1279588059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22bc1532f0 msgr2=0x7f22bc1556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:50:25.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c4340640 1 --2- 172.21.15.161:0/1279588059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22bc1532f0 0x7f22bc1556e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009870 tx=0x7f22b401ed30 comp rx=0 tx=0).stop 2024-02-02T11:50:25.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c4340640 1 -- 172.21.15.161:0/1279588059 shutdown_connections 2024-02-02T11:50:25.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c4340640 1 --2- 172.21.15.161:0/1279588059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22bc06a4c0 0x7f22bc06a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c4340640 1 --2- 172.21.15.161:0/1279588059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22bc1532f0 0x7f22bc1556e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c4340640 1 -- 172.21.15.161:0/1279588059 >> 172.21.15.161:0/1279588059 conn(0x7f22bc0c02e0 msgr2=0x7f22bc0c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:50:25.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c4340640 1 -- 172.21.15.161:0/1279588059 shutdown_connections 2024-02-02T11:50:25.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c4340640 1 -- 172.21.15.161:0/1279588059 wait complete. 2024-02-02T11:50:25.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c4340640 1 Processor -- start 2024-02-02T11:50:25.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c4340640 1 -- start start 2024-02-02T11:50:25.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c4340640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22bc06a4c0 0x7f22bc0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:50:25.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c4340640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22bc14b540 0x7f22bc1dfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:50:25.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c4340640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22bc1532f0 0x7f22bc0b9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:50:25.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c4340640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0b8630 con 0x7f22bc14b540 2024-02-02T11:50:25.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c4340640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0b6d50 con 0x7f22bc06a4c0 2024-02-02T11:50:25.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c4340640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0b8880 con 0x7f22bc1532f0 2024-02-02T11:50:25.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c18db640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22bc14b540 0x7f22bc1dfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:50:25.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c18db640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22bc14b540 0x7f22bc1dfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35668/0 (socket says 172.21.15.161:35668) 2024-02-02T11:50:25.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c18db640 1 -- 172.21.15.161:0/1663747922 learned_addr learned my addr 172.21.15.161:0/1663747922 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:50:25.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c20dc640 1 --2- 172.21.15.161:0/1663747922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22bc06a4c0 0x7f22bc0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:50:25.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c28dd640 1 --2- 172.21.15.161:0/1663747922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22bc1532f0 0x7f22bc0b9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:50:25.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c18db640 1 -- 172.21.15.161:0/1663747922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22bc1532f0 msgr2=0x7f22bc0b9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:50:25.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c18db640 1 --2- 172.21.15.161:0/1663747922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22bc1532f0 0x7f22bc0b9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c18db640 1 -- 172.21.15.161:0/1663747922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22bc06a4c0 msgr2=0x7f22bc0b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:50:25.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c18db640 1 --2- 172.21.15.161:0/1663747922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22bc06a4c0 0x7f22bc0b6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c18db640 1 -- 172.21.15.161:0/1663747922 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b40094d0 con 0x7f22bc14b540 2024-02-02T11:50:25.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c28dd640 1 --2- 172.21.15.161:0/1663747922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22bc1532f0 0x7f22bc0b9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:50:25.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.558+0000 7f22c18db640 1 --2- 172.21.15.161:0/1663747922 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22bc14b540 0x7f22bc1dfc10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f22b000d800 tx=0x7f22b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:50:25.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.562+0000 7f22baffd640 1 -- 172.21.15.161:0/1663747922 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b000b6c0 con 0x7f22bc14b540 2024-02-02T11:50:25.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.562+0000 7f22baffd640 1 -- 172.21.15.161:0/1663747922 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b000b820 con 0x7f22bc14b540 2024-02-02T11:50:25.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.562+0000 7f22c4340640 1 -- 172.21.15.161:0/1663747922 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22bc0b8bc0 con 0x7f22bc14b540 2024-02-02T11:50:25.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.562+0000 7f22baffd640 1 -- 172.21.15.161:0/1663747922 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b000bb90 con 0x7f22bc14b540 2024-02-02T11:50:25.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.562+0000 7f22c4340640 1 -- 172.21.15.161:0/1663747922 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22bc1e0a10 con 0x7f22bc14b540 2024-02-02T11:50:25.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.562+0000 7f22c4340640 1 -- 172.21.15.161:0/1663747922 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22bc0bf9e0 con 0x7f22bc14b540 2024-02-02T11:50:25.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.562+0000 7f22baffd640 1 -- 172.21.15.161:0/1663747922 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f22b000bcf0 con 0x7f22bc14b540 2024-02-02T11:50:25.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.562+0000 7f22baffd640 1 --2- 172.21.15.161:0/1663747922 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f22a8065a60 0x7f22a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:50:25.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.562+0000 7f22baffd640 1 -- 172.21.15.161:0/1663747922 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22b00840a0 con 0x7f22bc14b540 2024-02-02T11:50:25.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.562+0000 7f22c20dc640 1 --2- 172.21.15.161:0/1663747922 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f22a8065a60 0x7f22a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:50:25.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.562+0000 7f22c20dc640 1 --2- 172.21.15.161:0/1663747922 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f22a8065a60 0x7f22a8067f20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0012f0 tx=0x7f22ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:50:25.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.566+0000 7f22baffd640 1 -- 172.21.15.161:0/1663747922 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f22b0051a40 con 0x7f22bc14b540 2024-02-02T11:50:25.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.770+0000 7f22c4340640 1 -- 172.21.15.161:0/1663747922 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f22bc0bf9e0 con 0x7f22bc14b540 2024-02-02T11:50:25.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.770+0000 7f22baffd640 1 -- 172.21.15.161:0/1663747922 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) v1 ==== 92+0+63 (secure 0 0 0) 0x7f22bc0bf9e0 con 0x7f22bc14b540 2024-02-02T11:50:25.776 INFO:teuthology.orchestra.run.smithi161.stdout:[client.admin] 2024-02-02T11:50:25.776 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBp1rxlR51tBxAABbzxZahfKYl0M7QrtLzrXQ== 2024-02-02T11:50:25.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.774+0000 7f22c4340640 1 -- 172.21.15.161:0/1663747922 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f22a8065a60 msgr2=0x7f22a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:50:25.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.774+0000 7f22c4340640 1 --2- 172.21.15.161:0/1663747922 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f22a8065a60 0x7f22a8067f20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0012f0 tx=0x7f22ac009040 comp rx=0 tx=0).stop 2024-02-02T11:50:25.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.774+0000 7f22c4340640 1 -- 172.21.15.161:0/1663747922 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22bc14b540 msgr2=0x7f22bc1dfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:50:25.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.774+0000 7f22c4340640 1 --2- 172.21.15.161:0/1663747922 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22bc14b540 0x7f22bc1dfc10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f22b000d800 tx=0x7f22b000dcc0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.774+0000 7f22c4340640 1 -- 172.21.15.161:0/1663747922 shutdown_connections 2024-02-02T11:50:25.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.774+0000 7f22c4340640 1 --2- 172.21.15.161:0/1663747922 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f22a8065a60 0x7f22a8067f20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.774+0000 7f22c4340640 1 --2- 172.21.15.161:0/1663747922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22bc1532f0 0x7f22bc0b9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.774+0000 7f22c4340640 1 --2- 172.21.15.161:0/1663747922 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22bc14b540 0x7f22bc1dfc10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.774+0000 7f22c4340640 1 --2- 172.21.15.161:0/1663747922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22bc06a4c0 0x7f22bc0b6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:50:25.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.774+0000 7f22c4340640 1 -- 172.21.15.161:0/1663747922 >> 172.21.15.161:0/1663747922 conn(0x7f22bc0c02e0 msgr2=0x7f22bc0a1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:50:25.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.774+0000 7f22c4340640 1 -- 172.21.15.161:0/1663747922 shutdown_connections 2024-02-02T11:50:25.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:50:25.774+0000 7f22c4340640 1 -- 172.21.15.161:0/1663747922 wait complete. 2024-02-02T11:50:25.794 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T11:50:25.794 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/tmp/tmp.ByhSz7TqB0xfstests-dev/local.config 2024-02-02T11:50:25.813 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.161:6789:/test export TEST_DIR=/tmp/tmp.R1pG371raPtest export SCRATCH_DEV=172.21.15.161:6789:/scratch export SCRATCH_MNT=/tmp/tmp.jtqH6Jn1Mhscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBp1rxlR51tBxAABbzxZahfKYl0M7QrtLzrXQ==" 2024-02-02T11:50:25.814 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T11:50:25.814 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/tmp/tmp.ByhSz7TqB0xfstests-dev/ceph.exclude 2024-02-02T11:50:25.880 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.ByhSz7TqB0xfstests-dev && exec sudo make) 2024-02-02T11:50:25.948 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize -cfi 2024-02-02T11:50:26.297 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: putting auxiliary files in '.'. 2024-02-02T11:50:26.297 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file './config.guess' 2024-02-02T11:50:26.305 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file './config.sub' 2024-02-02T11:50:26.332 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file './install-sh' 2024-02-02T11:50:26.343 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file './ltmain.sh' 2024-02-02T11:50:26.384 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-02-02T11:50:26.384 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-02-02T11:50:26.406 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-02-02T11:50:26.418 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-02-02T11:50:26.428 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-02-02T11:50:26.439 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-02-02T11:50:26.449 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-02-02T11:50:26.451 INFO:teuthology.orchestra.run.smithi177.stdout:cp include/install-sh . 2024-02-02T11:50:26.453 INFO:teuthology.orchestra.run.smithi177.stdout:aclocal -I m4 2024-02-02T11:50:27.519 INFO:teuthology.orchestra.run.smithi177.stdout:autoheader 2024-02-02T11:50:27.872 INFO:teuthology.orchestra.run.smithi177.stdout:autoconf 2024-02-02T11:50:28.279 INFO:teuthology.orchestra.run.smithi177.stdout:./configure \ 2024-02-02T11:50:28.279 INFO:teuthology.orchestra.run.smithi177.stdout: --libexecdir=/usr/lib \ 2024-02-02T11:50:28.279 INFO:teuthology.orchestra.run.smithi177.stdout: --exec_prefix=/var/lib 2024-02-02T11:50:28.768 INFO:teuthology.orchestra.run.smithi177.stdout:checking build system type... x86_64-pc-linux-gnu 2024-02-02T11:50:28.769 INFO:teuthology.orchestra.run.smithi177.stdout:checking host system type... x86_64-pc-linux-gnu 2024-02-02T11:50:28.822 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to print strings... printf 2024-02-02T11:50:28.822 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc... gcc 2024-02-02T11:50:29.052 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether the C compiler works... yes 2024-02-02T11:50:29.053 INFO:teuthology.orchestra.run.smithi177.stdout:checking for C compiler default output file name... a.out 2024-02-02T11:50:29.094 INFO:teuthology.orchestra.run.smithi177.stdout:checking for suffix of executables... 2024-02-02T11:50:29.182 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether we are cross compiling... no 2024-02-02T11:50:29.209 INFO:teuthology.orchestra.run.smithi177.stdout:checking for suffix of object files... o 2024-02-02T11:50:29.231 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether the compiler supports GNU C... yes 2024-02-02T11:50:29.254 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether gcc accepts -g... yes 2024-02-02T11:50:29.385 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc option to enable C11 features... none needed 2024-02-02T11:50:29.391 INFO:teuthology.orchestra.run.smithi177.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-02-02T11:50:29.396 INFO:teuthology.orchestra.run.smithi177.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-02-02T11:50:29.398 INFO:teuthology.orchestra.run.smithi177.stdout:checking for egrep... /usr/bin/grep -E 2024-02-02T11:50:29.401 INFO:teuthology.orchestra.run.smithi177.stdout:checking for fgrep... /usr/bin/grep -F 2024-02-02T11:50:29.408 INFO:teuthology.orchestra.run.smithi177.stdout:checking for ld used by gcc... /usr/bin/ld 2024-02-02T11:50:29.412 INFO:teuthology.orchestra.run.smithi177.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-02-02T11:50:29.424 INFO:teuthology.orchestra.run.smithi177.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-02-02T11:50:29.455 INFO:teuthology.orchestra.run.smithi177.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-02-02T11:50:29.455 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether ln -s works... yes 2024-02-02T11:50:29.470 INFO:teuthology.orchestra.run.smithi177.stdout:checking the maximum length of command line arguments... 1572864 2024-02-02T11:50:29.476 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-02-02T11:50:29.477 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-02-02T11:50:29.477 INFO:teuthology.orchestra.run.smithi177.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-02-02T11:50:29.477 INFO:teuthology.orchestra.run.smithi177.stdout:checking for objdump... objdump 2024-02-02T11:50:29.477 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to recognize dependent libraries... pass_all 2024-02-02T11:50:29.478 INFO:teuthology.orchestra.run.smithi177.stdout:checking for dlltool... no 2024-02-02T11:50:29.478 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-02-02T11:50:29.478 INFO:teuthology.orchestra.run.smithi177.stdout:checking for ar... ar 2024-02-02T11:50:29.514 INFO:teuthology.orchestra.run.smithi177.stdout:checking for archiver @FILE support... @ 2024-02-02T11:50:29.514 INFO:teuthology.orchestra.run.smithi177.stdout:checking for strip... strip 2024-02-02T11:50:29.514 INFO:teuthology.orchestra.run.smithi177.stdout:checking for ranlib... ranlib 2024-02-02T11:50:29.514 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gawk... gawk 2024-02-02T11:50:29.601 INFO:teuthology.orchestra.run.smithi177.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-02-02T11:50:29.603 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sysroot... no 2024-02-02T11:50:29.611 INFO:teuthology.orchestra.run.smithi177.stdout:checking for a working dd... /usr/bin/dd 2024-02-02T11:50:29.617 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-02-02T11:50:29.637 INFO:teuthology.orchestra.run.smithi177.stdout:checking for mt... mt 2024-02-02T11:50:29.660 INFO:teuthology.orchestra.run.smithi177.stdout:checking if mt is a manifest tool... no 2024-02-02T11:50:29.686 INFO:teuthology.orchestra.run.smithi177.stdout:checking for stdio.h... yes 2024-02-02T11:50:29.739 INFO:teuthology.orchestra.run.smithi177.stdout:checking for stdlib.h... yes 2024-02-02T11:50:29.773 INFO:teuthology.orchestra.run.smithi177.stdout:checking for string.h... yes 2024-02-02T11:50:29.812 INFO:teuthology.orchestra.run.smithi177.stdout:checking for inttypes.h... yes 2024-02-02T11:50:29.844 INFO:teuthology.orchestra.run.smithi177.stdout:checking for stdint.h... yes 2024-02-02T11:50:29.876 INFO:teuthology.orchestra.run.smithi177.stdout:checking for strings.h... yes 2024-02-02T11:50:29.910 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/stat.h... yes 2024-02-02T11:50:29.942 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/types.h... yes 2024-02-02T11:50:29.992 INFO:teuthology.orchestra.run.smithi177.stdout:checking for unistd.h... yes 2024-02-02T11:50:30.035 INFO:teuthology.orchestra.run.smithi177.stdout:checking for dlfcn.h... yes 2024-02-02T11:50:30.040 INFO:teuthology.orchestra.run.smithi177.stdout:checking for objdir... .libs 2024-02-02T11:50:30.153 INFO:teuthology.orchestra.run.smithi177.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-02-02T11:50:30.154 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-02-02T11:50:30.180 INFO:teuthology.orchestra.run.smithi177.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-02-02T11:50:30.417 INFO:teuthology.orchestra.run.smithi177.stdout:checking if gcc static flag -static works... yes 2024-02-02T11:50:30.456 INFO:teuthology.orchestra.run.smithi177.stdout:checking if gcc supports -c -o file.o... yes 2024-02-02T11:50:30.457 INFO:teuthology.orchestra.run.smithi177.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-02-02T11:50:30.470 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-02-02T11:50:30.505 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether -lc should be explicitly linked in... no 2024-02-02T11:50:30.605 INFO:teuthology.orchestra.run.smithi177.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-02-02T11:50:30.605 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to hardcode library paths into programs... immediate 2024-02-02T11:50:30.625 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether stripping libraries is possible... yes 2024-02-02T11:50:30.625 INFO:teuthology.orchestra.run.smithi177.stdout:checking if libtool supports shared libraries... yes 2024-02-02T11:50:30.625 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether to build shared libraries... yes 2024-02-02T11:50:30.625 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether to build static libraries... yes 2024-02-02T11:50:30.639 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc... (cached) gcc 2024-02-02T11:50:30.680 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether the compiler supports GNU C... (cached) yes 2024-02-02T11:50:30.680 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether gcc accepts -g... (cached) yes 2024-02-02T11:50:30.680 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc option to enable C11 features... (cached) none needed 2024-02-02T11:50:30.681 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gmake... /usr/bin/gmake 2024-02-02T11:50:30.681 INFO:teuthology.orchestra.run.smithi177.stderr:./configure: line 12754: test: $(SHELL): binary operator expected 2024-02-02T11:50:30.682 INFO:teuthology.orchestra.run.smithi177.stdout:checking for tar... /bin/tar 2024-02-02T11:50:30.682 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gzip... /bin/gzip 2024-02-02T11:50:30.712 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether gcc -MM is supported... yes 2024-02-02T11:50:30.712 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sort... /bin/sort 2024-02-02T11:50:30.712 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether ln -s works... yes 2024-02-02T11:50:30.712 INFO:teuthology.orchestra.run.smithi177.stdout:checking for rpm... no 2024-02-02T11:50:30.749 INFO:teuthology.orchestra.run.smithi177.stdout:checking for assert.h... yes 2024-02-02T11:50:30.789 INFO:teuthology.orchestra.run.smithi177.stdout:checking for bstring.h... no 2024-02-02T11:50:30.827 INFO:teuthology.orchestra.run.smithi177.stdout:checking for libgen.h... yes 2024-02-02T11:50:30.892 INFO:teuthology.orchestra.run.smithi177.stdout:checking for dirent.h... yes 2024-02-02T11:50:30.974 INFO:teuthology.orchestra.run.smithi177.stdout:checking for errno.h... yes 2024-02-02T11:50:31.012 INFO:teuthology.orchestra.run.smithi177.stdout:checking for malloc.h... yes 2024-02-02T11:50:31.052 INFO:teuthology.orchestra.run.smithi177.stdout:checking for uuid.h... no 2024-02-02T11:50:31.097 INFO:teuthology.orchestra.run.smithi177.stdout:checking for uuid/uuid.h... yes 2024-02-02T11:50:31.138 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/uuid.h... no 2024-02-02T11:50:31.177 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/file.h... yes 2024-02-02T11:50:31.215 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/fcntl.h... yes 2024-02-02T11:50:31.255 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/syssgi.h... no 2024-02-02T11:50:31.318 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/param.h... yes 2024-02-02T11:50:31.318 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/stat.h... (cached) yes 2024-02-02T11:50:31.356 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/statvfs.h... yes 2024-02-02T11:50:31.392 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/time.h... yes 2024-02-02T11:50:31.433 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/ioctl.h... yes 2024-02-02T11:50:31.472 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/wait.h... yes 2024-02-02T11:50:31.473 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/types.h... (cached) yes 2024-02-02T11:50:31.473 INFO:teuthology.orchestra.run.smithi177.stdout:checking for strings.h... (cached) yes 2024-02-02T11:50:31.509 INFO:teuthology.orchestra.run.smithi177.stdout:checking for err.h... yes 2024-02-02T11:50:31.546 INFO:teuthology.orchestra.run.smithi177.stdout:checking for linux/falloc.h... yes 2024-02-02T11:50:31.587 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/fs/xfs_fsops.h... no 2024-02-02T11:50:31.627 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/fs/xfs_itable.h... no 2024-02-02T11:50:31.667 INFO:teuthology.orchestra.run.smithi177.stdout:checking for xfs/platform_defs.h... no 2024-02-02T11:50:31.708 INFO:teuthology.orchestra.run.smithi177.stdout:checking for btrfs/ioctl.h... no 2024-02-02T11:50:31.748 INFO:teuthology.orchestra.run.smithi177.stdout:checking for cifs/ioctl.h... no 2024-02-02T11:50:31.787 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/mman.h... yes 2024-02-02T11:50:31.810 INFO:teuthology.orchestra.run.smithi177.stdout:checking for xfs/xfs_log_format.h... no 2024-02-02T11:50:31.867 INFO:teuthology.orchestra.run.smithi177.stdout:checking for uuid_compare... no 2024-02-02T11:50:31.914 INFO:teuthology.orchestra.run.smithi177.stdout:checking for uuid_compare in -luuid... yes 2024-02-02T11:50:32.054 INFO:teuthology.orchestra.run.smithi177.stdout:checking for xfs/xfs.h... yes 2024-02-02T11:50:32.077 INFO:teuthology.orchestra.run.smithi177.stdout:checking for xfs/libxfs.h... no 2024-02-02T11:50:32.143 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2024-02-02T11:50:32.174 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether xlog_assign_lsn is declared... no 2024-02-02T11:50:32.220 INFO:teuthology.orchestra.run.smithi177.stdout:checking for xfs/xqm.h... yes 2024-02-02T11:50:32.292 INFO:teuthology.orchestra.run.smithi177.stdout:checking xfsctl from xfs/xfs.h... ok 2024-02-02T11:50:32.330 INFO:teuthology.orchestra.run.smithi177.stdout:checking for xfs/handle.h... yes 2024-02-02T11:50:32.379 INFO:teuthology.orchestra.run.smithi177.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-02-02T11:50:32.424 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/acl.h... yes 2024-02-02T11:50:32.465 INFO:teuthology.orchestra.run.smithi177.stdout:checking for acl/libacl.h... yes 2024-02-02T11:50:32.514 INFO:teuthology.orchestra.run.smithi177.stdout:checking for acl_init in -lacl... yes 2024-02-02T11:50:32.554 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gdbm-ndbm.h... no 2024-02-02T11:50:32.594 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gdbm/ndbm.h... no 2024-02-02T11:50:32.634 INFO:teuthology.orchestra.run.smithi177.stdout:checking for ndbm.h... no 2024-02-02T11:50:32.674 INFO:teuthology.orchestra.run.smithi177.stdout:checking for libaio.h... yes 2024-02-02T11:50:32.715 INFO:teuthology.orchestra.run.smithi177.stdout:checking for liburing.h... no 2024-02-02T11:50:32.755 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/capability.h... no 2024-02-02T11:50:32.794 INFO:teuthology.orchestra.run.smithi177.stdout:checking for linux/fiemap.h... yes 2024-02-02T11:50:32.844 INFO:teuthology.orchestra.run.smithi177.stdout:checking for fallocate... yes 2024-02-02T11:50:32.897 INFO:teuthology.orchestra.run.smithi177.stdout:checking for open_by_handle_at... yes 2024-02-02T11:50:32.937 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/prctl.h... yes 2024-02-02T11:50:32.975 INFO:teuthology.orchestra.run.smithi177.stdout:checking for linux/fs.h... yes 2024-02-02T11:50:33.015 INFO:teuthology.orchestra.run.smithi177.stdout:checking for btrfsutil.h... no 2024-02-02T11:50:33.080 INFO:teuthology.orchestra.run.smithi177.stdout:checking for copy_file_range... yes 2024-02-02T11:50:33.136 INFO:teuthology.orchestra.run.smithi177.stdout:checking for SEEK_DATA... yes 2024-02-02T11:50:33.211 INFO:teuthology.orchestra.run.smithi177.stdout:checking for BMV_OF_SHARED... yes 2024-02-02T11:50:33.265 INFO:teuthology.orchestra.run.smithi177.stdout:checking for nftw... yes 2024-02-02T11:50:33.325 INFO:teuthology.orchestra.run.smithi177.stdout:checking for RLIMIT_NOFILE... yes 2024-02-02T11:50:33.378 INFO:teuthology.orchestra.run.smithi177.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-02-02T11:50:33.428 INFO:teuthology.orchestra.run.smithi177.stdout:checking for FICLONE... yes 2024-02-02T11:50:33.480 INFO:teuthology.orchestra.run.smithi177.stdout:checking for renameat2... yes 2024-02-02T11:50:33.530 INFO:teuthology.orchestra.run.smithi177.stdout:checking for reallocarray... yes 2024-02-02T11:50:33.580 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct mount_attr... yes 2024-02-02T11:50:33.632 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct btrfs_qgroup_limit... yes 2024-02-02T11:50:33.684 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-02-02T11:50:33.735 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-02-02T11:50:33.787 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-02-02T11:50:33.839 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-02-02T11:50:33.890 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-02-02T11:50:33.942 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-02-02T11:50:33.980 INFO:teuthology.orchestra.run.smithi177.stdout:checking for linux/btrfs.h... yes 2024-02-02T11:50:34.020 INFO:teuthology.orchestra.run.smithi177.stdout:checking for linux/btrfs_tree.h... yes 2024-02-02T11:50:34.047 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-02-02T11:50:34.073 INFO:teuthology.orchestra.run.smithi177.stdout:configure: creating ./config.status 2024-02-02T11:50:34.865 INFO:teuthology.orchestra.run.smithi177.stdout:config.status: creating include/builddefs 2024-02-02T11:50:34.891 INFO:teuthology.orchestra.run.smithi177.stdout:config.status: creating include/config.h 2024-02-02T11:50:34.911 INFO:teuthology.orchestra.run.smithi177.stdout:config.status: executing libtool commands 2024-02-02T11:50:34.978 INFO:teuthology.orchestra.run.smithi177.stdout:Building include 2024-02-02T11:50:34.984 INFO:teuthology.orchestra.run.smithi177.stdout:Building lib 2024-02-02T11:50:34.990 INFO:teuthology.orchestra.run.smithi177.stdout: [LTDEP] 2024-02-02T11:50:35.181 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dataascii.lo 2024-02-02T11:50:35.324 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] databin.lo 2024-02-02T11:50:35.507 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] datapid.lo 2024-02-02T11:50:35.642 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] file_lock.lo 2024-02-02T11:50:35.829 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] forker.lo 2024-02-02T11:50:36.005 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] pattern.lo 2024-02-02T11:50:36.147 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] open_flags.lo 2024-02-02T11:50:36.320 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] random_range.lo 2024-02-02T11:50:36.574 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] string_to_tokens.lo 2024-02-02T11:50:36.698 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] str_to_bytes.lo 2024-02-02T11:50:36.863 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] tlibio.lo 2024-02-02T11:50:37.145 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] write_log.lo 2024-02-02T11:50:37.228 INFO:teuthology.orchestra.run.smithi177.stderr:write_log.c: In function 'wlog_record_write': 2024-02-02T11:50:37.228 INFO:teuthology.orchestra.run.smithi177.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:37.228 INFO:teuthology.orchestra.run.smithi177.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2024-02-02T11:50:37.228 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:50:37.229 INFO:teuthology.orchestra.run.smithi177.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:37.229 INFO:teuthology.orchestra.run.smithi177.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2024-02-02T11:50:37.229 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:50:37.413 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] random.lo 2024-02-02T11:50:37.538 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] 2024-02-02T11:50:37.646 INFO:teuthology.orchestra.run.smithi177.stdout:Building ltp 2024-02-02T11:50:37.652 INFO:teuthology.orchestra.run.smithi177.stdout: [DEP] 2024-02-02T11:50:37.861 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] doio 2024-02-02T11:50:38.587 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fsstress 2024-02-02T11:50:40.025 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fsx 2024-02-02T11:50:40.789 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] growfiles 2024-02-02T11:50:41.366 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] iogen 2024-02-02T11:50:41.525 INFO:teuthology.orchestra.run.smithi177.stderr:iogen.c: In function 'main': 2024-02-02T11:50:41.525 INFO:teuthology.orchestra.run.smithi177.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:41.525 INFO:teuthology.orchestra.run.smithi177.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2024-02-02T11:50:41.525 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:50:41.527 INFO:teuthology.orchestra.run.smithi177.stderr:iogen.c: In function 'parse_cmdline': 2024-02-02T11:50:41.527 INFO:teuthology.orchestra.run.smithi177.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:41.527 INFO:teuthology.orchestra.run.smithi177.stderr: 1535 | getcwd(fptr->f_path, 2024-02-02T11:50:41.527 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:50:41.528 INFO:teuthology.orchestra.run.smithi177.stderr: 1536 | sizeof(fptr->f_path)-1); 2024-02-02T11:50:41.528 INFO:teuthology.orchestra.run.smithi177.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:50:41.798 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-stress 2024-02-02T11:50:41.953 INFO:teuthology.orchestra.run.smithi177.stderr:aio-stress.c: In function 'setup_shared_mem': 2024-02-02T11:50:41.953 INFO:teuthology.orchestra.run.smithi177.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:41.954 INFO:teuthology.orchestra.run.smithi177.stderr: 1013 | ftruncate(fd, total_ram); 2024-02-02T11:50:41.954 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:50:42.267 INFO:teuthology.orchestra.run.smithi177.stdout:Building src 2024-02-02T11:50:42.275 INFO:teuthology.orchestra.run.smithi177.stdout: [DEP] 2024-02-02T11:50:44.646 INFO:teuthology.orchestra.run.smithi177.stdout: [DEP] 2024-02-02T11:50:44.691 INFO:teuthology.orchestra.run.smithi177.stdout: [DEP] 2024-02-02T11:50:44.705 INFO:teuthology.orchestra.run.smithi177.stdout: [DEP] 2024-02-02T11:50:45.022 INFO:teuthology.orchestra.run.smithi177.stdout: [DEP] 2024-02-02T11:50:45.057 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dirstress 2024-02-02T11:50:45.343 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fill 2024-02-02T11:50:45.529 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fill2 2024-02-02T11:50:45.796 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] getpagesize 2024-02-02T11:50:45.964 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] holes 2024-02-02T11:50:46.198 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] lstat64 2024-02-02T11:50:46.417 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] nametest 2024-02-02T11:50:46.574 INFO:teuthology.orchestra.run.smithi177.stderr:nametest.c: In function 'main': 2024-02-02T11:50:46.574 INFO:teuthology.orchestra.run.smithi177.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:46.574 INFO:teuthology.orchestra.run.smithi177.stderr: 236 | write(1, "\n", 1); 2024-02-02T11:50:46.574 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~ 2024-02-02T11:50:46.574 INFO:teuthology.orchestra.run.smithi177.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:46.574 INFO:teuthology.orchestra.run.smithi177.stderr: 238 | write(1, ".", 1); 2024-02-02T11:50:46.574 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~ 2024-02-02T11:50:46.574 INFO:teuthology.orchestra.run.smithi177.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:46.574 INFO:teuthology.orchestra.run.smithi177.stderr: 288 | write(1, ".", 1); 2024-02-02T11:50:46.574 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~ 2024-02-02T11:50:46.695 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] permname 2024-02-02T11:50:46.932 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] randholes 2024-02-02T11:50:47.221 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] runas 2024-02-02T11:50:47.433 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] truncfile 2024-02-02T11:50:47.650 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] usemem 2024-02-02T11:50:47.835 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] mmapcat 2024-02-02T11:50:47.976 INFO:teuthology.orchestra.run.smithi177.stderr:mmapcat.c: In function 'main': 2024-02-02T11:50:47.976 INFO:teuthology.orchestra.run.smithi177.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:47.976 INFO:teuthology.orchestra.run.smithi177.stderr: 29 | write(1,ptr2,ptr - ptr2); 2024-02-02T11:50:47.976 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:50:48.018 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] append_reader 2024-02-02T11:50:48.206 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] append_writer 2024-02-02T11:50:48.394 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dirperf 2024-02-02T11:50:48.653 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] metaperf 2024-02-02T11:50:48.802 INFO:teuthology.orchestra.run.smithi177.stderr:metaperf.c: In function 'crfiles': 2024-02-02T11:50:48.802 INFO:teuthology.orchestra.run.smithi177.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:48.802 INFO:teuthology.orchestra.run.smithi177.stderr: 166 | write(fd, buf, fsize); 2024-02-02T11:50:48.802 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:50:48.803 INFO:teuthology.orchestra.run.smithi177.stderr:metaperf.c: In function 't_linkun': 2024-02-02T11:50:48.803 INFO:teuthology.orchestra.run.smithi177.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:48.803 INFO:teuthology.orchestra.run.smithi177.stderr: 454 | link("a", *fnp); 2024-02-02T11:50:48.803 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~ 2024-02-02T11:50:48.803 INFO:teuthology.orchestra.run.smithi177.stderr:metaperf.c: In function 't_chown': 2024-02-02T11:50:48.803 INFO:teuthology.orchestra.run.smithi177.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:48.803 INFO:teuthology.orchestra.run.smithi177.stderr: 404 | chown(*fnp, 2, -1); 2024-02-02T11:50:48.804 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-02-02T11:50:48.804 INFO:teuthology.orchestra.run.smithi177.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:48.804 INFO:teuthology.orchestra.run.smithi177.stderr: 406 | chown(*fnp, 1, -1); 2024-02-02T11:50:48.804 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-02-02T11:50:48.804 INFO:teuthology.orchestra.run.smithi177.stderr:metaperf.c: In function 'i_chown': 2024-02-02T11:50:48.804 INFO:teuthology.orchestra.run.smithi177.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:48.804 INFO:teuthology.orchestra.run.smithi177.stderr: 291 | chown(*fnp, 1, -1); 2024-02-02T11:50:48.804 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-02-02T11:50:48.804 INFO:teuthology.orchestra.run.smithi177.stderr:metaperf.c: In function 'main': 2024-02-02T11:50:48.804 INFO:teuthology.orchestra.run.smithi177.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:48.804 INFO:teuthology.orchestra.run.smithi177.stderr: 152 | chdir(".."); 2024-02-02T11:50:48.804 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~ 2024-02-02T11:50:48.980 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] devzero 2024-02-02T11:50:49.193 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] feature 2024-02-02T11:50:49.448 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] alloc 2024-02-02T11:50:49.605 INFO:teuthology.orchestra.run.smithi177.stderr:alloc.c: In function 'main': 2024-02-02T11:50:49.605 INFO:teuthology.orchestra.run.smithi177.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:49.605 INFO:teuthology.orchestra.run.smithi177.stderr: 247 | mkstemp(tmpfile); 2024-02-02T11:50:49.605 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~ 2024-02-02T11:50:49.700 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fault 2024-02-02T11:50:49.900 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fstest 2024-02-02T11:50:50.179 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_access_root 2024-02-02T11:50:50.320 INFO:teuthology.orchestra.run.smithi177.stderr:t_access_root.c: In function 'main': 2024-02-02T11:50:50.321 INFO:teuthology.orchestra.run.smithi177.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:50.321 INFO:teuthology.orchestra.run.smithi177.stderr: 55 | system(cmd); 2024-02-02T11:50:50.321 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~ 2024-02-02T11:50:50.369 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] godown 2024-02-02T11:50:50.580 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] resvtest 2024-02-02T11:50:50.804 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] writemod 2024-02-02T11:50:50.983 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] writev_on_pagefault 2024-02-02T11:50:51.180 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] makeextents 2024-02-02T11:50:51.396 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] itrash 2024-02-02T11:50:51.583 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] rename 2024-02-02T11:50:51.754 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] multi_open_unlink 2024-02-02T11:50:51.862 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:50:51.864 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:50:51.867 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:50:51.960 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] unwritten_sync 2024-02-02T11:50:52.178 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] genhashnames 2024-02-02T11:50:52.400 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_holes 2024-02-02T11:50:52.584 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mmap_writev 2024-02-02T11:50:52.768 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_truncate_cmtime 2024-02-02T11:50:52.962 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dirhash_collide 2024-02-02T11:50:53.178 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_rename_overwrite 2024-02-02T11:50:53.353 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] holetest 2024-02-02T11:50:53.503 INFO:teuthology.orchestra.run.smithi177.stderr:holetest.c: In function 'pt_write_marker': 2024-02-02T11:50:53.504 INFO:teuthology.orchestra.run.smithi177.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:53.504 INFO:teuthology.orchestra.run.smithi177.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2024-02-02T11:50:53.504 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:50:53.618 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_truncate_self 2024-02-02T11:50:53.792 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] af_unix 2024-02-02T11:50:53.982 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mmap_stale_pmd 2024-02-02T11:50:54.126 INFO:teuthology.orchestra.run.smithi177.stderr:t_mmap_stale_pmd.c: In function 'main': 2024-02-02T11:50:54.126 INFO:teuthology.orchestra.run.smithi177.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:54.126 INFO:teuthology.orchestra.run.smithi177.stderr: 42 | ftruncate(fd, 0); 2024-02-02T11:50:54.126 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~ 2024-02-02T11:50:54.126 INFO:teuthology.orchestra.run.smithi177.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:54.126 INFO:teuthology.orchestra.run.smithi177.stderr: 43 | ftruncate(fd, MiB(4)); 2024-02-02T11:50:54.126 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:50:54.126 INFO:teuthology.orchestra.run.smithi177.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:54.126 INFO:teuthology.orchestra.run.smithi177.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2024-02-02T11:50:54.126 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:50:54.171 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mmap_cow_race 2024-02-02T11:50:54.319 INFO:teuthology.orchestra.run.smithi177.stderr:t_mmap_cow_race.c: In function 'main': 2024-02-02T11:50:54.319 INFO:teuthology.orchestra.run.smithi177.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:54.319 INFO:teuthology.orchestra.run.smithi177.stderr: 61 | ftruncate(fd, 0); 2024-02-02T11:50:54.319 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~ 2024-02-02T11:50:54.319 INFO:teuthology.orchestra.run.smithi177.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:54.319 INFO:teuthology.orchestra.run.smithi177.stderr: 62 | ftruncate(fd, MiB(2)); 2024-02-02T11:50:54.320 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:50:54.374 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mmap_fallocate 2024-02-02T11:50:54.560 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fsync-err 2024-02-02T11:50:54.782 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mmap_write_ro 2024-02-02T11:50:54.971 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_ext4_dax_journal_corruption 2024-02-02T11:50:55.116 INFO:teuthology.orchestra.run.smithi177.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2024-02-02T11:50:55.116 INFO:teuthology.orchestra.run.smithi177.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:55.116 INFO:teuthology.orchestra.run.smithi177.stderr: 61 | ftruncate(fd, 0); 2024-02-02T11:50:55.116 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~ 2024-02-02T11:50:55.168 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_ext4_dax_inline_corruption 2024-02-02T11:50:55.362 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_ofd_locks 2024-02-02T11:50:55.596 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mmap_collision 2024-02-02T11:50:55.835 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] mmap-write-concurrent 2024-02-02T11:50:56.042 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_get_file_time 2024-02-02T11:50:56.222 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_create_short_dirs 2024-02-02T11:50:56.426 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_create_long_dirs 2024-02-02T11:50:56.628 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_enospc 2024-02-02T11:50:56.863 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mmap_writev_overlap 2024-02-02T11:50:57.070 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] checkpoint_journal 2024-02-02T11:50:57.262 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] mmap-rw-fault 2024-02-02T11:50:57.484 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] allocstale 2024-02-02T11:50:57.815 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mmap_cow_memory_failure 2024-02-02T11:50:58.025 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fake-dump-rootino 2024-02-02T11:50:58.211 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dio-buf-fault 2024-02-02T11:50:58.401 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] rewinddir-test 2024-02-02T11:50:58.608 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] readdir-while-renames 2024-02-02T11:50:58.809 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfsctl 2024-02-02T11:50:59.037 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] bstat 2024-02-02T11:50:59.284 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mtab 2024-02-02T11:50:59.432 INFO:teuthology.orchestra.run.smithi177.stderr:t_mtab.c: In function 'update_mtab': 2024-02-02T11:50:59.432 INFO:teuthology.orchestra.run.smithi177.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:59.432 INFO:teuthology.orchestra.run.smithi177.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2024-02-02T11:50:59.432 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:50:59.511 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] getdevicesize 2024-02-02T11:50:59.689 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] preallo_rw_pattern_reader 2024-02-02T11:50:59.841 INFO:teuthology.orchestra.run.smithi177.stderr:In file included from preallo_rw_pattern_reader.c:2: 2024-02-02T11:50:59.842 INFO:teuthology.orchestra.run.smithi177.stderr:iopat.c: In function 'main': 2024-02-02T11:50:59.842 INFO:teuthology.orchestra.run.smithi177.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:50:59.842 INFO:teuthology.orchestra.run.smithi177.stderr: 38 | read(fd, &x, 1048576); 2024-02-02T11:50:59.842 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:50:59.884 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] preallo_rw_pattern_writer 2024-02-02T11:51:00.038 INFO:teuthology.orchestra.run.smithi177.stderr:In file included from preallo_rw_pattern_writer.c:2: 2024-02-02T11:51:00.038 INFO:teuthology.orchestra.run.smithi177.stderr:iopat.c: In function 'main': 2024-02-02T11:51:00.039 INFO:teuthology.orchestra.run.smithi177.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:00.039 INFO:teuthology.orchestra.run.smithi177.stderr: 34 | write(fd, &x, 1048576); 2024-02-02T11:51:00.039 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:00.080 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] ftrunc 2024-02-02T11:51:00.264 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] trunc 2024-02-02T11:51:00.466 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fs_perms 2024-02-02T11:51:00.611 INFO:teuthology.orchestra.run.smithi177.stderr:fs_perms.c: In function 'main': 2024-02-02T11:51:00.611 INFO:teuthology.orchestra.run.smithi177.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:00.611 INFO:teuthology.orchestra.run.smithi177.stderr: 54 | system("rm -f test.file"); 2024-02-02T11:51:00.612 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:00.612 INFO:teuthology.orchestra.run.smithi177.stderr:fs_perms.c: In function 'testsetup': 2024-02-02T11:51:00.612 INFO:teuthology.orchestra.run.smithi177.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:00.612 INFO:teuthology.orchestra.run.smithi177.stderr: 67 | system("cp testx.file test.file"); 2024-02-02T11:51:00.612 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:00.612 INFO:teuthology.orchestra.run.smithi177.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:00.612 INFO:teuthology.orchestra.run.smithi177.stderr: 69 | chown("test.file",cuserId,cgroupId); 2024-02-02T11:51:00.612 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:00.612 INFO:teuthology.orchestra.run.smithi177.stderr:fs_perms.c: In function 'testfperm': 2024-02-02T11:51:00.612 INFO:teuthology.orchestra.run.smithi177.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:00.612 INFO:teuthology.orchestra.run.smithi177.stderr: 123 | seteuid(0); 2024-02-02T11:51:00.612 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~ 2024-02-02T11:51:00.612 INFO:teuthology.orchestra.run.smithi177.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:00.612 INFO:teuthology.orchestra.run.smithi177.stderr: 124 | setegid(0); 2024-02-02T11:51:00.613 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~ 2024-02-02T11:51:00.665 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] testx 2024-02-02T11:51:00.827 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] looptest 2024-02-02T11:51:01.059 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] locktest 2024-02-02T11:51:01.406 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] unwritten_mmap 2024-02-02T11:51:01.606 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] bulkstat_unlink_test 2024-02-02T11:51:01.759 INFO:teuthology.orchestra.run.smithi177.stderr:bulkstat_unlink_test.c: In function 'main': 2024-02-02T11:51:01.760 INFO:teuthology.orchestra.run.smithi177.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:01.760 INFO:teuthology.orchestra.run.smithi177.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2024-02-02T11:51:01.760 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:01.760 INFO:teuthology.orchestra.run.smithi177.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:01.760 INFO:teuthology.orchestra.run.smithi177.stderr: 178 | system(fname); 2024-02-02T11:51:01.760 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~ 2024-02-02T11:51:01.846 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] deduperace 2024-02-02T11:51:02.081 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] bulkstat_unlink_test_modified 2024-02-02T11:51:02.234 INFO:teuthology.orchestra.run.smithi177.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2024-02-02T11:51:02.235 INFO:teuthology.orchestra.run.smithi177.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.235 INFO:teuthology.orchestra.run.smithi177.stderr: 83 | write(fd, fname, sizeof(fname)); 2024-02-02T11:51:02.235 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.235 INFO:teuthology.orchestra.run.smithi177.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.235 INFO:teuthology.orchestra.run.smithi177.stderr: 139 | write(fd, fname, sizeof(fname)); 2024-02-02T11:51:02.235 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.235 INFO:teuthology.orchestra.run.smithi177.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.235 INFO:teuthology.orchestra.run.smithi177.stderr: 185 | system(fname); 2024-02-02T11:51:02.235 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~ 2024-02-02T11:51:02.316 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_dir_offset 2024-02-02T11:51:02.499 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_futimens 2024-02-02T11:51:02.672 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_immutable 2024-02-02T11:51:02.842 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c: In function 'create_test_area': 2024-02-02T11:51:02.842 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.842 INFO:teuthology.orchestra.run.smithi177.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2024-02-02T11:51:02.842 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.842 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.843 INFO:teuthology.orchestra.run.smithi177.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2024-02-02T11:51:02.843 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.843 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c: In function 'remove_test_area': 2024-02-02T11:51:02.844 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.844 INFO:teuthology.orchestra.run.smithi177.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2024-02-02T11:51:02.844 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.844 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.844 INFO:teuthology.orchestra.run.smithi177.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2024-02-02T11:51:02.844 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.844 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.844 INFO:teuthology.orchestra.run.smithi177.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2024-02-02T11:51:02.844 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.844 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.844 INFO:teuthology.orchestra.run.smithi177.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2024-02-02T11:51:02.844 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.844 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.845 INFO:teuthology.orchestra.run.smithi177.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2024-02-02T11:51:02.845 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.846 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.846 INFO:teuthology.orchestra.run.smithi177.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2024-02-02T11:51:02.846 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.846 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c: In function 'check_test_area': 2024-02-02T11:51:02.846 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.846 INFO:teuthology.orchestra.run.smithi177.stderr: 1788 | asprintf(&path, "%s/", dir); 2024-02-02T11:51:02.846 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.846 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.847 INFO:teuthology.orchestra.run.smithi177.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2024-02-02T11:51:02.847 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.847 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.847 INFO:teuthology.orchestra.run.smithi177.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2024-02-02T11:51:02.847 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.847 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.847 INFO:teuthology.orchestra.run.smithi177.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2024-02-02T11:51:02.847 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.847 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.847 INFO:teuthology.orchestra.run.smithi177.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2024-02-02T11:51:02.847 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.847 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.847 INFO:teuthology.orchestra.run.smithi177.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2024-02-02T11:51:02.847 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.847 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.848 INFO:teuthology.orchestra.run.smithi177.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2024-02-02T11:51:02.848 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.848 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.848 INFO:teuthology.orchestra.run.smithi177.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2024-02-02T11:51:02.848 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.848 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.848 INFO:teuthology.orchestra.run.smithi177.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2024-02-02T11:51:02.848 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.850 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c: In function 'test_immutable': 2024-02-02T11:51:02.850 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.850 INFO:teuthology.orchestra.run.smithi177.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2024-02-02T11:51:02.850 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.850 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.850 INFO:teuthology.orchestra.run.smithi177.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2024-02-02T11:51:02.850 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.850 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.850 INFO:teuthology.orchestra.run.smithi177.stderr: 408 | chown(path, 0, 0); 2024-02-02T11:51:02.851 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.851 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.851 INFO:teuthology.orchestra.run.smithi177.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2024-02-02T11:51:02.851 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.851 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.851 INFO:teuthology.orchestra.run.smithi177.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2024-02-02T11:51:02.851 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.851 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.851 INFO:teuthology.orchestra.run.smithi177.stderr: 553 | chown(path, 0, 0); 2024-02-02T11:51:02.851 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.851 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.851 INFO:teuthology.orchestra.run.smithi177.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2024-02-02T11:51:02.851 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.851 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.851 INFO:teuthology.orchestra.run.smithi177.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2024-02-02T11:51:02.852 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.852 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.852 INFO:teuthology.orchestra.run.smithi177.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2024-02-02T11:51:02.852 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.852 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.852 INFO:teuthology.orchestra.run.smithi177.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2024-02-02T11:51:02.852 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.855 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.855 INFO:teuthology.orchestra.run.smithi177.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2024-02-02T11:51:02.855 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.856 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.856 INFO:teuthology.orchestra.run.smithi177.stderr: 653 | chown(path, 0, 0); 2024-02-02T11:51:02.856 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.856 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.856 INFO:teuthology.orchestra.run.smithi177.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2024-02-02T11:51:02.856 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.856 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.856 INFO:teuthology.orchestra.run.smithi177.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2024-02-02T11:51:02.856 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.856 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.856 INFO:teuthology.orchestra.run.smithi177.stderr: 705 | chown(path, 0, 0); 2024-02-02T11:51:02.856 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.856 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.857 INFO:teuthology.orchestra.run.smithi177.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2024-02-02T11:51:02.857 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.859 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c: In function 'test_append': 2024-02-02T11:51:02.859 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.859 INFO:teuthology.orchestra.run.smithi177.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2024-02-02T11:51:02.859 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.859 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.859 INFO:teuthology.orchestra.run.smithi177.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2024-02-02T11:51:02.859 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.859 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.859 INFO:teuthology.orchestra.run.smithi177.stderr: 1051 | chown(path, 0, 0); 2024-02-02T11:51:02.859 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.859 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.860 INFO:teuthology.orchestra.run.smithi177.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2024-02-02T11:51:02.860 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.860 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.860 INFO:teuthology.orchestra.run.smithi177.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2024-02-02T11:51:02.860 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.860 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.860 INFO:teuthology.orchestra.run.smithi177.stderr: 1516 | chown(path, 0, 0); 2024-02-02T11:51:02.860 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.860 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.860 INFO:teuthology.orchestra.run.smithi177.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2024-02-02T11:51:02.860 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.860 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.860 INFO:teuthology.orchestra.run.smithi177.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2024-02-02T11:51:02.860 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.861 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.861 INFO:teuthology.orchestra.run.smithi177.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2024-02-02T11:51:02.861 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.861 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.861 INFO:teuthology.orchestra.run.smithi177.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2024-02-02T11:51:02.861 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.861 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.861 INFO:teuthology.orchestra.run.smithi177.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2024-02-02T11:51:02.861 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.861 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.861 INFO:teuthology.orchestra.run.smithi177.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2024-02-02T11:51:02.861 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.861 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.861 INFO:teuthology.orchestra.run.smithi177.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2024-02-02T11:51:02.861 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.862 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.862 INFO:teuthology.orchestra.run.smithi177.stderr: 1618 | chown(path, 0, 0); 2024-02-02T11:51:02.862 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.862 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.862 INFO:teuthology.orchestra.run.smithi177.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2024-02-02T11:51:02.862 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.862 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.862 INFO:teuthology.orchestra.run.smithi177.stderr: 1644 | chown(path, 0, 0); 2024-02-02T11:51:02.862 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.862 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.862 INFO:teuthology.orchestra.run.smithi177.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2024-02-02T11:51:02.862 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.862 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.862 INFO:teuthology.orchestra.run.smithi177.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2024-02-02T11:51:02.862 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.863 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.863 INFO:teuthology.orchestra.run.smithi177.stderr: 1692 | chown(path, 0, 0); 2024-02-02T11:51:02.863 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~ 2024-02-02T11:51:02.863 INFO:teuthology.orchestra.run.smithi177.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:02.863 INFO:teuthology.orchestra.run.smithi177.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2024-02-02T11:51:02.863 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:03.412 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] stale_handle 2024-02-02T11:51:03.567 INFO:teuthology.orchestra.run.smithi177.stderr:stale_handle.c: In function 'main': 2024-02-02T11:51:03.567 INFO:teuthology.orchestra.run.smithi177.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:03.567 INFO:teuthology.orchestra.run.smithi177.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2024-02-02T11:51:03.567 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:03.623 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] pwrite_mmap_blocked 2024-02-02T11:51:03.813 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_dir_offset2 2024-02-02T11:51:04.043 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] seek_sanity_test 2024-02-02T11:51:04.205 INFO:teuthology.orchestra.run.smithi177.stderr:seek_sanity_test.c: In function 'test18': 2024-02-02T11:51:04.205 INFO:teuthology.orchestra.run.smithi177.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:04.205 INFO:teuthology.orchestra.run.smithi177.stderr: 460 | ftruncate(fd, 0); 2024-02-02T11:51:04.205 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~ 2024-02-02T11:51:04.207 INFO:teuthology.orchestra.run.smithi177.stderr:seek_sanity_test.c: In function 'test_basic_support': 2024-02-02T11:51:04.207 INFO:teuthology.orchestra.run.smithi177.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:04.207 INFO:teuthology.orchestra.run.smithi177.stderr: 1207 | ftruncate(fd, 0); 2024-02-02T11:51:04.207 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~ 2024-02-02T11:51:04.207 INFO:teuthology.orchestra.run.smithi177.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:04.207 INFO:teuthology.orchestra.run.smithi177.stderr: 1256 | ftruncate(fd, 0); 2024-02-02T11:51:04.207 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~ 2024-02-02T11:51:04.207 INFO:teuthology.orchestra.run.smithi177.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2024-02-02T11:51:04.208 INFO:teuthology.orchestra.run.smithi177.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:04.208 INFO:teuthology.orchestra.run.smithi177.stderr: 88 | ftruncate(fd, 0); 2024-02-02T11:51:04.208 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~ 2024-02-02T11:51:04.208 INFO:teuthology.orchestra.run.smithi177.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:04.208 INFO:teuthology.orchestra.run.smithi177.stderr: 89 | pwrite(fd, "a", 1, offset); 2024-02-02T11:51:04.208 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:04.208 INFO:teuthology.orchestra.run.smithi177.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:04.208 INFO:teuthology.orchestra.run.smithi177.stderr: 98 | ftruncate(fd, 0); 2024-02-02T11:51:04.208 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~ 2024-02-02T11:51:04.208 INFO:teuthology.orchestra.run.smithi177.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:04.208 INFO:teuthology.orchestra.run.smithi177.stderr: 99 | pwrite(fd, "a", 1, offset); 2024-02-02T11:51:04.208 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:04.517 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] seek_copy_test 2024-02-02T11:51:04.734 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_readdir_1 2024-02-02T11:51:04.876 INFO:teuthology.orchestra.run.smithi177.stderr:t_readdir_1.c: In function 'main': 2024-02-02T11:51:04.877 INFO:teuthology.orchestra.run.smithi177.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:04.877 INFO:teuthology.orchestra.run.smithi177.stderr: 30 | read(fd, buf, 100); 2024-02-02T11:51:04.877 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:04.918 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_readdir_2 2024-02-02T11:51:05.104 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fsync-tester 2024-02-02T11:51:05.250 INFO:teuthology.orchestra.run.smithi177.stderr:fsync-tester.c: In function 'main': 2024-02-02T11:51:05.250 INFO:teuthology.orchestra.run.smithi177.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:05.250 INFO:teuthology.orchestra.run.smithi177.stderr: 391 | read(fd, &seed, sizeof(seed)); 2024-02-02T11:51:05.250 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:05.250 INFO:teuthology.orchestra.run.smithi177.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:05.250 INFO:teuthology.orchestra.run.smithi177.stderr: 541 | system("reboot -fn"); 2024-02-02T11:51:05.250 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:05.251 INFO:teuthology.orchestra.run.smithi177.stderr:fsync-tester.c: In function 'drop_all_caches': 2024-02-02T11:51:05.251 INFO:teuthology.orchestra.run.smithi177.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:05.251 INFO:teuthology.orchestra.run.smithi177.stderr: 90 | write(fd, value, sizeof(value)-1); 2024-02-02T11:51:05.251 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:05.398 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] nsexec 2024-02-02T11:51:05.615 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] cloner 2024-02-02T11:51:05.829 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] renameat2 2024-02-02T11:51:06.032 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_getcwd 2024-02-02T11:51:06.175 INFO:teuthology.orchestra.run.smithi177.stderr:t_getcwd.c: In function 'test_getcwd': 2024-02-02T11:51:06.175 INFO:teuthology.orchestra.run.smithi177.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:06.175 INFO:teuthology.orchestra.run.smithi177.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2024-02-02T11:51:06.175 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:06.229 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] e4compact 2024-02-02T11:51:06.471 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] test-nextquota 2024-02-02T11:51:06.683 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] punch-alternating 2024-02-02T11:51:06.894 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] attr-list-by-handle-cursor-test 2024-02-02T11:51:07.099 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] listxattr 2024-02-02T11:51:07.280 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dio-interleaved 2024-02-02T11:51:07.479 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_dir_type 2024-02-02T11:51:07.672 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dio-invalidate-cache 2024-02-02T11:51:07.816 INFO:teuthology.orchestra.run.smithi177.stderr:dio-invalidate-cache.c: In function 'main': 2024-02-02T11:51:07.817 INFO:teuthology.orchestra.run.smithi177.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:07.817 INFO:teuthology.orchestra.run.smithi177.stderr: 286 | write(fd, buf, blksz * nr_child); 2024-02-02T11:51:07.817 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:07.914 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] stat_test 2024-02-02T11:51:08.244 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_encrypted_d_revalidate 2024-02-02T11:51:08.446 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] attr_replace_test 2024-02-02T11:51:08.647 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] swapon 2024-02-02T11:51:08.851 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] mkswap 2024-02-02T11:51:09.039 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_attr_corruption 2024-02-02T11:51:09.225 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_open_tmpfiles 2024-02-02T11:51:09.443 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fscrypt-crypt-util 2024-02-02T11:51:10.113 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] bulkstat_null_ocount 2024-02-02T11:51:10.308 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] splice-test 2024-02-02T11:51:10.529 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] chprojid_fail 2024-02-02T11:51:10.731 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] detached_mounts_propagation 2024-02-02T11:51:10.955 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] ext4_resize 2024-02-02T11:51:11.142 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_readdir_3 2024-02-02T11:51:11.375 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] splice2pipe 2024-02-02T11:51:11.519 INFO:teuthology.orchestra.run.smithi177.stderr:splice2pipe.c: In function 'prepare_pipe': 2024-02-02T11:51:11.519 INFO:teuthology.orchestra.run.smithi177.stderr:splice2pipe.c:57:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:11.519 INFO:teuthology.orchestra.run.smithi177.stderr: 57 | write(p[1], buffer, n); 2024-02-02T11:51:11.519 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:11.519 INFO:teuthology.orchestra.run.smithi177.stderr:splice2pipe.c:65:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:11.519 INFO:teuthology.orchestra.run.smithi177.stderr: 65 | read(p[0], buffer, n); 2024-02-02T11:51:11.519 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:11.575 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] uuid_ioctl 2024-02-02T11:51:11.769 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fiemap-tester 2024-02-02T11:51:12.072 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_stripealign 2024-02-02T11:51:12.265 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] open_by_handle 2024-02-02T11:51:12.554 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_mmap_dio 2024-02-02T11:51:12.754 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfsfind 2024-02-02T11:51:12.986 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] t_reflink_read_race 2024-02-02T11:51:13.220 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fssum 2024-02-02T11:51:13.694 INFO:teuthology.orchestra.run.smithi177.stdout:Building log-writes 2024-02-02T11:51:13.702 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] replay-log 2024-02-02T11:51:14.073 INFO:teuthology.orchestra.run.smithi177.stdout:Building perf 2024-02-02T11:51:14.078 INFO:teuthology.orchestra.run.smithi177.stdout:Building aio-dio-regress 2024-02-02T11:51:14.088 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aiocp 2024-02-02T11:51:14.364 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-append-write-fallocate-race 2024-02-02T11:51:14.579 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-append-write-read-race 2024-02-02T11:51:14.802 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-cow-race 2024-02-02T11:51:15.001 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-cycle-write 2024-02-02T11:51:15.145 INFO:teuthology.orchestra.run.smithi177.stderr:aio-dio-cycle-write.c: In function 'init_test': 2024-02-02T11:51:15.145 INFO:teuthology.orchestra.run.smithi177.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:15.145 INFO:teuthology.orchestra.run.smithi177.stderr: 83 | ftruncate(fd, buf_size); 2024-02-02T11:51:15.145 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:15.234 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-eof-race 2024-02-02T11:51:15.464 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-extend-stat 2024-02-02T11:51:15.676 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-fcntl-race 2024-02-02T11:51:15.883 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-hole-filling-race 2024-02-02T11:51:16.078 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-invalidate-failure 2024-02-02T11:51:16.282 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-invalidate-readahead 2024-02-02T11:51:16.495 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aiodio_sparse2 2024-02-02T11:51:16.640 INFO:teuthology.orchestra.run.smithi177.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2024-02-02T11:51:16.640 INFO:teuthology.orchestra.run.smithi177.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:16.640 INFO:teuthology.orchestra.run.smithi177.stderr: 111 | ftruncate(fd, filesize); 2024-02-02T11:51:16.640 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:16.640 INFO:teuthology.orchestra.run.smithi177.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2024-02-02T11:51:16.640 INFO:teuthology.orchestra.run.smithi177.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2024-02-02T11:51:16.641 INFO:teuthology.orchestra.run.smithi177.stderr: 274 | ftruncate(fd, size); 2024-02-02T11:51:16.641 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-02-02T11:51:16.761 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-subblock-eof-read 2024-02-02T11:51:16.950 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-dio-write-verify 2024-02-02T11:51:17.196 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-02-02T11:51:17.373 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-02-02T11:51:17.550 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] aio-last-ref-held-by-io 2024-02-02T11:51:17.771 INFO:teuthology.orchestra.run.smithi177.stdout:Building vfs 2024-02-02T11:51:17.780 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] vfstest 2024-02-02T11:51:19.934 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] mount-idmapped 2024-02-02T11:51:20.368 INFO:teuthology.orchestra.run.smithi177.stdout:Building m4 2024-02-02T11:51:20.374 INFO:teuthology.orchestra.run.smithi177.stdout:Building common 2024-02-02T11:51:20.381 INFO:teuthology.orchestra.run.smithi177.stdout:Building tests 2024-02-02T11:51:20.389 INFO:teuthology.orchestra.run.smithi177.stdout:Building btrfs 2024-02-02T11:51:20.398 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/btrfs/group.list 2024-02-02T11:51:20.525 INFO:teuthology.orchestra.run.smithi177.stdout:Building ceph 2024-02-02T11:51:20.534 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/ceph/group.list 2024-02-02T11:51:20.564 INFO:teuthology.orchestra.run.smithi177.stdout:Building cifs 2024-02-02T11:51:20.573 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/cifs/group.list 2024-02-02T11:51:20.599 INFO:teuthology.orchestra.run.smithi177.stdout:Building ext4 2024-02-02T11:51:20.608 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/ext4/group.list 2024-02-02T11:51:20.688 INFO:teuthology.orchestra.run.smithi177.stdout:Building f2fs 2024-02-02T11:51:20.696 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/f2fs/group.list 2024-02-02T11:51:20.733 INFO:teuthology.orchestra.run.smithi177.stdout:Building generic 2024-02-02T11:51:20.744 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/generic/group.list 2024-02-02T11:51:20.950 INFO:teuthology.orchestra.run.smithi177.stdout:Building nfs 2024-02-02T11:51:20.958 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/nfs/group.list 2024-02-02T11:51:20.989 INFO:teuthology.orchestra.run.smithi177.stdout:Building ocfs2 2024-02-02T11:51:20.997 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/ocfs2/group.list 2024-02-02T11:51:21.026 INFO:teuthology.orchestra.run.smithi177.stdout:Building overlay 2024-02-02T11:51:21.035 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/overlay/group.list 2024-02-02T11:51:21.122 INFO:teuthology.orchestra.run.smithi177.stdout:Building perf 2024-02-02T11:51:21.130 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/perf/group.list 2024-02-02T11:51:21.154 INFO:teuthology.orchestra.run.smithi177.stdout:Building selftest 2024-02-02T11:51:21.163 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/selftest/group.list 2024-02-02T11:51:21.190 INFO:teuthology.orchestra.run.smithi177.stdout:Building shared 2024-02-02T11:51:21.198 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/shared/group.list 2024-02-02T11:51:21.235 INFO:teuthology.orchestra.run.smithi177.stdout:Building tmpfs 2024-02-02T11:51:21.243 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/tmpfs/group.list 2024-02-02T11:51:21.272 INFO:teuthology.orchestra.run.smithi177.stdout:Building udf 2024-02-02T11:51:21.280 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/udf/group.list 2024-02-02T11:51:21.305 INFO:teuthology.orchestra.run.smithi177.stdout:Building xfs 2024-02-02T11:51:21.315 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/xfs/group.list 2024-02-02T11:51:21.523 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.ByhSz7TqB0xfstests-dev && exec sudo make install) 2024-02-02T11:51:21.564 INFO:teuthology.orchestra.run.smithi177.stdout:Building include 2024-02-02T11:51:21.570 INFO:teuthology.orchestra.run.smithi177.stdout:Building lib 2024-02-02T11:51:21.576 INFO:teuthology.orchestra.run.smithi177.stdout:Building ltp 2024-02-02T11:51:21.583 INFO:teuthology.orchestra.run.smithi177.stdout:Building src 2024-02-02T11:51:21.637 INFO:teuthology.orchestra.run.smithi177.stdout:Building log-writes 2024-02-02T11:51:21.644 INFO:teuthology.orchestra.run.smithi177.stdout:Building perf 2024-02-02T11:51:21.649 INFO:teuthology.orchestra.run.smithi177.stdout:Building aio-dio-regress 2024-02-02T11:51:21.656 INFO:teuthology.orchestra.run.smithi177.stdout:Building vfs 2024-02-02T11:51:21.663 INFO:teuthology.orchestra.run.smithi177.stdout:Building m4 2024-02-02T11:51:21.669 INFO:teuthology.orchestra.run.smithi177.stdout:Building common 2024-02-02T11:51:21.675 INFO:teuthology.orchestra.run.smithi177.stdout:Building tests 2024-02-02T11:51:21.684 INFO:teuthology.orchestra.run.smithi177.stdout:Building btrfs 2024-02-02T11:51:21.693 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/btrfs/group.list 2024-02-02T11:51:21.816 INFO:teuthology.orchestra.run.smithi177.stdout:Building ceph 2024-02-02T11:51:21.824 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/ceph/group.list 2024-02-02T11:51:21.855 INFO:teuthology.orchestra.run.smithi177.stdout:Building cifs 2024-02-02T11:51:21.864 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/cifs/group.list 2024-02-02T11:51:21.890 INFO:teuthology.orchestra.run.smithi177.stdout:Building ext4 2024-02-02T11:51:21.899 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/ext4/group.list 2024-02-02T11:51:21.917 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:51:21.920 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:51:21.922 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:51:21.982 INFO:teuthology.orchestra.run.smithi177.stdout:Building f2fs 2024-02-02T11:51:21.991 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/f2fs/group.list 2024-02-02T11:51:22.028 INFO:teuthology.orchestra.run.smithi177.stdout:Building generic 2024-02-02T11:51:22.039 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/generic/group.list 2024-02-02T11:51:22.239 INFO:teuthology.orchestra.run.smithi177.stdout:Building nfs 2024-02-02T11:51:22.247 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/nfs/group.list 2024-02-02T11:51:22.278 INFO:teuthology.orchestra.run.smithi177.stdout:Building ocfs2 2024-02-02T11:51:22.286 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/ocfs2/group.list 2024-02-02T11:51:22.315 INFO:teuthology.orchestra.run.smithi177.stdout:Building overlay 2024-02-02T11:51:22.324 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/overlay/group.list 2024-02-02T11:51:22.409 INFO:teuthology.orchestra.run.smithi177.stdout:Building perf 2024-02-02T11:51:22.418 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/perf/group.list 2024-02-02T11:51:22.442 INFO:teuthology.orchestra.run.smithi177.stdout:Building selftest 2024-02-02T11:51:22.451 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/selftest/group.list 2024-02-02T11:51:22.477 INFO:teuthology.orchestra.run.smithi177.stdout:Building shared 2024-02-02T11:51:22.486 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/shared/group.list 2024-02-02T11:51:22.523 INFO:teuthology.orchestra.run.smithi177.stdout:Building tmpfs 2024-02-02T11:51:22.531 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/tmpfs/group.list 2024-02-02T11:51:22.560 INFO:teuthology.orchestra.run.smithi177.stdout:Building udf 2024-02-02T11:51:22.568 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/udf/group.list 2024-02-02T11:51:22.593 INFO:teuthology.orchestra.run.smithi177.stdout:Building xfs 2024-02-02T11:51:22.603 INFO:teuthology.orchestra.run.smithi177.stdout: [GROUP] /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/xfs/group.list 2024-02-02T11:51:22.803 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-02-02T11:51:22.807 INFO:teuthology.orchestra.run.smithi177.stdout:gmake[1]: Nothing to be done for 'install'. 2024-02-02T11:51:22.807 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-02-02T11:51:22.811 INFO:teuthology.orchestra.run.smithi177.stdout:gmake[1]: Nothing to be done for 'install'. 2024-02-02T11:51:22.811 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-02-02T11:51:22.816 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-02-02T11:51:22.836 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-02-02T11:51:22.988 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-02-02T11:51:23.008 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-02-02T11:51:23.036 INFO:teuthology.orchestra.run.smithi177.stdout:Building log-writes 2024-02-02T11:51:23.042 INFO:teuthology.orchestra.run.smithi177.stdout:Building perf 2024-02-02T11:51:23.048 INFO:teuthology.orchestra.run.smithi177.stdout:Building aio-dio-regress 2024-02-02T11:51:23.055 INFO:teuthology.orchestra.run.smithi177.stdout:Building vfs 2024-02-02T11:51:23.060 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake -C log-writes install 2024-02-02T11:51:23.064 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-02-02T11:51:23.083 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-02-02T11:51:23.103 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake -C perf install 2024-02-02T11:51:23.106 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-02-02T11:51:23.126 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-02-02T11:51:23.172 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-02-02T11:51:23.176 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-02-02T11:51:23.196 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-02-02T11:51:23.304 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake -C vfs install 2024-02-02T11:51:23.308 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-02-02T11:51:23.327 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-02-02T11:51:23.353 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-02-02T11:51:23.373 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-02-02T11:51:26.046 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-02-02T11:51:26.257 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-02-02T11:51:26.302 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-02-02T11:51:26.306 INFO:teuthology.orchestra.run.smithi177.stdout:gmake[1]: Nothing to be done for 'install'. 2024-02-02T11:51:26.306 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-02-02T11:51:26.310 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-02-02T11:51:26.329 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-02-02T11:51:26.598 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-02-02T11:51:26.602 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/btrfs/ install 2024-02-02T11:51:26.607 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-02-02T11:51:26.627 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 /var/lib/xfstests/tests/btrfs 2024-02-02T11:51:28.272 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-02-02T11:51:28.292 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out /var/lib/xfstests/tests/btrfs 2024-02-02T11:51:29.948 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/ceph/ install 2024-02-02T11:51:29.952 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-02-02T11:51:29.971 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-02-02T11:51:30.012 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-02-02T11:51:30.032 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-02-02T11:51:30.072 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/cifs/ install 2024-02-02T11:51:30.076 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-02-02T11:51:30.095 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-02-02T11:51:30.115 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-02-02T11:51:30.134 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-02-02T11:51:30.154 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/ext4/ install 2024-02-02T11:51:30.158 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-02-02T11:51:30.178 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-02-02T11:51:30.556 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-02-02T11:51:30.575 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-02-02T11:51:30.973 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/f2fs/ install 2024-02-02T11:51:30.977 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-02-02T11:51:30.996 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-02-02T11:51:31.021 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-02-02T11:51:31.040 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-02-02T11:51:31.065 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/generic/ install 2024-02-02T11:51:31.072 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-02-02T11:51:31.091 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 /var/lib/xfstests/tests/generic 2024-02-02T11:51:35.092 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-02-02T11:51:35.111 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out /var/lib/xfstests/tests/generic 2024-02-02T11:51:39.148 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/nfs/ install 2024-02-02T11:51:39.152 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-02-02T11:51:39.171 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-02-02T11:51:39.190 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-02-02T11:51:39.209 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-02-02T11:51:39.229 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/ocfs2/ install 2024-02-02T11:51:39.233 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-02-02T11:51:39.251 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-02-02T11:51:39.271 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-02-02T11:51:39.290 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-02-02T11:51:39.310 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/overlay/ install 2024-02-02T11:51:39.314 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-02-02T11:51:39.333 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-02-02T11:51:39.910 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-02-02T11:51:39.929 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-02-02T11:51:40.503 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/perf/ install 2024-02-02T11:51:40.507 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-02-02T11:51:40.526 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-02-02T11:51:40.546 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-02-02T11:51:40.565 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-02-02T11:51:40.584 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/selftest/ install 2024-02-02T11:51:40.588 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-02-02T11:51:40.607 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-02-02T11:51:40.653 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-02-02T11:51:40.673 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-02-02T11:51:40.719 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/shared/ install 2024-02-02T11:51:40.722 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-02-02T11:51:40.742 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-02-02T11:51:40.772 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-02-02T11:51:40.791 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-02-02T11:51:40.822 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/tmpfs/ install 2024-02-02T11:51:40.826 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-02-02T11:51:40.844 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-02-02T11:51:40.864 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-02-02T11:51:40.884 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-02-02T11:51:40.903 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/udf/ install 2024-02-02T11:51:40.907 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-02-02T11:51:40.926 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-02-02T11:51:40.945 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-02-02T11:51:40.965 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-02-02T11:51:40.984 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ByhSz7TqB0xfstests-dev/tests/xfs/ install 2024-02-02T11:51:40.991 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-02-02T11:51:41.011 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 602 603 604 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-02-02T11:51:44.776 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-02-02T11:51:44.795 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 602.out 603.out 604.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-02-02T11:51:48.623 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-02-02T11:51:48.642 INFO:teuthology.orchestra.run.smithi177.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-02-02T11:51:48.661 INFO:teuthology.orchestra.run.smithi177.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-02-02T11:51:48.680 INFO:teuthology.orchestra.run.smithi177.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-02-02T11:51:48.703 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.mSCij3RKBAxfsprogs-dev && exec sudo make) 2024-02-02T11:51:48.769 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize -c -i -f 2024-02-02T11:51:48.972 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, '.'. 2024-02-02T11:51:48.973 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file './config.guess' 2024-02-02T11:51:48.981 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file './config.sub' 2024-02-02T11:51:48.990 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file './install-sh' 2024-02-02T11:51:48.999 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file './ltmain.sh' 2024-02-02T11:51:49.039 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-02-02T11:51:49.040 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-02-02T11:51:49.049 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-02-02T11:51:49.059 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-02-02T11:51:49.068 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-02-02T11:51:49.078 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-02-02T11:51:49.088 INFO:teuthology.orchestra.run.smithi177.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-02-02T11:51:49.090 INFO:teuthology.orchestra.run.smithi177.stdout:cp include/install-sh . 2024-02-02T11:51:49.092 INFO:teuthology.orchestra.run.smithi177.stdout:aclocal -I m4 2024-02-02T11:51:50.101 INFO:teuthology.orchestra.run.smithi177.stdout:autoconf 2024-02-02T11:51:50.534 INFO:teuthology.orchestra.run.smithi177.stdout:./configure $LOCAL_CONFIGURE_OPTIONS 2024-02-02T11:51:50.681 INFO:teuthology.orchestra.run.smithi177.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-02-02T11:51:50.751 INFO:teuthology.orchestra.run.smithi177.stdout:checking build system type... x86_64-pc-linux-gnu 2024-02-02T11:51:50.751 INFO:teuthology.orchestra.run.smithi177.stdout:checking host system type... x86_64-pc-linux-gnu 2024-02-02T11:51:50.781 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to print strings... printf 2024-02-02T11:51:50.781 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc... gcc 2024-02-02T11:51:50.867 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether the C compiler works... yes 2024-02-02T11:51:50.867 INFO:teuthology.orchestra.run.smithi177.stdout:checking for C compiler default output file name... a.out 2024-02-02T11:51:50.907 INFO:teuthology.orchestra.run.smithi177.stdout:checking for suffix of executables... 2024-02-02T11:51:50.955 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether we are cross compiling... no 2024-02-02T11:51:50.981 INFO:teuthology.orchestra.run.smithi177.stdout:checking for suffix of object files... o 2024-02-02T11:51:51.004 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether the compiler supports GNU C... yes 2024-02-02T11:51:51.027 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether gcc accepts -g... yes 2024-02-02T11:51:51.078 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc option to enable C11 features... none needed 2024-02-02T11:51:51.084 INFO:teuthology.orchestra.run.smithi177.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-02-02T11:51:51.089 INFO:teuthology.orchestra.run.smithi177.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-02-02T11:51:51.092 INFO:teuthology.orchestra.run.smithi177.stdout:checking for egrep... /usr/bin/grep -E 2024-02-02T11:51:51.094 INFO:teuthology.orchestra.run.smithi177.stdout:checking for fgrep... /usr/bin/grep -F 2024-02-02T11:51:51.101 INFO:teuthology.orchestra.run.smithi177.stdout:checking for ld used by gcc... /usr/bin/ld 2024-02-02T11:51:51.105 INFO:teuthology.orchestra.run.smithi177.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-02-02T11:51:51.109 INFO:teuthology.orchestra.run.smithi177.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-02-02T11:51:51.138 INFO:teuthology.orchestra.run.smithi177.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-02-02T11:51:51.138 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether ln -s works... yes 2024-02-02T11:51:51.144 INFO:teuthology.orchestra.run.smithi177.stdout:checking the maximum length of command line arguments... 1572864 2024-02-02T11:51:51.150 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-02-02T11:51:51.151 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-02-02T11:51:51.151 INFO:teuthology.orchestra.run.smithi177.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-02-02T11:51:51.151 INFO:teuthology.orchestra.run.smithi177.stdout:checking for objdump... objdump 2024-02-02T11:51:51.151 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to recognize dependent libraries... pass_all 2024-02-02T11:51:51.152 INFO:teuthology.orchestra.run.smithi177.stdout:checking for dlltool... no 2024-02-02T11:51:51.152 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-02-02T11:51:51.152 INFO:teuthology.orchestra.run.smithi177.stdout:checking for ar... ar 2024-02-02T11:51:51.188 INFO:teuthology.orchestra.run.smithi177.stdout:checking for archiver @FILE support... @ 2024-02-02T11:51:51.188 INFO:teuthology.orchestra.run.smithi177.stdout:checking for strip... strip 2024-02-02T11:51:51.188 INFO:teuthology.orchestra.run.smithi177.stdout:checking for ranlib... ranlib 2024-02-02T11:51:51.188 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gawk... gawk 2024-02-02T11:51:51.275 INFO:teuthology.orchestra.run.smithi177.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-02-02T11:51:51.277 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sysroot... no 2024-02-02T11:51:51.284 INFO:teuthology.orchestra.run.smithi177.stdout:checking for a working dd... /usr/bin/dd 2024-02-02T11:51:51.291 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-02-02T11:51:51.310 INFO:teuthology.orchestra.run.smithi177.stdout:checking for mt... mt 2024-02-02T11:51:51.317 INFO:teuthology.orchestra.run.smithi177.stdout:checking if mt is a manifest tool... no 2024-02-02T11:51:51.342 INFO:teuthology.orchestra.run.smithi177.stdout:checking for stdio.h... yes 2024-02-02T11:51:51.372 INFO:teuthology.orchestra.run.smithi177.stdout:checking for stdlib.h... yes 2024-02-02T11:51:51.403 INFO:teuthology.orchestra.run.smithi177.stdout:checking for string.h... yes 2024-02-02T11:51:51.435 INFO:teuthology.orchestra.run.smithi177.stdout:checking for inttypes.h... yes 2024-02-02T11:51:51.467 INFO:teuthology.orchestra.run.smithi177.stdout:checking for stdint.h... yes 2024-02-02T11:51:51.498 INFO:teuthology.orchestra.run.smithi177.stdout:checking for strings.h... yes 2024-02-02T11:51:51.531 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/stat.h... yes 2024-02-02T11:51:51.563 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/types.h... yes 2024-02-02T11:51:51.600 INFO:teuthology.orchestra.run.smithi177.stdout:checking for unistd.h... yes 2024-02-02T11:51:51.636 INFO:teuthology.orchestra.run.smithi177.stdout:checking for dlfcn.h... yes 2024-02-02T11:51:51.642 INFO:teuthology.orchestra.run.smithi177.stdout:checking for objdir... .libs 2024-02-02T11:51:51.740 INFO:teuthology.orchestra.run.smithi177.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-02-02T11:51:51.740 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-02-02T11:51:51.767 INFO:teuthology.orchestra.run.smithi177.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-02-02T11:51:51.869 INFO:teuthology.orchestra.run.smithi177.stdout:checking if gcc static flag -static works... yes 2024-02-02T11:51:51.909 INFO:teuthology.orchestra.run.smithi177.stdout:checking if gcc supports -c -o file.o... yes 2024-02-02T11:51:51.910 INFO:teuthology.orchestra.run.smithi177.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-02-02T11:51:51.923 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-02-02T11:51:51.958 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether -lc should be explicitly linked in... no 2024-02-02T11:51:52.046 INFO:teuthology.orchestra.run.smithi177.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-02-02T11:51:52.046 INFO:teuthology.orchestra.run.smithi177.stdout:checking how to hardcode library paths into programs... immediate 2024-02-02T11:51:52.049 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether stripping libraries is possible... yes 2024-02-02T11:51:52.049 INFO:teuthology.orchestra.run.smithi177.stdout:checking if libtool supports shared libraries... yes 2024-02-02T11:51:52.049 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether to build shared libraries... yes 2024-02-02T11:51:52.050 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether to build static libraries... yes 2024-02-02T11:51:52.050 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc... (cached) gcc 2024-02-02T11:51:52.056 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:51:52.058 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:51:52.061 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:51:52.092 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether the compiler supports GNU C... (cached) yes 2024-02-02T11:51:52.092 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether gcc accepts -g... (cached) yes 2024-02-02T11:51:52.092 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc option to enable C11 features... (cached) none needed 2024-02-02T11:51:52.106 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc... (cached) gcc 2024-02-02T11:51:52.147 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether the compiler supports GNU C... (cached) yes 2024-02-02T11:51:52.147 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether gcc accepts -g... (cached) yes 2024-02-02T11:51:52.147 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc option to enable C11 features... (cached) none needed 2024-02-02T11:51:52.155 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc... (cached) gcc 2024-02-02T11:51:52.197 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether the compiler supports GNU C... (cached) yes 2024-02-02T11:51:52.197 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether gcc accepts -g... (cached) yes 2024-02-02T11:51:52.197 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc option to enable C11 features... (cached) none needed 2024-02-02T11:51:52.198 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gmake... /usr/bin/gmake 2024-02-02T11:51:52.198 INFO:teuthology.orchestra.run.smithi177.stdout:checking for tar... /usr/bin/tar 2024-02-02T11:51:52.198 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gzip... /usr/bin/gzip 2024-02-02T11:51:52.211 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether gcc -MM is supported... yes 2024-02-02T11:51:52.212 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sort... /bin/sort 2024-02-02T11:51:52.212 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether ln -s works... yes 2024-02-02T11:51:52.213 INFO:teuthology.orchestra.run.smithi177.stdout:checking for msgfmt... /usr/bin/msgfmt 2024-02-02T11:51:52.213 INFO:teuthology.orchestra.run.smithi177.stdout:checking for msgmerge... /usr/bin/msgmerge 2024-02-02T11:51:52.213 INFO:teuthology.orchestra.run.smithi177.stdout:checking for xgettext... /usr/bin/xgettext 2024-02-02T11:51:52.213 INFO:teuthology.orchestra.run.smithi177.stdout:checking for rpm... no 2024-02-02T11:51:52.265 INFO:teuthology.orchestra.run.smithi177.stdout:checking for ini.h... yes 2024-02-02T11:51:52.313 INFO:teuthology.orchestra.run.smithi177.stdout:checking for ini_parse in -linih... yes 2024-02-02T11:51:52.353 INFO:teuthology.orchestra.run.smithi177.stdout:checking for uuid.h... no 2024-02-02T11:51:52.393 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sys/uuid.h... no 2024-02-02T11:51:52.431 INFO:teuthology.orchestra.run.smithi177.stdout:checking for uuid/uuid.h... yes 2024-02-02T11:51:52.488 INFO:teuthology.orchestra.run.smithi177.stdout:checking for uuid_compare... no 2024-02-02T11:51:52.536 INFO:teuthology.orchestra.run.smithi177.stdout:checking for uuid_compare in -luuid... yes 2024-02-02T11:51:52.575 INFO:teuthology.orchestra.run.smithi177.stdout:checking for pthread.h... yes 2024-02-02T11:51:52.623 INFO:teuthology.orchestra.run.smithi177.stdout:checking for pthread_mutex_init in -lpthread... yes 2024-02-02T11:51:52.666 INFO:teuthology.orchestra.run.smithi177.stdout:checking for urcu.h... yes 2024-02-02T11:51:52.704 INFO:teuthology.orchestra.run.smithi177.stdout:checking for liburcu... yes 2024-02-02T11:51:52.732 INFO:teuthology.orchestra.run.smithi177.stdout:checking for fadvise ... yes 2024-02-02T11:51:52.759 INFO:teuthology.orchestra.run.smithi177.stdout:checking for madvise ... yes 2024-02-02T11:51:52.787 INFO:teuthology.orchestra.run.smithi177.stdout:checking for mincore ... yes 2024-02-02T11:51:52.826 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sendfile ... yes 2024-02-02T11:51:52.856 INFO:teuthology.orchestra.run.smithi177.stdout:checking for getmntent ... yes 2024-02-02T11:51:52.907 INFO:teuthology.orchestra.run.smithi177.stdout:checking for fallocate... yes 2024-02-02T11:51:52.958 INFO:teuthology.orchestra.run.smithi177.stdout:checking for fiemap... yes 2024-02-02T11:51:53.016 INFO:teuthology.orchestra.run.smithi177.stdout:checking for pwritev2... yes 2024-02-02T11:51:53.073 INFO:teuthology.orchestra.run.smithi177.stdout:checking for preadv... yes 2024-02-02T11:51:53.127 INFO:teuthology.orchestra.run.smithi177.stdout:checking for copy_file_range... yes 2024-02-02T11:51:53.178 INFO:teuthology.orchestra.run.smithi177.stdout:checking for sync_file_range... yes 2024-02-02T11:51:53.233 INFO:teuthology.orchestra.run.smithi177.stdout:checking for syncfs... yes 2024-02-02T11:51:53.271 INFO:teuthology.orchestra.run.smithi177.stdout:checking for mntent.h... yes 2024-02-02T11:51:53.318 INFO:teuthology.orchestra.run.smithi177.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2024-02-02T11:51:53.352 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether fls is declared... no 2024-02-02T11:51:53.406 INFO:teuthology.orchestra.run.smithi177.stdout:checking for readdir... yes 2024-02-02T11:51:53.444 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether fsetxattr is declared... yes 2024-02-02T11:51:53.480 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether mremap is declared... yes 2024-02-02T11:51:53.530 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct fsxattr... yes 2024-02-02T11:51:53.557 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct fsxattr.fsx_cowextsize... yes 2024-02-02T11:51:53.608 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct fscrypt_add_key_arg... yes 2024-02-02T11:51:53.634 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct fscrypt_add_key_arg.key_id... yes 2024-02-02T11:51:53.706 INFO:teuthology.orchestra.run.smithi177.stdout:checking for GETFSMAP... yes 2024-02-02T11:51:53.759 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct statfs... yes 2024-02-02T11:51:53.785 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct statfs.f_flags... yes 2024-02-02T11:51:53.810 INFO:teuthology.orchestra.run.smithi177.stdout:checking for MAP_SYNC... yes 2024-02-02T11:51:53.935 INFO:teuthology.orchestra.run.smithi177.stdout:checking for library containing dm_task_create... -ldevmapper 2024-02-02T11:51:53.971 INFO:teuthology.orchestra.run.smithi177.stdout:checking for mallinfo ... yes 2024-02-02T11:51:54.003 INFO:teuthology.orchestra.run.smithi177.stdout:checking for mallinfo2 ... yes 2024-02-02T11:51:54.041 INFO:teuthology.orchestra.run.smithi177.stdout:checking for attr/attributes.h... yes 2024-02-02T11:51:54.068 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct attrlist_cursor... yes 2024-02-02T11:51:54.071 INFO:teuthology.orchestra.run.smithi177.stdout:checking for pkg-config... /usr/bin/pkg-config 2024-02-02T11:51:54.073 INFO:teuthology.orchestra.run.smithi177.stdout:checking pkg-config is at least version 0.9.0... yes 2024-02-02T11:51:54.084 INFO:teuthology.orchestra.run.smithi177.stdout:checking for icu-i18n... yes 2024-02-02T11:51:54.122 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether openat is declared... yes 2024-02-02T11:51:54.165 INFO:teuthology.orchestra.run.smithi177.stdout:checking whether fstatat is declared... yes 2024-02-02T11:51:54.199 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct sg_io_hdr ... yes 2024-02-02T11:51:54.228 INFO:teuthology.orchestra.run.smithi177.stdout:checking for struct hd_geometry ... yes 2024-02-02T11:51:54.242 INFO:teuthology.orchestra.run.smithi177.stdout:checking for systemd... yes 2024-02-02T11:51:54.246 INFO:teuthology.orchestra.run.smithi177.stdout:checking for systemd system unit dir... /lib/systemd/system 2024-02-02T11:51:54.246 INFO:teuthology.orchestra.run.smithi177.stdout:checking for system crontab dir... /etc/cron.d 2024-02-02T11:51:54.257 INFO:teuthology.orchestra.run.smithi177.stdout:checking for udev... yes 2024-02-02T11:51:54.260 INFO:teuthology.orchestra.run.smithi177.stdout:checking for udev rule dir... /lib/udev/rules.d 2024-02-02T11:51:54.367 INFO:teuthology.orchestra.run.smithi177.stdout:checking for library containing blkid_probe_all... -lblkid 2024-02-02T11:51:54.419 INFO:teuthology.orchestra.run.smithi177.stdout:checking for blkid_probe_get_topology... yes 2024-02-02T11:51:54.492 INFO:teuthology.orchestra.run.smithi177.stdout:checking size of long... 8 2024-02-02T11:51:54.564 INFO:teuthology.orchestra.run.smithi177.stdout:checking size of char *... 8 2024-02-02T11:51:54.585 INFO:teuthology.orchestra.run.smithi177.stdout:checking for umode_t... no 2024-02-02T11:51:54.651 INFO:teuthology.orchestra.run.smithi177.stdout:checking for atomic64_t support in liburcu... yes 2024-02-02T11:51:54.680 INFO:teuthology.orchestra.run.smithi177.stdout:configure: creating ./config.status 2024-02-02T11:51:55.489 INFO:teuthology.orchestra.run.smithi177.stdout:config.status: creating include/builddefs 2024-02-02T11:51:55.514 INFO:teuthology.orchestra.run.smithi177.stdout:config.status: creating include/platform_defs.h 2024-02-02T11:51:55.535 INFO:teuthology.orchestra.run.smithi177.stdout:config.status: executing libtool commands 2024-02-02T11:51:55.613 INFO:teuthology.orchestra.run.smithi177.stdout: [HEADERS] include 2024-02-02T11:51:55.637 INFO:teuthology.orchestra.run.smithi177.stdout: [HEADERS] libxfs 2024-02-02T11:51:55.671 INFO:teuthology.orchestra.run.smithi177.stdout:Building include 2024-02-02T11:51:55.679 INFO:teuthology.orchestra.run.smithi177.stdout: [LN] disk 2024-02-02T11:51:55.684 INFO:teuthology.orchestra.run.smithi177.stdout:Building libfrog 2024-02-02T11:51:55.689 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] gen_crc32table 2024-02-02T11:51:55.756 INFO:teuthology.orchestra.run.smithi177.stdout: [GENERATE] crc32table.h 2024-02-02T11:51:56.215 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] avl64.lo 2024-02-02T11:51:56.670 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] bitmap.lo 2024-02-02T11:51:56.999 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] bulkstat.lo 2024-02-02T11:51:57.382 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] convert.lo 2024-02-02T11:51:57.738 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] crc32.lo 2024-02-02T11:51:57.966 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fsgeom.lo 2024-02-02T11:51:58.287 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] list_sort.lo 2024-02-02T11:51:58.503 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] linux.lo 2024-02-02T11:51:58.835 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] logging.lo 2024-02-02T11:51:58.999 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] paths.lo 2024-02-02T11:51:59.432 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] projects.lo 2024-02-02T11:51:59.737 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] ptvar.lo 2024-02-02T11:51:59.996 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] radix-tree.lo 2024-02-02T11:52:00.514 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] randbytes.lo 2024-02-02T11:52:00.732 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] scrub.lo 2024-02-02T11:52:00.940 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] util.lo 2024-02-02T11:52:01.168 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] workqueue.lo 2024-02-02T11:52:01.451 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] libfrog.la 2024-02-02T11:52:01.569 INFO:teuthology.orchestra.run.smithi177.stdout:Building libxfs 2024-02-02T11:52:03.171 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] cache.lo 2024-02-02T11:52:03.696 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] defer_item.lo 2024-02-02T11:52:04.115 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] init.lo 2024-02-02T11:52:04.795 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] kmem.lo 2024-02-02T11:52:05.095 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] logitem.lo 2024-02-02T11:52:05.414 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] rdwr.lo 2024-02-02T11:52:06.231 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] topology.lo 2024-02-02T11:52:06.601 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] trans.lo 2024-02-02T11:52:07.109 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] util.lo 2024-02-02T11:52:07.608 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_ag.lo 2024-02-02T11:52:08.372 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_ag_resv.lo 2024-02-02T11:52:08.724 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_alloc.lo 2024-02-02T11:52:10.188 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_alloc_btree.lo 2024-02-02T11:52:10.658 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_attr.lo 2024-02-02T11:52:11.241 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_attr_leaf.lo 2024-02-02T11:52:12.580 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_attr_remote.lo 2024-02-02T11:52:13.102 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_bit.lo 2024-02-02T11:52:13.389 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_bmap.lo 2024-02-02T11:52:16.017 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_bmap_btree.lo 2024-02-02T11:52:16.532 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_btree.lo 2024-02-02T11:52:18.603 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_btree_staging.lo 2024-02-02T11:52:19.057 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_da_btree.lo 2024-02-02T11:52:20.290 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_defer.lo 2024-02-02T11:52:20.787 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_dir2.lo 2024-02-02T11:52:21.294 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_dir2_block.lo 2024-02-02T11:52:22.108 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_dir2_data.lo 2024-02-02T11:52:22.178 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:52:22.181 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:52:22.184 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:52:22.851 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_dir2_leaf.lo 2024-02-02T11:52:23.734 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_dir2_node.lo 2024-02-02T11:52:24.746 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_dir2_sf.lo 2024-02-02T11:52:25.499 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_dquot_buf.lo 2024-02-02T11:52:25.885 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_ialloc.lo 2024-02-02T11:52:27.141 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_iext_tree.lo 2024-02-02T11:52:27.838 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_inode_buf.lo 2024-02-02T11:52:28.460 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_inode_fork.lo 2024-02-02T11:52:29.071 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_ialloc_btree.lo 2024-02-02T11:52:29.583 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_log_rlimit.lo 2024-02-02T11:52:29.895 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_refcount.lo 2024-02-02T11:52:30.698 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_refcount_btree.lo 2024-02-02T11:52:31.147 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_rmap.lo 2024-02-02T11:52:32.289 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_rmap_btree.lo 2024-02-02T11:52:32.806 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_rtbitmap.lo 2024-02-02T11:52:33.416 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_sb.lo 2024-02-02T11:52:34.203 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_symlink_remote.lo 2024-02-02T11:52:34.563 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_trans_inode.lo 2024-02-02T11:52:34.856 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_trans_resv.lo 2024-02-02T11:52:35.412 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_types.lo 2024-02-02T11:52:35.766 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] libxfs.la 2024-02-02T11:52:35.976 INFO:teuthology.orchestra.run.smithi177.stdout:Building libxlog 2024-02-02T11:52:36.067 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_log_recover.lo 2024-02-02T11:52:36.851 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] util.lo 2024-02-02T11:52:37.217 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] libxlog.la 2024-02-02T11:52:37.316 INFO:teuthology.orchestra.run.smithi177.stdout:Building libxcmd 2024-02-02T11:52:37.447 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] command.lo 2024-02-02T11:52:37.788 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] input.lo 2024-02-02T11:52:38.095 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] help.lo 2024-02-02T11:52:38.348 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] quit.lo 2024-02-02T11:52:38.576 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] libxcmd.la 2024-02-02T11:52:38.675 INFO:teuthology.orchestra.run.smithi177.stdout:Building libhandle 2024-02-02T11:52:38.754 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] handle.lo 2024-02-02T11:52:39.126 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] jdm.lo 2024-02-02T11:52:39.410 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] libhandle.la 2024-02-02T11:52:39.548 INFO:teuthology.orchestra.run.smithi177.stdout:Building copy 2024-02-02T11:52:39.602 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_copy.o 2024-02-02T11:52:40.028 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] xfs_copy 2024-02-02T11:52:40.209 INFO:teuthology.orchestra.run.smithi177.stdout:Building db 2024-02-02T11:52:42.187 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] addr.o 2024-02-02T11:52:42.297 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] agf.o 2024-02-02T11:52:42.402 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] agfl.o 2024-02-02T11:52:42.508 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] agi.o 2024-02-02T11:52:42.613 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] attr.o 2024-02-02T11:52:42.809 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] attrshort.o 2024-02-02T11:52:42.931 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] bit.o 2024-02-02T11:52:43.058 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] block.o 2024-02-02T11:52:43.207 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] bmap.o 2024-02-02T11:52:43.403 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] btblock.o 2024-02-02T11:52:43.536 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] bmroot.o 2024-02-02T11:52:43.698 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] check.o 2024-02-02T11:52:45.430 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] command.o 2024-02-02T11:52:45.542 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] crc.o 2024-02-02T11:52:45.664 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] debug.o 2024-02-02T11:52:45.760 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dir2.o 2024-02-02T11:52:46.045 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dir2sf.o 2024-02-02T11:52:46.189 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dquot.o 2024-02-02T11:52:46.307 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] echo.o 2024-02-02T11:52:46.401 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] faddr.o 2024-02-02T11:52:46.587 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] field.o 2024-02-02T11:52:46.703 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] flist.o 2024-02-02T11:52:46.931 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fprint.o 2024-02-02T11:52:47.096 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] frag.o 2024-02-02T11:52:47.332 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] freesp.o 2024-02-02T11:52:47.525 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] hash.o 2024-02-02T11:52:47.601 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c: In function 'hash_f': 2024-02-02T11:52:47.601 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c:76:58: warning: pointer targets in passing argument 1 of 'libxfs_da_hashname' differ in signedness [-Wpointer-sign] 2024-02-02T11:52:47.601 INFO:teuthology.orchestra.run.smithi177.stderr: 76 | hashval = libxfs_da_hashname(argv[c], strlen(argv[c])); 2024-02-02T11:52:47.601 INFO:teuthology.orchestra.run.smithi177.stderr: | ~~~~^~~ 2024-02-02T11:52:47.601 INFO:teuthology.orchestra.run.smithi177.stderr: | | 2024-02-02T11:52:47.602 INFO:teuthology.orchestra.run.smithi177.stderr: | char * 2024-02-02T11:52:47.602 INFO:teuthology.orchestra.run.smithi177.stderr:In file included from ../include/libxfs.h:59, 2024-02-02T11:52:47.602 INFO:teuthology.orchestra.run.smithi177.stderr: from hash.c:7: 2024-02-02T11:52:47.602 INFO:teuthology.orchestra.run.smithi177.stderr:../libxfs/xfs_da_btree.h:223:37: note: expected 'const uint8_t *' {aka 'const unsigned char *'} but argument is of type 'char *' 2024-02-02T11:52:47.602 INFO:teuthology.orchestra.run.smithi177.stderr: 223 | uint xfs_da_hashname(const uint8_t *name_string, int name_length); 2024-02-02T11:52:47.602 INFO:teuthology.orchestra.run.smithi177.stderr: | ~~~~~~~~~~~~~~~^~~~~~~~~~~ 2024-02-02T11:52:47.606 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c: In function 'collide_dirents': 2024-02-02T11:52:47.606 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c:258:36: warning: pointer targets in passing argument 2 of 'openat' differ in signedness [-Wpointer-sign] 2024-02-02T11:52:47.606 INFO:teuthology.orchestra.run.smithi177.stderr: 258 | newfd = openat(fd, name, O_CREAT, 0600); 2024-02-02T11:52:47.606 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~ 2024-02-02T11:52:47.606 INFO:teuthology.orchestra.run.smithi177.stderr: | | 2024-02-02T11:52:47.606 INFO:teuthology.orchestra.run.smithi177.stderr: | const unsigned char * 2024-02-02T11:52:47.606 INFO:teuthology.orchestra.run.smithi177.stderr:In file included from /usr/include/fcntl.h:314, 2024-02-02T11:52:47.606 INFO:teuthology.orchestra.run.smithi177.stderr: from ../include/platform_defs.h:12, 2024-02-02T11:52:47.606 INFO:teuthology.orchestra.run.smithi177.stderr: from ../include/libxfs.h:11, 2024-02-02T11:52:47.606 INFO:teuthology.orchestra.run.smithi177.stderr: from hash.c:7: 2024-02-02T11:52:47.607 INFO:teuthology.orchestra.run.smithi177.stderr:/usr/include/x86_64-linux-gnu/bits/fcntl2.h:117:31: note: expected 'const char *' but argument is of type 'const unsigned char *' 2024-02-02T11:52:47.607 INFO:teuthology.orchestra.run.smithi177.stderr: 117 | openat (int __fd, const char *__path, int __oflag, ...) 2024-02-02T11:52:47.607 INFO:teuthology.orchestra.run.smithi177.stderr: | ~~~~~~~~~~~~^~~~~~ 2024-02-02T11:52:47.607 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c:273:25: warning: pointer targets in passing argument 1 of 'strncpy' differ in signedness [-Wpointer-sign] 2024-02-02T11:52:47.607 INFO:teuthology.orchestra.run.smithi177.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2024-02-02T11:52:47.607 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~ 2024-02-02T11:52:47.607 INFO:teuthology.orchestra.run.smithi177.stderr: | | 2024-02-02T11:52:47.607 INFO:teuthology.orchestra.run.smithi177.stderr: | unsigned char * 2024-02-02T11:52:47.607 INFO:teuthology.orchestra.run.smithi177.stderr:In file included from /usr/include/features.h:486, 2024-02-02T11:52:47.607 INFO:teuthology.orchestra.run.smithi177.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2024-02-02T11:52:47.607 INFO:teuthology.orchestra.run.smithi177.stderr: from /usr/include/stdio.h:27, 2024-02-02T11:52:47.607 INFO:teuthology.orchestra.run.smithi177.stderr: from ../include/platform_defs.h:10, 2024-02-02T11:52:47.607 INFO:teuthology.orchestra.run.smithi177.stderr: from ../include/libxfs.h:11, 2024-02-02T11:52:47.607 INFO:teuthology.orchestra.run.smithi177.stderr: from hash.c:7: 2024-02-02T11:52:47.608 INFO:teuthology.orchestra.run.smithi177.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:92:1: note: expected 'char * restrict' but argument is of type 'unsigned char *' 2024-02-02T11:52:47.608 INFO:teuthology.orchestra.run.smithi177.stderr: 92 | __NTH (strncpy (char *__restrict __dest, const char *__restrict __src, 2024-02-02T11:52:47.608 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~ 2024-02-02T11:52:47.608 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c:273:37: warning: pointer targets in passing argument 2 of 'strncpy' differ in signedness [-Wpointer-sign] 2024-02-02T11:52:47.608 INFO:teuthology.orchestra.run.smithi177.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2024-02-02T11:52:47.608 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~ 2024-02-02T11:52:47.608 INFO:teuthology.orchestra.run.smithi177.stderr: | | 2024-02-02T11:52:47.608 INFO:teuthology.orchestra.run.smithi177.stderr: | const unsigned char * 2024-02-02T11:52:47.608 INFO:teuthology.orchestra.run.smithi177.stderr:In file included from /usr/include/features.h:486, 2024-02-02T11:52:47.608 INFO:teuthology.orchestra.run.smithi177.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2024-02-02T11:52:47.608 INFO:teuthology.orchestra.run.smithi177.stderr: from /usr/include/stdio.h:27, 2024-02-02T11:52:47.608 INFO:teuthology.orchestra.run.smithi177.stderr: from ../include/platform_defs.h:10, 2024-02-02T11:52:47.609 INFO:teuthology.orchestra.run.smithi177.stderr: from ../include/libxfs.h:11, 2024-02-02T11:52:47.609 INFO:teuthology.orchestra.run.smithi177.stderr: from hash.c:7: 2024-02-02T11:52:47.609 INFO:teuthology.orchestra.run.smithi177.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:92:1: note: expected 'const char * restrict' but argument is of type 'const unsigned char *' 2024-02-02T11:52:47.609 INFO:teuthology.orchestra.run.smithi177.stderr: 92 | __NTH (strncpy (char *__restrict __dest, const char *__restrict __src, 2024-02-02T11:52:47.609 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~ 2024-02-02T11:52:47.609 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c:278:44: warning: pointer targets in passing argument 2 of 'linkat' differ in signedness [-Wpointer-sign] 2024-02-02T11:52:47.609 INFO:teuthology.orchestra.run.smithi177.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2024-02-02T11:52:47.609 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~ 2024-02-02T11:52:47.609 INFO:teuthology.orchestra.run.smithi177.stderr: | | 2024-02-02T11:52:47.609 INFO:teuthology.orchestra.run.smithi177.stderr: | const unsigned char * 2024-02-02T11:52:47.609 INFO:teuthology.orchestra.run.smithi177.stderr:In file included from ../include/platform_defs.h:19, 2024-02-02T11:52:47.609 INFO:teuthology.orchestra.run.smithi177.stderr: from ../include/libxfs.h:11, 2024-02-02T11:52:47.609 INFO:teuthology.orchestra.run.smithi177.stderr: from hash.c:7: 2024-02-02T11:52:47.610 INFO:teuthology.orchestra.run.smithi177.stderr:/usr/include/unistd.h:825:46: note: expected 'const char *' but argument is of type 'const unsigned char *' 2024-02-02T11:52:47.610 INFO:teuthology.orchestra.run.smithi177.stderr: 825 | extern int linkat (int __fromfd, const char *__from, int __tofd, 2024-02-02T11:52:47.610 INFO:teuthology.orchestra.run.smithi177.stderr: | ~~~~~~~~~~~~^~~~~~ 2024-02-02T11:52:47.610 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c:278:54: warning: pointer targets in passing argument 4 of 'linkat' differ in signedness [-Wpointer-sign] 2024-02-02T11:52:47.610 INFO:teuthology.orchestra.run.smithi177.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2024-02-02T11:52:47.610 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~~ 2024-02-02T11:52:47.610 INFO:teuthology.orchestra.run.smithi177.stderr: | | 2024-02-02T11:52:47.610 INFO:teuthology.orchestra.run.smithi177.stderr: | unsigned char * 2024-02-02T11:52:47.610 INFO:teuthology.orchestra.run.smithi177.stderr:In file included from ../include/platform_defs.h:19, 2024-02-02T11:52:47.610 INFO:teuthology.orchestra.run.smithi177.stderr: from ../include/libxfs.h:11, 2024-02-02T11:52:47.610 INFO:teuthology.orchestra.run.smithi177.stderr: from hash.c:7: 2024-02-02T11:52:47.610 INFO:teuthology.orchestra.run.smithi177.stderr:/usr/include/unistd.h:826:32: note: expected 'const char *' but argument is of type 'unsigned char *' 2024-02-02T11:52:47.610 INFO:teuthology.orchestra.run.smithi177.stderr: 826 | const char *__to, int __flags) 2024-02-02T11:52:47.610 INFO:teuthology.orchestra.run.smithi177.stderr: | ~~~~~~~~~~~~^~~~ 2024-02-02T11:52:47.611 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c: In function 'collide_xattrs': 2024-02-02T11:52:47.611 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c:318:26: warning: pointer targets in passing argument 1 of 'snprintf' differ in signedness [-Wpointer-sign] 2024-02-02T11:52:47.611 INFO:teuthology.orchestra.run.smithi177.stderr: 318 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2024-02-02T11:52:47.611 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~ 2024-02-02T11:52:47.611 INFO:teuthology.orchestra.run.smithi177.stderr: | | 2024-02-02T11:52:47.611 INFO:teuthology.orchestra.run.smithi177.stderr: | unsigned char * 2024-02-02T11:52:47.611 INFO:teuthology.orchestra.run.smithi177.stderr:In file included from /usr/include/features.h:486, 2024-02-02T11:52:47.611 INFO:teuthology.orchestra.run.smithi177.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2024-02-02T11:52:47.611 INFO:teuthology.orchestra.run.smithi177.stderr: from /usr/include/stdio.h:27, 2024-02-02T11:52:47.611 INFO:teuthology.orchestra.run.smithi177.stderr: from ../include/platform_defs.h:10, 2024-02-02T11:52:47.611 INFO:teuthology.orchestra.run.smithi177.stderr: from ../include/libxfs.h:11, 2024-02-02T11:52:47.611 INFO:teuthology.orchestra.run.smithi177.stderr: from hash.c:7: 2024-02-02T11:52:47.611 INFO:teuthology.orchestra.run.smithi177.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:68:1: note: expected 'char * restrict' but argument is of type 'unsigned char *' 2024-02-02T11:52:47.611 INFO:teuthology.orchestra.run.smithi177.stderr: 68 | __NTH (snprintf (char *__restrict __s, size_t __n, 2024-02-02T11:52:47.611 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~ 2024-02-02T11:52:47.612 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c:319:39: warning: pointer targets in passing argument 2 of 'fsetxattr' differ in signedness [-Wpointer-sign] 2024-02-02T11:52:47.612 INFO:teuthology.orchestra.run.smithi177.stderr: 319 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2024-02-02T11:52:47.612 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~ 2024-02-02T11:52:47.612 INFO:teuthology.orchestra.run.smithi177.stderr: | | 2024-02-02T11:52:47.612 INFO:teuthology.orchestra.run.smithi177.stderr: | unsigned char * 2024-02-02T11:52:47.612 INFO:teuthology.orchestra.run.smithi177.stderr:In file included from hash.c:16: 2024-02-02T11:52:47.612 INFO:teuthology.orchestra.run.smithi177.stderr:/usr/include/x86_64-linux-gnu/sys/xattr.h:54:45: note: expected 'const char *' but argument is of type 'unsigned char *' 2024-02-02T11:52:47.612 INFO:teuthology.orchestra.run.smithi177.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2024-02-02T11:52:47.612 INFO:teuthology.orchestra.run.smithi177.stderr: | ~~~~~~~~~~~~^~~~~~ 2024-02-02T11:52:47.612 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c:332:26: warning: pointer targets in passing argument 1 of 'snprintf' differ in signedness [-Wpointer-sign] 2024-02-02T11:52:47.612 INFO:teuthology.orchestra.run.smithi177.stderr: 332 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2024-02-02T11:52:47.612 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~ 2024-02-02T11:52:47.612 INFO:teuthology.orchestra.run.smithi177.stderr: | | 2024-02-02T11:52:47.612 INFO:teuthology.orchestra.run.smithi177.stderr: | unsigned char * 2024-02-02T11:52:47.612 INFO:teuthology.orchestra.run.smithi177.stderr:In file included from /usr/include/features.h:486, 2024-02-02T11:52:47.613 INFO:teuthology.orchestra.run.smithi177.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2024-02-02T11:52:47.613 INFO:teuthology.orchestra.run.smithi177.stderr: from /usr/include/stdio.h:27, 2024-02-02T11:52:47.613 INFO:teuthology.orchestra.run.smithi177.stderr: from ../include/platform_defs.h:10, 2024-02-02T11:52:47.613 INFO:teuthology.orchestra.run.smithi177.stderr: from ../include/libxfs.h:11, 2024-02-02T11:52:47.613 INFO:teuthology.orchestra.run.smithi177.stderr: from hash.c:7: 2024-02-02T11:52:47.613 INFO:teuthology.orchestra.run.smithi177.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:68:1: note: expected 'char * restrict' but argument is of type 'unsigned char *' 2024-02-02T11:52:47.613 INFO:teuthology.orchestra.run.smithi177.stderr: 68 | __NTH (snprintf (char *__restrict __s, size_t __n, 2024-02-02T11:52:47.613 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~ 2024-02-02T11:52:47.613 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c:337:47: warning: pointer targets in passing argument 2 of 'fsetxattr' differ in signedness [-Wpointer-sign] 2024-02-02T11:52:47.613 INFO:teuthology.orchestra.run.smithi177.stderr: 337 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2024-02-02T11:52:47.613 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~~~~~~~ 2024-02-02T11:52:47.613 INFO:teuthology.orchestra.run.smithi177.stderr: | | 2024-02-02T11:52:47.613 INFO:teuthology.orchestra.run.smithi177.stderr: | unsigned char * 2024-02-02T11:52:47.613 INFO:teuthology.orchestra.run.smithi177.stderr:In file included from hash.c:16: 2024-02-02T11:52:47.613 INFO:teuthology.orchestra.run.smithi177.stderr:/usr/include/x86_64-linux-gnu/sys/xattr.h:54:45: note: expected 'const char *' but argument is of type 'unsigned char *' 2024-02-02T11:52:47.613 INFO:teuthology.orchestra.run.smithi177.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2024-02-02T11:52:47.613 INFO:teuthology.orchestra.run.smithi177.stderr: | ~~~~~~~~~~~~^~~~~~ 2024-02-02T11:52:47.614 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c: In function 'hashcoll_f': 2024-02-02T11:52:47.614 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c:417:52: warning: pointer targets in passing argument 2 of 'collide_xattrs' differ in signedness [-Wpointer-sign] 2024-02-02T11:52:47.614 INFO:teuthology.orchestra.run.smithi177.stderr: 417 | error = collide_xattrs(nr, buf, len, fd); 2024-02-02T11:52:47.614 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~ 2024-02-02T11:52:47.614 INFO:teuthology.orchestra.run.smithi177.stderr: | | 2024-02-02T11:52:47.614 INFO:teuthology.orchestra.run.smithi177.stderr: | char * 2024-02-02T11:52:47.614 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c:300:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2024-02-02T11:52:47.614 INFO:teuthology.orchestra.run.smithi177.stderr: 300 | const unsigned char *name, 2024-02-02T11:52:47.614 INFO:teuthology.orchestra.run.smithi177.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2024-02-02T11:52:47.614 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c:419:53: warning: pointer targets in passing argument 2 of 'collide_dirents' differ in signedness [-Wpointer-sign] 2024-02-02T11:52:47.614 INFO:teuthology.orchestra.run.smithi177.stderr: 419 | error = collide_dirents(nr, buf, len, fd); 2024-02-02T11:52:47.614 INFO:teuthology.orchestra.run.smithi177.stderr: | ^~~ 2024-02-02T11:52:47.614 INFO:teuthology.orchestra.run.smithi177.stderr: | | 2024-02-02T11:52:47.614 INFO:teuthology.orchestra.run.smithi177.stderr: | char * 2024-02-02T11:52:47.614 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c:234:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2024-02-02T11:52:47.614 INFO:teuthology.orchestra.run.smithi177.stderr: 234 | const unsigned char *name, 2024-02-02T11:52:47.614 INFO:teuthology.orchestra.run.smithi177.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2024-02-02T11:52:47.615 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c:431:56: warning: pointer targets in passing argument 2 of 'collide_xattrs' differ in signedness [-Wpointer-sign] 2024-02-02T11:52:47.615 INFO:teuthology.orchestra.run.smithi177.stderr: 431 | error = collide_xattrs(nr, argv[c], len, fd); 2024-02-02T11:52:47.615 INFO:teuthology.orchestra.run.smithi177.stderr: | ~~~~^~~ 2024-02-02T11:52:47.615 INFO:teuthology.orchestra.run.smithi177.stderr: | | 2024-02-02T11:52:47.615 INFO:teuthology.orchestra.run.smithi177.stderr: | char * 2024-02-02T11:52:47.615 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c:300:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2024-02-02T11:52:47.615 INFO:teuthology.orchestra.run.smithi177.stderr: 300 | const unsigned char *name, 2024-02-02T11:52:47.615 INFO:teuthology.orchestra.run.smithi177.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2024-02-02T11:52:47.615 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c:433:57: warning: pointer targets in passing argument 2 of 'collide_dirents' differ in signedness [-Wpointer-sign] 2024-02-02T11:52:47.615 INFO:teuthology.orchestra.run.smithi177.stderr: 433 | error = collide_dirents(nr, argv[c], len, fd); 2024-02-02T11:52:47.615 INFO:teuthology.orchestra.run.smithi177.stderr: | ~~~~^~~ 2024-02-02T11:52:47.615 INFO:teuthology.orchestra.run.smithi177.stderr: | | 2024-02-02T11:52:47.615 INFO:teuthology.orchestra.run.smithi177.stderr: | char * 2024-02-02T11:52:47.615 INFO:teuthology.orchestra.run.smithi177.stderr:hash.c:234:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2024-02-02T11:52:47.615 INFO:teuthology.orchestra.run.smithi177.stderr: 234 | const unsigned char *name, 2024-02-02T11:52:47.616 INFO:teuthology.orchestra.run.smithi177.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2024-02-02T11:52:47.701 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] help.o 2024-02-02T11:52:47.803 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] init.o 2024-02-02T11:52:47.933 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] inode.o 2024-02-02T11:52:48.204 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] input.o 2024-02-02T11:52:48.344 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] io.o 2024-02-02T11:52:48.548 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] logformat.o 2024-02-02T11:52:48.671 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] malloc.o 2024-02-02T11:52:48.772 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] metadump.o 2024-02-02T11:52:49.551 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] output.o 2024-02-02T11:52:49.661 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] print.o 2024-02-02T11:52:49.818 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] quit.o 2024-02-02T11:52:49.909 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] sb.o 2024-02-02T11:52:50.154 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] sig.o 2024-02-02T11:52:50.251 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] strvec.o 2024-02-02T11:52:50.359 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] text.o 2024-02-02T11:52:50.467 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] type.o 2024-02-02T11:52:50.592 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] write.o 2024-02-02T11:52:50.824 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] attrset.o 2024-02-02T11:52:50.956 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] symlink.o 2024-02-02T11:52:51.058 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fsmap.o 2024-02-02T11:52:51.186 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fuzz.o 2024-02-02T11:52:51.352 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] obfuscate.o 2024-02-02T11:52:51.495 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] btdump.o 2024-02-02T11:52:51.672 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] btheight.o 2024-02-02T11:52:51.845 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] convert.o 2024-02-02T11:52:51.991 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] info.o 2024-02-02T11:52:52.113 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] iunlink.o 2024-02-02T11:52:52.290 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] namei.o 2024-02-02T11:52:52.308 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:52:52.310 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:52:52.313 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:52:52.497 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] timelimit.o 2024-02-02T11:52:52.610 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] xfs_db 2024-02-02T11:52:52.852 INFO:teuthology.orchestra.run.smithi177.stdout:Building estimate 2024-02-02T11:52:52.907 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_estimate.o 2024-02-02T11:52:53.046 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] xfs_estimate 2024-02-02T11:52:53.131 INFO:teuthology.orchestra.run.smithi177.stdout:Building fsck 2024-02-02T11:52:53.137 INFO:teuthology.orchestra.run.smithi177.stdout:Building fsr 2024-02-02T11:52:53.193 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_fsr.o 2024-02-02T11:52:53.602 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] xfs_fsr 2024-02-02T11:52:53.725 INFO:teuthology.orchestra.run.smithi177.stdout:Building growfs 2024-02-02T11:52:53.780 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_growfs.o 2024-02-02T11:52:53.954 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] xfs_growfs 2024-02-02T11:52:54.136 INFO:teuthology.orchestra.run.smithi177.stdout:Building io 2024-02-02T11:52:55.461 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] init.o 2024-02-02T11:52:55.574 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] attr.o 2024-02-02T11:52:55.715 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] bmap.o 2024-02-02T11:52:55.890 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] bulkstat.o 2024-02-02T11:52:56.047 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] crc32cselftest.o 2024-02-02T11:52:56.131 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] cowextsize.o 2024-02-02T11:52:56.238 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] encrypt.o 2024-02-02T11:52:56.456 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] file.o 2024-02-02T11:52:56.556 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] freeze.o 2024-02-02T11:52:56.641 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fsuuid.o 2024-02-02T11:52:56.738 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fsync.o 2024-02-02T11:52:56.814 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] getrusage.o 2024-02-02T11:52:56.903 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] imap.o 2024-02-02T11:52:56.988 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] inject.o 2024-02-02T11:52:57.082 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] label.o 2024-02-02T11:52:57.188 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] link.o 2024-02-02T11:52:57.265 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] mmap.o 2024-02-02T11:52:57.467 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] open.o 2024-02-02T11:52:57.737 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] parent.o 2024-02-02T11:52:57.892 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] pread.o 2024-02-02T11:52:58.059 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] prealloc.o 2024-02-02T11:52:58.198 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] pwrite.o 2024-02-02T11:52:58.349 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] reflink.o 2024-02-02T11:52:58.477 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] resblks.o 2024-02-02T11:52:58.559 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] scrub.o 2024-02-02T11:52:58.686 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] seek.o 2024-02-02T11:52:58.790 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] shutdown.o 2024-02-02T11:52:58.870 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] stat.o 2024-02-02T11:52:59.064 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] swapext.o 2024-02-02T11:52:59.147 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] sync.o 2024-02-02T11:52:59.222 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] truncate.o 2024-02-02T11:52:59.300 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] utimes.o 2024-02-02T11:52:59.380 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fadvise.o 2024-02-02T11:52:59.467 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] madvise.o 2024-02-02T11:52:59.554 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] mincore.o 2024-02-02T11:52:59.647 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] sendfile.o 2024-02-02T11:52:59.746 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fiemap.o 2024-02-02T11:52:59.894 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] copy_file_range.o 2024-02-02T11:52:59.992 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] sync_file_range.o 2024-02-02T11:53:00.078 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] readdir.o 2024-02-02T11:53:00.177 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] log_writes.o 2024-02-02T11:53:00.264 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fsmap.o 2024-02-02T11:53:00.491 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] xfs_io 2024-02-02T11:53:00.674 INFO:teuthology.orchestra.run.smithi177.stdout:Building logprint 2024-02-02T11:53:00.943 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] logprint.o 2024-02-02T11:53:01.077 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] log_copy.o 2024-02-02T11:53:01.184 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] log_dump.o 2024-02-02T11:53:01.300 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] log_misc.o 2024-02-02T11:53:01.793 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] log_print_all.o 2024-02-02T11:53:02.037 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] log_print_trans.o 2024-02-02T11:53:02.145 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] log_redo.o 2024-02-02T11:53:02.387 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] xfs_logprint 2024-02-02T11:53:02.575 INFO:teuthology.orchestra.run.smithi177.stdout:Building mkfs 2024-02-02T11:53:02.666 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] proto.o 2024-02-02T11:53:02.933 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_mkfs.o 2024-02-02T11:53:03.624 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] mkfs.xfs 2024-02-02T11:53:03.813 INFO:teuthology.orchestra.run.smithi177.stdout:Building quota 2024-02-02T11:53:04.185 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] init.o 2024-02-02T11:53:04.283 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] util.o 2024-02-02T11:53:04.439 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] edit.o 2024-02-02T11:53:04.631 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] free.o 2024-02-02T11:53:04.775 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] linux.o 2024-02-02T11:53:04.847 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] path.o 2024-02-02T11:53:04.954 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] project.o 2024-02-02T11:53:05.094 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] quot.o 2024-02-02T11:53:05.244 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] quota.o 2024-02-02T11:53:05.414 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] report.o 2024-02-02T11:53:05.635 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] state.o 2024-02-02T11:53:05.808 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] xfs_quota 2024-02-02T11:53:05.937 INFO:teuthology.orchestra.run.smithi177.stdout:Building mdrestore 2024-02-02T11:53:05.992 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_mdrestore.o 2024-02-02T11:53:06.151 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] xfs_mdrestore 2024-02-02T11:53:06.315 INFO:teuthology.orchestra.run.smithi177.stdout:Building repair 2024-02-02T11:53:07.593 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] agheader.o 2024-02-02T11:53:07.796 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] agbtree.o 2024-02-02T11:53:08.023 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] attr_repair.o 2024-02-02T11:53:08.364 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] avl.o 2024-02-02T11:53:08.566 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] bulkload.o 2024-02-02T11:53:08.680 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] bmap.o 2024-02-02T11:53:08.822 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] btree.o 2024-02-02T11:53:09.145 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] da_util.o 2024-02-02T11:53:09.359 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dino_chunks.o 2024-02-02T11:53:09.715 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dinode.o 2024-02-02T11:53:10.416 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] dir2.o 2024-02-02T11:53:10.811 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] globals.o 2024-02-02T11:53:10.897 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] incore_bmc.o 2024-02-02T11:53:10.994 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] incore.o 2024-02-02T11:53:11.133 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] incore_ext.o 2024-02-02T11:53:11.339 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] incore_ino.o 2024-02-02T11:53:11.591 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] init.o 2024-02-02T11:53:11.720 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] phase1.o 2024-02-02T11:53:11.837 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] phase2.o 2024-02-02T11:53:12.016 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] phase3.o 2024-02-02T11:53:12.148 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] phase4.o 2024-02-02T11:53:12.325 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] phase5.o 2024-02-02T11:53:12.570 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] phase6.o 2024-02-02T11:53:13.392 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] phase7.o 2024-02-02T11:53:13.520 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] prefetch.o 2024-02-02T11:53:13.846 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] progress.o 2024-02-02T11:53:14.042 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] quotacheck.o 2024-02-02T11:53:14.240 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] rmap.o 2024-02-02T11:53:14.618 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] rt.o 2024-02-02T11:53:14.769 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] sb.o 2024-02-02T11:53:14.982 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] scan.o 2024-02-02T11:53:15.722 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] slab.o 2024-02-02T11:53:15.876 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] threads.o 2024-02-02T11:53:15.978 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] versions.o 2024-02-02T11:53:16.095 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_repair.o 2024-02-02T11:53:16.387 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] xfs_repair 2024-02-02T11:53:16.632 INFO:teuthology.orchestra.run.smithi177.stdout:Building rtcp 2024-02-02T11:53:16.686 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_rtcp.o 2024-02-02T11:53:16.852 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] xfs_rtcp 2024-02-02T11:53:16.953 INFO:teuthology.orchestra.run.smithi177.stdout:Building m4 2024-02-02T11:53:16.959 INFO:teuthology.orchestra.run.smithi177.stdout:Building man 2024-02-02T11:53:16.968 INFO:teuthology.orchestra.run.smithi177.stdout:Building man2 2024-02-02T11:53:16.978 INFO:teuthology.orchestra.run.smithi177.stdout:Building man3 2024-02-02T11:53:16.986 INFO:teuthology.orchestra.run.smithi177.stdout:Building man5 2024-02-02T11:53:16.995 INFO:teuthology.orchestra.run.smithi177.stdout:Building man8 2024-02-02T11:53:17.012 INFO:teuthology.orchestra.run.smithi177.stdout: [SED] mkfs.xfs.8 2024-02-02T11:53:17.019 INFO:teuthology.orchestra.run.smithi177.stdout:Building doc 2024-02-02T11:53:17.027 INFO:teuthology.orchestra.run.smithi177.stdout: [ZIP] CHANGES.gz 2024-02-02T11:53:17.040 INFO:teuthology.orchestra.run.smithi177.stdout:Building debian 2024-02-02T11:53:17.046 INFO:teuthology.orchestra.run.smithi177.stdout:Building spaceman 2024-02-02T11:53:17.319 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] info.o 2024-02-02T11:53:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] init.o 2024-02-02T11:53:17.530 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] file.o 2024-02-02T11:53:17.644 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] health.o 2024-02-02T11:53:17.800 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] prealloc.o 2024-02-02T11:53:17.908 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] trim.o 2024-02-02T11:53:18.022 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] freesp.o 2024-02-02T11:53:18.195 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] xfs_spaceman 2024-02-02T11:53:18.319 INFO:teuthology.orchestra.run.smithi177.stdout:Building scrub 2024-02-02T11:53:19.013 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] common.o 2024-02-02T11:53:19.153 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] counter.o 2024-02-02T11:53:19.224 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] descr.o 2024-02-02T11:53:19.307 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] disk.o 2024-02-02T11:53:19.425 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] filemap.o 2024-02-02T11:53:19.515 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] fscounters.o 2024-02-02T11:53:19.612 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] inodes.o 2024-02-02T11:53:19.756 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] phase1.o 2024-02-02T11:53:19.864 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] phase2.o 2024-02-02T11:53:19.967 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] phase3.o 2024-02-02T11:53:20.081 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] phase4.o 2024-02-02T11:53:20.177 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] phase5.o 2024-02-02T11:53:20.320 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] phase6.o 2024-02-02T11:53:20.499 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] phase7.o 2024-02-02T11:53:20.616 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] progress.o 2024-02-02T11:53:20.724 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] read_verify.o 2024-02-02T11:53:20.847 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] repair.o 2024-02-02T11:53:20.967 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] scrub.o 2024-02-02T11:53:21.174 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] spacemap.o 2024-02-02T11:53:21.288 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] vfs.o 2024-02-02T11:53:21.406 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] xfs_scrub.o 2024-02-02T11:53:21.605 INFO:teuthology.orchestra.run.smithi177.stdout: [CC] unicrash.o 2024-02-02T11:53:21.779 INFO:teuthology.orchestra.run.smithi177.stdout: [LD] xfs_scrub 2024-02-02T11:53:21.971 INFO:teuthology.orchestra.run.smithi177.stdout: [SED] xfs_scrub_all 2024-02-02T11:53:21.980 INFO:teuthology.orchestra.run.smithi177.stdout: [SED] xfs_scrub@.service 2024-02-02T11:53:21.986 INFO:teuthology.orchestra.run.smithi177.stdout: [SED] xfs_scrub_all.service 2024-02-02T11:53:21.992 INFO:teuthology.orchestra.run.smithi177.stdout: [SED] xfs_scrub_fail@.service 2024-02-02T11:53:21.998 INFO:teuthology.orchestra.run.smithi177.stdout: [SED] xfs_scrub_all.cron 2024-02-02T11:53:22.004 INFO:teuthology.orchestra.run.smithi177.stdout:Building po 2024-02-02T11:53:22.031 INFO:teuthology.orchestra.run.smithi177.stdout: [GETTXT] xfsprogs.pot 2024-02-02T11:53:22.248 INFO:teuthology.orchestra.run.smithi177.stdout: [MSGFMT] de.mo 2024-02-02T11:53:22.289 INFO:teuthology.orchestra.run.smithi177.stderr:2345 translated messages. 2024-02-02T11:53:22.291 INFO:teuthology.orchestra.run.smithi177.stdout: [MSGFMT] pl.mo 2024-02-02T11:53:22.336 INFO:teuthology.orchestra.run.smithi177.stderr:3104 translated messages. 2024-02-02T11:53:22.337 INFO:teuthology.orchestra.run.smithi177.stdout:gmake[2]: Nothing to be done for 'include'. 2024-02-02T11:53:22.341 DEBUG:teuthology.orchestra.run.smithi177:> (cd /tmp/tmp.mSCij3RKBAxfsprogs-dev && exec sudo make install) 2024-02-02T11:53:22.371 INFO:teuthology.orchestra.run.smithi177.stdout:Installing libfrog-install 2024-02-02T11:53:22.413 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:53:22.416 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:53:22.419 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:53:22.794 INFO:teuthology.orchestra.run.smithi177.stdout:Installing libxfs-install 2024-02-02T11:53:24.384 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2024-02-02T11:53:24.405 INFO:teuthology.orchestra.run.smithi177.stdout:Installing libxlog-install 2024-02-02T11:53:24.493 INFO:teuthology.orchestra.run.smithi177.stdout:Installing libxcmd-install 2024-02-02T11:53:24.622 INFO:teuthology.orchestra.run.smithi177.stdout:Installing libhandle-install 2024-02-02T11:53:24.695 INFO:teuthology.orchestra.run.smithi177.stdout:cd ../libhandle/.libs; ../../install-sh -o root -g root -m 755 -d /lib; ../../install-sh -o root -g root -m 755 -T so_dot_version libhandle.lai /lib; ../../install-sh -o root -g root -T so_dot_current libhandle.lai /lib 2024-02-02T11:53:24.758 INFO:teuthology.orchestra.run.smithi177.stdout:Installing copy-install 2024-02-02T11:53:24.809 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-02T11:53:24.828 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_copy /usr/sbin 2024-02-02T11:53:24.881 INFO:teuthology.orchestra.run.smithi177.stdout:Installing db-install 2024-02-02T11:53:26.851 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-02T11:53:26.870 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_db /usr/sbin 2024-02-02T11:53:26.924 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 xfs_admin.sh /usr/sbin/xfs_admin 2024-02-02T11:53:26.944 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 xfs_ncheck.sh /usr/sbin/xfs_ncheck 2024-02-02T11:53:26.963 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 xfs_metadump.sh /usr/sbin/xfs_metadump 2024-02-02T11:53:26.984 INFO:teuthology.orchestra.run.smithi177.stdout:Installing estimate-install 2024-02-02T11:53:27.034 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-02T11:53:27.053 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_estimate /usr/sbin 2024-02-02T11:53:27.099 INFO:teuthology.orchestra.run.smithi177.stdout:Installing fsck-install 2024-02-02T11:53:27.103 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /sbin 2024-02-02T11:53:27.122 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 xfs_fsck.sh /sbin/fsck.xfs 2024-02-02T11:53:27.144 INFO:teuthology.orchestra.run.smithi177.stdout:Installing fsr-install 2024-02-02T11:53:27.195 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-02T11:53:27.214 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_fsr /usr/sbin 2024-02-02T11:53:27.261 INFO:teuthology.orchestra.run.smithi177.stdout:Installing growfs-install 2024-02-02T11:53:27.311 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-02T11:53:27.330 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_growfs /usr/sbin 2024-02-02T11:53:27.382 INFO:teuthology.orchestra.run.smithi177.stdout:Installing io-install 2024-02-02T11:53:28.705 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-02T11:53:28.724 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_io /usr/sbin 2024-02-02T11:53:28.771 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_bmap.sh /usr/sbin/xfs_bmap 2024-02-02T11:53:28.815 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_freeze.sh /usr/sbin/xfs_freeze 2024-02-02T11:53:28.860 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mkfile.sh /usr/sbin/xfs_mkfile 2024-02-02T11:53:28.907 INFO:teuthology.orchestra.run.smithi177.stdout:Installing logprint-install 2024-02-02T11:53:29.170 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-02T11:53:29.189 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_logprint /usr/sbin 2024-02-02T11:53:29.242 INFO:teuthology.orchestra.run.smithi177.stdout:Installing mkfs-install 2024-02-02T11:53:29.330 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /sbin 2024-02-02T11:53:29.348 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 mkfs.xfs /sbin 2024-02-02T11:53:29.400 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /usr/share/xfsprogs/mkfs 2024-02-02T11:53:29.419 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 644 dax_x86_64.conf lts_4.19.conf lts_5.4.conf lts_5.10.conf lts_5.15.conf lts_6.1.conf lts_6.6.conf /usr/share/xfsprogs/mkfs 2024-02-02T11:53:29.473 INFO:teuthology.orchestra.run.smithi177.stdout:Installing quota-install 2024-02-02T11:53:29.822 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-02T11:53:29.841 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_quota /usr/sbin 2024-02-02T11:53:29.888 INFO:teuthology.orchestra.run.smithi177.stdout:Installing mdrestore-install 2024-02-02T11:53:29.938 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-02T11:53:29.957 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mdrestore /usr/sbin 2024-02-02T11:53:30.009 INFO:teuthology.orchestra.run.smithi177.stdout:Installing repair-install 2024-02-02T11:53:31.278 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /sbin 2024-02-02T11:53:31.297 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_repair /sbin 2024-02-02T11:53:31.352 INFO:teuthology.orchestra.run.smithi177.stdout:Installing rtcp-install 2024-02-02T11:53:31.402 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-02T11:53:31.421 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_rtcp /usr/sbin 2024-02-02T11:53:31.468 INFO:teuthology.orchestra.run.smithi177.stdout:Installing m4-install 2024-02-02T11:53:31.472 INFO:teuthology.orchestra.run.smithi177.stdout:gmake[1]: Nothing to be done for 'install'. 2024-02-02T11:53:31.474 INFO:teuthology.orchestra.run.smithi177.stdout:Installing man-install 2024-02-02T11:53:31.484 INFO:teuthology.orchestra.run.smithi177.stdout:gmake[2]: Nothing to be done for 'install'. 2024-02-02T11:53:31.490 INFO:teuthology.orchestra.run.smithi177.stdout:gmake[2]: Nothing to be done for 'install'. 2024-02-02T11:53:31.498 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man5 2024-02-02T11:53:31.522 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 projects.5 /usr/share/man/man5/projects.5 2024-02-02T11:53:31.545 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 projid.5 /usr/share/man/man5/projid.5 2024-02-02T11:53:31.568 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs.5 /usr/share/man/man5/xfs.5 2024-02-02T11:53:31.597 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man8 2024-02-02T11:53:31.622 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 fsck.xfs.8 /usr/share/man/man8/fsck.xfs.8 2024-02-02T11:53:31.645 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2024-02-02T11:53:31.667 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_admin.8 /usr/share/man/man8/xfs_admin.8 2024-02-02T11:53:31.690 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_bmap.8 /usr/share/man/man8/xfs_bmap.8 2024-02-02T11:53:31.713 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_copy.8 /usr/share/man/man8/xfs_copy.8 2024-02-02T11:53:31.735 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_db.8 /usr/share/man/man8/xfs_db.8 2024-02-02T11:53:31.758 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_estimate.8 /usr/share/man/man8/xfs_estimate.8 2024-02-02T11:53:31.781 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_freeze.8 /usr/share/man/man8/xfs_freeze.8 2024-02-02T11:53:31.804 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_fsr.8 /usr/share/man/man8/xfs_fsr.8 2024-02-02T11:53:31.826 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_growfs.8 /usr/share/man/man8/xfs_growfs.8 2024-02-02T11:53:31.849 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_info.8 /usr/share/man/man8/xfs_info.8 2024-02-02T11:53:31.871 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_io.8 /usr/share/man/man8/xfs_io.8 2024-02-02T11:53:31.894 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_logprint.8 /usr/share/man/man8/xfs_logprint.8 2024-02-02T11:53:31.917 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_mdrestore.8 /usr/share/man/man8/xfs_mdrestore.8 2024-02-02T11:53:31.940 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_metadump.8 /usr/share/man/man8/xfs_metadump.8 2024-02-02T11:53:31.962 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_mkfile.8 /usr/share/man/man8/xfs_mkfile.8 2024-02-02T11:53:31.985 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_ncheck.8 /usr/share/man/man8/xfs_ncheck.8 2024-02-02T11:53:32.008 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_quota.8 /usr/share/man/man8/xfs_quota.8 2024-02-02T11:53:32.031 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_repair.8 /usr/share/man/man8/xfs_repair.8 2024-02-02T11:53:32.053 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_rtcp.8 /usr/share/man/man8/xfs_rtcp.8 2024-02-02T11:53:32.076 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_scrub.8 /usr/share/man/man8/xfs_scrub.8 2024-02-02T11:53:32.098 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_scrub_all.8 /usr/share/man/man8/xfs_scrub_all.8 2024-02-02T11:53:32.121 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 xfs_spaceman.8 /usr/share/man/man8/xfs_spaceman.8 2024-02-02T11:53:32.144 INFO:teuthology.orchestra.run.smithi177.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2024-02-02T11:53:32.165 INFO:teuthology.orchestra.run.smithi177.stdout:Installing doc-install 2024-02-02T11:53:32.168 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2024-02-02T11:53:32.188 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 644 CHANGES.gz CREDITS /usr/share/doc/xfsprogs 2024-02-02T11:53:32.217 INFO:teuthology.orchestra.run.smithi177.stdout:Installing debian-install 2024-02-02T11:53:32.222 INFO:teuthology.orchestra.run.smithi177.stdout:gmake[1]: Nothing to be done for 'install'. 2024-02-02T11:53:32.223 INFO:teuthology.orchestra.run.smithi177.stdout:Installing spaceman-install 2024-02-02T11:53:32.491 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-02T11:53:32.511 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_spaceman /usr/sbin 2024-02-02T11:53:32.556 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 xfs_info.sh /usr/sbin/xfs_info 2024-02-02T11:53:32.577 INFO:teuthology.orchestra.run.smithi177.stdout:Installing scrub-install 2024-02-02T11:53:33.264 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-02T11:53:33.283 INFO:teuthology.orchestra.run.smithi177.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_scrub /usr/sbin 2024-02-02T11:53:33.329 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 xfs_scrub_all /usr/sbin 2024-02-02T11:53:33.348 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /lib/systemd/system 2024-02-02T11:53:33.367 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 644 xfs_scrub@.service xfs_scrub_all.service xfs_scrub_all.timer xfs_scrub_fail@.service /lib/systemd/system 2024-02-02T11:53:33.403 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/xfsprogs 2024-02-02T11:53:33.422 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 xfs_scrub_fail /usr/lib/xfsprogs 2024-02-02T11:53:33.444 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/xfsprogs 2024-02-02T11:53:33.463 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 644 xfs_scrub_all.cron /usr/lib/xfsprogs 2024-02-02T11:53:33.483 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /lib/udev/rules.d 2024-02-02T11:53:33.501 INFO:teuthology.orchestra.run.smithi177.stdout:for i in xfs.rules; do \ 2024-02-02T11:53:33.501 INFO:teuthology.orchestra.run.smithi177.stdout: ../install-sh -o root -g root -m 644 $i /lib/udev/rules.d/64-$i; \ 2024-02-02T11:53:33.502 INFO:teuthology.orchestra.run.smithi177.stdout:done 2024-02-02T11:53:33.523 INFO:teuthology.orchestra.run.smithi177.stdout:Installing po-install 2024-02-02T11:53:33.614 INFO:teuthology.orchestra.run.smithi177.stdout:Installing include-install 2024-02-02T11:53:33.618 INFO:teuthology.orchestra.run.smithi177.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2024-02-02T11:53:33.637 INFO:teuthology.orchestra.run.smithi177.stdout:./install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2024-02-02T11:53:33.656 INFO:teuthology.orchestra.run.smithi177.stdout:./install-sh -o root -g root -m 644 README /usr/share/doc/xfsprogs 2024-02-02T11:53:33.678 INFO:tasks.cephfs.test_fscrypt:client is kernel mounted 2024-02-02T11:53:33.679 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-02-02T11:53:33.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.802+0000 7f2a796fc640 1 Processor -- start 2024-02-02T11:53:33.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.802+0000 7f2a796fc640 1 -- start start 2024-02-02T11:53:33.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a796fc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2a740bc340 0x7f2a7406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:53:33.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a796fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2a7406f4f0 0x7f2a74144830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:53:33.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a796fc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a74144d70 0x7f2a7414ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:53:33.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a796fc640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a740703c0 con 0x7f2a7406f4f0 2024-02-02T11:53:33.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a796fc640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a740707e0 con 0x7f2a740bc340 2024-02-02T11:53:33.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a796fc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a740b8750 con 0x7f2a74144d70 2024-02-02T11:53:33.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a727fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2a7406f4f0 0x7f2a74144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:53:33.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a727fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2a7406f4f0 0x7f2a74144830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45798/0 (socket says 172.21.15.161:45798) 2024-02-02T11:53:33.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a727fc640 1 -- 172.21.15.161:0/3811717161 learned_addr learned my addr 172.21.15.161:0/3811717161 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:53:33.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a737fe640 1 --2- 172.21.15.161:0/3811717161 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a74144d70 0x7f2a7414ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:53:33.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a72ffd640 1 --2- 172.21.15.161:0/3811717161 >> v2:172.21.15.162:3300/0 conn(0x7f2a740bc340 0x7f2a7406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:53:33.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a727fc640 1 -- 172.21.15.161:0/3811717161 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a74144d70 msgr2=0x7f2a7414ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:53:33.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a727fc640 1 --2- 172.21.15.161:0/3811717161 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a74144d70 0x7f2a7414ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:33.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a727fc640 1 -- 172.21.15.161:0/3811717161 >> v2:172.21.15.162:3300/0 conn(0x7f2a740bc340 msgr2=0x7f2a7406eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:53:33.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a727fc640 1 --2- 172.21.15.161:0/3811717161 >> v2:172.21.15.162:3300/0 conn(0x7f2a740bc340 0x7f2a7406eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:33.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a727fc640 1 -- 172.21.15.161:0/3811717161 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7406fa10 con 0x7f2a7406f4f0 2024-02-02T11:53:33.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a72ffd640 1 --2- 172.21.15.161:0/3811717161 >> v2:172.21.15.162:3300/0 conn(0x7f2a740bc340 0x7f2a7406eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:53:33.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a727fc640 1 --2- 172.21.15.161:0/3811717161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a7406f4f0 0x7f2a74144830 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2a7406d110 tx=0x7f2a5c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188850d258c36f2a server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:53:33.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a71ffb640 1 -- 172.21.15.161:0/3811717161 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0ab600 con 0x7f2a7406f4f0 2024-02-02T11:53:33.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a71ffb640 1 -- 172.21.15.161:0/3811717161 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c0a7050 con 0x7f2a7406f4f0 2024-02-02T11:53:33.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.806+0000 7f2a71ffb640 1 -- 172.21.15.161:0/3811717161 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0ab980 con 0x7f2a7406f4f0 2024-02-02T11:53:33.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 -- 172.21.15.161:0/3811717161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a7406f4f0 msgr2=0x7f2a74144830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:53:33.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 --2- 172.21.15.161:0/3811717161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a7406f4f0 0x7f2a74144830 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2a7406d110 tx=0x7f2a5c01c4a0 comp rx=0 tx=0).stop 2024-02-02T11:53:33.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 -- 172.21.15.161:0/3811717161 shutdown_connections 2024-02-02T11:53:33.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 --2- 172.21.15.161:0/3811717161 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a74144d70 0x7f2a7414ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:33.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 --2- 172.21.15.161:0/3811717161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a7406f4f0 0x7f2a74144830 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:33.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 --2- 172.21.15.161:0/3811717161 >> v2:172.21.15.162:3300/0 conn(0x7f2a740bc340 0x7f2a7406eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:33.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 -- 172.21.15.161:0/3811717161 >> 172.21.15.161:0/3811717161 conn(0x7f2a74069ef0 msgr2=0x7f2a7406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:53:33.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 -- 172.21.15.161:0/3811717161 shutdown_connections 2024-02-02T11:53:33.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 -- 172.21.15.161:0/3811717161 wait complete. 2024-02-02T11:53:33.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 Processor -- start 2024-02-02T11:53:33.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 -- start start 2024-02-02T11:53:33.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a7406f4f0 0x7f2a74145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:53:33.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a740bc340 0x7f2a74147da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:53:33.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a74144d70 0x7f2a7413f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:53:33.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a741482e0 con 0x7f2a74144d70 2024-02-02T11:53:33.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a741484c0 con 0x7f2a740bc340 2024-02-02T11:53:33.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a740b3790 con 0x7f2a7406f4f0 2024-02-02T11:53:33.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a737fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a74144d70 0x7f2a7413f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:53:33.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a737fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a74144d70 0x7f2a7413f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45808/0 (socket says 172.21.15.161:45808) 2024-02-02T11:53:33.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a737fe640 1 -- 172.21.15.161:0/3288486925 learned_addr learned my addr 172.21.15.161:0/3288486925 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:53:33.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a72ffd640 1 --2- 172.21.15.161:0/3288486925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a7406f4f0 0x7f2a74145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:53:33.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a727fc640 1 --2- 172.21.15.161:0/3288486925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a740bc340 0x7f2a74147da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:53:33.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a737fe640 1 -- 172.21.15.161:0/3288486925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a7406f4f0 msgr2=0x7f2a74145270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:53:33.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a737fe640 1 --2- 172.21.15.161:0/3288486925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a7406f4f0 0x7f2a74145270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:33.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a737fe640 1 -- 172.21.15.161:0/3288486925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a740bc340 msgr2=0x7f2a74147da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:53:33.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a737fe640 1 --2- 172.21.15.161:0/3288486925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a740bc340 0x7f2a74147da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:33.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a737fe640 1 -- 172.21.15.161:0/3288486925 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c0094d0 con 0x7f2a74144d70 2024-02-02T11:53:33.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a737fe640 1 --2- 172.21.15.161:0/3288486925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a74144d70 0x7f2a7413f640 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00d560 tx=0x7f2a6c00da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:53:33.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a6b7fe640 1 -- 172.21.15.161:0/3288486925 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c0125f0 con 0x7f2a74144d70 2024-02-02T11:53:33.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a6b7fe640 1 -- 172.21.15.161:0/3288486925 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6c012770 con 0x7f2a74144d70 2024-02-02T11:53:33.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 -- 172.21.15.161:0/3288486925 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a74146fe0 con 0x7f2a74144d70 2024-02-02T11:53:33.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a6b7fe640 1 -- 172.21.15.161:0/3288486925 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c012b20 con 0x7f2a74144d70 2024-02-02T11:53:33.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 -- 172.21.15.161:0/3288486925 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7413fb80 con 0x7f2a74144d70 2024-02-02T11:53:33.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.810+0000 7f2a796fc640 1 -- 172.21.15.161:0/3288486925 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7404e000 con 0x7f2a74144d70 2024-02-02T11:53:33.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.814+0000 7f2a6b7fe640 1 -- 172.21.15.161:0/3288486925 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2a6c012c80 con 0x7f2a74144d70 2024-02-02T11:53:33.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.814+0000 7f2a6b7fe640 1 --2- 172.21.15.161:0/3288486925 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2a54065a60 0x7f2a54067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:53:33.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.814+0000 7f2a6b7fe640 1 -- 172.21.15.161:0/3288486925 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a6c0835c0 con 0x7f2a74144d70 2024-02-02T11:53:33.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.814+0000 7f2a72ffd640 1 --2- 172.21.15.161:0/3288486925 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2a54065a60 0x7f2a54067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:53:33.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.814+0000 7f2a72ffd640 1 --2- 172.21.15.161:0/3288486925 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2a54065a60 0x7f2a54067f20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2a64007130 tx=0x7f2a640079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:53:33.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:33.818+0000 7f2a6b7fe640 1 -- 172.21.15.161:0/3288486925 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2a6c051010 con 0x7f2a74144d70 2024-02-02T11:53:34.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.026+0000 7f2a796fc640 1 -- 172.21.15.161:0/3288486925 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2a740b40c0 con 0x7f2a74144d70 2024-02-02T11:53:34.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.026+0000 7f2a6b7fe640 1 -- 172.21.15.161:0/3288486925 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7f2a6c054630 con 0x7f2a74144d70 2024-02-02T11:53:34.031 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T11:53:34.031 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","modified":"2024-02-02T11:47:52.887531Z","created":"2024-02-02T11:47:52.887531Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:3300","nonce":0},{"type":"v1","addr":"172.21.15.161:6789","nonce":0}]},"addr":"172.21.15.161:6789/0","public_addr":"172.21.15.161:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3301","nonce":0},{"type":"v1","addr":"172.21.15.162:6790","nonce":0}]},"addr":"172.21.15.162:6790/0","public_addr":"172.21.15.162:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-02-02T11:53:34.031 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-02-02T11:53:34.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.030+0000 7f2a796fc640 1 -- 172.21.15.161:0/3288486925 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2a54065a60 msgr2=0x7f2a54067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:53:34.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.030+0000 7f2a796fc640 1 --2- 172.21.15.161:0/3288486925 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2a54065a60 0x7f2a54067f20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2a64007130 tx=0x7f2a640079c0 comp rx=0 tx=0).stop 2024-02-02T11:53:34.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.030+0000 7f2a796fc640 1 -- 172.21.15.161:0/3288486925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a74144d70 msgr2=0x7f2a7413f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:53:34.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.030+0000 7f2a796fc640 1 --2- 172.21.15.161:0/3288486925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a74144d70 0x7f2a7413f640 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00d560 tx=0x7f2a6c00da20 comp rx=0 tx=0).stop 2024-02-02T11:53:34.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.030+0000 7f2a796fc640 1 -- 172.21.15.161:0/3288486925 shutdown_connections 2024-02-02T11:53:34.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.030+0000 7f2a796fc640 1 --2- 172.21.15.161:0/3288486925 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2a54065a60 0x7f2a54067f20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:34.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.030+0000 7f2a796fc640 1 --2- 172.21.15.161:0/3288486925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a74144d70 0x7f2a7413f640 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:34.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.030+0000 7f2a796fc640 1 --2- 172.21.15.161:0/3288486925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a740bc340 0x7f2a74147da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:34.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.030+0000 7f2a796fc640 1 --2- 172.21.15.161:0/3288486925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a7406f4f0 0x7f2a74145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:34.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.030+0000 7f2a796fc640 1 -- 172.21.15.161:0/3288486925 >> 172.21.15.161:0/3288486925 conn(0x7f2a74069ef0 msgr2=0x7f2a74143480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:53:34.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.030+0000 7f2a796fc640 1 -- 172.21.15.161:0/3288486925 shutdown_connections 2024-02-02T11:53:34.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.030+0000 7f2a796fc640 1 -- 172.21.15.161:0/3288486925 wait complete. 2024-02-02T11:53:34.048 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-02-02T11:53:34.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faec55e6640 1 Processor -- start 2024-02-02T11:53:34.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faec55e6640 1 -- start start 2024-02-02T11:53:34.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faec55e6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faec014b540 0x7faec00bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:53:34.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faec55e6640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec014edf0 con 0x7faec006a4c0 2024-02-02T11:53:34.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faec55e6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec00bc590 con 0x7faec006a900 2024-02-02T11:53:34.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faec55e6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec00bc320 con 0x7faec014b540 2024-02-02T11:53:34.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebe7fc640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7faec006a4c0 0x7faec014dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:41192/0 (socket says 172.21.15.161:41192) 2024-02-02T11:53:34.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebe7fc640 1 -- 172.21.15.161:0/868814319 learned_addr learned my addr 172.21.15.161:0/868814319 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T11:53:34.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebdffb640 1 -- 172.21.15.161:0/868814319 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366000789 0 0) 0x7faec014edf0 con 0x7faec006a4c0 2024-02-02T11:53:34.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebeffd640 1 --2- 172.21.15.161:0/868814319 >> v2:172.21.15.162:3300/0 conn(0x7faec014b540 0x7faec00bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:53:34.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebdffb640 1 -- 172.21.15.161:0/868814319 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeac003530 con 0x7faec006a4c0 2024-02-02T11:53:34.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebdffb640 1 -- 172.21.15.161:0/868814319 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 685241019 0 0) 0x7faeac003530 con 0x7faec006a4c0 2024-02-02T11:53:34.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebdffb640 1 -- 172.21.15.161:0/868814319 >> v2:172.21.15.162:3300/0 conn(0x7faec014b540 msgr2=0x7faec00bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:53:34.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebdffb640 1 --2- 172.21.15.161:0/868814319 >> v2:172.21.15.162:3300/0 conn(0x7faec014b540 0x7faec00bac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:34.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebdffb640 1 -- 172.21.15.161:0/868814319 >> v1:172.21.15.162:6789/0 conn(0x7faec006a900 legacy=0x7faec014e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:53:34.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebdffb640 1 -- 172.21.15.161:0/868814319 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec00b3a10 con 0x7faec006a4c0 2024-02-02T11:53:34.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebdffb640 1 -- 172.21.15.161:0/868814319 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7faeb0001680 con 0x7faec006a4c0 2024-02-02T11:53:34.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebdffb640 1 -- 172.21.15.161:0/868814319 >> v1:172.21.15.161:6789/0 conn(0x7faec006a4c0 legacy=0x7faec014dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:53:34.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebdffb640 1 --2- 172.21.15.161:0/868814319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faeac003980 0x7faeac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:53:34.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebdffb640 1 --2- 172.21.15.161:0/868814319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faeac0047d0 0x7faeac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:53:34.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebdffb640 1 --2- 172.21.15.161:0/868814319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faeac005190 0x7faeac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:53:34.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebdffb640 1 -- 172.21.15.161:0/868814319 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac00c010 con 0x7faeac0047d0 2024-02-02T11:53:34.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebdffb640 1 -- 172.21.15.161:0/868814319 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac00c180 con 0x7faeac003980 2024-02-02T11:53:34.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebdffb640 1 -- 172.21.15.161:0/868814319 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac00c340 con 0x7faeac005190 2024-02-02T11:53:34.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebe7fc640 1 --2- 172.21.15.161:0/868814319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faeac0047d0 0x7faeac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:53:34.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebeffd640 1 --2- 172.21.15.161:0/868814319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faeac003980 0x7faeac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:53:34.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebf7fe640 1 --2- 172.21.15.161:0/868814319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faeac005190 0x7faeac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:53:34.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebe7fc640 1 -- 172.21.15.161:0/868814319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faeac005190 msgr2=0x7faeac00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:53:34.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebe7fc640 1 --2- 172.21.15.161:0/868814319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faeac005190 0x7faeac00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:34.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebe7fc640 1 -- 172.21.15.161:0/868814319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faeac003980 msgr2=0x7faeac003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T11:53:34.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebe7fc640 1 --2- 172.21.15.161:0/868814319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faeac003980 0x7faeac003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:34.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebf7fe640 1 -- 172.21.15.161:0/868814319 reap_dead start 2024-02-02T11:53:34.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebe7fc640 1 -- 172.21.15.161:0/868814319 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac003530 con 0x7faeac0047d0 2024-02-02T11:53:34.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.166+0000 7faebeffd640 1 --2- 172.21.15.161:0/868814319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faeac003980 0x7faeac003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T11:53:34.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faebe7fc640 1 --2- 172.21.15.161:0/868814319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faeac0047d0 0x7faeac004c50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7faeb000c240 tx=0x7faeb001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d0e9d1640b34f7 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:53:34.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faebdffb640 1 -- 172.21.15.161:0/868814319 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb00a5b40 con 0x7faeac0047d0 2024-02-02T11:53:34.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faebdffb640 1 -- 172.21.15.161:0/868814319 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb00a5ca0 con 0x7faeac0047d0 2024-02-02T11:53:34.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faebdffb640 1 -- 172.21.15.161:0/868814319 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb0005b20 con 0x7faeac0047d0 2024-02-02T11:53:34.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faec55e6640 1 -- 172.21.15.161:0/868814319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faeac0047d0 msgr2=0x7faeac004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:53:34.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faec55e6640 1 --2- 172.21.15.161:0/868814319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faeac0047d0 0x7faeac004c50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7faeb000c240 tx=0x7faeb001cc40 comp rx=0 tx=0).stop 2024-02-02T11:53:34.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faec55e6640 1 -- 172.21.15.161:0/868814319 shutdown_connections 2024-02-02T11:53:34.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faec55e6640 1 --2- 172.21.15.161:0/868814319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faeac0047d0 0x7faeac004c50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:34.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faec55e6640 1 -- 172.21.15.161:0/868814319 >> 172.21.15.161:0/868814319 conn(0x7faec00c02e0 msgr2=0x7faec00c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:53:34.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faec55e6640 1 -- 172.21.15.161:0/868814319 shutdown_connections 2024-02-02T11:53:34.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faec55e6640 1 -- 172.21.15.161:0/868814319 wait complete. 2024-02-02T11:53:34.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faec55e6640 1 Processor -- start 2024-02-02T11:53:34.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faec55e6640 1 -- start start 2024-02-02T11:53:34.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faec55e6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faeac0047d0 0x7faec00a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:53:34.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faec55e6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faec0143a90 0x7faec01dfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:53:34.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faec55e6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faec01e0130 0x7faec00b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:53:34.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faec55e6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec00a3ba0 con 0x7faeac0047d0 2024-02-02T11:53:34.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faec55e6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec00a4d70 con 0x7faec0143a90 2024-02-02T11:53:34.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faec55e6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec00a56c0 con 0x7faec01e0130 2024-02-02T11:53:34.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faebeffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faeac0047d0 0x7faec00a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:53:34.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faebeffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faeac0047d0 0x7faec00a3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45824/0 (socket says 172.21.15.161:45824) 2024-02-02T11:53:34.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faebeffd640 1 -- 172.21.15.161:0/1840777612 learned_addr learned my addr 172.21.15.161:0/1840777612 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T11:53:34.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faebf7fe640 1 --2- 172.21.15.161:0/1840777612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faec01e0130 0x7faec00b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:53:34.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faebe7fc640 1 --2- 172.21.15.161:0/1840777612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faec0143a90 0x7faec01dfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:53:34.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faebeffd640 1 -- 172.21.15.161:0/1840777612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faec01e0130 msgr2=0x7faec00b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:53:34.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faebeffd640 1 --2- 172.21.15.161:0/1840777612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faec01e0130 0x7faec00b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:34.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faebeffd640 1 -- 172.21.15.161:0/1840777612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faec0143a90 msgr2=0x7faec01dfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:53:34.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faebeffd640 1 --2- 172.21.15.161:0/1840777612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faec0143a90 0x7faec01dfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:34.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faebeffd640 1 -- 172.21.15.161:0/1840777612 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec01e05b0 con 0x7faeac0047d0 2024-02-02T11:53:34.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faebeffd640 1 --2- 172.21.15.161:0/1840777612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faeac0047d0 0x7faec00a3660 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faea80107c0 tx=0x7faea8010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:53:34.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faeb77fe640 1 -- 172.21.15.161:0/1840777612 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8004220 con 0x7faeac0047d0 2024-02-02T11:53:34.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.170+0000 7faec55e6640 1 -- 172.21.15.161:0/1840777612 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec00a5910 con 0x7faeac0047d0 2024-02-02T11:53:34.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.174+0000 7faec55e6640 1 -- 172.21.15.161:0/1840777612 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec01df6d0 con 0x7faeac0047d0 2024-02-02T11:53:34.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.174+0000 7faeb77fe640 1 -- 172.21.15.161:0/1840777612 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea8010ed0 con 0x7faeac0047d0 2024-02-02T11:53:34.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.174+0000 7faeb77fe640 1 -- 172.21.15.161:0/1840777612 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea80059a0 con 0x7faeac0047d0 2024-02-02T11:53:34.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.174+0000 7faec55e6640 1 -- 172.21.15.161:0/1840777612 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea4005260 con 0x7faeac0047d0 2024-02-02T11:53:34.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.174+0000 7faeb77fe640 1 -- 172.21.15.161:0/1840777612 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faea8005b00 con 0x7faeac0047d0 2024-02-02T11:53:34.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.174+0000 7faeb77fe640 1 --2- 172.21.15.161:0/1840777612 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7faea0065a60 0x7faea0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T11:53:34.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.174+0000 7faeb77fe640 1 -- 172.21.15.161:0/1840777612 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faea8083500 con 0x7faeac0047d0 2024-02-02T11:53:34.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.174+0000 7faebe7fc640 1 --2- 172.21.15.161:0/1840777612 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7faea0065a60 0x7faea0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T11:53:34.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.174+0000 7faebe7fc640 1 --2- 172.21.15.161:0/1840777612 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7faea0065a60 0x7faea0067f20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7faeb00ab000 tx=0x7faeb0006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T11:53:34.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.178+0000 7faeb77fe640 1 -- 172.21.15.161:0/1840777612 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7faea8050ec0 con 0x7faeac0047d0 2024-02-02T11:53:34.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.370+0000 7faec55e6640 1 -- 172.21.15.161:0/1840777612 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7faea4005a90 con 0x7faeac0047d0 2024-02-02T11:53:34.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.370+0000 7faeb77fe640 1 -- 172.21.15.161:0/1840777612 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) v1 ==== 92+0+63 (secure 0 0 0) 0x7faea80544e0 con 0x7faeac0047d0 2024-02-02T11:53:34.375 INFO:teuthology.orchestra.run.smithi161.stdout:[client.admin] 2024-02-02T11:53:34.375 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBp1rxlR51tBxAABbzxZahfKYl0M7QrtLzrXQ== 2024-02-02T11:53:34.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.370+0000 7faec55e6640 1 -- 172.21.15.161:0/1840777612 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7faea0065a60 msgr2=0x7faea0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:53:34.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.370+0000 7faec55e6640 1 --2- 172.21.15.161:0/1840777612 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7faea0065a60 0x7faea0067f20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7faeb00ab000 tx=0x7faeb0006040 comp rx=0 tx=0).stop 2024-02-02T11:53:34.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.370+0000 7faec55e6640 1 -- 172.21.15.161:0/1840777612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faeac0047d0 msgr2=0x7faec00a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T11:53:34.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.370+0000 7faec55e6640 1 --2- 172.21.15.161:0/1840777612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faeac0047d0 0x7faec00a3660 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faea80107c0 tx=0x7faea8010c80 comp rx=0 tx=0).stop 2024-02-02T11:53:34.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.374+0000 7faec55e6640 1 -- 172.21.15.161:0/1840777612 shutdown_connections 2024-02-02T11:53:34.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.374+0000 7faec55e6640 1 --2- 172.21.15.161:0/1840777612 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7faea0065a60 0x7faea0067f20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:34.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.374+0000 7faec55e6640 1 --2- 172.21.15.161:0/1840777612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faec01e0130 0x7faec00b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:34.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.374+0000 7faec55e6640 1 --2- 172.21.15.161:0/1840777612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faec0143a90 0x7faec01dfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:34.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.374+0000 7faec55e6640 1 --2- 172.21.15.161:0/1840777612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faeac0047d0 0x7faec00a3660 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T11:53:34.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.374+0000 7faec55e6640 1 -- 172.21.15.161:0/1840777612 >> 172.21.15.161:0/1840777612 conn(0x7faec00c02e0 msgr2=0x7faec0148ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T11:53:34.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.374+0000 7faec55e6640 1 -- 172.21.15.161:0/1840777612 shutdown_connections 2024-02-02T11:53:34.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T11:53:34.374+0000 7faec55e6640 1 -- 172.21.15.161:0/1840777612 wait complete. 2024-02-02T11:53:34.392 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T11:53:34.392 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/tmp/tmp.ByhSz7TqB0xfstests-dev/local.config 2024-02-02T11:53:34.412 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.161:6789:/test export TEST_DIR=/tmp/tmp.R1pG371raPtest export SCRATCH_DEV=172.21.15.161:6789:/scratch export SCRATCH_MNT=/tmp/tmp.jtqH6Jn1Mhscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBp1rxlR51tBxAABbzxZahfKYl0M7QrtLzrXQ==,test_dummy_encryption" 2024-02-02T11:53:34.412 INFO:teuthology.orchestra.run:Running command with timeout 10800 2024-02-02T11:53:34.412 DEBUG:teuthology.orchestra.run.smithi177:running tests for dummy_encryption from xfstests-dev> (cd /tmp/tmp.ByhSz7TqB0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check -g quick -E ./ceph.exclude) 2024-02-02T11:53:36.137 INFO:teuthology.orchestra.run.smithi177.stdout:FSTYP -- ceph 2024-02-02T11:53:36.147 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM -- Linux/x86_64 smithi177 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 2024-02-02T11:53:36.149 INFO:teuthology.orchestra.run.smithi177.stdout:MKFS_OPTIONS -- 172.21.15.161:6789:/scratch 2024-02-02T11:53:36.151 INFO:teuthology.orchestra.run.smithi177.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBp1rxlR51tBxAABbzxZahfKYl0M7QrtLzrXQ==,test_dummy_encryption 172.21.15.161:6789:/scratch /tmp/tmp.jtqH6Jn1Mhscratch 2024-02-02T11:53:36.151 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T11:53:36.282 INFO:teuthology.orchestra.run.smithi177.stdout:ceph/001 [expunged] 2024-02-02T11:53:36.756 INFO:teuthology.orchestra.run.smithi177.stdout:ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T11:53:37.073 INFO:teuthology.orchestra.run.smithi177.stdout:ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T11:53:37.508 INFO:teuthology.orchestra.run.smithi177.stdout:ceph/004 0s 2024-02-02T11:53:37.798 INFO:teuthology.orchestra.run.smithi177.stdout:ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T11:53:46.602 INFO:teuthology.orchestra.run.smithi177.stdout:generic/001 9s 2024-02-02T11:53:47.261 INFO:teuthology.orchestra.run.smithi177.stdout:generic/002 1s 2024-02-02T11:53:47.555 INFO:teuthology.orchestra.run.smithi177.stdout:generic/003 [not run] atime not maintained by ceph 2024-02-02T11:53:47.842 INFO:teuthology.orchestra.run.smithi177.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-02-02T11:53:48.553 INFO:teuthology.orchestra.run.smithi177.stdout:generic/005 1s 2024-02-02T11:53:52.531 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:53:52.533 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:53:52.536 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:54:23.018 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:54:23.021 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:54:23.023 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:54:26.341 INFO:teuthology.orchestra.run.smithi177.stdout:generic/006 38s 2024-02-02T11:54:53.247 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:54:53.250 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:54:53.253 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:55:23.373 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:55:23.376 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:55:23.378 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:55:44.573 INFO:teuthology.orchestra.run.smithi177.stdout:generic/007 78s 2024-02-02T11:55:48.149 INFO:teuthology.orchestra.run.smithi177.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-02T11:55:50.551 INFO:teuthology.orchestra.run.smithi177.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-02T11:55:53.535 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:55:53.538 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:55:53.541 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:56:23.823 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:56:23.827 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:56:23.829 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:56:39.711 INFO:teuthology.orchestra.run.smithi177.stdout:generic/011 49s 2024-02-02T11:56:42.017 INFO:teuthology.orchestra.run.smithi177.stdout:generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-02T11:56:53.891 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:56:53.894 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:56:53.896 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:57:24.161 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:57:24.164 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:57:24.167 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:57:30.782 INFO:teuthology.orchestra.run.smithi177.stdout:generic/013 48s 2024-02-02T11:57:31.145 INFO:teuthology.orchestra.run.smithi177.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-02-02T11:57:31.447 INFO:teuthology.orchestra.run.smithi177.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-02T11:57:34.457 INFO:teuthology.orchestra.run.smithi177.stdout:generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-02T11:57:34.844 INFO:teuthology.orchestra.run.smithi177.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2024-02-02T11:57:40.113 INFO:teuthology.orchestra.run.smithi177.stdout:generic/020 6s 2024-02-02T11:57:45.040 INFO:teuthology.orchestra.run.smithi177.stdout:generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-02T11:57:48.287 INFO:teuthology.orchestra.run.smithi177.stdout:generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-02T11:57:50.199 INFO:teuthology.orchestra.run.smithi177.stdout:generic/023 2s 2024-02-02T11:57:50.527 INFO:teuthology.orchestra.run.smithi177.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-02-02T11:57:50.848 INFO:teuthology.orchestra.run.smithi177.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-02-02T11:57:51.166 INFO:teuthology.orchestra.run.smithi177.stdout:generic/026 [not run] ceph does not define maximum ACL count 2024-02-02T11:57:54.407 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:57:54.410 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:57:54.412 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:57:56.481 INFO:teuthology.orchestra.run.smithi177.stdout:generic/028 5s 2024-02-02T11:57:57.617 INFO:teuthology.orchestra.run.smithi177.stdout:generic/029 1s 2024-02-02T11:58:02.561 INFO:teuthology.orchestra.run.smithi177.stdout:generic/030 5s 2024-02-02T11:58:05.964 INFO:teuthology.orchestra.run.smithi177.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-02-02T11:58:06.253 INFO:teuthology.orchestra.run.smithi177.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T11:58:09.124 INFO:teuthology.orchestra.run.smithi177.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-02T11:58:09.437 INFO:teuthology.orchestra.run.smithi177.stdout:generic/034 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T11:58:09.826 INFO:teuthology.orchestra.run.smithi177.stdout:generic/035 0s 2024-02-02T11:58:16.670 INFO:teuthology.orchestra.run.smithi177.stdout:generic/037 7s 2024-02-02T11:58:17.040 INFO:teuthology.orchestra.run.smithi177.stdout:generic/039 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T11:58:17.364 INFO:teuthology.orchestra.run.smithi177.stdout:generic/040 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T11:58:17.685 INFO:teuthology.orchestra.run.smithi177.stdout:generic/041 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T11:58:18.095 INFO:teuthology.orchestra.run.smithi177.stdout:generic/042 [not run] ceph does not support shutdown 2024-02-02T11:58:18.507 INFO:teuthology.orchestra.run.smithi177.stdout:generic/050 [not run] ceph does not support shutdown 2024-02-02T11:58:18.901 INFO:teuthology.orchestra.run.smithi177.stdout:generic/052 [not run] ceph does not support shutdown 2024-02-02T11:58:19.754 INFO:teuthology.orchestra.run.smithi177.stdout:generic/053 1s 2024-02-02T11:58:20.126 INFO:teuthology.orchestra.run.smithi177.stdout:generic/056 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T11:58:20.450 INFO:teuthology.orchestra.run.smithi177.stdout:generic/057 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T11:58:24.466 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:58:24.469 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:58:24.472 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:58:25.699 INFO:teuthology.orchestra.run.smithi177.stdout:generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-02T11:58:26.011 INFO:teuthology.orchestra.run.smithi177.stdout:generic/059 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T11:58:28.705 INFO:teuthology.orchestra.run.smithi177.stdout:generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-02T11:58:32.066 INFO:teuthology.orchestra.run.smithi177.stdout:generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-02T11:58:34.542 INFO:teuthology.orchestra.run.smithi177.stdout:generic/062 2s 2024-02-02T11:58:37.918 INFO:teuthology.orchestra.run.smithi177.stdout:generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-02T11:58:38.236 INFO:teuthology.orchestra.run.smithi177.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-02T11:58:38.535 INFO:teuthology.orchestra.run.smithi177.stdout:generic/065 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T11:58:38.846 INFO:teuthology.orchestra.run.smithi177.stdout:generic/066 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T11:58:39.174 INFO:teuthology.orchestra.run.smithi177.stdout:generic/067 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T11:58:54.626 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:58:54.629 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:58:54.632 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:59:03.843 INFO:teuthology.orchestra.run.smithi177.stdout:generic/069 24s 2024-02-02T11:59:20.154 INFO:teuthology.orchestra.run.smithi177.stdout:generic/070 17s 2024-02-02T11:59:20.463 INFO:teuthology.orchestra.run.smithi177.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-02T11:59:20.762 INFO:teuthology.orchestra.run.smithi177.stdout:generic/073 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T11:59:24.743 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:59:24.746 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:59:24.749 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:59:54.888 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:59:54.891 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T11:59:54.894 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:00:00.184 INFO:teuthology.orchestra.run.smithi177.stdout:generic/075 40s 2024-02-02T12:00:00.586 INFO:teuthology.orchestra.run.smithi177.stdout:generic/076 [not run] require 172.21.15.161:6789:/scratch to be local device 2024-02-02T12:00:00.894 INFO:teuthology.orchestra.run.smithi177.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-02-02T12:00:01.178 INFO:teuthology.orchestra.run.smithi177.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-02-02T12:00:03.528 INFO:teuthology.orchestra.run.smithi177.stdout:generic/080 2s 2024-02-02T12:00:03.926 INFO:teuthology.orchestra.run.smithi177.stdout:generic/081 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:00:04.216 INFO:teuthology.orchestra.run.smithi177.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:00:10.224 INFO:teuthology.orchestra.run.smithi177.stdout:generic/084 6s 2024-02-02T12:00:10.586 INFO:teuthology.orchestra.run.smithi177.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:00:10.980 INFO:teuthology.orchestra.run.smithi177.stdout:generic/087 0s 2024-02-02T12:00:11.305 INFO:teuthology.orchestra.run.smithi177.stdout:generic/088 0s 2024-02-02T12:00:11.614 INFO:teuthology.orchestra.run.smithi177.stdout:generic/090 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:00:24.957 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:00:24.960 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:00:24.963 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:00:55.046 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:00:55.049 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:00:55.052 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:01:25.136 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:01:25.139 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:01:25.142 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:01:55.196 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:01:55.200 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:01:55.202 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:01:55.221 INFO:tasks.ceph.mds.c.smithi161.stderr:2024-02-02T12:01:55.218+0000 7f9bde098640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37560) UID: 0 2024-02-02T12:01:55.221 INFO:tasks.ceph.mds.a.smithi161.stderr:2024-02-02T12:01:55.218+0000 7f392d34c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37560) UID: 0 2024-02-02T12:02:17.104 INFO:teuthology.orchestra.run.smithi177.stdout:generic/091 126s 2024-02-02T12:02:17.404 INFO:teuthology.orchestra.run.smithi177.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:02:17.769 INFO:teuthology.orchestra.run.smithi177.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-02T12:02:21.978 INFO:teuthology.orchestra.run.smithi177.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-02T12:02:22.612 INFO:teuthology.orchestra.run.smithi177.stdout:generic/097 0s 2024-02-02T12:02:23.704 INFO:teuthology.orchestra.run.smithi177.stdout:generic/098 1s 2024-02-02T12:02:25.217 INFO:teuthology.orchestra.run.smithi177.stdout:generic/099 2s 2024-02-02T12:02:25.534 INFO:teuthology.orchestra.run.smithi177.stdout:generic/101 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:02:25.825 INFO:teuthology.orchestra.run.smithi177.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:02:26.128 INFO:teuthology.orchestra.run.smithi177.stdout:generic/104 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:02:26.882 INFO:teuthology.orchestra.run.smithi177.stdout:generic/105 0s 2024-02-02T12:02:27.249 INFO:teuthology.orchestra.run.smithi177.stdout:generic/106 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:02:27.559 INFO:teuthology.orchestra.run.smithi177.stdout:generic/107 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:02:28.052 INFO:teuthology.orchestra.run.smithi177.stdout:generic/108 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:02:28.390 INFO:teuthology.orchestra.run.smithi177.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:02:28.715 INFO:teuthology.orchestra.run.smithi177.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:03:13.307 INFO:teuthology.orchestra.run.smithi177.stdout:generic/112 45s 2024-02-02T12:04:45.264 INFO:teuthology.orchestra.run.smithi177.stdout:generic/113 92s 2024-02-02T12:04:45.571 INFO:teuthology.orchestra.run.smithi177.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-02-02T12:04:45.882 INFO:teuthology.orchestra.run.smithi177.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:04:46.215 INFO:teuthology.orchestra.run.smithi177.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:04:57.450 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:04:57.454 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:04:57.460 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:04:58.500 INFO:teuthology.orchestra.run.smithi177.stdout:generic/117 12s 2024-02-02T12:04:58.901 INFO:teuthology.orchestra.run.smithi177.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:04:59.227 INFO:teuthology.orchestra.run.smithi177.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:04:59.514 INFO:teuthology.orchestra.run.smithi177.stdout:generic/120 [not run] atime not maintained by ceph 2024-02-02T12:04:59.847 INFO:teuthology.orchestra.run.smithi177.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-02T12:05:00.196 INFO:teuthology.orchestra.run.smithi177.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-02T12:05:00.855 INFO:teuthology.orchestra.run.smithi177.stdout:generic/123 0s 2024-02-02T12:05:27.605 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:05:27.607 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:05:27.609 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:05:37.570 INFO:teuthology.orchestra.run.smithi177.stdout:generic/124 37s 2024-02-02T12:05:38.173 INFO:teuthology.orchestra.run.smithi177.stdout:generic/126 1s 2024-02-02T12:05:39.553 INFO:teuthology.orchestra.run.smithi177.stdout:generic/128 1s 2024-02-02T12:05:39.915 INFO:teuthology.orchestra.run.smithi177.stdout:generic/129 [not run] Sparse files are not supported or do not work as expected 2024-02-02T12:05:40.233 INFO:teuthology.orchestra.run.smithi177.stdout:generic/130 [not run] Sparse files are not supported or do not work as expected 2024-02-02T12:05:41.766 INFO:teuthology.orchestra.run.smithi177.stdout:generic/131 1s 2024-02-02T12:05:42.092 INFO:teuthology.orchestra.run.smithi177.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:43.327 INFO:teuthology.orchestra.run.smithi177.stdout:generic/135 1s 2024-02-02T12:05:43.746 INFO:teuthology.orchestra.run.smithi177.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-02T12:05:44.087 INFO:teuthology.orchestra.run.smithi177.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:44.405 INFO:teuthology.orchestra.run.smithi177.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:44.728 INFO:teuthology.orchestra.run.smithi177.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:46.341 INFO:teuthology.orchestra.run.smithi177.stdout:generic/141 2s 2024-02-02T12:05:46.761 INFO:teuthology.orchestra.run.smithi177.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:47.098 INFO:teuthology.orchestra.run.smithi177.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:47.412 INFO:teuthology.orchestra.run.smithi177.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:47.746 INFO:teuthology.orchestra.run.smithi177.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:48.073 INFO:teuthology.orchestra.run.smithi177.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:48.399 INFO:teuthology.orchestra.run.smithi177.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:48.721 INFO:teuthology.orchestra.run.smithi177.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:49.040 INFO:teuthology.orchestra.run.smithi177.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:49.343 INFO:teuthology.orchestra.run.smithi177.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:49.683 INFO:teuthology.orchestra.run.smithi177.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:50.028 INFO:teuthology.orchestra.run.smithi177.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:50.352 INFO:teuthology.orchestra.run.smithi177.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:50.670 INFO:teuthology.orchestra.run.smithi177.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:51.007 INFO:teuthology.orchestra.run.smithi177.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:51.321 INFO:teuthology.orchestra.run.smithi177.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:51.642 INFO:teuthology.orchestra.run.smithi177.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:05:51.967 INFO:teuthology.orchestra.run.smithi177.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-02T12:05:52.258 INFO:teuthology.orchestra.run.smithi177.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-02-02T12:05:52.587 INFO:teuthology.orchestra.run.smithi177.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-02-02T12:05:53.210 INFO:teuthology.orchestra.run.smithi177.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:05:53.672 INFO:teuthology.orchestra.run.smithi177.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-02-02T12:05:54.280 INFO:teuthology.orchestra.run.smithi177.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-02-02T12:05:55.375 INFO:teuthology.orchestra.run.smithi177.stdout:generic/169 1s 2024-02-02T12:05:56.050 INFO:teuthology.orchestra.run.smithi177.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:05:56.611 INFO:teuthology.orchestra.run.smithi177.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:05:57.236 INFO:teuthology.orchestra.run.smithi177.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:05:57.685 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:05:57.688 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:05:57.690 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:05:57.784 INFO:teuthology.orchestra.run.smithi177.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:06:04.316 INFO:teuthology.orchestra.run.smithi177.stdout:generic/177 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-02T12:06:04.647 INFO:teuthology.orchestra.run.smithi177.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:06:04.984 INFO:teuthology.orchestra.run.smithi177.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:06:05.308 INFO:teuthology.orchestra.run.smithi177.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:06:05.646 INFO:teuthology.orchestra.run.smithi177.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:06:05.977 INFO:teuthology.orchestra.run.smithi177.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-02T12:06:06.610 INFO:teuthology.orchestra.run.smithi177.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:06:06.951 INFO:teuthology.orchestra.run.smithi177.stdout:generic/184 0s 2024-02-02T12:06:07.662 INFO:teuthology.orchestra.run.smithi177.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:06:08.265 INFO:teuthology.orchestra.run.smithi177.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:06:08.960 INFO:teuthology.orchestra.run.smithi177.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:06:09.609 INFO:teuthology.orchestra.run.smithi177.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:06:10.233 INFO:teuthology.orchestra.run.smithi177.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:06:11.596 INFO:teuthology.orchestra.run.smithi177.stdout:generic/193 1s 2024-02-02T12:06:12.220 INFO:teuthology.orchestra.run.smithi177.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:06:12.860 INFO:teuthology.orchestra.run.smithi177.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:06:13.505 INFO:teuthology.orchestra.run.smithi177.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:06:14.070 INFO:teuthology.orchestra.run.smithi177.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:06:27.809 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:06:27.811 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:06:27.813 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:06:44.557 INFO:teuthology.orchestra.run.smithi177.stdout:generic/198 30s 2024-02-02T12:06:45.173 INFO:teuthology.orchestra.run.smithi177.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:06:45.786 INFO:teuthology.orchestra.run.smithi177.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:06:46.482 INFO:teuthology.orchestra.run.smithi177.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:06:47.069 INFO:teuthology.orchestra.run.smithi177.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:06:47.709 INFO:teuthology.orchestra.run.smithi177.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:06:48.350 INFO:teuthology.orchestra.run.smithi177.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:06:48.997 INFO:teuthology.orchestra.run.smithi177.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:06:57.863 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:06:57.866 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:06:57.868 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:07:13.234 INFO:teuthology.orchestra.run.smithi177.stdout:generic/207 24s 2024-02-02T12:07:13.695 INFO:teuthology.orchestra.run.smithi177.stdout:generic/210 0s 2024-02-02T12:07:14.480 INFO:teuthology.orchestra.run.smithi177.stdout:generic/211 1s 2024-02-02T12:07:14.906 INFO:teuthology.orchestra.run.smithi177.stdout:generic/212 0s 2024-02-02T12:07:15.212 INFO:teuthology.orchestra.run.smithi177.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:07:15.533 INFO:teuthology.orchestra.run.smithi177.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:07:17.934 INFO:teuthology.orchestra.run.smithi177.stdout:generic/215 2s 2024-02-02T12:07:18.671 INFO:teuthology.orchestra.run.smithi177.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:07:19.369 INFO:teuthology.orchestra.run.smithi177.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:07:19.989 INFO:teuthology.orchestra.run.smithi177.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:07:20.259 INFO:teuthology.orchestra.run.smithi177.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:07:20.935 INFO:teuthology.orchestra.run.smithi177.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:07:22.253 INFO:teuthology.orchestra.run.smithi177.stdout:generic/221 2s 2024-02-02T12:07:22.952 INFO:teuthology.orchestra.run.smithi177.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:07:23.247 INFO:teuthology.orchestra.run.smithi177.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:07:23.622 INFO:teuthology.orchestra.run.smithi177.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-02T12:07:24.240 INFO:teuthology.orchestra.run.smithi177.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:07:24.536 INFO:teuthology.orchestra.run.smithi177.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:07:25.155 INFO:teuthology.orchestra.run.smithi177.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:07:25.451 INFO:teuthology.orchestra.run.smithi177.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:07:25.762 INFO:teuthology.orchestra.run.smithi177.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:07:27.174 INFO:teuthology.orchestra.run.smithi177.stdout:generic/236 2s 2024-02-02T12:07:27.596 INFO:teuthology.orchestra.run.smithi177.stdout:generic/237 0s 2024-02-02T12:07:27.977 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:07:27.980 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:07:27.982 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:07:28.226 INFO:teuthology.orchestra.run.smithi177.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:07:28.543 INFO:teuthology.orchestra.run.smithi177.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-02-02T12:07:28.814 INFO:teuthology.orchestra.run.smithi177.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:07:29.228 INFO:teuthology.orchestra.run.smithi177.stdout:generic/245 1s 2024-02-02T12:07:29.540 INFO:teuthology.orchestra.run.smithi177.stdout:generic/246 0s 2024-02-02T12:07:58.080 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:07:58.083 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:07:58.085 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:08:28.492 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:08:28.495 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:08:28.497 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:08:58.796 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:08:58.798 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:08:58.800 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:09:28.852 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:09:28.855 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:09:28.857 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:09:59.186 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:09:59.189 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:09:59.192 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:10:29.350 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:10:29.352 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:10:29.354 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:10:59.434 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:10:59.436 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:10:59.438 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:11:29.754 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:11:29.757 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:11:29.759 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:12:00.033 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:12:00.036 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:12:00.038 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:12:30.134 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:12:30.137 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:12:30.139 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:12:53.719 INFO:teuthology.orchestra.run.smithi177.stdout:generic/247 324s 2024-02-02T12:12:54.094 INFO:teuthology.orchestra.run.smithi177.stdout:generic/248 1s 2024-02-02T12:13:00.213 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:13:00.216 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:13:00.218 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:13:26.106 INFO:teuthology.orchestra.run.smithi177.stdout:generic/249 32s 2024-02-02T12:13:26.410 INFO:teuthology.orchestra.run.smithi177.stdout:generic/250 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:13:26.726 INFO:teuthology.orchestra.run.smithi177.stdout:generic/252 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:13:27.323 INFO:teuthology.orchestra.run.smithi177.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:13:27.886 INFO:teuthology.orchestra.run.smithi177.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:13:30.485 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:13:30.488 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:13:30.490 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:13:35.533 INFO:teuthology.orchestra.run.smithi177.stdout:generic/255 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-02T12:13:44.087 INFO:teuthology.orchestra.run.smithi177.stdout:generic/256 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-02T12:13:45.292 INFO:teuthology.orchestra.run.smithi177.stdout:generic/257 1s 2024-02-02T12:13:45.565 INFO:teuthology.orchestra.run.smithi177.stdout:generic/258 [not run] ceph does not support negative timestamps 2024-02-02T12:13:46.274 INFO:teuthology.orchestra.run.smithi177.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:13:46.675 INFO:teuthology.orchestra.run.smithi177.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.jtqH6Jn1Mhscratch 2024-02-02T12:13:47.291 INFO:teuthology.orchestra.run.smithi177.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:13:47.851 INFO:teuthology.orchestra.run.smithi177.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:14:00.617 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:14:00.620 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:14:00.623 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:14:30.755 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:14:30.758 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:14:30.760 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:15:00.894 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:15:00.896 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:15:00.899 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:15:31.031 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:15:31.035 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:15:31.037 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:15:57.068 INFO:teuthology.orchestra.run.smithi177.stdout:generic/263 130s 2024-02-02T12:15:57.877 INFO:teuthology.orchestra.run.smithi177.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:15:58.606 INFO:teuthology.orchestra.run.smithi177.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:15:59.306 INFO:teuthology.orchestra.run.smithi177.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:15:59.986 INFO:teuthology.orchestra.run.smithi177.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:00.610 INFO:teuthology.orchestra.run.smithi177.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:01.164 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:16:01.170 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:16:01.174 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:16:01.237 INFO:teuthology.orchestra.run.smithi177.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:01.878 INFO:teuthology.orchestra.run.smithi177.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:02.584 INFO:teuthology.orchestra.run.smithi177.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:02.885 INFO:teuthology.orchestra.run.smithi177.stdout:generic/277 [not run] file system doesn't support chattr +A 2024-02-02T12:16:03.622 INFO:teuthology.orchestra.run.smithi177.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:04.264 INFO:teuthology.orchestra.run.smithi177.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:04.922 INFO:teuthology.orchestra.run.smithi177.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:05.549 INFO:teuthology.orchestra.run.smithi177.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:06.218 INFO:teuthology.orchestra.run.smithi177.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:06.814 INFO:teuthology.orchestra.run.smithi177.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:07.115 INFO:teuthology.orchestra.run.smithi177.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:16:07.727 INFO:teuthology.orchestra.run.smithi177.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:08.184 INFO:teuthology.orchestra.run.smithi177.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.jtqH6Jn1Mhscratch 2024-02-02T12:16:08.799 INFO:teuthology.orchestra.run.smithi177.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:09.409 INFO:teuthology.orchestra.run.smithi177.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:10.087 INFO:teuthology.orchestra.run.smithi177.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:10.710 INFO:teuthology.orchestra.run.smithi177.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:11.361 INFO:teuthology.orchestra.run.smithi177.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:12.117 INFO:teuthology.orchestra.run.smithi177.stdout:generic/294 1s 2024-02-02T12:16:12.902 INFO:teuthology.orchestra.run.smithi177.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:13.493 INFO:teuthology.orchestra.run.smithi177.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:14.104 INFO:teuthology.orchestra.run.smithi177.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:14.682 INFO:teuthology.orchestra.run.smithi177.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:15.052 INFO:teuthology.orchestra.run.smithi177.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:16:15.407 INFO:teuthology.orchestra.run.smithi177.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-02T12:16:16.040 INFO:teuthology.orchestra.run.smithi177.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:16.908 INFO:teuthology.orchestra.run.smithi177.stdout:generic/306 0s 2024-02-02T12:16:19.014 INFO:teuthology.orchestra.run.smithi177.stdout:generic/307 3s 2024-02-02T12:16:19.406 INFO:teuthology.orchestra.run.smithi177.stdout:generic/308 0s 2024-02-02T12:16:20.774 INFO:teuthology.orchestra.run.smithi177.stdout:generic/309 1s 2024-02-02T12:16:21.050 INFO:teuthology.orchestra.run.smithi177.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:16:25.434 INFO:teuthology.orchestra.run.smithi177.stdout:generic/313 4s 2024-02-02T12:16:26.057 INFO:teuthology.orchestra.run.smithi177.stdout:generic/314 1s 2024-02-02T12:16:26.345 INFO:teuthology.orchestra.run.smithi177.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-02T12:16:31.275 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:16:31.278 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:16:31.280 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:16:37.788 INFO:teuthology.orchestra.run.smithi177.stdout:generic/316 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-02T12:16:39.044 INFO:teuthology.orchestra.run.smithi177.stdout:generic/317 - output mismatch (see /tmp/tmp.ByhSz7TqB0xfstests-dev/results//generic/317.out.bad) 2024-02-02T12:16:39.050 INFO:teuthology.orchestra.run.smithi177.stdout: --- tests/generic/317.out 2024-02-02 11:49:43.228570640 +0000 2024-02-02T12:16:39.050 INFO:teuthology.orchestra.run.smithi177.stdout: +++ /tmp/tmp.ByhSz7TqB0xfstests-dev/results//generic/317.out.bad 2024-02-02 12:16:39.042157447 +0000 2024-02-02T12:16:39.050 INFO:teuthology.orchestra.run.smithi177.stdout: @@ -4,9 +4,7 @@ 2024-02-02T12:16:39.050 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 0 Filetype: Regular File 2024-02-02T12:16:39.050 INFO:teuthology.orchestra.run.smithi177.stdout: Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) 2024-02-02T12:16:39.050 INFO:teuthology.orchestra.run.smithi177.stdout: From user_ns 2024-02-02T12:16:39.050 INFO:teuthology.orchestra.run.smithi177.stdout: - File: "$SCRATCH_MNT/file1" 2024-02-02T12:16:39.050 INFO:teuthology.orchestra.run.smithi177.stdout: - Size: 0 Filetype: Regular File 2024-02-02T12:16:39.050 INFO:teuthology.orchestra.run.smithi177.stdout: - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) 2024-02-02T12:16:39.050 INFO:teuthology.orchestra.run.smithi177.stdout: +execvp: Permission denied 2024-02-02T12:16:39.050 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T12:16:39.050 INFO:teuthology.orchestra.run.smithi177.stdout: *** Remounting *** 2024-02-02T12:16:39.051 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T12:16:39.051 INFO:teuthology.orchestra.run.smithi177.stdout: @@ -15,6 +13,4 @@ 2024-02-02T12:16:39.051 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 0 Filetype: Regular File 2024-02-02T12:16:39.051 INFO:teuthology.orchestra.run.smithi177.stdout: Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) 2024-02-02T12:16:39.051 INFO:teuthology.orchestra.run.smithi177.stdout: From user_ns 2024-02-02T12:16:39.051 INFO:teuthology.orchestra.run.smithi177.stdout: - File: "$SCRATCH_MNT/file1" 2024-02-02T12:16:39.051 INFO:teuthology.orchestra.run.smithi177.stdout: - Size: 0 Filetype: Regular File 2024-02-02T12:16:39.051 INFO:teuthology.orchestra.run.smithi177.stdout: - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) 2024-02-02T12:16:39.051 INFO:teuthology.orchestra.run.smithi177.stdout: +execvp: Permission denied 2024-02-02T12:16:39.893 INFO:teuthology.orchestra.run.smithi177.stdout:generic/318 0s 2024-02-02T12:16:40.461 INFO:teuthology.orchestra.run.smithi177.stdout:generic/319 1s 2024-02-02T12:16:40.799 INFO:teuthology.orchestra.run.smithi177.stdout:generic/321 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:16:41.131 INFO:teuthology.orchestra.run.smithi177.stdout:generic/322 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:16:41.430 INFO:teuthology.orchestra.run.smithi177.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2024-02-02T12:16:41.739 INFO:teuthology.orchestra.run.smithi177.stdout:generic/325 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:16:42.358 INFO:teuthology.orchestra.run.smithi177.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:43.101 INFO:teuthology.orchestra.run.smithi177.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:43.867 INFO:teuthology.orchestra.run.smithi177.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:44.471 INFO:teuthology.orchestra.run.smithi177.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:45.179 INFO:teuthology.orchestra.run.smithi177.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:45.874 INFO:teuthology.orchestra.run.smithi177.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:46.571 INFO:teuthology.orchestra.run.smithi177.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:16:46.887 INFO:teuthology.orchestra.run.smithi177.stdout:generic/335 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:16:47.228 INFO:teuthology.orchestra.run.smithi177.stdout:generic/336 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:16:47.916 INFO:teuthology.orchestra.run.smithi177.stdout:generic/337 0s 2024-02-02T12:16:48.270 INFO:teuthology.orchestra.run.smithi177.stdout:generic/338 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:16:48.596 INFO:teuthology.orchestra.run.smithi177.stdout:generic/341 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:16:48.908 INFO:teuthology.orchestra.run.smithi177.stdout:generic/342 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:16:49.240 INFO:teuthology.orchestra.run.smithi177.stdout:generic/343 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:17:01.407 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:17:01.410 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:17:01.412 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:17:31.572 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:17:31.574 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:17:31.576 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:18:01.669 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:18:01.672 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:18:01.674 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:18:31.794 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:18:31.797 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:18:31.799 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:19:01.881 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:19:01.884 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:19:01.886 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:19:32.027 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:19:32.030 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:19:32.032 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:20:02.325 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:20:02.328 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:20:02.330 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:20:23.524 INFO:teuthology.orchestra.run.smithi177.stdout:generic/346 214s 2024-02-02T12:20:23.903 INFO:teuthology.orchestra.run.smithi177.stdout:generic/347 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:20:24.221 INFO:teuthology.orchestra.run.smithi177.stdout:generic/348 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:20:24.795 INFO:teuthology.orchestra.run.smithi177.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:20:25.712 INFO:teuthology.orchestra.run.smithi177.stdout:generic/355 1s 2024-02-02T12:20:26.274 INFO:teuthology.orchestra.run.smithi177.stdout:generic/356 [not run] swapfiles are not supported 2024-02-02T12:20:26.816 INFO:teuthology.orchestra.run.smithi177.stdout:generic/357 [not run] swapfiles are not supported 2024-02-02T12:20:27.556 INFO:teuthology.orchestra.run.smithi177.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:20:28.160 INFO:teuthology.orchestra.run.smithi177.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:20:28.506 INFO:teuthology.orchestra.run.smithi177.stdout:generic/360 0s 2024-02-02T12:20:28.858 INFO:teuthology.orchestra.run.smithi177.stdout:generic/361 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:20:29.148 INFO:teuthology.orchestra.run.smithi177.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-02T12:20:29.421 INFO:teuthology.orchestra.run.smithi177.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-02T12:20:29.692 INFO:teuthology.orchestra.run.smithi177.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-02T12:20:29.963 INFO:teuthology.orchestra.run.smithi177.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-02T12:20:30.233 INFO:teuthology.orchestra.run.smithi177.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-02T12:20:30.508 INFO:teuthology.orchestra.run.smithi177.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-02T12:20:30.792 INFO:teuthology.orchestra.run.smithi177.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-02T12:20:31.053 INFO:teuthology.orchestra.run.smithi177.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-02T12:20:31.326 INFO:teuthology.orchestra.run.smithi177.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-02T12:20:31.626 INFO:teuthology.orchestra.run.smithi177.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:20:32.254 INFO:teuthology.orchestra.run.smithi177.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:20:32.534 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:20:32.536 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:20:32.538 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:20:32.859 INFO:teuthology.orchestra.run.smithi177.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:20:33.332 INFO:teuthology.orchestra.run.smithi177.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-02-02T12:20:33.941 INFO:teuthology.orchestra.run.smithi177.stdout:generic/375 0s 2024-02-02T12:20:34.239 INFO:teuthology.orchestra.run.smithi177.stdout:generic/376 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:20:34.990 INFO:teuthology.orchestra.run.smithi177.stdout:generic/377 0s 2024-02-02T12:20:35.549 INFO:teuthology.orchestra.run.smithi177.stdout:generic/378 0s 2024-02-02T12:20:35.827 INFO:teuthology.orchestra.run.smithi177.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:20:36.127 INFO:teuthology.orchestra.run.smithi177.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:20:36.427 INFO:teuthology.orchestra.run.smithi177.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:20:36.716 INFO:teuthology.orchestra.run.smithi177.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:20:37.015 INFO:teuthology.orchestra.run.smithi177.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:20:37.323 INFO:teuthology.orchestra.run.smithi177.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:20:37.597 INFO:teuthology.orchestra.run.smithi177.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:20:37.870 INFO:teuthology.orchestra.run.smithi177.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:20:38.159 INFO:teuthology.orchestra.run.smithi177.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-02-02T12:20:38.481 INFO:teuthology.orchestra.run.smithi177.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:20:38.882 INFO:teuthology.orchestra.run.smithi177.stdout:generic/392 [not run] ceph does not support shutdown 2024-02-02T12:20:40.150 INFO:teuthology.orchestra.run.smithi177.stdout:generic/393 2s 2024-02-02T12:20:40.557 INFO:teuthology.orchestra.run.smithi177.stdout:generic/394 0s 2024-02-02T12:20:40.931 INFO:teuthology.orchestra.run.smithi177.stdout:generic/395 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:20:41.297 INFO:teuthology.orchestra.run.smithi177.stdout:generic/396 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:20:41.692 INFO:teuthology.orchestra.run.smithi177.stdout:generic/397 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:20:42.084 INFO:teuthology.orchestra.run.smithi177.stdout:generic/398 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:20:42.349 INFO:teuthology.orchestra.run.smithi177.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:20:43.137 INFO:teuthology.orchestra.run.smithi177.stdout:generic/401 1s 2024-02-02T12:20:43.665 INFO:teuthology.orchestra.run.smithi177.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2024-02-02T12:20:44.782 INFO:teuthology.orchestra.run.smithi177.stdout:generic/403 1s 2024-02-02T12:20:45.132 INFO:teuthology.orchestra.run.smithi177.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:20:47.862 INFO:teuthology.orchestra.run.smithi177.stdout:generic/406 2s 2024-02-02T12:20:48.281 INFO:teuthology.orchestra.run.smithi177.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:20:48.636 INFO:teuthology.orchestra.run.smithi177.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-02T12:20:48.950 INFO:teuthology.orchestra.run.smithi177.stdout:generic/409 [not run] require 172.21.15.161:6789:/scratch to be local device 2024-02-02T12:20:49.244 INFO:teuthology.orchestra.run.smithi177.stdout:generic/410 [not run] require 172.21.15.161:6789:/scratch to be local device 2024-02-02T12:20:49.565 INFO:teuthology.orchestra.run.smithi177.stdout:generic/411 [not run] require 172.21.15.161:6789:/scratch to be local device 2024-02-02T12:20:50.653 INFO:teuthology.orchestra.run.smithi177.stdout:generic/412 1s 2024-02-02T12:20:51.107 INFO:teuthology.orchestra.run.smithi177.stdout:generic/413 [not run] mount 172.21.15.161:6789:/scratch with dax failed 2024-02-02T12:20:51.733 INFO:teuthology.orchestra.run.smithi177.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:20:52.121 INFO:teuthology.orchestra.run.smithi177.stdout:generic/417 [not run] ceph does not support shutdown 2024-02-02T12:20:52.493 INFO:teuthology.orchestra.run.smithi177.stdout:generic/419 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:21:02.597 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:21:02.600 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:21:02.603 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:21:02.875 INFO:teuthology.orchestra.run.smithi177.stdout:generic/420 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-02T12:21:03.252 INFO:teuthology.orchestra.run.smithi177.stdout:generic/421 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:21:03.569 INFO:teuthology.orchestra.run.smithi177.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-02T12:21:04.058 INFO:teuthology.orchestra.run.smithi177.stdout:generic/423 1s 2024-02-02T12:21:04.365 INFO:teuthology.orchestra.run.smithi177.stdout:generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i 2024-02-02T12:21:04.738 INFO:teuthology.orchestra.run.smithi177.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2024-02-02T12:21:32.717 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:21:32.719 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:21:32.722 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:21:36.988 INFO:teuthology.orchestra.run.smithi177.stdout:generic/426 32s 2024-02-02T12:21:37.965 INFO:teuthology.orchestra.run.smithi177.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-02T12:21:38.312 INFO:teuthology.orchestra.run.smithi177.stdout:generic/428 1s 2024-02-02T12:21:38.771 INFO:teuthology.orchestra.run.smithi177.stdout:generic/430 0s 2024-02-02T12:21:39.194 INFO:teuthology.orchestra.run.smithi177.stdout:generic/431 1s 2024-02-02T12:21:39.644 INFO:teuthology.orchestra.run.smithi177.stdout:generic/432 0s 2024-02-02T12:21:40.051 INFO:teuthology.orchestra.run.smithi177.stdout:generic/433 1s 2024-02-02T12:21:40.507 INFO:teuthology.orchestra.run.smithi177.stdout:generic/434 0s 2024-02-02T12:21:41.217 INFO:teuthology.orchestra.run.smithi177.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:21:42.301 INFO:teuthology.orchestra.run.smithi177.stdout:generic/437 1s 2024-02-02T12:21:53.156 INFO:teuthology.orchestra.run.smithi177.stdout:generic/439 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-02T12:21:53.539 INFO:teuthology.orchestra.run.smithi177.stdout:generic/440 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:21:53.868 INFO:teuthology.orchestra.run.smithi177.stdout:generic/441 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:21:54.193 INFO:teuthology.orchestra.run.smithi177.stdout:generic/443 1s 2024-02-02T12:21:54.626 INFO:teuthology.orchestra.run.smithi177.stdout:generic/444 0s 2024-02-02T12:21:55.314 INFO:teuthology.orchestra.run.smithi177.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:22:03.598 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:22:03.601 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:22:03.603 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:22:09.237 INFO:teuthology.orchestra.run.smithi177.stdout:generic/446 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-02T12:22:10.362 INFO:teuthology.orchestra.run.smithi177.stdout:generic/448 1s 2024-02-02T12:22:10.720 INFO:teuthology.orchestra.run.smithi177.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-02T12:22:17.631 INFO:teuthology.orchestra.run.smithi177.stdout:generic/450 7s 2024-02-02T12:22:34.164 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:22:34.168 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:22:34.170 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:22:48.179 INFO:teuthology.orchestra.run.smithi177.stdout:generic/451 31s 2024-02-02T12:22:49.739 INFO:teuthology.orchestra.run.smithi177.stdout:generic/452 1s 2024-02-02T12:22:50.055 INFO:teuthology.orchestra.run.smithi177.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2024-02-02T12:22:50.380 INFO:teuthology.orchestra.run.smithi177.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2024-02-02T12:22:50.722 INFO:teuthology.orchestra.run.smithi177.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:22:51.374 INFO:teuthology.orchestra.run.smithi177.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:23:04.221 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:23:04.224 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:23:04.226 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:23:34.373 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:23:34.376 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:23:34.378 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:24:04.771 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:24:04.774 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:24:04.776 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:24:34.853 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:24:34.856 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:24:34.858 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:25:05.183 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:25:05.186 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:25:05.188 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:25:35.385 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:25:35.387 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:25:35.390 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:26:05.704 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:26:05.706 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:26:05.708 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:26:35.766 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:26:35.768 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:26:35.770 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:27:05.931 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:27:05.941 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:27:05.943 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:27:17.078 INFO:teuthology.orchestra.run.smithi177.stdout:generic/460 265s 2024-02-02T12:27:17.527 INFO:teuthology.orchestra.run.smithi177.stdout:generic/462 [not run] mount 172.21.15.161:6789:/scratch with dax failed 2024-02-02T12:27:17.908 INFO:teuthology.orchestra.run.smithi177.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:27:24.368 INFO:teuthology.orchestra.run.smithi177.stdout:generic/465 7s 2024-02-02T12:27:24.679 INFO:teuthology.orchestra.run.smithi177.stdout:generic/466 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:27:28.110 INFO:teuthology.orchestra.run.smithi177.stdout:generic/467 4s 2024-02-02T12:27:29.660 INFO:teuthology.orchestra.run.smithi177.stdout:generic/468 [not run] ceph does not support shutdown 2024-02-02T12:27:29.990 INFO:teuthology.orchestra.run.smithi177.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-02T12:27:30.335 INFO:teuthology.orchestra.run.smithi177.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2024-02-02T12:27:36.140 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:27:36.144 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:27:36.147 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:28:06.786 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:28:06.841 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:28:06.844 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:28:27.466 INFO:teuthology.orchestra.run.smithi177.stdout:generic/471 57s 2024-02-02T12:28:28.333 INFO:teuthology.orchestra.run.smithi177.stdout:generic/472 [not run] swapfiles are not supported 2024-02-02T12:28:28.736 INFO:teuthology.orchestra.run.smithi177.stdout:generic/474 [not run] ceph does not support shutdown 2024-02-02T12:28:35.738 INFO:teuthology.orchestra.run.smithi177.stdout:generic/477 7s 2024-02-02T12:28:37.177 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:28:37.181 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:28:37.183 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:28:47.171 INFO:teuthology.orchestra.run.smithi177.stdout:generic/478 12s 2024-02-02T12:28:47.543 INFO:teuthology.orchestra.run.smithi177.stdout:generic/479 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:28:47.877 INFO:teuthology.orchestra.run.smithi177.stdout:generic/480 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:28:48.194 INFO:teuthology.orchestra.run.smithi177.stdout:generic/481 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:28:48.482 INFO:teuthology.orchestra.run.smithi177.stdout:generic/483 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:28:48.813 INFO:teuthology.orchestra.run.smithi177.stdout:generic/484 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:28:49.153 INFO:teuthology.orchestra.run.smithi177.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-02T12:28:50.661 INFO:teuthology.orchestra.run.smithi177.stdout:generic/486 1s 2024-02-02T12:28:51.025 INFO:teuthology.orchestra.run.smithi177.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2024-02-02T12:28:51.339 INFO:teuthology.orchestra.run.smithi177.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-02T12:28:51.682 INFO:teuthology.orchestra.run.smithi177.stdout:generic/489 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:28:52.651 INFO:teuthology.orchestra.run.smithi177.stdout:generic/490 1s 2024-02-02T12:28:52.979 INFO:teuthology.orchestra.run.smithi177.stdout:generic/491 [not run] ceph does not support freezing 2024-02-02T12:28:53.299 INFO:teuthology.orchestra.run.smithi177.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2024-02-02T12:28:53.916 INFO:teuthology.orchestra.run.smithi177.stdout:generic/493 [not run] swapfiles are not supported 2024-02-02T12:28:54.474 INFO:teuthology.orchestra.run.smithi177.stdout:generic/494 [not run] swapfiles are not supported 2024-02-02T12:28:55.027 INFO:teuthology.orchestra.run.smithi177.stdout:generic/495 [not run] swapfiles are not supported 2024-02-02T12:28:55.604 INFO:teuthology.orchestra.run.smithi177.stdout:generic/496 [not run] swapfiles are not supported 2024-02-02T12:28:56.184 INFO:teuthology.orchestra.run.smithi177.stdout:generic/497 [not run] swapfiles are not supported 2024-02-02T12:28:56.506 INFO:teuthology.orchestra.run.smithi177.stdout:generic/498 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:28:56.797 INFO:teuthology.orchestra.run.smithi177.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-02T12:28:57.563 INFO:teuthology.orchestra.run.smithi177.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:28:57.879 INFO:teuthology.orchestra.run.smithi177.stdout:generic/502 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:28:58.206 INFO:teuthology.orchestra.run.smithi177.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:28:58.600 INFO:teuthology.orchestra.run.smithi177.stdout:generic/504 0s 2024-02-02T12:28:59.023 INFO:teuthology.orchestra.run.smithi177.stdout:generic/505 [not run] ceph does not support shutdown 2024-02-02T12:28:59.326 INFO:teuthology.orchestra.run.smithi177.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:28:59.639 INFO:teuthology.orchestra.run.smithi177.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-02-02T12:28:59.905 INFO:teuthology.orchestra.run.smithi177.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2024-02-02T12:29:00.223 INFO:teuthology.orchestra.run.smithi177.stdout:generic/509 [not run] O_TMPFILE is not supported 2024-02-02T12:29:00.526 INFO:teuthology.orchestra.run.smithi177.stdout:generic/510 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:29:00.819 INFO:teuthology.orchestra.run.smithi177.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-02T12:29:01.150 INFO:teuthology.orchestra.run.smithi177.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:29:01.901 INFO:teuthology.orchestra.run.smithi177.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:29:02.490 INFO:teuthology.orchestra.run.smithi177.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:29:03.085 INFO:teuthology.orchestra.run.smithi177.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:29:03.417 INFO:teuthology.orchestra.run.smithi177.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-02T12:29:03.886 INFO:teuthology.orchestra.run.smithi177.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-02-02T12:29:04.685 INFO:teuthology.orchestra.run.smithi177.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:29:05.006 INFO:teuthology.orchestra.run.smithi177.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2024-02-02T12:29:05.300 INFO:teuthology.orchestra.run.smithi177.stdout:generic/520 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:29:06.001 INFO:teuthology.orchestra.run.smithi177.stdout:generic/523 0s 2024-02-02T12:29:07.711 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:29:07.713 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:29:07.715 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:29:37.804 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:29:37.806 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:29:37.881 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:30:08.057 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:30:08.060 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:30:08.081 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:30:38.236 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:30:38.239 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:30:38.309 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:31:08.565 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:31:08.568 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:31:08.570 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:31:38.631 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:31:38.634 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:31:38.635 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:31:42.333 INFO:teuthology.orchestra.run.smithi177.stdout:generic/524 156s 2024-02-02T12:31:42.829 INFO:teuthology.orchestra.run.smithi177.stdout:generic/525 [not run] filesystem does not support huge file size 2024-02-02T12:31:43.154 INFO:teuthology.orchestra.run.smithi177.stdout:generic/526 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:31:43.494 INFO:teuthology.orchestra.run.smithi177.stdout:generic/527 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:31:43.892 INFO:teuthology.orchestra.run.smithi177.stdout:generic/528 0s 2024-02-02T12:31:44.770 INFO:teuthology.orchestra.run.smithi177.stdout:generic/529 1s 2024-02-02T12:31:45.203 INFO:teuthology.orchestra.run.smithi177.stdout:generic/530 [not run] ceph does not support shutdown 2024-02-02T12:31:45.512 INFO:teuthology.orchestra.run.smithi177.stdout:generic/531 [not run] O_TMPFILE is not supported 2024-02-02T12:31:45.872 INFO:teuthology.orchestra.run.smithi177.stdout:generic/532 0s 2024-02-02T12:31:46.713 INFO:teuthology.orchestra.run.smithi177.stdout:generic/533 1s 2024-02-02T12:31:47.015 INFO:teuthology.orchestra.run.smithi177.stdout:generic/534 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:31:47.312 INFO:teuthology.orchestra.run.smithi177.stdout:generic/535 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:31:47.707 INFO:teuthology.orchestra.run.smithi177.stdout:generic/536 [not run] ceph does not support shutdown 2024-02-02T12:31:48.118 INFO:teuthology.orchestra.run.smithi177.stdout:generic/537 [not run] FSTRIM not supported 2024-02-02T12:32:08.786 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:32:08.839 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:32:08.841 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:32:38.930 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:32:39.031 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:32:39.034 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:33:09.093 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:33:09.096 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:33:09.099 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:33:39.197 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:33:39.221 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:33:39.223 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:34:09.285 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:34:09.288 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:34:09.290 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:34:39.430 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:34:39.433 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:34:39.436 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:35:09.524 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:35:09.528 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:35:09.531 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:35:39.804 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:35:39.807 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:35:39.809 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:36:09.948 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:36:09.952 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:36:09.954 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:36:40.069 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:36:40.072 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:36:40.075 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:37:10.400 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:37:10.403 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:37:10.406 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:37:40.512 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:37:40.515 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:37:40.518 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:38:10.661 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:38:10.664 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:38:10.667 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:38:40.770 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:38:40.773 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:38:40.776 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:39:10.927 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:39:10.931 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:39:10.934 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:39:41.079 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:39:41.083 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:39:41.086 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:40:11.386 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:40:11.389 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:40:11.393 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:40:41.503 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:40:41.506 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:40:41.509 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:41:11.648 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:41:11.652 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:41:11.666 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:41:41.717 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:41:41.721 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:41:41.787 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:42:11.854 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:42:11.857 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:42:11.861 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:42:41.980 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:42:41.984 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:42:41.986 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:43:12.054 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:43:12.057 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:43:12.059 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:43:42.173 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:43:42.176 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:43:42.178 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:44:12.237 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:44:12.240 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:44:12.242 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:44:42.376 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:44:42.379 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:44:42.382 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:45:12.447 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:45:12.451 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:45:12.453 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:45:42.528 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:45:42.531 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:45:42.534 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:46:12.659 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:46:12.663 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:46:12.666 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:46:42.932 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:46:42.935 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:46:42.938 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:47:00.050 INFO:teuthology.orchestra.run.smithi177.stdout:generic/538 912s 2024-02-02T12:47:12.994 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:47:12.997 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:47:13.000 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:47:14.288 INFO:teuthology.orchestra.run.smithi177.stdout:generic/539 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-02T12:47:15.046 INFO:teuthology.orchestra.run.smithi177.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:47:15.758 INFO:teuthology.orchestra.run.smithi177.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:47:16.401 INFO:teuthology.orchestra.run.smithi177.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:47:16.955 INFO:teuthology.orchestra.run.smithi177.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:47:17.536 INFO:teuthology.orchestra.run.smithi177.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:47:17.863 INFO:teuthology.orchestra.run.smithi177.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-02-02T12:47:18.173 INFO:teuthology.orchestra.run.smithi177.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:47:18.490 INFO:teuthology.orchestra.run.smithi177.stdout:generic/547 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:47:18.876 INFO:teuthology.orchestra.run.smithi177.stdout:generic/548 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:47:19.268 INFO:teuthology.orchestra.run.smithi177.stdout:generic/549 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:47:19.651 INFO:teuthology.orchestra.run.smithi177.stdout:generic/550 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:47:20.033 INFO:teuthology.orchestra.run.smithi177.stdout:generic/552 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:47:20.406 INFO:teuthology.orchestra.run.smithi177.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2024-02-02T12:47:21.015 INFO:teuthology.orchestra.run.smithi177.stdout:generic/554 [not run] swapfiles are not supported 2024-02-02T12:47:21.351 INFO:teuthology.orchestra.run.smithi177.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2024-02-02T12:47:21.639 INFO:teuthology.orchestra.run.smithi177.stdout:generic/556 [not run] ceph does not support casefold feature 2024-02-02T12:47:21.957 INFO:teuthology.orchestra.run.smithi177.stdout:generic/557 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:47:22.286 INFO:teuthology.orchestra.run.smithi177.stdout:generic/563 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:47:22.868 INFO:teuthology.orchestra.run.smithi177.stdout:generic/564 0s 2024-02-02T12:47:23.664 INFO:teuthology.orchestra.run.smithi177.stdout:generic/565 1s 2024-02-02T12:47:23.954 INFO:teuthology.orchestra.run.smithi177.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:47:33.669 INFO:teuthology.orchestra.run.smithi177.stdout:generic/567 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-02T12:47:33.959 INFO:teuthology.orchestra.run.smithi177.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:47:34.283 INFO:teuthology.orchestra.run.smithi177.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:47:34.581 INFO:teuthology.orchestra.run.smithi177.stdout:generic/570 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:47:34.910 INFO:teuthology.orchestra.run.smithi177.stdout:generic/571 [not run] Require fcntl setlease support 2024-02-02T12:47:35.204 INFO:teuthology.orchestra.run.smithi177.stdout:generic/572 [not run] fsverity utility required, skipped this test 2024-02-02T12:47:35.517 INFO:teuthology.orchestra.run.smithi177.stdout:generic/573 [not run] fsverity utility required, skipped this test 2024-02-02T12:47:35.796 INFO:teuthology.orchestra.run.smithi177.stdout:generic/574 [not run] fsverity utility required, skipped this test 2024-02-02T12:47:36.096 INFO:teuthology.orchestra.run.smithi177.stdout:generic/575 [not run] fsverity utility required, skipped this test 2024-02-02T12:47:36.466 INFO:teuthology.orchestra.run.smithi177.stdout:generic/576 [not run] fsverity utility required, skipped this test 2024-02-02T12:47:36.776 INFO:teuthology.orchestra.run.smithi177.stdout:generic/577 [not run] fsverity utility required, skipped this test 2024-02-02T12:47:37.130 INFO:teuthology.orchestra.run.smithi177.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-02T12:47:37.501 INFO:teuthology.orchestra.run.smithi177.stdout:generic/580 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:47:38.421 INFO:teuthology.orchestra.run.smithi177.stdout:generic/581 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:47:38.815 INFO:teuthology.orchestra.run.smithi177.stdout:generic/582 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:47:39.197 INFO:teuthology.orchestra.run.smithi177.stdout:generic/583 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:47:39.581 INFO:teuthology.orchestra.run.smithi177.stdout:generic/584 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:47:40.022 INFO:teuthology.orchestra.run.smithi177.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T12:47:40.372 INFO:teuthology.orchestra.run.smithi177.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:47:41.104 INFO:teuthology.orchestra.run.smithi177.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:47:41.573 INFO:teuthology.orchestra.run.smithi177.stdout:generic/591 0s 2024-02-02T12:47:41.945 INFO:teuthology.orchestra.run.smithi177.stdout:generic/592 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:47:42.333 INFO:teuthology.orchestra.run.smithi177.stdout:generic/593 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:47:42.617 INFO:teuthology.orchestra.run.smithi177.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:47:42.999 INFO:teuthology.orchestra.run.smithi177.stdout:generic/595 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:47:43.073 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:47:43.076 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:47:43.079 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:47:43.269 INFO:teuthology.orchestra.run.smithi177.stdout:generic/596 [not run] accton utility required, skipped this test 2024-02-02T12:47:44.238 INFO:teuthology.orchestra.run.smithi177.stdout:generic/597 1s 2024-02-02T12:47:45.257 INFO:teuthology.orchestra.run.smithi177.stdout:generic/598 1s 2024-02-02T12:47:45.682 INFO:teuthology.orchestra.run.smithi177.stdout:generic/599 [not run] ceph does not support shutdown 2024-02-02T12:47:45.987 INFO:teuthology.orchestra.run.smithi177.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:47:46.255 INFO:teuthology.orchestra.run.smithi177.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:47:46.659 INFO:teuthology.orchestra.run.smithi177.stdout:generic/602 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:47:46.956 INFO:teuthology.orchestra.run.smithi177.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T12:47:51.477 INFO:teuthology.orchestra.run.smithi177.stdout:generic/604 5s 2024-02-02T12:47:53.770 INFO:teuthology.orchestra.run.smithi177.stdout:generic/605 [not run] mount 172.21.15.161:6789:/scratch with dax=always failed 2024-02-02T12:47:54.160 INFO:teuthology.orchestra.run.smithi177.stdout:generic/606 [not run] mount 172.21.15.161:6789:/scratch with dax=always failed 2024-02-02T12:47:54.576 INFO:teuthology.orchestra.run.smithi177.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2024-02-02T12:47:54.956 INFO:teuthology.orchestra.run.smithi177.stdout:generic/608 [not run] mount 172.21.15.161:6789:/scratch with dax=always failed 2024-02-02T12:47:55.534 INFO:teuthology.orchestra.run.smithi177.stdout:generic/609 1s 2024-02-02T12:48:10.275 INFO:teuthology.orchestra.run.smithi177.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-02T12:48:11.153 INFO:teuthology.orchestra.run.smithi177.stdout:generic/611 1s 2024-02-02T12:48:11.556 INFO:teuthology.orchestra.run.smithi177.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T12:48:11.940 INFO:teuthology.orchestra.run.smithi177.stdout:generic/613 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:48:12.358 INFO:teuthology.orchestra.run.smithi177.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2024-02-02T12:48:13.169 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:48:13.171 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:48:13.174 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:48:13.246 INFO:teuthology.orchestra.run.smithi177.stdout:generic/618 1s 2024-02-02T12:48:13.651 INFO:teuthology.orchestra.run.smithi177.stdout:generic/620 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:48:14.060 INFO:teuthology.orchestra.run.smithi177.stdout:generic/621 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T12:48:14.472 INFO:teuthology.orchestra.run.smithi177.stdout:generic/623 [not run] ceph does not support shutdown 2024-02-02T12:48:14.768 INFO:teuthology.orchestra.run.smithi177.stdout:generic/624 [not run] fsverity utility required, skipped this test 2024-02-02T12:48:15.049 INFO:teuthology.orchestra.run.smithi177.stdout:generic/625 [not run] fsverity utility required, skipped this test 2024-02-02T12:48:15.388 INFO:teuthology.orchestra.run.smithi177.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2024-02-02T12:48:16.160 INFO:teuthology.orchestra.run.smithi177.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:48:16.463 INFO:teuthology.orchestra.run.smithi177.stdout:generic/629 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:48:16.919 INFO:teuthology.orchestra.run.smithi177.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-02-02T12:48:18.837 INFO:teuthology.orchestra.run.smithi177.stdout:generic/632 1s 2024-02-02T12:48:20.502 INFO:teuthology.orchestra.run.smithi177.stdout:generic/633 2s 2024-02-02T12:48:22.184 INFO:teuthology.orchestra.run.smithi177.stdout:generic/634 2s 2024-02-02T12:48:22.660 INFO:teuthology.orchestra.run.smithi177.stdout:generic/635 [not run] ceph does not support shutdown 2024-02-02T12:48:23.188 INFO:teuthology.orchestra.run.smithi177.stdout:generic/636 [not run] swapfiles are not supported 2024-02-02T12:48:23.957 INFO:teuthology.orchestra.run.smithi177.stdout:generic/637 0s 2024-02-02T12:48:24.325 INFO:teuthology.orchestra.run.smithi177.stdout:generic/638 1s 2024-02-02T12:48:25.141 INFO:teuthology.orchestra.run.smithi177.stdout:generic/639 1s 2024-02-02T12:48:25.427 INFO:teuthology.orchestra.run.smithi177.stdout:generic/640 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T12:48:25.975 INFO:teuthology.orchestra.run.smithi177.stdout:generic/641 [not run] swapfiles are not supported 2024-02-02T12:48:26.337 INFO:teuthology.orchestra.run.smithi177.stdout:generic/644 1s 2024-02-02T12:48:43.280 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:48:43.283 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:48:43.286 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:49:13.409 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:49:13.411 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:49:13.414 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:49:43.512 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:49:43.515 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:49:43.517 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:50:13.649 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:50:13.652 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:50:13.655 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:50:44.069 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:50:44.072 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:50:44.075 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:51:14.435 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:51:14.438 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:51:14.441 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:51:44.765 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:51:44.768 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:51:44.771 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:51:44.792 INFO:tasks.ceph.mds.c.smithi161.stderr:2024-02-02T12:51:44.789+0000 7f9bde098640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37915) UID: 0 2024-02-02T12:51:44.793 INFO:tasks.ceph.mds.a.smithi161.stderr:2024-02-02T12:51:44.789+0000 7f392d34c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37915) UID: 0 2024-02-02T12:53:17.238 INFO:teuthology.orchestra.run.smithi177.stdout:generic/645 291s 2024-02-02T12:53:17.867 INFO:teuthology.orchestra.run.smithi177.stdout:generic/646 [not run] ceph does not support shutdown 2024-02-02T12:53:18.512 INFO:teuthology.orchestra.run.smithi177.stdout:generic/647 1s 2024-02-02T12:53:19.289 INFO:teuthology.orchestra.run.smithi177.stdout:generic/651 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:53:19.872 INFO:teuthology.orchestra.run.smithi177.stdout:generic/652 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:53:20.408 INFO:teuthology.orchestra.run.smithi177.stdout:generic/653 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:53:20.968 INFO:teuthology.orchestra.run.smithi177.stdout:generic/654 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:53:21.579 INFO:teuthology.orchestra.run.smithi177.stdout:generic/655 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:53:22.155 INFO:teuthology.orchestra.run.smithi177.stdout:generic/657 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:53:22.690 INFO:teuthology.orchestra.run.smithi177.stdout:generic/658 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:53:23.264 INFO:teuthology.orchestra.run.smithi177.stdout:generic/659 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:53:23.859 INFO:teuthology.orchestra.run.smithi177.stdout:generic/660 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:53:24.437 INFO:teuthology.orchestra.run.smithi177.stdout:generic/661 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:53:25.032 INFO:teuthology.orchestra.run.smithi177.stdout:generic/662 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:53:25.602 INFO:teuthology.orchestra.run.smithi177.stdout:generic/663 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:53:26.263 INFO:teuthology.orchestra.run.smithi177.stdout:generic/664 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:53:26.868 INFO:teuthology.orchestra.run.smithi177.stdout:generic/665 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:53:27.507 INFO:teuthology.orchestra.run.smithi177.stdout:generic/666 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:53:28.270 INFO:teuthology.orchestra.run.smithi177.stdout:generic/667 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:53:28.946 INFO:teuthology.orchestra.run.smithi177.stdout:generic/668 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:53:29.556 INFO:teuthology.orchestra.run.smithi177.stdout:generic/669 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:53:30.501 INFO:teuthology.orchestra.run.smithi177.stdout:generic/673 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:53:31.018 INFO:teuthology.orchestra.run.smithi177.stdout:generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-02-02T12:53:31.804 INFO:teuthology.orchestra.run.smithi177.stdout:generic/675 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T12:54:28.392 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:54:28.396 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:54:28.398 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:54:58.769 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:54:58.772 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:54:58.775 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:55:28.898 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:55:28.901 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:55:28.904 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:55:28.916 INFO:tasks.ceph.mds.a.smithi161.stderr:2024-02-02T12:55:28.913+0000 7f392d34c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37934) UID: 0 2024-02-02T12:55:28.916 INFO:tasks.ceph.mds.c.smithi161.stderr:2024-02-02T12:55:28.913+0000 7f9bde098640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37934) UID: 0 2024-02-02T12:57:31.655 INFO:teuthology.orchestra.run.smithi161.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.c.log.1: 2024-02-02T12:57:31.655 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: stdin: file size changed while zipping 2024-02-02T12:58:04.259 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:58:04.262 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:58:04.265 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T12:58:04.280 INFO:tasks.ceph.mds.a.smithi161.stderr:2024-02-02T12:58:04.274+0000 7f392d34c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37943) UID: 0 2024-02-02T12:58:04.281 INFO:tasks.ceph.mds.c.smithi161.stderr:2024-02-02T12:58:04.274+0000 7f9bde098640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37943) UID: 0 2024-02-02T13:00:36.458 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:00:36.461 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:00:36.464 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:00:36.503 INFO:tasks.ceph.mds.c.smithi161.stderr:2024-02-02T13:00:36.499+0000 7f9bde098640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37953) UID: 0 2024-02-02T13:00:36.504 INFO:tasks.ceph.mds.a.smithi161.stderr:2024-02-02T13:00:36.499+0000 7f392d34c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 37953) UID: 0 2024-02-02T13:02:46.286 INFO:teuthology.orchestra.run.smithi177.stdout:generic/676 555s 2024-02-02T13:02:46.578 INFO:teuthology.orchestra.run.smithi177.stdout:generic/677 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T13:02:46.972 INFO:teuthology.orchestra.run.smithi177.stdout:generic/678 [not run] kernel does not support IO_URING 2024-02-02T13:02:47.265 INFO:teuthology.orchestra.run.smithi177.stdout:generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T13:02:47.955 INFO:teuthology.orchestra.run.smithi177.stdout:generic/680 0s 2024-02-02T13:02:48.221 INFO:teuthology.orchestra.run.smithi177.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T13:02:48.496 INFO:teuthology.orchestra.run.smithi177.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-02T13:02:48.888 INFO:teuthology.orchestra.run.smithi177.stdout:generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T13:02:58.948 INFO:teuthology.orchestra.run.smithi177.stdout:generic/684 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-02T13:03:04.558 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:03:04.561 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:03:04.564 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:03:09.161 INFO:teuthology.orchestra.run.smithi177.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-02T13:03:21.866 INFO:teuthology.orchestra.run.smithi177.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-02-02T13:03:29.938 INFO:teuthology.orchestra.run.smithi177.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-02-02T13:03:30.316 INFO:teuthology.orchestra.run.smithi177.stdout:generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T13:03:30.771 INFO:teuthology.orchestra.run.smithi177.stdout:generic/689 0s 2024-02-02T13:03:31.085 INFO:teuthology.orchestra.run.smithi177.stdout:generic/690 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T13:03:31.378 INFO:teuthology.orchestra.run.smithi177.stdout:generic/692 [not run] fsverity utility required, skipped this test 2024-02-02T13:03:31.776 INFO:teuthology.orchestra.run.smithi177.stdout:generic/693 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-02T13:03:32.095 INFO:teuthology.orchestra.run.smithi177.stdout:generic/695 [not run] require 172.21.15.161:6789:/scratch to be valid block disk 2024-02-02T13:03:32.659 INFO:teuthology.orchestra.run.smithi177.stdout:generic/696 0s 2024-02-02T13:03:33.064 INFO:teuthology.orchestra.run.smithi177.stdout:generic/697 1s 2024-02-02T13:03:34.620 INFO:teuthology.orchestra.run.smithi177.stdout:generic/698 1s 2024-02-02T13:03:34.688 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:03:34.691 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:03:34.693 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:03:35.503 INFO:teuthology.orchestra.run.smithi177.stdout:generic/699 [not run] overlayfs doesn't support idmappped layers 2024-02-02T13:03:35.842 INFO:teuthology.orchestra.run.smithi177.stdout:generic/700 [not run] kernel doesn't support renameat2 syscall 2024-02-02T13:03:36.591 INFO:teuthology.orchestra.run.smithi177.stdout:generic/702 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-02T13:03:36.955 INFO:teuthology.orchestra.run.smithi177.stdout:generic/703 [not run] kernel does not support IO_URING 2024-02-02T13:03:37.352 INFO:teuthology.orchestra.run.smithi177.stdout:generic/704 [not run] require 172.21.15.161:6789:/test to be valid block disk 2024-02-02T13:03:38.506 INFO:teuthology.orchestra.run.smithi177.stdout:generic/706 1s 2024-02-02T13:03:38.955 INFO:teuthology.orchestra.run.smithi177.stdout:generic/708 0s 2024-02-02T13:03:39.270 INFO:teuthology.orchestra.run.smithi177.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-02T13:03:39.597 INFO:teuthology.orchestra.run.smithi177.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-02T13:03:39.922 INFO:teuthology.orchestra.run.smithi177.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-02T13:03:40.227 INFO:teuthology.orchestra.run.smithi177.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-02T13:03:40.551 INFO:teuthology.orchestra.run.smithi177.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2024-02-02T13:03:40.870 INFO:teuthology.orchestra.run.smithi177.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-02T13:03:41.173 INFO:teuthology.orchestra.run.smithi177.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2024-02-02T13:03:41.495 INFO:teuthology.orchestra.run.smithi177.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-02T13:03:41.827 INFO:teuthology.orchestra.run.smithi177.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-02T13:03:42.159 INFO:teuthology.orchestra.run.smithi177.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-02T13:03:42.463 INFO:teuthology.orchestra.run.smithi177.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-02T13:03:42.774 INFO:teuthology.orchestra.run.smithi177.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-02T13:03:43.095 INFO:teuthology.orchestra.run.smithi177.stdout:generic/721 [not run] xfs_io startupdate support is missing 2024-02-02T13:03:43.414 INFO:teuthology.orchestra.run.smithi177.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-02-02T13:03:43.747 INFO:teuthology.orchestra.run.smithi177.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-02T13:03:44.050 INFO:teuthology.orchestra.run.smithi177.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-02-02T13:03:44.359 INFO:teuthology.orchestra.run.smithi177.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-02-02T13:03:44.772 INFO:teuthology.orchestra.run.smithi177.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-02-02T13:03:45.190 INFO:teuthology.orchestra.run.smithi177.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-02-02T13:03:49.582 INFO:teuthology.orchestra.run.smithi177.stdout:generic/728 4s 2024-02-02T13:03:50.224 INFO:teuthology.orchestra.run.smithi177.stdout:generic/729 1s 2024-02-02T13:03:50.525 INFO:teuthology.orchestra.run.smithi177.stdout:generic/730 [not run] require 172.21.15.161:6789:/test to be valid block disk 2024-02-02T13:03:50.809 INFO:teuthology.orchestra.run.smithi177.stdout:generic/731 [not run] require 172.21.15.161:6789:/test to be valid block disk 2024-02-02T13:03:51.905 INFO:teuthology.orchestra.run.smithi177.stdout:generic/732 1s 2024-02-02T13:03:52.236 INFO:teuthology.orchestra.run.smithi177.stdout:generic/734 [not run] Reflink not supported by test filesystem type: ceph 2024-02-02T13:03:52.598 INFO:teuthology.orchestra.run.smithi177.stdout:generic/735 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-02T13:03:52.971 INFO:teuthology.orchestra.run.smithi177.stdout:generic/736 - output mismatch (see /tmp/tmp.ByhSz7TqB0xfstests-dev/results//generic/736.out.bad) 2024-02-02T13:03:52.977 INFO:teuthology.orchestra.run.smithi177.stdout: --- tests/generic/736.out 2024-02-02 11:49:43.280568928 +0000 2024-02-02T13:03:52.977 INFO:teuthology.orchestra.run.smithi177.stdout: +++ /tmp/tmp.ByhSz7TqB0xfstests-dev/results//generic/736.out.bad 2024-02-02 13:03:52.963376121 +0000 2024-02-02T13:03:52.977 INFO:teuthology.orchestra.run.smithi177.stdout: @@ -1,2 +1,4 @@ 2024-02-02T13:03:52.977 INFO:teuthology.orchestra.run.smithi177.stdout: QA output created by 736 2024-02-02T13:03:52.977 INFO:teuthology.orchestra.run.smithi177.stdout: +*** buffer overflow detected ***: terminated 2024-02-02T13:03:52.978 INFO:teuthology.orchestra.run.smithi177.stdout: +/tmp/tmp.ByhSz7TqB0xfstests-dev/tests/generic/736: line 32: 229327 Aborted $here/src/readdir-while-renames $target_dir 2024-02-02T13:03:52.978 INFO:teuthology.orchestra.run.smithi177.stdout: Silence is golden 2024-02-02T13:03:53.431 INFO:teuthology.orchestra.run.smithi177.stdout:generic/737 [not run] ceph does not support shutdown 2024-02-02T13:03:53.761 INFO:teuthology.orchestra.run.smithi177.stdout:generic/738 [not run] ceph does not support freezing 2024-02-02T13:03:54.068 INFO:teuthology.orchestra.run.smithi177.stdout:shared/002 [not run] not suitable for this filesystem type: ceph 2024-02-02T13:03:54.330 INFO:teuthology.orchestra.run.smithi177.stdout:shared/032 [not run] not suitable for this filesystem type: ceph 2024-02-02T13:03:54.346 INFO:teuthology.orchestra.run.smithi177.stdout:Ran: ceph/002 ceph/003 ceph/004 ceph/005 generic/001 generic/002 generic/003 generic/004 generic/005 generic/006 generic/007 generic/008 generic/009 generic/011 generic/012 generic/013 generic/014 generic/015 generic/016 generic/018 generic/020 generic/021 generic/022 generic/023 generic/024 generic/025 generic/026 generic/028 generic/029 generic/030 generic/031 generic/032 generic/033 generic/034 generic/035 generic/037 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/053 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/062 generic/063 generic/064 generic/065 generic/066 generic/067 generic/069 generic/070 generic/071 generic/073 generic/075 generic/076 generic/078 generic/079 generic/080 generic/081 generic/082 generic/084 generic/086 generic/087 generic/088 generic/090 generic/091 generic/092 generic/094 generic/096 generic/097 generic/098 generic/099 generic/101 generic/103 generic/104 generic/105 generic/106 generic/107 generic/108 generic/110 generic/111 generic/112 generic/113 generic/114 generic/115 generic/116 generic/117 generic/118 generic/119 generic/120 generic/121 generic/122 generic/123 generic/124 generic/126 generic/128 generic/129 generic/130 generic/131 generic/134 generic/135 generic/136 generic/138 generic/139 generic/140 generic/141 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/169 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/184 generic/185 generic/188 generic/189 generic/190 generic/191 generic/193 generic/194 generic/195 generic/196 generic/197 generic/198 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/207 generic/210 generic/211 generic/212 generic/213 generic/214 generic/215 generic/216 generic/217 generic/218 generic/219 generic/220 generic/221 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/236 generic/237 generic/238 generic/240 generic/244 generic/245 generic/246 generic/247 generic/248 generic/249 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/257 generic/258 generic/259 generic/260 generic/261 generic/262 generic/263 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/294 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/306 generic/307 generic/308 generic/309 generic/312 generic/313 generic/314 generic/315 generic/316 generic/317 generic/318 generic/319 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/337 generic/338 generic/341 generic/342 generic/343 generic/346 generic/347 generic/348 generic/353 generic/355 generic/356 generic/357 generic/358 generic/359 generic/360 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/375 generic/376 generic/377 generic/378 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/393 generic/394 generic/395 generic/396 generic/397 generic/398 generic/400 generic/401 generic/402 generic/403 generic/404 generic/406 generic/407 generic/408 generic/409 generic/410 generic/411 generic/412 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/423 generic/424 generic/425 generic/426 generic/427 generic/428 generic/430 generic/431 generic/432 generic/433 generic/434 generic/436 generic/437 generic/439 generic/440 generic/441 generic/443 generic/444 generic/445 generic/446 generic/448 generic/449 generic/450 generic/451 generic/452 generic/453 generic/454 generic/456 generic/458 generic/460 generic/462 generic/463 generic/465 generic/466 generic/467 generic/468 generic/469 generic/470 generic/471 generic/472 generic/474 generic/477 generic/478 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/486 generic/487 generic/488 generic/489 generic/490 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/504 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/523 generic/524 generic/525 generic/526 generic/527 generic/528 generic/529 generic/530 generic/531 generic/532 generic/533 generic/534 generic/535 generic/536 generic/537 generic/538 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/564 generic/565 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/591 generic/592 generic/593 generic/594 generic/595 generic/596 generic/597 generic/598 generic/599 generic/600 generic/601 generic/602 generic/603 generic/604 generic/605 generic/606 generic/607 generic/608 generic/609 generic/610 generic/611 generic/612 generic/613 generic/614 generic/618 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/632 generic/633 generic/634 generic/635 generic/636 generic/637 generic/638 generic/639 generic/640 generic/641 generic/644 generic/645 generic/646 generic/647 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/676 generic/677 generic/678 generic/679 generic/680 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/689 generic/690 generic/692 generic/693 generic/695 generic/696 generic/697 generic/698 generic/699 generic/700 generic/702 generic/703 generic/704 generic/706 generic/708 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/728 generic/729 generic/730 generic/731 generic/732 generic/734 generic/735 generic/736 generic/737 generic/738 shared/002 shared/032 2024-02-02T13:03:54.346 INFO:teuthology.orchestra.run.smithi177.stdout:Not run: ceph/002 ceph/003 ceph/005 generic/003 generic/004 generic/008 generic/009 generic/012 generic/014 generic/015 generic/016 generic/018 generic/021 generic/022 generic/024 generic/025 generic/026 generic/031 generic/032 generic/033 generic/034 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/063 generic/064 generic/065 generic/066 generic/067 generic/071 generic/073 generic/076 generic/078 generic/079 generic/081 generic/082 generic/086 generic/090 generic/092 generic/094 generic/096 generic/101 generic/103 generic/104 generic/106 generic/107 generic/108 generic/110 generic/111 generic/114 generic/115 generic/116 generic/118 generic/119 generic/120 generic/121 generic/122 generic/129 generic/130 generic/134 generic/136 generic/138 generic/139 generic/140 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/185 generic/188 generic/189 generic/190 generic/191 generic/194 generic/195 generic/196 generic/197 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/213 generic/214 generic/216 generic/217 generic/218 generic/219 generic/220 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/238 generic/240 generic/244 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/258 generic/259 generic/260 generic/261 generic/262 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/312 generic/315 generic/316 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/338 generic/341 generic/342 generic/343 generic/347 generic/348 generic/353 generic/356 generic/357 generic/358 generic/359 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/376 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/395 generic/396 generic/397 generic/398 generic/400 generic/402 generic/404 generic/407 generic/408 generic/409 generic/410 generic/411 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/424 generic/425 generic/427 generic/436 generic/439 generic/440 generic/441 generic/445 generic/446 generic/449 generic/453 generic/454 generic/456 generic/458 generic/462 generic/463 generic/466 generic/468 generic/469 generic/470 generic/472 generic/474 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/487 generic/488 generic/489 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/525 generic/526 generic/527 generic/530 generic/531 generic/534 generic/535 generic/536 generic/537 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/592 generic/593 generic/594 generic/595 generic/596 generic/599 generic/600 generic/601 generic/602 generic/603 generic/605 generic/606 generic/607 generic/608 generic/610 generic/612 generic/613 generic/614 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/635 generic/636 generic/640 generic/641 generic/646 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/677 generic/678 generic/679 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/690 generic/692 generic/693 generic/695 generic/699 generic/700 generic/702 generic/703 generic/704 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/730 generic/731 generic/734 generic/735 generic/737 generic/738 shared/002 shared/032 2024-02-02T13:03:54.347 INFO:teuthology.orchestra.run.smithi177.stdout:Failures: generic/317 generic/736 2024-02-02T13:03:54.347 INFO:teuthology.orchestra.run.smithi177.stdout:Failed 2 of 603 tests 2024-02-02T13:03:54.363 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-02-02T13:03:55.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-02T13:03:55.223 INFO:tasks.cephfs.test_fscrypt:Command failed. 2024-02-02T13:03:55.223 INFO:tasks.cephfs.test_fscrypt:Command return value: 1 2024-02-02T13:03:55.224 INFO:tasks.cephfs.test_fscrypt:Command stdout - FSTYP -- ceph PLATFORM -- Linux/x86_64 smithi177 6.7.0-gcd42140e6285 #1 SMP PREEMPT_DYNAMIC Thu Jan 25 04:09:18 UTC 2024 MKFS_OPTIONS -- 172.21.15.161:6789:/scratch MOUNT_OPTIONS -- -o name=admin,secret=AQBp1rxlR51tBxAABbzxZahfKYl0M7QrtLzrXQ==,test_dummy_encryption 172.21.15.161:6789:/scratch /tmp/tmp.jtqH6Jn1Mhscratch ceph/001 [expunged] ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test ceph/004 0s ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test generic/001 9s generic/002 1s generic/003 [not run] atime not maintained by ceph generic/004 [not run] O_TMPFILE is not supported generic/005 1s generic/006 38s generic/007 78s generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/011 49s generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/013 48s generic/014 [not run] Sparse files are not supported or do not work as expected generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/018 [not run] defragmentation not supported for fstype "ceph" generic/020 6s generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/023 2s generic/024 [not run] kernel doesn't support renameat2 syscall generic/025 [not run] kernel doesn't support renameat2 syscall generic/026 [not run] ceph does not define maximum ACL count generic/028 5s generic/029 1s generic/030 5s generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/034 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/035 0s generic/037 7s generic/039 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/040 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/041 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/042 [not run] ceph does not support shutdown generic/050 [not run] ceph does not support shutdown generic/052 [not run] ceph does not support shutdown generic/053 1s generic/056 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/057 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/059 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/062 2s generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/065 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/066 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/067 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/069 24s generic/070 17s generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/073 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/075 40s generic/076 [not run] require 172.21.15.161:6789:/scratch to be local device generic/078 [not run] kernel doesn't support renameat2 syscall generic/079 [not run] file system doesn't support chattr +ia generic/080 2s generic/081 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/082 [not run] disk quotas not supported by this filesystem type: ceph generic/084 6s generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/087 0s generic/088 0s generic/090 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/091 126s generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/097 0s generic/098 1s generic/099 2s generic/101 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/104 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/105 0s generic/106 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/107 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/108 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/110 [not run] Reflink not supported by test filesystem type: ceph generic/111 [not run] Reflink not supported by test filesystem type: ceph generic/112 45s generic/113 92s generic/114 [not run] Sparse files are not supported or do not work as expected generic/115 [not run] Reflink not supported by test filesystem type: ceph generic/116 [not run] Reflink not supported by test filesystem type: ceph generic/117 12s generic/118 [not run] Reflink not supported by test filesystem type: ceph generic/119 [not run] Reflink not supported by test filesystem type: ceph generic/120 [not run] atime not maintained by ceph generic/121 [not run] Dedupe not supported by test filesystem type: ceph generic/122 [not run] Dedupe not supported by test filesystem type: ceph generic/123 0s generic/124 37s generic/126 1s generic/128 1s generic/129 [not run] Sparse files are not supported or do not work as expected generic/130 [not run] Sparse files are not supported or do not work as expected generic/131 1s generic/134 [not run] Reflink not supported by test filesystem type: ceph generic/135 1s generic/136 [not run] Dedupe not supported by test filesystem type: ceph generic/138 [not run] Reflink not supported by test filesystem type: ceph generic/139 [not run] Reflink not supported by test filesystem type: ceph generic/140 [not run] Reflink not supported by test filesystem type: ceph generic/141 2s generic/142 [not run] Reflink not supported by test filesystem type: ceph generic/143 [not run] Reflink not supported by test filesystem type: ceph generic/144 [not run] Reflink not supported by test filesystem type: ceph generic/145 [not run] Reflink not supported by test filesystem type: ceph generic/146 [not run] Reflink not supported by test filesystem type: ceph generic/147 [not run] Reflink not supported by test filesystem type: ceph generic/148 [not run] Reflink not supported by test filesystem type: ceph generic/149 [not run] Reflink not supported by test filesystem type: ceph generic/150 [not run] Reflink not supported by test filesystem type: ceph generic/151 [not run] Reflink not supported by test filesystem type: ceph generic/152 [not run] Reflink not supported by test filesystem type: ceph generic/153 [not run] Reflink not supported by test filesystem type: ceph generic/154 [not run] Reflink not supported by test filesystem type: ceph generic/155 [not run] Reflink not supported by test filesystem type: ceph generic/156 [not run] Reflink not supported by test filesystem type: ceph generic/157 [not run] Reflink not supported by test filesystem type: ceph generic/158 [not run] Dedupe not supported by test filesystem type: ceph generic/159 [not run] file system doesn't support chattr +i generic/160 [not run] file system doesn't support chattr +i generic/161 [not run] Reflink not supported by scratch filesystem type: ceph generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph generic/169 1s generic/171 [not run] Reflink not supported by scratch filesystem type: ceph generic/172 [not run] Reflink not supported by scratch filesystem type: ceph generic/173 [not run] Reflink not supported by scratch filesystem type: ceph generic/174 [not run] Reflink not supported by scratch filesystem type: ceph generic/177 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/178 [not run] Reflink not supported by test filesystem type: ceph generic/179 [not run] Reflink not supported by test filesystem type: ceph generic/180 [not run] Reflink not supported by test filesystem type: ceph generic/181 [not run] Reflink not supported by test filesystem type: ceph generic/182 [not run] Dedupe not supported by test filesystem type: ceph generic/183 [not run] Reflink not supported by scratch filesystem type: ceph generic/184 0s generic/185 [not run] Reflink not supported by scratch filesystem type: ceph generic/188 [not run] Reflink not supported by scratch filesystem type: ceph generic/189 [not run] Reflink not supported by scratch filesystem type: ceph generic/190 [not run] Reflink not supported by scratch filesystem type: ceph generic/191 [not run] Reflink not supported by scratch filesystem type: ceph generic/193 1s generic/194 [not run] Reflink not supported by scratch filesystem type: ceph generic/195 [not run] Reflink not supported by scratch filesystem type: ceph generic/196 [not run] Reflink not supported by scratch filesystem type: ceph generic/197 [not run] Reflink not supported by scratch filesystem type: ceph generic/198 30s generic/199 [not run] Reflink not supported by scratch filesystem type: ceph generic/200 [not run] Reflink not supported by scratch filesystem type: ceph generic/201 [not run] Reflink not supported by scratch filesystem type: ceph generic/202 [not run] Reflink not supported by scratch filesystem type: ceph generic/203 [not run] Reflink not supported by scratch filesystem type: ceph generic/205 [not run] Reflink not supported by scratch filesystem type: ceph generic/206 [not run] Reflink not supported by scratch filesystem type: ceph generic/207 24s generic/210 0s generic/211 1s generic/212 0s generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/215 2s generic/216 [not run] Reflink not supported by scratch filesystem type: ceph generic/217 [not run] Reflink not supported by scratch filesystem type: ceph generic/218 [not run] Reflink not supported by scratch filesystem type: ceph generic/219 [not run] disk quotas not supported by this filesystem type: ceph generic/220 [not run] Reflink not supported by scratch filesystem type: ceph generic/221 2s generic/222 [not run] Reflink not supported by scratch filesystem type: ceph generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/227 [not run] Reflink not supported by scratch filesystem type: ceph generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/229 [not run] Reflink not supported by scratch filesystem type: ceph generic/230 [not run] disk quotas not supported by this filesystem type: ceph generic/235 [not run] disk quotas not supported by this filesystem type: ceph generic/236 2s generic/237 0s generic/238 [not run] Reflink not supported by scratch filesystem type: ceph generic/240 [not run] Sparse files are not supported or do not work as expected generic/244 [not run] disk quotas not supported by this filesystem type: ceph generic/245 1s generic/246 0s generic/247 324s generic/248 1s generic/249 32s generic/250 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/252 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/253 [not run] Reflink not supported by scratch filesystem type: ceph generic/254 [not run] Reflink not supported by scratch filesystem type: ceph generic/255 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/256 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/257 1s generic/258 [not run] ceph does not support negative timestamps generic/259 [not run] Reflink not supported by scratch filesystem type: ceph generic/260 [not run] FITRIM not supported on /tmp/tmp.jtqH6Jn1Mhscratch generic/261 [not run] Reflink not supported by scratch filesystem type: ceph generic/262 [not run] Reflink not supported by scratch filesystem type: ceph generic/263 130s generic/264 [not run] Reflink not supported by scratch filesystem type: ceph generic/265 [not run] Reflink not supported by scratch filesystem type: ceph generic/266 [not run] Reflink not supported by scratch filesystem type: ceph generic/267 [not run] Reflink not supported by scratch filesystem type: ceph generic/268 [not run] Reflink not supported by scratch filesystem type: ceph generic/271 [not run] Reflink not supported by scratch filesystem type: ceph generic/272 [not run] Reflink not supported by scratch filesystem type: ceph generic/276 [not run] Reflink not supported by scratch filesystem type: ceph generic/277 [not run] file system doesn't support chattr +A generic/278 [not run] Reflink not supported by scratch filesystem type: ceph generic/279 [not run] Reflink not supported by scratch filesystem type: ceph generic/281 [not run] Reflink not supported by scratch filesystem type: ceph generic/282 [not run] Reflink not supported by scratch filesystem type: ceph generic/283 [not run] Reflink not supported by scratch filesystem type: ceph generic/284 [not run] Reflink not supported by scratch filesystem type: ceph generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/287 [not run] Reflink not supported by scratch filesystem type: ceph generic/288 [not run] FITRIM not supported on /tmp/tmp.jtqH6Jn1Mhscratch generic/289 [not run] Reflink not supported by scratch filesystem type: ceph generic/290 [not run] Reflink not supported by scratch filesystem type: ceph generic/291 [not run] Reflink not supported by scratch filesystem type: ceph generic/292 [not run] Reflink not supported by scratch filesystem type: ceph generic/293 [not run] Reflink not supported by scratch filesystem type: ceph generic/294 1s generic/295 [not run] Reflink not supported by scratch filesystem type: ceph generic/296 [not run] Reflink not supported by scratch filesystem type: ceph generic/301 [not run] Reflink not supported by scratch filesystem type: ceph generic/302 [not run] Reflink not supported by scratch filesystem type: ceph generic/303 [not run] Reflink not supported by test filesystem type: ceph generic/304 [not run] Dedupe not supported by test filesystem type: ceph generic/305 [not run] Reflink not supported by scratch filesystem type: ceph generic/306 0s generic/307 3s generic/308 0s generic/309 1s generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/313 4s generic/314 1s generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/316 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/317 - output mismatch (see /tmp/tmp.ByhSz7TqB0xfstests-dev/results//generic/317.out.bad) --- tests/generic/317.out 2024-02-02 11:49:43.228570640 +0000 +++ /tmp/tmp.ByhSz7TqB0xfstests-dev/results//generic/317.out.bad 2024-02-02 12:16:39.042157447 +0000 @@ -4,9 +4,7 @@ Size: 0 Filetype: Regular File Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) From user_ns - File: "$SCRATCH_MNT/file1" - Size: 0 Filetype: Regular File - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) +execvp: Permission denied *** Remounting *** @@ -15,6 +13,4 @@ Size: 0 Filetype: Regular File Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) From user_ns - File: "$SCRATCH_MNT/file1" - Size: 0 Filetype: Regular File - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) +execvp: Permission denied generic/318 0s generic/319 1s generic/321 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/322 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/324 [not run] defragmentation not supported for fstype "ceph" generic/325 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/326 [not run] Reflink not supported by scratch filesystem type: ceph generic/327 [not run] Reflink not supported by scratch filesystem type: ceph generic/328 [not run] Reflink not supported by scratch filesystem type: ceph generic/329 [not run] Reflink not supported by scratch filesystem type: ceph generic/330 [not run] Reflink not supported by scratch filesystem type: ceph generic/331 [not run] Reflink not supported by scratch filesystem type: ceph generic/332 [not run] Reflink not supported by scratch filesystem type: ceph generic/335 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/336 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/337 0s generic/338 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/341 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/342 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/343 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/346 214s generic/347 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/348 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/353 [not run] Reflink not supported by scratch filesystem type: ceph generic/355 1s generic/356 [not run] swapfiles are not supported generic/357 [not run] swapfiles are not supported generic/358 [not run] Reflink not supported by scratch filesystem type: ceph generic/359 [not run] Reflink not supported by scratch filesystem type: ceph generic/360 0s generic/361 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/362 [not run] this test requires richacl support on $SCRATCH_DEV generic/363 [not run] this test requires richacl support on $SCRATCH_DEV generic/364 [not run] this test requires richacl support on $SCRATCH_DEV generic/365 [not run] this test requires richacl support on $SCRATCH_DEV generic/366 [not run] this test requires richacl support on $SCRATCH_DEV generic/367 [not run] this test requires richacl support on $SCRATCH_DEV generic/368 [not run] this test requires richacl support on $SCRATCH_DEV generic/369 [not run] this test requires richacl support on $SCRATCH_DEV generic/370 [not run] this test requires richacl support on $SCRATCH_DEV generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/372 [not run] Reflink not supported by scratch filesystem type: ceph generic/373 [not run] Reflink not supported by scratch filesystem type: ceph generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph generic/375 0s generic/376 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/377 0s generic/378 0s generic/379 [not run] disk quotas not supported by this filesystem type: ceph generic/380 [not run] disk quotas not supported by this filesystem type: ceph generic/381 [not run] disk quotas not supported by this filesystem type: ceph generic/382 [not run] disk quotas not supported by this filesystem type: ceph generic/383 [not run] disk quotas not supported by this filesystem type: ceph generic/384 [not run] disk quotas not supported by this filesystem type: ceph generic/385 [not run] disk quotas not supported by this filesystem type: ceph generic/386 [not run] disk quotas not supported by this filesystem type: ceph generic/389 [not run] O_TMPFILE is not supported generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/392 [not run] ceph does not support shutdown generic/393 2s generic/394 0s generic/395 [not run] mount option "test_dummy_encryption" not allowed in this test generic/396 [not run] mount option "test_dummy_encryption" not allowed in this test generic/397 [not run] mount option "test_dummy_encryption" not allowed in this test generic/398 [not run] mount option "test_dummy_encryption" not allowed in this test generic/400 [not run] disk quotas not supported by this filesystem type: ceph generic/401 1s generic/402 [not run] filesystem ceph timestamp bounds are unknown generic/403 1s generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/406 2s generic/407 [not run] Reflink not supported by test filesystem type: ceph generic/408 [not run] Dedupe not supported by test filesystem type: ceph generic/409 [not run] require 172.21.15.161:6789:/scratch to be local device generic/410 [not run] require 172.21.15.161:6789:/scratch to be local device generic/411 [not run] require 172.21.15.161:6789:/scratch to be local device generic/412 1s generic/413 [not run] mount 172.21.15.161:6789:/scratch with dax failed generic/414 [not run] Reflink not supported by scratch filesystem type: ceph generic/417 [not run] ceph does not support shutdown generic/419 [not run] mount option "test_dummy_encryption" not allowed in this test generic/420 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/421 [not run] mount option "test_dummy_encryption" not allowed in this test generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/423 1s generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) generic/426 32s generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/428 1s generic/430 0s generic/431 1s generic/432 0s generic/433 1s generic/434 0s generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/437 1s generic/439 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/440 [not run] mount option "test_dummy_encryption" not allowed in this test generic/441 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/443 1s generic/444 0s generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/446 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/448 1s generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/450 7s generic/451 31s generic/452 1s generic/453 [not run] ceph does not allow unrestricted byte streams for names generic/454 [not run] ceph does not allow unrestricted byte streams for names generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/458 [not run] Reflink not supported by scratch filesystem type: ceph generic/460 265s generic/462 [not run] mount 172.21.15.161:6789:/scratch with dax failed generic/463 [not run] Reflink not supported by test filesystem type: ceph generic/465 7s generic/466 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/467 4s generic/468 [not run] ceph does not support shutdown generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/470 [not run] This test requires a valid $LOGWRITES_DEV generic/471 57s generic/472 [not run] swapfiles are not supported generic/474 [not run] ceph does not support shutdown generic/477 7s generic/478 12s generic/479 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/480 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/481 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/483 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/484 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/486 1s generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/489 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/490 1s generic/491 [not run] ceph does not support freezing generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) generic/493 [not run] swapfiles are not supported generic/494 [not run] swapfiles are not supported generic/495 [not run] swapfiles are not supported generic/496 [not run] swapfiles are not supported generic/497 [not run] swapfiles are not supported generic/498 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/501 [not run] Reflink not supported by scratch filesystem type: ceph generic/502 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/504 0s generic/505 [not run] ceph does not support shutdown generic/506 [not run] disk quotas not supported by this filesystem type: ceph generic/507 [not run] file system doesn't support chattr +ASai generic/508 [not run] lsattr not supported by test filesystem type: ceph generic/509 [not run] O_TMPFILE is not supported generic/510 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/513 [not run] Reflink not supported by scratch filesystem type: ceph generic/514 [not run] Reflink not supported by scratch filesystem type: ceph generic/515 [not run] Reflink not supported by scratch filesystem type: ceph generic/516 [not run] Dedupe not supported by test filesystem type: ceph generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph generic/518 [not run] Reflink not supported by scratch filesystem type: ceph generic/519 [not run] FIBMAP not supported by this filesystem generic/520 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/523 0s generic/524 156s generic/525 [not run] filesystem does not support huge file size generic/526 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/527 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/528 0s generic/529 1s generic/530 [not run] ceph does not support shutdown generic/531 [not run] O_TMPFILE is not supported generic/532 0s generic/533 1s generic/534 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/535 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/536 [not run] ceph does not support shutdown generic/537 [not run] FSTRIM not supported generic/538 912s generic/539 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/540 [not run] Reflink not supported by scratch filesystem type: ceph generic/541 [not run] Reflink not supported by scratch filesystem type: ceph generic/542 [not run] Reflink not supported by scratch filesystem type: ceph generic/543 [not run] Reflink not supported by scratch filesystem type: ceph generic/544 [not run] Reflink not supported by scratch filesystem type: ceph generic/545 [not run] file system doesn't support chattr +i generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/547 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/548 [not run] mount option "test_dummy_encryption" not allowed in this test generic/549 [not run] mount option "test_dummy_encryption" not allowed in this test generic/550 [not run] mount option "test_dummy_encryption" not allowed in this test generic/552 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) generic/554 [not run] swapfiles are not supported generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) generic/556 [not run] ceph does not support casefold feature generic/557 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/563 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/564 0s generic/565 1s generic/566 [not run] disk quotas not supported by this filesystem type: ceph generic/567 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/570 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/571 [not run] Require fcntl setlease support generic/572 [not run] fsverity utility required, skipped this test generic/573 [not run] fsverity utility required, skipped this test generic/574 [not run] fsverity utility required, skipped this test generic/575 [not run] fsverity utility required, skipped this test generic/576 [not run] fsverity utility required, skipped this test generic/577 [not run] fsverity utility required, skipped this test generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/580 [not run] mount option "test_dummy_encryption" not allowed in this test generic/581 [not run] mount option "test_dummy_encryption" not allowed in this test generic/582 [not run] mount option "test_dummy_encryption" not allowed in this test generic/583 [not run] mount option "test_dummy_encryption" not allowed in this test generic/584 [not run] mount option "test_dummy_encryption" not allowed in this test generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/587 [not run] disk quotas not supported by this filesystem type: ceph generic/588 [not run] Reflink not supported by scratch filesystem type: ceph generic/591 0s generic/592 [not run] mount option "test_dummy_encryption" not allowed in this test generic/593 [not run] mount option "test_dummy_encryption" not allowed in this test generic/594 [not run] disk quotas not supported by this filesystem type: ceph generic/595 [not run] mount option "test_dummy_encryption" not allowed in this test generic/596 [not run] accton utility required, skipped this test generic/597 1s generic/598 1s generic/599 [not run] ceph does not support shutdown generic/600 [not run] disk quotas not supported by this filesystem type: ceph generic/601 [not run] disk quotas not supported by this filesystem type: ceph generic/602 [not run] mount option "test_dummy_encryption" not allowed in this test generic/603 [not run] disk quotas not supported by this filesystem type: ceph generic/604 5s generic/605 [not run] mount 172.21.15.161:6789:/scratch with dax=always failed generic/606 [not run] mount 172.21.15.161:6789:/scratch with dax=always failed generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) generic/608 [not run] mount 172.21.15.161:6789:/scratch with dax=always failed generic/609 1s generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/611 1s generic/612 [not run] Reflink not supported by test filesystem type: ceph generic/613 [not run] mount option "test_dummy_encryption" not allowed in this test generic/614 [not run] test requires delayed allocation buffered writes generic/618 1s generic/620 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/621 [not run] mount option "test_dummy_encryption" not allowed in this test generic/623 [not run] ceph does not support shutdown generic/624 [not run] fsverity utility required, skipped this test generic/625 [not run] fsverity utility required, skipped this test generic/626 [not run] kernel doesn't support renameat2 syscall generic/628 [not run] Reflink not supported by scratch filesystem type: ceph generic/629 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph generic/632 1s generic/633 2s generic/634 2s generic/635 [not run] ceph does not support shutdown generic/636 [not run] swapfiles are not supported generic/637 0s generic/638 1s generic/639 1s generic/640 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/641 [not run] swapfiles are not supported generic/644 1s generic/645 291s generic/646 [not run] ceph does not support shutdown generic/647 1s generic/651 [not run] Reflink not supported by scratch filesystem type: ceph generic/652 [not run] Reflink not supported by scratch filesystem type: ceph generic/653 [not run] Reflink not supported by scratch filesystem type: ceph generic/654 [not run] Reflink not supported by scratch filesystem type: ceph generic/655 [not run] Reflink not supported by scratch filesystem type: ceph generic/657 [not run] Reflink not supported by scratch filesystem type: ceph generic/658 [not run] Reflink not supported by scratch filesystem type: ceph generic/659 [not run] Reflink not supported by scratch filesystem type: ceph generic/660 [not run] Reflink not supported by scratch filesystem type: ceph generic/661 [not run] Reflink not supported by scratch filesystem type: ceph generic/662 [not run] Reflink not supported by scratch filesystem type: ceph generic/663 [not run] Reflink not supported by scratch filesystem type: ceph generic/664 [not run] Reflink not supported by scratch filesystem type: ceph generic/665 [not run] Reflink not supported by scratch filesystem type: ceph generic/666 [not run] Reflink not supported by scratch filesystem type: ceph generic/667 [not run] Reflink not supported by scratch filesystem type: ceph generic/668 [not run] Reflink not supported by scratch filesystem type: ceph generic/669 [not run] Reflink not supported by scratch filesystem type: ceph generic/673 [not run] Reflink not supported by scratch filesystem type: ceph generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph generic/675 [not run] Reflink not supported by scratch filesystem type: ceph generic/676 555s generic/677 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/678 [not run] kernel does not support IO_URING generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/680 0s generic/681 [not run] disk quotas not supported by this filesystem type: ceph generic/682 [not run] disk quotas not supported by this filesystem type: ceph generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/684 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/689 0s generic/690 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/692 [not run] fsverity utility required, skipped this test generic/693 [not run] mount option "test_dummy_encryption" not allowed in this test generic/695 [not run] require 172.21.15.161:6789:/scratch to be valid block disk generic/696 0s generic/697 1s generic/698 1s generic/699 [not run] overlayfs doesn't support idmappped layers generic/700 [not run] kernel doesn't support renameat2 syscall generic/702 [not run] Reflink not supported by scratch filesystem type: ceph generic/703 [not run] kernel does not support IO_URING generic/704 [not run] require 172.21.15.161:6789:/test to be valid block disk generic/706 1s generic/708 0s generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph generic/721 [not run] xfs_io startupdate support is missing generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/728 4s generic/729 1s generic/730 [not run] require 172.21.15.161:6789:/test to be valid block disk generic/731 [not run] require 172.21.15.161:6789:/test to be valid block disk generic/732 1s generic/734 [not run] Reflink not supported by test filesystem type: ceph generic/735 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/736 - output mismatch (see /tmp/tmp.ByhSz7TqB0xfstests-dev/results//generic/736.out.bad) --- tests/generic/736.out 2024-02-02 11:49:43.280568928 +0000 +++ /tmp/tmp.ByhSz7TqB0xfstests-dev/results//generic/736.out.bad 2024-02-02 13:03:52.963376121 +0000 @@ -1,2 +1,4 @@ QA output created by 736 +*** buffer overflow detected ***: terminated +/tmp/tmp.ByhSz7TqB0xfstests-dev/tests/generic/736: line 32: 229327 Aborted $here/src/readdir-while-renames $target_dir Silence is golden generic/737 [not run] ceph does not support shutdown generic/738 [not run] ceph does not support freezing shared/002 [not run] not suitable for this filesystem type: ceph shared/032 [not run] not suitable for this filesystem type: ceph Ran: ceph/002 ceph/003 ceph/004 ceph/005 generic/001 generic/002 generic/003 generic/004 generic/005 generic/006 generic/007 generic/008 generic/009 generic/011 generic/012 generic/013 generic/014 generic/015 generic/016 generic/018 generic/020 generic/021 generic/022 generic/023 generic/024 generic/025 generic/026 generic/028 generic/029 generic/030 generic/031 generic/032 generic/033 generic/034 generic/035 generic/037 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/053 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/062 generic/063 generic/064 generic/065 generic/066 generic/067 generic/069 generic/070 generic/071 generic/073 generic/075 generic/076 generic/078 generic/079 generic/080 generic/081 generic/082 generic/084 generic/086 generic/087 generic/088 generic/090 generic/091 generic/092 generic/094 generic/096 generic/097 generic/098 generic/099 generic/101 generic/103 generic/104 generic/105 generic/106 generic/107 generic/108 generic/110 generic/111 generic/112 generic/113 generic/114 generic/115 generic/116 generic/117 generic/118 generic/119 generic/120 generic/121 generic/122 generic/123 generic/124 generic/126 generic/128 generic/129 generic/130 generic/131 generic/134 generic/135 generic/136 generic/138 generic/139 generic/140 generic/141 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/169 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/184 generic/185 generic/188 generic/189 generic/190 generic/191 generic/193 generic/194 generic/195 generic/196 generic/197 generic/198 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/207 generic/210 generic/211 generic/212 generic/213 generic/214 generic/215 generic/216 generic/217 generic/218 generic/219 generic/220 generic/221 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/236 generic/237 generic/238 generic/240 generic/244 generic/245 generic/246 generic/247 generic/248 generic/249 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/257 generic/258 generic/259 generic/260 generic/261 generic/262 generic/263 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/294 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/306 generic/307 generic/308 generic/309 generic/312 generic/313 generic/314 generic/315 generic/316 generic/317 generic/318 generic/319 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/337 generic/338 generic/341 generic/342 generic/343 generic/346 generic/347 generic/348 generic/353 generic/355 generic/356 generic/357 generic/358 generic/359 generic/360 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/375 generic/376 generic/377 generic/378 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/393 generic/394 generic/395 generic/396 generic/397 generic/398 generic/400 generic/401 generic/402 generic/403 generic/404 generic/406 generic/407 generic/408 generic/409 generic/410 generic/411 generic/412 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/423 generic/424 generic/425 generic/426 generic/427 generic/428 generic/430 generic/431 generic/432 generic/433 generic/434 generic/436 generic/437 generic/439 generic/440 generic/441 generic/443 generic/444 generic/445 generic/446 generic/448 generic/449 generic/450 generic/451 generic/452 generic/453 generic/454 generic/456 generic/458 generic/460 generic/462 generic/463 generic/465 generic/466 generic/467 generic/468 generic/469 generic/470 generic/471 generic/472 generic/474 generic/477 generic/478 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/486 generic/487 generic/488 generic/489 generic/490 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/504 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/523 generic/524 generic/525 generic/526 generic/527 generic/528 generic/529 generic/530 generic/531 generic/532 generic/533 generic/534 generic/535 generic/536 generic/537 generic/538 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/564 generic/565 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/591 generic/592 generic/593 generic/594 generic/595 generic/596 generic/597 generic/598 generic/599 generic/600 generic/601 generic/602 generic/603 generic/604 generic/605 generic/606 generic/607 generic/608 generic/609 generic/610 generic/611 generic/612 generic/613 generic/614 generic/618 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/632 generic/633 generic/634 generic/635 generic/636 generic/637 generic/638 generic/639 generic/640 generic/641 generic/644 generic/645 generic/646 generic/647 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/676 generic/677 generic/678 generic/679 generic/680 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/689 generic/690 generic/692 generic/693 generic/695 generic/696 generic/697 generic/698 generic/699 generic/700 generic/702 generic/703 generic/704 generic/706 generic/708 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/728 generic/729 generic/730 generic/731 generic/732 generic/734 generic/735 generic/736 generic/737 generic/738 shared/002 shared/032 Not run: ceph/002 ceph/003 ceph/005 generic/003 generic/004 generic/008 generic/009 generic/012 generic/014 generic/015 generic/016 generic/018 generic/021 generic/022 generic/024 generic/025 generic/026 generic/031 generic/032 generic/033 generic/034 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/063 generic/064 generic/065 generic/066 generic/067 generic/071 generic/073 generic/076 generic/078 generic/079 generic/081 generic/082 generic/086 generic/090 generic/092 generic/094 generic/096 generic/101 generic/103 generic/104 generic/106 generic/107 generic/108 generic/110 generic/111 generic/114 generic/115 generic/116 generic/118 generic/119 generic/120 generic/121 generic/122 generic/129 generic/130 generic/134 generic/136 generic/138 generic/139 generic/140 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/185 generic/188 generic/189 generic/190 generic/191 generic/194 generic/195 generic/196 generic/197 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/213 generic/214 generic/216 generic/217 generic/218 generic/219 generic/220 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/238 generic/240 generic/244 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/258 generic/259 generic/260 generic/261 generic/262 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/312 generic/315 generic/316 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/338 generic/341 generic/342 generic/343 generic/347 generic/348 generic/353 generic/356 generic/357 generic/358 generic/359 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/376 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/395 generic/396 generic/397 generic/398 generic/400 generic/402 generic/404 generic/407 generic/408 generic/409 generic/410 generic/411 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/424 generic/425 generic/427 generic/436 generic/439 generic/440 generic/441 generic/445 generic/446 generic/449 generic/453 generic/454 generic/456 generic/458 generic/462 generic/463 generic/466 generic/468 generic/469 generic/470 generic/472 generic/474 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/487 generic/488 generic/489 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/525 generic/526 generic/527 generic/530 generic/531 generic/534 generic/535 generic/536 generic/537 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/592 generic/593 generic/594 generic/595 generic/596 generic/599 generic/600 generic/601 generic/602 generic/603 generic/605 generic/606 generic/607 generic/608 generic/610 generic/612 generic/613 generic/614 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/635 generic/636 generic/640 generic/641 generic/646 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/677 generic/678 generic/679 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/690 generic/692 generic/693 generic/695 generic/699 generic/700 generic/702 generic/703 generic/704 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/730 generic/731 generic/734 generic/735 generic/737 generic/738 shared/002 shared/032 Failures: generic/317 generic/736 Failed 2 of 603 tests 2024-02-02T13:03:55.224 INFO:tasks.cephfs.test_fscrypt:Command stderr - 2024-02-02T13:03:55.224 DEBUG:teuthology.orchestra.run.smithi177:> sudo userdel --force --remove fsgqa 2024-02-02T13:03:55.316 INFO:teuthology.orchestra.run.smithi177.stderr:userdel: fsgqa mail spool (/var/mail/fsgqa) not found 2024-02-02T13:03:55.663 DEBUG:teuthology.orchestra.run.smithi177:> sudo userdel --force --remove 123456-fsgqa 2024-02-02T13:03:55.696 INFO:teuthology.orchestra.run.smithi177.stderr:userdel: 123456-fsgqa mail spool (/var/mail/123456-fsgqa) not found 2024-02-02T13:03:55.696 INFO:teuthology.orchestra.run.smithi177.stderr:userdel: 123456-fsgqa home directory (/home/123456-fsgqa) not found 2024-02-02T13:03:55.965 DEBUG:teuthology.orchestra.run.smithi177:> sudo groupdel fsgqa 2024-02-02T13:03:56.034 INFO:teuthology.orchestra.run.smithi177.stderr:groupdel: group 'fsgqa' does not exist 2024-02-02T13:03:56.036 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-02T13:03:56.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T13:03:56.037 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.ByhSz7TqB0xfstests-dev/results) 2024-02-02T13:03:56.104 INFO:teuthology.orchestra.run.smithi177.stdout: File: /tmp/tmp.ByhSz7TqB0xfstests-dev/results 2024-02-02T13:03:56.104 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2024-02-02T13:03:56.104 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 801h/2049d Inode: 801869 Links: 5 2024-02-02T13:03:56.104 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-02T13:03:56.104 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-02-02 11:53:36.098564782 +0000 2024-02-02T13:03:56.104 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-02-02 13:03:54.339338263 +0000 2024-02-02T13:03:56.104 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-02-02 13:03:54.339338263 +0000 2024-02-02T13:03:56.104 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-02-02 11:53:36.098564782 +0000 2024-02-02T13:03:56.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T13:03:56.106 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2024-02-02T13:03:56.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T13:03:56.173 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.ByhSz7TqB0xfstests-dev/results /var/log/ceph/xfstests-dev-results) 2024-02-02T13:03:56.645 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.ByhSz7TqB0xfstests-dev to /var/log/ceph. 2024-02-02T13:03:56.646 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -rf /tmp/tmp.ByhSz7TqB0xfstests-dev 2024-02-02T13:03:56.987 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -rf /tmp/tmp.mSCij3RKBAxfsprogs-dev 2024-02-02T13:03:57.068 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-02-02T13:03:57.068 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-02T13:03:57.203 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-02T13:03:57.356 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-02T13:03:57.509 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-02-02T13:03:57.509 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T13:03:57.510 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-02T13:03:57.550 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T13:03:57.550 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-02T13:03:57.606 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T13:03:58.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f76340cd640 1 Processor -- start 2024-02-02T13:03:58.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f76340cd640 1 -- start start 2024-02-02T13:03:58.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f76340cd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f762c0bc340 0x7f762c1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f76340cd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f762c0b8020 0x7f762c151f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f76340cd640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762c071550 con 0x7f762c141b30 2024-02-02T13:03:58.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f76340cd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762c071810 con 0x7f762c0bc340 2024-02-02T13:03:58.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f76340cd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762c071950 con 0x7f762c0b8020 2024-02-02T13:03:58.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7631668640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f762c141b30 0x7f762c147c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50424/0 (socket says 172.21.15.161:50424) 2024-02-02T13:03:58.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7631668640 1 -- 172.21.15.161:0/3347022763 learned_addr learned my addr 172.21.15.161:0/3347022763 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:03:58.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7631e69640 1 --2- 172.21.15.161:0/3347022763 >> v2:172.21.15.162:3300/0 conn(0x7f762c0bc340 0x7f762c1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f763266a640 1 --2- 172.21.15.161:0/3347022763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f762c0b8020 0x7f762c151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7630e67640 1 -- 172.21.15.161:0/3347022763 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190005055 0 0) 0x7f762c071550 con 0x7f762c141b30 2024-02-02T13:03:58.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7630e67640 1 -- 172.21.15.161:0/3347022763 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7618003530 con 0x7f762c141b30 2024-02-02T13:03:58.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7630e67640 1 -- 172.21.15.161:0/3347022763 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1062941490 0 0) 0x7f7618003530 con 0x7f762c141b30 2024-02-02T13:03:58.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7630e67640 1 -- 172.21.15.161:0/3347022763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f762c0b8020 msgr2=0x7f762c151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:03:58.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7630e67640 1 --2- 172.21.15.161:0/3347022763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f762c0b8020 0x7f762c151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7630e67640 1 -- 172.21.15.161:0/3347022763 >> v2:172.21.15.162:3300/0 conn(0x7f762c0bc340 msgr2=0x7f762c1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:03:58.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7630e67640 1 --2- 172.21.15.161:0/3347022763 >> v2:172.21.15.162:3300/0 conn(0x7f762c0bc340 0x7f762c1415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7630e67640 1 -- 172.21.15.161:0/3347022763 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c0bc720 con 0x7f762c141b30 2024-02-02T13:03:58.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7630e67640 1 -- 172.21.15.161:0/3347022763 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f7628001a00 con 0x7f762c141b30 2024-02-02T13:03:58.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7630e67640 1 -- 172.21.15.161:0/3347022763 >> v1:172.21.15.161:6789/0 conn(0x7f762c141b30 legacy=0x7f762c147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7630e67640 1 --2- 172.21.15.161:0/3347022763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f762c0b8020 0x7f7618003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7630e67640 1 --2- 172.21.15.161:0/3347022763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7618003f00 0x7f76180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7630e67640 1 --2- 172.21.15.161:0/3347022763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7618004d10 0x7f7618005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7630e67640 1 -- 172.21.15.161:0/3347022763 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c071810 con 0x7f7618003f00 2024-02-02T13:03:58.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7630e67640 1 -- 172.21.15.161:0/3347022763 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761800b990 con 0x7f7618004d10 2024-02-02T13:03:58.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7630e67640 1 -- 172.21.15.161:0/3347022763 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761800bb20 con 0x7f762c0b8020 2024-02-02T13:03:58.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7631668640 1 --2- 172.21.15.161:0/3347022763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7618003f00 0x7f76180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7631e69640 1 --2- 172.21.15.161:0/3347022763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f762c0b8020 0x7f7618003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f763266a640 1 --2- 172.21.15.161:0/3347022763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7618004d10 0x7f7618005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7631668640 1 -- 172.21.15.161:0/3347022763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f762c0b8020 msgr2=0x7f7618003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:03:58.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7631668640 1 --2- 172.21.15.161:0/3347022763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f762c0b8020 0x7f7618003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7631668640 1 -- 172.21.15.161:0/3347022763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7618004d10 msgr2=0x7f7618005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:03:58.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7631668640 1 --2- 172.21.15.161:0/3347022763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7618004d10 0x7f7618005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7631668640 1 -- 172.21.15.161:0/3347022763 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7618003530 con 0x7f7618003f00 2024-02-02T13:03:58.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.103+0000 7f7631e69640 1 --2- 172.21.15.161:0/3347022763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f762c0b8020 0x7f7618003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T13:03:58.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.131+0000 7f7631668640 1 --2- 172.21.15.161:0/3347022763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7618003f00 0x7f76180047d0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f762800a890 tx=0x7f762801d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3455029020e3269a server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:03:58.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.131+0000 7f7630e67640 1 -- 172.21.15.161:0/3347022763 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76280ad630 con 0x7f7618003f00 2024-02-02T13:03:58.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.131+0000 7f7630e67640 1 -- 172.21.15.161:0/3347022763 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76280a8070 con 0x7f7618003f00 2024-02-02T13:03:58.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.131+0000 7f7630e67640 1 -- 172.21.15.161:0/3347022763 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76280ada30 con 0x7f7618003f00 2024-02-02T13:03:58.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.131+0000 7f76340cd640 1 -- 172.21.15.161:0/3347022763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7618003f00 msgr2=0x7f76180047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.131+0000 7f76340cd640 1 --2- 172.21.15.161:0/3347022763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7618003f00 0x7f76180047d0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f762800a890 tx=0x7f762801d360 comp rx=0 tx=0).stop 2024-02-02T13:03:58.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.131+0000 7f763266a640 1 -- 172.21.15.161:0/3347022763 reap_dead start 2024-02-02T13:03:58.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f76340cd640 1 -- 172.21.15.161:0/3347022763 shutdown_connections 2024-02-02T13:03:58.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f76340cd640 1 -- 172.21.15.161:0/3347022763 >> 172.21.15.161:0/3347022763 conn(0x7f762c069ef0 msgr2=0x7f762c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:03:58.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f76340cd640 1 -- 172.21.15.161:0/3347022763 shutdown_connections 2024-02-02T13:03:58.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f76340cd640 1 -- 172.21.15.161:0/3347022763 wait complete. 2024-02-02T13:03:58.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f76340cd640 1 Processor -- start 2024-02-02T13:03:58.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f76340cd640 1 -- start start 2024-02-02T13:03:58.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f76340cd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7618003f00 0x7f762c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f76340cd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f762c0b5ff0 0x7f762c0bab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f76340cd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f762c1e3340 0x7f762c0bb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f76340cd640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0b4990 con 0x7f762c1e3340 2024-02-02T13:03:58.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f76340cd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0ba410 con 0x7f7618003f00 2024-02-02T13:03:58.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f76340cd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0ba6f0 con 0x7f762c0b5ff0 2024-02-02T13:03:58.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f763266a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f762c1e3340 0x7f762c0bb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f763266a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f762c1e3340 0x7f762c0bb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:50260/0 (socket says 172.21.15.161:50260) 2024-02-02T13:03:58.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f763266a640 1 -- 172.21.15.161:0/4217463264 learned_addr learned my addr 172.21.15.161:0/4217463264 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:03:58.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f7631668640 1 --2- 172.21.15.161:0/4217463264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f762c0b5ff0 0x7f762c0bab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f7631e69640 1 --2- 172.21.15.161:0/4217463264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7618003f00 0x7f762c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f763266a640 1 -- 172.21.15.161:0/4217463264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f762c0b5ff0 msgr2=0x7f762c0bab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f763266a640 1 --2- 172.21.15.161:0/4217463264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f762c0b5ff0 0x7f762c0bab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f763266a640 1 -- 172.21.15.161:0/4217463264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7618003f00 msgr2=0x7f762c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f763266a640 1 --2- 172.21.15.161:0/4217463264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7618003f00 0x7f762c0b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f763266a640 1 -- 172.21.15.161:0/4217463264 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c1e3900 con 0x7f762c1e3340 2024-02-02T13:03:58.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f763266a640 1 --2- 172.21.15.161:0/4217463264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f762c1e3340 0x7f762c0bb0c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f7624011860 tx=0x7f7624011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:03:58.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f761e7fc640 1 -- 172.21.15.161:0/4217463264 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7624011e50 con 0x7f762c1e3340 2024-02-02T13:03:58.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f761e7fc640 1 -- 172.21.15.161:0/4217463264 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7624004240 con 0x7f762c1e3340 2024-02-02T13:03:58.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f76340cd640 1 -- 172.21.15.161:0/4217463264 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762c1e3be0 con 0x7f762c1e3340 2024-02-02T13:03:58.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f761e7fc640 1 -- 172.21.15.161:0/4217463264 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762400f7a0 con 0x7f762c1e3340 2024-02-02T13:03:58.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.135+0000 7f76340cd640 1 -- 172.21.15.161:0/4217463264 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762c137f80 con 0x7f762c1e3340 2024-02-02T13:03:58.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.139+0000 7f76340cd640 1 -- 172.21.15.161:0/4217463264 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762c04e000 con 0x7f762c1e3340 2024-02-02T13:03:58.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.139+0000 7f761e7fc640 1 -- 172.21.15.161:0/4217463264 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f762400f900 con 0x7f762c1e3340 2024-02-02T13:03:58.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.139+0000 7f761e7fc640 1 --2- 172.21.15.161:0/4217463264 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7610065a60 0x7f7610067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.139+0000 7f7631e69640 1 --2- 172.21.15.161:0/4217463264 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7610065a60 0x7f7610067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.139+0000 7f761e7fc640 1 -- 172.21.15.161:0/4217463264 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7624083d90 con 0x7f762c1e3340 2024-02-02T13:03:58.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.139+0000 7f7631e69640 1 --2- 172.21.15.161:0/4217463264 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7610065a60 0x7f7610067f20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7620009ab0 tx=0x7f7620008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:03:58.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.147+0000 7f761e7fc640 1 -- 172.21.15.161:0/4217463264 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7624051730 con 0x7f762c1e3340 2024-02-02T13:03:58.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.303+0000 7f76340cd640 1 -- 172.21.15.161:0/4217463264 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f762c140f30 con 0x7f762c1e3340 2024-02-02T13:03:58.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.303+0000 7f761e7fc640 1 -- 172.21.15.161:0/4217463264 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16149 (secure 0 0 0) 0x7f7624006c40 con 0x7f762c1e3340 2024-02-02T13:03:58.309 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T13:03:58.309 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":31,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:49:32.837266+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:49:30.264273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-02T11:49:30.811831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T13:03:58.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.307+0000 7f76340cd640 1 -- 172.21.15.161:0/4217463264 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7610065a60 msgr2=0x7f7610067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.307+0000 7f76340cd640 1 --2- 172.21.15.161:0/4217463264 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7610065a60 0x7f7610067f20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7620009ab0 tx=0x7f7620008040 comp rx=0 tx=0).stop 2024-02-02T13:03:58.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.307+0000 7f76340cd640 1 -- 172.21.15.161:0/4217463264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f762c1e3340 msgr2=0x7f762c0bb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.307+0000 7f76340cd640 1 --2- 172.21.15.161:0/4217463264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f762c1e3340 0x7f762c0bb0c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f7624011860 tx=0x7f7624011d20 comp rx=0 tx=0).stop 2024-02-02T13:03:58.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.307+0000 7f76340cd640 1 -- 172.21.15.161:0/4217463264 shutdown_connections 2024-02-02T13:03:58.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.307+0000 7f76340cd640 1 --2- 172.21.15.161:0/4217463264 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7610065a60 0x7f7610067f20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.307+0000 7f76340cd640 1 --2- 172.21.15.161:0/4217463264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f762c1e3340 0x7f762c0bb0c0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.307+0000 7f76340cd640 1 --2- 172.21.15.161:0/4217463264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f762c0b5ff0 0x7f762c0bab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.307+0000 7f76340cd640 1 --2- 172.21.15.161:0/4217463264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7618003f00 0x7f762c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.307+0000 7f76340cd640 1 -- 172.21.15.161:0/4217463264 >> 172.21.15.161:0/4217463264 conn(0x7f762c069ef0 msgr2=0x7f762c13f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:03:58.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.307+0000 7f76340cd640 1 -- 172.21.15.161:0/4217463264 shutdown_connections 2024-02-02T13:03:58.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.307+0000 7f76340cd640 1 -- 172.21.15.161:0/4217463264 wait complete. 2024-02-02T13:03:58.328 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-02T11:48:40.330782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-02T11:49:30.264273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-02-02T11:49:30.811831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-02T13:03:58.328 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-02T13:03:58.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.447+0000 7ffaa960d640 1 Processor -- start 2024-02-02T13:03:58.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.447+0000 7ffaa960d640 1 -- start start 2024-02-02T13:03:58.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa960d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffaa40b3320 0x7ffaa41541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa960d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa4148a80 con 0x7ffaa40b8540 2024-02-02T13:03:58.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa960d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa40b3890 con 0x7ffaa40b8df0 2024-02-02T13:03:58.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa960d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40b3b70 con 0x7ffaa40b3320 2024-02-02T13:03:58.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa27fc640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ffaa40b8540 0x7ffaa4148f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50426/0 (socket says 172.21.15.161:50426) 2024-02-02T13:03:58.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa27fc640 1 -- 172.21.15.161:0/2526613439 learned_addr learned my addr 172.21.15.161:0/2526613439 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:03:58.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa37fe640 1 --2- 172.21.15.161:0/2526613439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffaa40b3320 0x7ffaa41541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa1ffb640 1 -- 172.21.15.161:0/2526613439 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074005120 0 0) 0x7ffaa4148a80 con 0x7ffaa40b8540 2024-02-02T13:03:58.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa1ffb640 1 -- 172.21.15.161:0/2526613439 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa8c003530 con 0x7ffaa40b8540 2024-02-02T13:03:58.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa1ffb640 1 -- 172.21.15.161:0/2526613439 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4177122440 0 0) 0x7ffa8c003530 con 0x7ffaa40b8540 2024-02-02T13:03:58.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa1ffb640 1 -- 172.21.15.161:0/2526613439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffaa40b3320 msgr2=0x7ffaa41541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:03:58.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa1ffb640 1 --2- 172.21.15.161:0/2526613439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffaa40b3320 0x7ffaa41541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa1ffb640 1 -- 172.21.15.161:0/2526613439 >> v1:172.21.15.162:6789/0 conn(0x7ffaa40b8df0 legacy=0x7ffaa4142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa1ffb640 1 -- 172.21.15.161:0/2526613439 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa40b3e50 con 0x7ffaa40b8540 2024-02-02T13:03:58.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa1ffb640 1 -- 172.21.15.161:0/2526613439 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7ffa98001a00 con 0x7ffaa40b8540 2024-02-02T13:03:58.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa1ffb640 1 -- 172.21.15.161:0/2526613439 >> v1:172.21.15.161:6789/0 conn(0x7ffaa40b8540 legacy=0x7ffaa4148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa1ffb640 1 --2- 172.21.15.161:0/2526613439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffaa40b3320 0x7ffa8c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa1ffb640 1 --2- 172.21.15.161:0/2526613439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa8c003f30 0x7ffa8c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa1ffb640 1 --2- 172.21.15.161:0/2526613439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa8c004d10 0x7ffa8c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa1ffb640 1 -- 172.21.15.161:0/2526613439 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40b3b70 con 0x7ffa8c003f30 2024-02-02T13:03:58.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa1ffb640 1 -- 172.21.15.161:0/2526613439 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c00ba70 con 0x7ffa8c004d10 2024-02-02T13:03:58.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa1ffb640 1 -- 172.21.15.161:0/2526613439 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c00bc30 con 0x7ffaa40b3320 2024-02-02T13:03:58.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa27fc640 1 --2- 172.21.15.161:0/2526613439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa8c003f30 0x7ffa8c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa2ffd640 1 --2- 172.21.15.161:0/2526613439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffaa40b3320 0x7ffa8c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa37fe640 1 --2- 172.21.15.161:0/2526613439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa8c004d10 0x7ffa8c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa27fc640 1 -- 172.21.15.161:0/2526613439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffaa40b3320 msgr2=0x7ffa8c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:03:58.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa27fc640 1 --2- 172.21.15.161:0/2526613439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffaa40b3320 0x7ffa8c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa27fc640 1 -- 172.21.15.161:0/2526613439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa8c004d10 msgr2=0x7ffa8c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:03:58.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa27fc640 1 --2- 172.21.15.161:0/2526613439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa8c004d10 0x7ffa8c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.451+0000 7ffaa27fc640 1 -- 172.21.15.161:0/2526613439 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c003530 con 0x7ffa8c003f30 2024-02-02T13:03:58.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa27fc640 1 --2- 172.21.15.161:0/2526613439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa8c003f30 0x7ffa8c0047d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800a820 tx=0x7ffa9801fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb05e4f2940c34c server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:03:58.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa1ffb640 1 -- 172.21.15.161:0/2526613439 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa980aa6b0 con 0x7ffa8c003f30 2024-02-02T13:03:58.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa1ffb640 1 -- 172.21.15.161:0/2526613439 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa980aa830 con 0x7ffa8c003f30 2024-02-02T13:03:58.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa1ffb640 1 -- 172.21.15.161:0/2526613439 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa980aabe0 con 0x7ffa8c003f30 2024-02-02T13:03:58.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa960d640 1 -- 172.21.15.161:0/2526613439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa8c003f30 msgr2=0x7ffa8c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa960d640 1 --2- 172.21.15.161:0/2526613439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa8c003f30 0x7ffa8c0047d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800a820 tx=0x7ffa9801fa80 comp rx=0 tx=0).stop 2024-02-02T13:03:58.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa37fe640 1 -- 172.21.15.161:0/2526613439 reap_dead start 2024-02-02T13:03:58.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa960d640 1 -- 172.21.15.161:0/2526613439 shutdown_connections 2024-02-02T13:03:58.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa960d640 1 -- 172.21.15.161:0/2526613439 >> 172.21.15.161:0/2526613439 conn(0x7ffaa406a120 msgr2=0x7ffaa406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:03:58.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa960d640 1 -- 172.21.15.161:0/2526613439 shutdown_connections 2024-02-02T13:03:58.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa960d640 1 -- 172.21.15.161:0/2526613439 wait complete. 2024-02-02T13:03:58.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa960d640 1 Processor -- start 2024-02-02T13:03:58.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa960d640 1 -- start start 2024-02-02T13:03:58.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa960d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa8c003f30 0x7ffaa4143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa960d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffaa41e1b60 0x7ffaa41cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa960d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffaa41d10f0 0x7ffaa413d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa960d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa41d03a0 con 0x7ffa8c003f30 2024-02-02T13:03:58.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa960d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa41e1110 con 0x7ffaa41e1b60 2024-02-02T13:03:58.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa960d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa41e1fa0 con 0x7ffaa41d10f0 2024-02-02T13:03:58.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa2ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa8c003f30 0x7ffaa4143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa2ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa8c003f30 0x7ffaa4143490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:50286/0 (socket says 172.21.15.161:50286) 2024-02-02T13:03:58.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa2ffd640 1 -- 172.21.15.161:0/652440116 learned_addr learned my addr 172.21.15.161:0/652440116 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:03:58.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa37fe640 1 --2- 172.21.15.161:0/652440116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffaa41d10f0 0x7ffaa413d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa2ffd640 1 -- 172.21.15.161:0/652440116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffaa41d10f0 msgr2=0x7ffaa413d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa2ffd640 1 --2- 172.21.15.161:0/652440116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffaa41d10f0 0x7ffaa413d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa2ffd640 1 -- 172.21.15.161:0/652440116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffaa41e1b60 msgr2=0x7ffaa41cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa2ffd640 1 --2- 172.21.15.161:0/652440116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffaa41e1b60 0x7ffaa41cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa2ffd640 1 -- 172.21.15.161:0/652440116 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa413dd50 con 0x7ffa8c003f30 2024-02-02T13:03:58.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa37fe640 1 --2- 172.21.15.161:0/652440116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffaa41d10f0 0x7ffaa413d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:03:58.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa2ffd640 1 --2- 172.21.15.161:0/652440116 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa8c003f30 0x7ffaa4143490 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00e550 tx=0x7ffa9c00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:03:58.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffa8b7fe640 1 -- 172.21.15.161:0/652440116 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c0052e0 con 0x7ffa8c003f30 2024-02-02T13:03:58.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffa8b7fe640 1 -- 172.21.15.161:0/652440116 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c005440 con 0x7ffa8c003f30 2024-02-02T13:03:58.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa960d640 1 -- 172.21.15.161:0/652440116 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa41e1360 con 0x7ffa8c003f30 2024-02-02T13:03:58.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffa8b7fe640 1 -- 172.21.15.161:0/652440116 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c003820 con 0x7ffa8c003f30 2024-02-02T13:03:58.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.455+0000 7ffaa960d640 1 -- 172.21.15.161:0/652440116 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa41460c0 con 0x7ffa8c003f30 2024-02-02T13:03:58.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.459+0000 7ffaa960d640 1 -- 172.21.15.161:0/652440116 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa404e000 con 0x7ffa8c003f30 2024-02-02T13:03:58.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.459+0000 7ffa8b7fe640 1 -- 172.21.15.161:0/652440116 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffa9c003980 con 0x7ffa8c003f30 2024-02-02T13:03:58.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.459+0000 7ffa8b7fe640 1 --2- 172.21.15.161:0/652440116 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ffa90065a60 0x7ffa90067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.459+0000 7ffa8b7fe640 1 -- 172.21.15.161:0/652440116 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa9c082f00 con 0x7ffa8c003f30 2024-02-02T13:03:58.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.459+0000 7ffaa27fc640 1 --2- 172.21.15.161:0/652440116 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ffa90065a60 0x7ffa90067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.459+0000 7ffaa27fc640 1 --2- 172.21.15.161:0/652440116 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ffa90065a60 0x7ffa90067f20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffa980b1000 tx=0x7ffa980b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:03:58.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.463+0000 7ffa8b7fe640 1 -- 172.21.15.161:0/652440116 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffa9c050950 con 0x7ffa8c003f30 2024-02-02T13:03:58.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.619+0000 7ffaa960d640 1 -- 172.21.15.161:0/652440116 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffaa41484d0 con 0x7ffa8c003f30 2024-02-02T13:03:58.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.623+0000 7ffa8b7fe640 1 -- 172.21.15.161:0/652440116 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa9c053f70 con 0x7ffa8c003f30 2024-02-02T13:03:58.625 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-02-02T13:03:58.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.623+0000 7ffaa960d640 1 -- 172.21.15.161:0/652440116 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ffa90065a60 msgr2=0x7ffa90067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.623+0000 7ffaa960d640 1 --2- 172.21.15.161:0/652440116 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ffa90065a60 0x7ffa90067f20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffa980b1000 tx=0x7ffa980b6040 comp rx=0 tx=0).stop 2024-02-02T13:03:58.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.623+0000 7ffaa960d640 1 -- 172.21.15.161:0/652440116 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa8c003f30 msgr2=0x7ffaa4143490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.623+0000 7ffaa960d640 1 --2- 172.21.15.161:0/652440116 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa8c003f30 0x7ffaa4143490 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00e550 tx=0x7ffa9c00ea10 comp rx=0 tx=0).stop 2024-02-02T13:03:58.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.623+0000 7ffaa960d640 1 -- 172.21.15.161:0/652440116 shutdown_connections 2024-02-02T13:03:58.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.623+0000 7ffaa960d640 1 --2- 172.21.15.161:0/652440116 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ffa90065a60 0x7ffa90067f20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.623+0000 7ffaa960d640 1 --2- 172.21.15.161:0/652440116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffaa41d10f0 0x7ffaa413d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.623+0000 7ffaa960d640 1 --2- 172.21.15.161:0/652440116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffaa41e1b60 0x7ffaa41cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.623+0000 7ffaa960d640 1 --2- 172.21.15.161:0/652440116 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa8c003f30 0x7ffaa4143490 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.623+0000 7ffaa960d640 1 -- 172.21.15.161:0/652440116 >> 172.21.15.161:0/652440116 conn(0x7ffaa406a120 msgr2=0x7ffaa41402d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:03:58.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.623+0000 7ffaa960d640 1 -- 172.21.15.161:0/652440116 shutdown_connections 2024-02-02T13:03:58.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.623+0000 7ffaa960d640 1 -- 172.21.15.161:0/652440116 wait complete. 2024-02-02T13:03:58.645 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-02T13:03:58.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1ea4cf640 1 Processor -- start 2024-02-02T13:03:58.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1ea4cf640 1 -- start start 2024-02-02T13:03:58.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1ea4cf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1e40b3320 0x7fd1e41541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1ea4cf640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e4148a80 con 0x7fd1e40b8df0 2024-02-02T13:03:58.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1ea4cf640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e40b3890 con 0x7fd1e40b8540 2024-02-02T13:03:58.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1ea4cf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e40b3b70 con 0x7fd1e40b3320 2024-02-02T13:03:58.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e3fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd1e40b8df0 0x7fd1e4142840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50428/0 (socket says 172.21.15.161:50428) 2024-02-02T13:03:58.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e3fff640 1 -- 172.21.15.161:0/1859475072 learned_addr learned my addr 172.21.15.161:0/1859475072 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:03:58.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e8a6c640 1 --2- 172.21.15.161:0/1859475072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1e40b3320 0x7fd1e41541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e37fe640 1 -- 172.21.15.161:0/1859475072 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279731474 0 0) 0x7fd1e4148a80 con 0x7fd1e40b8df0 2024-02-02T13:03:58.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e37fe640 1 -- 172.21.15.161:0/1859475072 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1d0003530 con 0x7fd1e40b8df0 2024-02-02T13:03:58.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e37fe640 1 -- 172.21.15.161:0/1859475072 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3766789155 0 0) 0x7fd1d0003530 con 0x7fd1e40b8df0 2024-02-02T13:03:58.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e37fe640 1 -- 172.21.15.161:0/1859475072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1e40b3320 msgr2=0x7fd1e41541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:03:58.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e37fe640 1 --2- 172.21.15.161:0/1859475072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1e40b3320 0x7fd1e41541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e37fe640 1 -- 172.21.15.161:0/1859475072 >> v1:172.21.15.162:6789/0 conn(0x7fd1e40b8540 legacy=0x7fd1e4148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e37fe640 1 -- 172.21.15.161:0/1859475072 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e40b3e50 con 0x7fd1e40b8df0 2024-02-02T13:03:58.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e37fe640 1 -- 172.21.15.161:0/1859475072 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7fd1cc001680 con 0x7fd1e40b8df0 2024-02-02T13:03:58.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e37fe640 1 -- 172.21.15.161:0/1859475072 >> v1:172.21.15.161:6789/0 conn(0x7fd1e40b8df0 legacy=0x7fd1e4142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e37fe640 1 --2- 172.21.15.161:0/1859475072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1d00039b0 0x7fd1d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e37fe640 1 --2- 172.21.15.161:0/1859475072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1e40b3320 0x7fd1d00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e37fe640 1 --2- 172.21.15.161:0/1859475072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1d0004d10 0x7fd1d0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e37fe640 1 -- 172.21.15.161:0/1859475072 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e40b3b70 con 0x7fd1d0004d10 2024-02-02T13:03:58.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e37fe640 1 -- 172.21.15.161:0/1859475072 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d000ba70 con 0x7fd1d00039b0 2024-02-02T13:03:58.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e37fe640 1 -- 172.21.15.161:0/1859475072 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d000bc30 con 0x7fd1e40b3320 2024-02-02T13:03:58.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e8a6c640 1 --2- 172.21.15.161:0/1859475072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1d0004d10 0x7fd1d0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e3fff640 1 --2- 172.21.15.161:0/1859475072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1d00039b0 0x7fd1d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1db7fe640 1 --2- 172.21.15.161:0/1859475072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1e40b3320 0x7fd1d00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e8a6c640 1 -- 172.21.15.161:0/1859475072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1e40b3320 msgr2=0x7fd1d00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:03:58.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e8a6c640 1 --2- 172.21.15.161:0/1859475072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1e40b3320 0x7fd1d00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e8a6c640 1 -- 172.21.15.161:0/1859475072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1d00039b0 msgr2=0x7fd1d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:03:58.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e8a6c640 1 --2- 172.21.15.161:0/1859475072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1d00039b0 0x7fd1d0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.763+0000 7fd1e8a6c640 1 -- 172.21.15.161:0/1859475072 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d0003530 con 0x7fd1d0004d10 2024-02-02T13:03:58.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1e8a6c640 1 --2- 172.21.15.161:0/1859475072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1d0004d10 0x7fd1d0005190 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009f90 tx=0x7fd1dc01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e66133ae566e98 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:03:58.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1e37fe640 1 -- 172.21.15.161:0/1859475072 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc0a5c30 con 0x7fd1d0004d10 2024-02-02T13:03:58.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1e37fe640 1 -- 172.21.15.161:0/1859475072 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1dc00f040 con 0x7fd1d0004d10 2024-02-02T13:03:58.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1e37fe640 1 -- 172.21.15.161:0/1859475072 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc0ad440 con 0x7fd1d0004d10 2024-02-02T13:03:58.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1ea4cf640 1 -- 172.21.15.161:0/1859475072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1d0004d10 msgr2=0x7fd1d0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1ea4cf640 1 --2- 172.21.15.161:0/1859475072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1d0004d10 0x7fd1d0005190 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009f90 tx=0x7fd1dc01cc20 comp rx=0 tx=0).stop 2024-02-02T13:03:58.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1e8a6c640 1 -- 172.21.15.161:0/1859475072 reap_dead start 2024-02-02T13:03:58.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1ea4cf640 1 -- 172.21.15.161:0/1859475072 shutdown_connections 2024-02-02T13:03:58.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1ea4cf640 1 -- 172.21.15.161:0/1859475072 >> 172.21.15.161:0/1859475072 conn(0x7fd1e406a120 msgr2=0x7fd1e406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:03:58.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1ea4cf640 1 -- 172.21.15.161:0/1859475072 shutdown_connections 2024-02-02T13:03:58.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1ea4cf640 1 -- 172.21.15.161:0/1859475072 wait complete. 2024-02-02T13:03:58.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1ea4cf640 1 Processor -- start 2024-02-02T13:03:58.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1ea4cf640 1 -- start start 2024-02-02T13:03:58.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1ea4cf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1e4145cf0 0x7fd1e41431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1ea4cf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1e41d0e80 0x7fd1e4143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1ea4cf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1e4143700 0x7fd1e41443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1ea4cf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e41d0200 con 0x7fd1e4143700 2024-02-02T13:03:58.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1ea4cf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e41448e0 con 0x7fd1e41d0e80 2024-02-02T13:03:58.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1ea4cf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e41cf3d0 con 0x7fd1e4145cf0 2024-02-02T13:03:58.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1e8a6c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1e4143700 0x7fd1e41443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1e8a6c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1e4143700 0x7fd1e41443a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:50302/0 (socket says 172.21.15.161:50302) 2024-02-02T13:03:58.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1e8a6c640 1 -- 172.21.15.161:0/1198538065 learned_addr learned my addr 172.21.15.161:0/1198538065 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:03:58.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.767+0000 7fd1e3fff640 1 --2- 172.21.15.161:0/1198538065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1e4145cf0 0x7fd1e41431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.771+0000 7fd1db7fe640 1 --2- 172.21.15.161:0/1198538065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1e41d0e80 0x7fd1e4143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.771+0000 7fd1e8a6c640 1 -- 172.21.15.161:0/1198538065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1e4145cf0 msgr2=0x7fd1e41431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.771+0000 7fd1e8a6c640 1 --2- 172.21.15.161:0/1198538065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1e4145cf0 0x7fd1e41431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.771+0000 7fd1e8a6c640 1 -- 172.21.15.161:0/1198538065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1e41d0e80 msgr2=0x7fd1e4143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.771+0000 7fd1e8a6c640 1 --2- 172.21.15.161:0/1198538065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1e41d0e80 0x7fd1e4143e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.771+0000 7fd1e8a6c640 1 -- 172.21.15.161:0/1198538065 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e41cf6b0 con 0x7fd1e4143700 2024-02-02T13:03:58.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.771+0000 7fd1db7fe640 1 --2- 172.21.15.161:0/1198538065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1e41d0e80 0x7fd1e4143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:03:58.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.771+0000 7fd1e8a6c640 1 --2- 172.21.15.161:0/1198538065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1e4143700 0x7fd1e41443a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0b0040 tx=0x7fd1dc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:03:58.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.771+0000 7fd1e17fa640 1 -- 172.21.15.161:0/1198538065 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc0039a0 con 0x7fd1e4143700 2024-02-02T13:03:58.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.771+0000 7fd1e17fa640 1 -- 172.21.15.161:0/1198538065 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1dc003b00 con 0x7fd1e4143700 2024-02-02T13:03:58.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.771+0000 7fd1ea4cf640 1 -- 172.21.15.161:0/1198538065 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e41cfa00 con 0x7fd1e4143700 2024-02-02T13:03:58.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.771+0000 7fd1e17fa640 1 -- 172.21.15.161:0/1198538065 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc0ae890 con 0x7fd1e4143700 2024-02-02T13:03:58.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.771+0000 7fd1ea4cf640 1 -- 172.21.15.161:0/1198538065 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e41460d0 con 0x7fd1e4143700 2024-02-02T13:03:58.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.771+0000 7fd1ea4cf640 1 -- 172.21.15.161:0/1198538065 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e4142ed0 con 0x7fd1e4143700 2024-02-02T13:03:58.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.771+0000 7fd1e17fa640 1 -- 172.21.15.161:0/1198538065 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd1dc0b4040 con 0x7fd1e4143700 2024-02-02T13:03:58.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.771+0000 7fd1e17fa640 1 --2- 172.21.15.161:0/1198538065 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd1c4065a60 0x7fd1c4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:58.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.771+0000 7fd1e3fff640 1 --2- 172.21.15.161:0/1198538065 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd1c4065a60 0x7fd1c4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:58.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.771+0000 7fd1e17fa640 1 -- 172.21.15.161:0/1198538065 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1dc11cf00 con 0x7fd1e4143700 2024-02-02T13:03:58.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.771+0000 7fd1e3fff640 1 --2- 172.21.15.161:0/1198538065 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd1c4065a60 0x7fd1c4067f20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc001060 tx=0x7fd1cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:03:58.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.775+0000 7fd1e17fa640 1 -- 172.21.15.161:0/1198538065 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd1dc0ea8c0 con 0x7fd1e4143700 2024-02-02T13:03:58.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.919+0000 7fd1ea4cf640 1 -- 172.21.15.161:0/1198538065 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1e404e000 con 0x7fd1e4143700 2024-02-02T13:03:58.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.919+0000 7fd1e17fa640 1 -- 172.21.15.161:0/1198538065 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd1dc0b20a0 con 0x7fd1e4143700 2024-02-02T13:03:58.922 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-02-02T13:03:58.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.919+0000 7fd1ea4cf640 1 -- 172.21.15.161:0/1198538065 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd1c4065a60 msgr2=0x7fd1c4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.919+0000 7fd1ea4cf640 1 --2- 172.21.15.161:0/1198538065 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd1c4065a60 0x7fd1c4067f20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc001060 tx=0x7fd1cc009040 comp rx=0 tx=0).stop 2024-02-02T13:03:58.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.919+0000 7fd1ea4cf640 1 -- 172.21.15.161:0/1198538065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1e4143700 msgr2=0x7fd1e41443a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:58.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.919+0000 7fd1ea4cf640 1 --2- 172.21.15.161:0/1198538065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1e4143700 0x7fd1e41443a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0b0040 tx=0x7fd1dc009750 comp rx=0 tx=0).stop 2024-02-02T13:03:58.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.919+0000 7fd1ea4cf640 1 -- 172.21.15.161:0/1198538065 shutdown_connections 2024-02-02T13:03:58.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.919+0000 7fd1ea4cf640 1 --2- 172.21.15.161:0/1198538065 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fd1c4065a60 0x7fd1c4067f20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.919+0000 7fd1ea4cf640 1 --2- 172.21.15.161:0/1198538065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1e4143700 0x7fd1e41443a0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.919+0000 7fd1ea4cf640 1 --2- 172.21.15.161:0/1198538065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1e41d0e80 0x7fd1e4143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.919+0000 7fd1ea4cf640 1 --2- 172.21.15.161:0/1198538065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1e4145cf0 0x7fd1e41431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:58.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.919+0000 7fd1ea4cf640 1 -- 172.21.15.161:0/1198538065 >> 172.21.15.161:0/1198538065 conn(0x7fd1e406a120 msgr2=0x7fd1e40b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:03:58.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.919+0000 7fd1ea4cf640 1 -- 172.21.15.161:0/1198538065 shutdown_connections 2024-02-02T13:03:58.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:58.919+0000 7fd1ea4cf640 1 -- 172.21.15.161:0/1198538065 wait complete. 2024-02-02T13:03:58.940 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-02T13:03:59.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.059+0000 7fbb4d6b6640 1 Processor -- start 2024-02-02T13:03:59.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.059+0000 7fbb4d6b6640 1 -- start start 2024-02-02T13:03:59.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.059+0000 7fbb4d6b6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb4806db10 0x7fbb480715f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.059+0000 7fbb4d6b6640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbb480b3980 0x7fbb481415a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.059+0000 7fbb4d6b6640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb48070360 con 0x7fbb48070af0 2024-02-02T13:03:59.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.059+0000 7fbb4d6b6640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb480711d0 con 0x7fbb480b3980 2024-02-02T13:03:59.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.059+0000 7fbb4d6b6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4806fde0 con 0x7fbb4806db10 2024-02-02T13:03:59.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.059+0000 7fbb477fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbb480b3980 0x7fbb481415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:59.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.059+0000 7fbb46ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb4806db10 0x7fbb480715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:59.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.059+0000 7fbb467fc640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fbb48070af0 0x7fbb48147800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50442/0 (socket says 172.21.15.161:50442) 2024-02-02T13:03:59.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.059+0000 7fbb467fc640 1 -- 172.21.15.161:0/3741845723 learned_addr learned my addr 172.21.15.161:0/3741845723 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:03:59.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.059+0000 7fbb477fe640 1 -- 172.21.15.161:0/3741845723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb4806db10 msgr2=0x7fbb480715f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:03:59.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.059+0000 7fbb477fe640 1 --2- 172.21.15.161:0/3741845723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb4806db10 0x7fbb480715f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.059+0000 7fbb477fe640 1 -- 172.21.15.161:0/3741845723 >> v1:172.21.15.161:6789/0 conn(0x7fbb48070af0 legacy=0x7fbb48147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:59.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.059+0000 7fbb477fe640 1 -- 172.21.15.161:0/3741845723 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb48070080 con 0x7fbb480b3980 2024-02-02T13:03:59.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.059+0000 7fbb477fe640 1 --2- 172.21.15.161:0/3741845723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb480b3980 0x7fbb481415a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009d90 tx=0x7fbb4001c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5c1a409e0f398f server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:03:59.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb45ffb640 1 -- 172.21.15.161:0/3741845723 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb400a5800 con 0x7fbb480b3980 2024-02-02T13:03:59.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb45ffb640 1 -- 172.21.15.161:0/3741845723 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb400a5960 con 0x7fbb480b3980 2024-02-02T13:03:59.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb45ffb640 1 -- 172.21.15.161:0/3741845723 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb400a5cf0 con 0x7fbb480b3980 2024-02-02T13:03:59.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb4d6b6640 1 -- 172.21.15.161:0/3741845723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb480b3980 msgr2=0x7fbb481415a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:59.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb4d6b6640 1 --2- 172.21.15.161:0/3741845723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb480b3980 0x7fbb481415a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009d90 tx=0x7fbb4001c830 comp rx=0 tx=0).stop 2024-02-02T13:03:59.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb4d6b6640 1 -- 172.21.15.161:0/3741845723 shutdown_connections 2024-02-02T13:03:59.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb4d6b6640 1 --2- 172.21.15.161:0/3741845723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb480b3980 0x7fbb481415a0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb4d6b6640 1 --2- 172.21.15.161:0/3741845723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb4806db10 0x7fbb480715f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb4d6b6640 1 -- 172.21.15.161:0/3741845723 >> 172.21.15.161:0/3741845723 conn(0x7fbb480bcf90 msgr2=0x7fbb480bd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:03:59.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb4d6b6640 1 -- 172.21.15.161:0/3741845723 shutdown_connections 2024-02-02T13:03:59.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb4d6b6640 1 -- 172.21.15.161:0/3741845723 wait complete. 2024-02-02T13:03:59.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb4d6b6640 1 Processor -- start 2024-02-02T13:03:59.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb4d6b6640 1 -- start start 2024-02-02T13:03:59.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb4d6b6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb4806db10 0x7fbb48069f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb4d6b6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb48070af0 0x7fbb4814ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb4d6b6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb480b3980 0x7fbb4814b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb4d6b6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4806a4c0 con 0x7fbb4806db10 2024-02-02T13:03:59.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb4d6b6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4814c120 con 0x7fbb480b3980 2024-02-02T13:03:59.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb4d6b6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4814a700 con 0x7fbb48070af0 2024-02-02T13:03:59.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb46ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb4806db10 0x7fbb48069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:59.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb46ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb4806db10 0x7fbb48069f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:50322/0 (socket says 172.21.15.161:50322) 2024-02-02T13:03:59.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb46ffd640 1 -- 172.21.15.161:0/2237327712 learned_addr learned my addr 172.21.15.161:0/2237327712 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:03:59.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb46ffd640 1 -- 172.21.15.161:0/2237327712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb48070af0 msgr2=0x7fbb4814ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:59.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb46ffd640 1 --2- 172.21.15.161:0/2237327712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb48070af0 0x7fbb4814ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb46ffd640 1 -- 172.21.15.161:0/2237327712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb480b3980 msgr2=0x7fbb4814b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:59.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb46ffd640 1 --2- 172.21.15.161:0/2237327712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb480b3980 0x7fbb4814b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb46ffd640 1 -- 172.21.15.161:0/2237327712 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb40009a70 con 0x7fbb4806db10 2024-02-02T13:03:59.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb46ffd640 1 --2- 172.21.15.161:0/2237327712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb4806db10 0x7fbb48069f80 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800e870 tx=0x7fbb3800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:03:59.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb2f7fe640 1 -- 172.21.15.161:0/2237327712 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb38009510 con 0x7fbb4806db10 2024-02-02T13:03:59.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb2f7fe640 1 -- 172.21.15.161:0/2237327712 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3800eec0 con 0x7fbb4806db10 2024-02-02T13:03:59.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb4d6b6640 1 -- 172.21.15.161:0/2237327712 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4806abb0 con 0x7fbb4806db10 2024-02-02T13:03:59.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb2f7fe640 1 -- 172.21.15.161:0/2237327712 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3800cb40 con 0x7fbb4806db10 2024-02-02T13:03:59.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.063+0000 7fbb4d6b6640 1 -- 172.21.15.161:0/2237327712 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4814c610 con 0x7fbb4806db10 2024-02-02T13:03:59.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.067+0000 7fbb4d6b6640 1 -- 172.21.15.161:0/2237327712 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb4804e000 con 0x7fbb4806db10 2024-02-02T13:03:59.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.067+0000 7fbb2f7fe640 1 -- 172.21.15.161:0/2237327712 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbb3800cca0 con 0x7fbb4806db10 2024-02-02T13:03:59.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.067+0000 7fbb2f7fe640 1 --2- 172.21.15.161:0/2237327712 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbb34065a60 0x7fbb34067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.067+0000 7fbb2f7fe640 1 -- 172.21.15.161:0/2237327712 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb38083a20 con 0x7fbb4806db10 2024-02-02T13:03:59.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.067+0000 7fbb467fc640 1 --2- 172.21.15.161:0/2237327712 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbb34065a60 0x7fbb34067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:59.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.067+0000 7fbb467fc640 1 --2- 172.21.15.161:0/2237327712 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbb34065a60 0x7fbb34067f20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbb4806a860 tx=0x7fbb3c007a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:03:59.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.071+0000 7fbb2f7fe640 1 -- 172.21.15.161:0/2237327712 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbb38051440 con 0x7fbb4806db10 2024-02-02T13:03:59.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.223+0000 7fbb4d6b6640 1 -- 172.21.15.161:0/2237327712 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb4814da20 con 0x7fbb4806db10 2024-02-02T13:03:59.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.223+0000 7fbb2f7fe640 1 -- 172.21.15.161:0/2237327712 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb38017020 con 0x7fbb4806db10 2024-02-02T13:03:59.227 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2024-02-02T13:03:59.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.223+0000 7fbb4d6b6640 1 -- 172.21.15.161:0/2237327712 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbb34065a60 msgr2=0x7fbb34067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:59.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.223+0000 7fbb4d6b6640 1 --2- 172.21.15.161:0/2237327712 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbb34065a60 0x7fbb34067f20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbb4806a860 tx=0x7fbb3c007a50 comp rx=0 tx=0).stop 2024-02-02T13:03:59.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.223+0000 7fbb4d6b6640 1 -- 172.21.15.161:0/2237327712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb4806db10 msgr2=0x7fbb48069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:59.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.223+0000 7fbb4d6b6640 1 --2- 172.21.15.161:0/2237327712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb4806db10 0x7fbb48069f80 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800e870 tx=0x7fbb3800ec70 comp rx=0 tx=0).stop 2024-02-02T13:03:59.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.223+0000 7fbb4d6b6640 1 -- 172.21.15.161:0/2237327712 shutdown_connections 2024-02-02T13:03:59.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.223+0000 7fbb4d6b6640 1 --2- 172.21.15.161:0/2237327712 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbb34065a60 0x7fbb34067f20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.223+0000 7fbb4d6b6640 1 --2- 172.21.15.161:0/2237327712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb480b3980 0x7fbb4814b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.223+0000 7fbb4d6b6640 1 --2- 172.21.15.161:0/2237327712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb48070af0 0x7fbb4814ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.223+0000 7fbb4d6b6640 1 --2- 172.21.15.161:0/2237327712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb4806db10 0x7fbb48069f80 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.223+0000 7fbb4d6b6640 1 -- 172.21.15.161:0/2237327712 >> 172.21.15.161:0/2237327712 conn(0x7fbb480bcf90 msgr2=0x7fbb480b8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:03:59.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.223+0000 7fbb4d6b6640 1 -- 172.21.15.161:0/2237327712 shutdown_connections 2024-02-02T13:03:59.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.223+0000 7fbb4d6b6640 1 -- 172.21.15.161:0/2237327712 wait complete. 2024-02-02T13:03:59.245 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-02T13:03:59.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.363+0000 7f41a9b70640 1 Processor -- start 2024-02-02T13:03:59.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.363+0000 7f41a9b70640 1 -- start start 2024-02-02T13:03:59.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.363+0000 7f41a9b70640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f41a40bc340 0x7f41a4142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.363+0000 7f41a9b70640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f41a4142d50 0x7f41a4148d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.363+0000 7f41a9b70640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a4071770 con 0x7f41a41492a0 2024-02-02T13:03:59.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.363+0000 7f41a9b70640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a41496d0 con 0x7f41a4142d50 2024-02-02T13:03:59.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.363+0000 7f41a9b70640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a40b37e0 con 0x7f41a40bc340 2024-02-02T13:03:59.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.363+0000 7f41a2ffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f41a4142d50 0x7f41a4148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:59.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.363+0000 7f41a2ffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f41a4142d50 0x7f41a4148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:50324/0 (socket says 172.21.15.161:50324) 2024-02-02T13:03:59.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.363+0000 7f41a2ffd640 1 -- 172.21.15.161:0/1358926826 learned_addr learned my addr 172.21.15.161:0/1358926826 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:03:59.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.363+0000 7f41a37fe640 1 --2- 172.21.15.161:0/1358926826 >> v2:172.21.15.162:3300/0 conn(0x7f41a40bc340 0x7f41a4142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:59.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.363+0000 7f41a2ffd640 1 -- 172.21.15.161:0/1358926826 >> v2:172.21.15.162:3300/0 conn(0x7f41a40bc340 msgr2=0x7f41a4142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:03:59.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.363+0000 7f41a2ffd640 1 --2- 172.21.15.161:0/1358926826 >> v2:172.21.15.162:3300/0 conn(0x7f41a40bc340 0x7f41a4142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.363+0000 7f41a2ffd640 1 -- 172.21.15.161:0/1358926826 >> v1:172.21.15.162:6789/0 conn(0x7f41a41492a0 legacy=0x7f41a40b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:59.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.363+0000 7f41a2ffd640 1 -- 172.21.15.161:0/1358926826 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a40b3ac0 con 0x7f41a4142d50 2024-02-02T13:03:59.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.367+0000 7f41a2ffd640 1 --2- 172.21.15.161:0/1358926826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41a4142d50 0x7f41a4148d60 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f41a406d110 tx=0x7f419801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb3b864a1516b8e server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:03:59.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.367+0000 7f41a27fc640 1 -- 172.21.15.161:0/1358926826 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41980a89f0 con 0x7f41a4142d50 2024-02-02T13:03:59.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.367+0000 7f41a27fc640 1 -- 172.21.15.161:0/1358926826 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41980a8b50 con 0x7f41a4142d50 2024-02-02T13:03:59.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.367+0000 7f41a27fc640 1 -- 172.21.15.161:0/1358926826 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41980b0440 con 0x7f41a4142d50 2024-02-02T13:03:59.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.367+0000 7f41a9b70640 1 -- 172.21.15.161:0/1358926826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41a4142d50 msgr2=0x7f41a4148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:59.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.367+0000 7f41a9b70640 1 --2- 172.21.15.161:0/1358926826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41a4142d50 0x7f41a4148d60 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f41a406d110 tx=0x7f419801ecf0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.367+0000 7f41a9b70640 1 -- 172.21.15.161:0/1358926826 shutdown_connections 2024-02-02T13:03:59.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.367+0000 7f41a9b70640 1 --2- 172.21.15.161:0/1358926826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41a4142d50 0x7f41a4148d60 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.367+0000 7f41a9b70640 1 --2- 172.21.15.161:0/1358926826 >> v2:172.21.15.162:3300/0 conn(0x7f41a40bc340 0x7f41a4142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.367+0000 7f41a9b70640 1 -- 172.21.15.161:0/1358926826 >> 172.21.15.161:0/1358926826 conn(0x7f41a4069ef0 msgr2=0x7f41a406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:03:59.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.367+0000 7f41a9b70640 1 -- 172.21.15.161:0/1358926826 shutdown_connections 2024-02-02T13:03:59.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.367+0000 7f41a9b70640 1 -- 172.21.15.161:0/1358926826 wait complete. 2024-02-02T13:03:59.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a9b70640 1 Processor -- start 2024-02-02T13:03:59.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a9b70640 1 -- start start 2024-02-02T13:03:59.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a9b70640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41a40bc340 0x7f41a41d4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a9b70640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41a41492a0 0x7f41a4136bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a9b70640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41a4137c40 0x7f41a41380f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a9b70640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a41d53d0 con 0x7f41a41492a0 2024-02-02T13:03:59.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a9b70640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a4135f40 con 0x7f41a40bc340 2024-02-02T13:03:59.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a9b70640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a4138f80 con 0x7f41a4137c40 2024-02-02T13:03:59.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a2ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41a41492a0 0x7f41a4136bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:59.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a2ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41a41492a0 0x7f41a4136bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:50330/0 (socket says 172.21.15.161:50330) 2024-02-02T13:03:59.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a2ffd640 1 -- 172.21.15.161:0/1019123269 learned_addr learned my addr 172.21.15.161:0/1019123269 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:03:59.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a37fe640 1 --2- 172.21.15.161:0/1019123269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41a40bc340 0x7f41a41d4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:59.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a3fff640 1 --2- 172.21.15.161:0/1019123269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41a4137c40 0x7f41a41380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:59.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a2ffd640 1 -- 172.21.15.161:0/1019123269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41a4137c40 msgr2=0x7f41a41380f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:59.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a2ffd640 1 --2- 172.21.15.161:0/1019123269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41a4137c40 0x7f41a41380f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a2ffd640 1 -- 172.21.15.161:0/1019123269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41a40bc340 msgr2=0x7f41a41d4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:59.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a2ffd640 1 --2- 172.21.15.161:0/1019123269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41a40bc340 0x7f41a41d4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a2ffd640 1 -- 172.21.15.161:0/1019123269 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41980094d0 con 0x7f41a41492a0 2024-02-02T13:03:59.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a3fff640 1 --2- 172.21.15.161:0/1019123269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41a4137c40 0x7f41a41380f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:03:59.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a2ffd640 1 --2- 172.21.15.161:0/1019123269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41a41492a0 0x7f41a4136bc0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f419801b900 tx=0x7f419801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:03:59.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f418bfff640 1 -- 172.21.15.161:0/1019123269 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41980a89f0 con 0x7f41a41492a0 2024-02-02T13:03:59.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f418bfff640 1 -- 172.21.15.161:0/1019123269 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41980b9410 con 0x7f41a41492a0 2024-02-02T13:03:59.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a9b70640 1 -- 172.21.15.161:0/1019123269 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a41d5a30 con 0x7f41a41492a0 2024-02-02T13:03:59.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f418bfff640 1 -- 172.21.15.161:0/1019123269 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41980b97e0 con 0x7f41a41492a0 2024-02-02T13:03:59.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a9b70640 1 -- 172.21.15.161:0/1019123269 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a4147e00 con 0x7f41a41492a0 2024-02-02T13:03:59.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a9b70640 1 -- 172.21.15.161:0/1019123269 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a41360b0 con 0x7f41a41492a0 2024-02-02T13:03:59.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f418bfff640 1 -- 172.21.15.161:0/1019123269 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f41980b7040 con 0x7f41a41492a0 2024-02-02T13:03:59.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f418bfff640 1 --2- 172.21.15.161:0/1019123269 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4190065a60 0x7f4190067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f418bfff640 1 -- 172.21.15.161:0/1019123269 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4198120ec0 con 0x7f41a41492a0 2024-02-02T13:03:59.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.371+0000 7f41a37fe640 1 --2- 172.21.15.161:0/1019123269 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4190065a60 0x7f4190067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:59.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.375+0000 7f41a37fe640 1 --2- 172.21.15.161:0/1019123269 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4190065a60 0x7f4190067f20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4194003fd0 tx=0x7f41940039c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:03:59.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.379+0000 7f418bfff640 1 -- 172.21.15.161:0/1019123269 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f41980ee910 con 0x7f41a41492a0 2024-02-02T13:03:59.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.543+0000 7f41a9b70640 1 -- 172.21.15.161:0/1019123269 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f41a40b3d70 con 0x7f41a41492a0 2024-02-02T13:03:59.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.543+0000 7f418bfff640 1 -- 172.21.15.161:0/1019123269 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f41980c7020 con 0x7f41a41492a0 2024-02-02T13:03:59.548 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2024-02-02T13:03:59.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.547+0000 7f41a9b70640 1 -- 172.21.15.161:0/1019123269 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4190065a60 msgr2=0x7f4190067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:59.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.547+0000 7f41a9b70640 1 --2- 172.21.15.161:0/1019123269 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4190065a60 0x7f4190067f20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4194003fd0 tx=0x7f41940039c0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.547+0000 7f41a9b70640 1 -- 172.21.15.161:0/1019123269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41a41492a0 msgr2=0x7f41a4136bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:59.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.547+0000 7f41a9b70640 1 --2- 172.21.15.161:0/1019123269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41a41492a0 0x7f41a4136bc0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f419801b900 tx=0x7f419801ba90 comp rx=0 tx=0).stop 2024-02-02T13:03:59.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.547+0000 7f41a9b70640 1 -- 172.21.15.161:0/1019123269 shutdown_connections 2024-02-02T13:03:59.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.547+0000 7f41a9b70640 1 --2- 172.21.15.161:0/1019123269 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4190065a60 0x7f4190067f20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.547+0000 7f41a9b70640 1 --2- 172.21.15.161:0/1019123269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41a4137c40 0x7f41a41380f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.547+0000 7f41a9b70640 1 --2- 172.21.15.161:0/1019123269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41a41492a0 0x7f41a4136bc0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.547+0000 7f41a9b70640 1 --2- 172.21.15.161:0/1019123269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41a40bc340 0x7f41a41d4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.547+0000 7f41a9b70640 1 -- 172.21.15.161:0/1019123269 >> 172.21.15.161:0/1019123269 conn(0x7f41a4069ef0 msgr2=0x7f41a40b8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:03:59.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.547+0000 7f41a9b70640 1 -- 172.21.15.161:0/1019123269 shutdown_connections 2024-02-02T13:03:59.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.547+0000 7f41a9b70640 1 -- 172.21.15.161:0/1019123269 wait complete. 2024-02-02T13:03:59.567 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-02T13:03:59.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T13:03:59.567 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-02-02T13:03:59.600 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-02-02T13:03:59.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T13:03:59.601 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-02T13:03:59.671 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-02T13:03:59.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f09192d9640 1 Processor -- start 2024-02-02T13:03:59.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f09192d9640 1 -- start start 2024-02-02T13:03:59.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f09192d9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09140b9900 0x7f09140b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f09192d9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09140b3c40 con 0x7f0914071160 2024-02-02T13:03:59.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f09192d9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09140b9d70 con 0x7f09141429f0 2024-02-02T13:03:59.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f09192d9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09140b5140 con 0x7f09140b9900 2024-02-02T13:03:59.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f0912ffd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0914071160 0x7f09140b8ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50456/0 (socket says 172.21.15.161:50456) 2024-02-02T13:03:59.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f0912ffd640 1 -- 172.21.15.161:0/14164534 learned_addr learned my addr 172.21.15.161:0/14164534 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:03:59.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f0911ffb640 1 -- 172.21.15.161:0/14164534 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925977157 0 0) 0x7f09140b3c40 con 0x7f0914071160 2024-02-02T13:03:59.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f0911ffb640 1 -- 172.21.15.161:0/14164534 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08fc003530 con 0x7f0914071160 2024-02-02T13:03:59.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f09127fc640 1 --2- 172.21.15.161:0/14164534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09140b9900 0x7f09140b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:59.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f0911ffb640 1 -- 172.21.15.161:0/14164534 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 197647126 0 0) 0x7f08fc003530 con 0x7f0914071160 2024-02-02T13:03:59.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f0911ffb640 1 -- 172.21.15.161:0/14164534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09140b9900 msgr2=0x7f09140b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:03:59.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f0911ffb640 1 --2- 172.21.15.161:0/14164534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09140b9900 0x7f09140b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f0911ffb640 1 -- 172.21.15.161:0/14164534 >> v1:172.21.15.162:6789/0 conn(0x7f09141429f0 legacy=0x7f0914153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:59.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f0911ffb640 1 -- 172.21.15.161:0/14164534 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09140b9f60 con 0x7f0914071160 2024-02-02T13:03:59.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f0911ffb640 1 -- 172.21.15.161:0/14164534 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f0904001680 con 0x7f0914071160 2024-02-02T13:03:59.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f0911ffb640 1 -- 172.21.15.161:0/14164534 >> v1:172.21.15.161:6789/0 conn(0x7f0914071160 legacy=0x7f09140b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:59.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f0911ffb640 1 --2- 172.21.15.161:0/14164534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09140b9900 0x7f08fc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f0911ffb640 1 --2- 172.21.15.161:0/14164534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc003ef0 0x7f08fc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f0911ffb640 1 --2- 172.21.15.161:0/14164534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08fc004d10 0x7f08fc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f0911ffb640 1 -- 172.21.15.161:0/14164534 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09140b5140 con 0x7f08fc003ef0 2024-02-02T13:03:59.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f0911ffb640 1 -- 172.21.15.161:0/14164534 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc00b9f0 con 0x7f08fc004d10 2024-02-02T13:03:59.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f0911ffb640 1 -- 172.21.15.161:0/14164534 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc00bbb0 con 0x7f09140b9900 2024-02-02T13:03:59.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f09127fc640 1 --2- 172.21.15.161:0/14164534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc003ef0 0x7f08fc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:59.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f09137fe640 1 --2- 172.21.15.161:0/14164534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08fc004d10 0x7f08fc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:59.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f0912ffd640 1 --2- 172.21.15.161:0/14164534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09140b9900 0x7f08fc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:59.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f09127fc640 1 -- 172.21.15.161:0/14164534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09140b9900 msgr2=0x7f08fc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:03:59.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f09127fc640 1 --2- 172.21.15.161:0/14164534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09140b9900 0x7f08fc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f09127fc640 1 -- 172.21.15.161:0/14164534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08fc004d10 msgr2=0x7f08fc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:03:59.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f09127fc640 1 --2- 172.21.15.161:0/14164534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08fc004d10 0x7f08fc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f09127fc640 1 -- 172.21.15.161:0/14164534 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc003530 con 0x7f08fc003ef0 2024-02-02T13:03:59.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f09137fe640 1 --2- 172.21.15.161:0/14164534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08fc004d10 0x7f08fc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:03:59.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.787+0000 7f0912ffd640 1 --2- 172.21.15.161:0/14164534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09140b9900 0x7f08fc0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:03:59.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f09127fc640 1 --2- 172.21.15.161:0/14164534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc003ef0 0x7f08fc0047d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f0908009ae0 tx=0x7f090801c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4750837ed0c8304 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:03:59.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f0911ffb640 1 -- 172.21.15.161:0/14164534 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09080a5580 con 0x7f08fc003ef0 2024-02-02T13:03:59.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f0911ffb640 1 -- 172.21.15.161:0/14164534 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09080a56e0 con 0x7f08fc003ef0 2024-02-02T13:03:59.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f0911ffb640 1 -- 172.21.15.161:0/14164534 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09080a5a90 con 0x7f08fc003ef0 2024-02-02T13:03:59.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f09192d9640 1 -- 172.21.15.161:0/14164534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc003ef0 msgr2=0x7f08fc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:59.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f09192d9640 1 --2- 172.21.15.161:0/14164534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc003ef0 0x7f08fc0047d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f0908009ae0 tx=0x7f090801c990 comp rx=0 tx=0).stop 2024-02-02T13:03:59.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f09137fe640 1 -- 172.21.15.161:0/14164534 reap_dead start 2024-02-02T13:03:59.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f09192d9640 1 -- 172.21.15.161:0/14164534 shutdown_connections 2024-02-02T13:03:59.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f09192d9640 1 -- 172.21.15.161:0/14164534 >> 172.21.15.161:0/14164534 conn(0x7f09140be150 msgr2=0x7f09140be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:03:59.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f09192d9640 1 -- 172.21.15.161:0/14164534 shutdown_connections 2024-02-02T13:03:59.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f09192d9640 1 -- 172.21.15.161:0/14164534 wait complete. 2024-02-02T13:03:59.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f09192d9640 1 Processor -- start 2024-02-02T13:03:59.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f09192d9640 1 -- start start 2024-02-02T13:03:59.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f09192d9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc003ef0 0x7f09140bd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f09192d9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f091413cbb0 0x7f09140b5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f09192d9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09141dd990 0x7f09141dde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f09192d9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09141e0e90 con 0x7f08fc003ef0 2024-02-02T13:03:59.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f09192d9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09141de930 con 0x7f091413cbb0 2024-02-02T13:03:59.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f09192d9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09141e1e30 con 0x7f09141dd990 2024-02-02T13:03:59.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f0912ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc003ef0 0x7f09140bd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:59.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f0912ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc003ef0 0x7f09140bd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:50352/0 (socket says 172.21.15.161:50352) 2024-02-02T13:03:59.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f0912ffd640 1 -- 172.21.15.161:0/3603386688 learned_addr learned my addr 172.21.15.161:0/3603386688 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:03:59.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f09127fc640 1 --2- 172.21.15.161:0/3603386688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f091413cbb0 0x7f09140b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:59.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.791+0000 7f09137fe640 1 --2- 172.21.15.161:0/3603386688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09141dd990 0x7f09141dde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:59.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.795+0000 7f0912ffd640 1 -- 172.21.15.161:0/3603386688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09141dd990 msgr2=0x7f09141dde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:59.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.795+0000 7f0912ffd640 1 --2- 172.21.15.161:0/3603386688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09141dd990 0x7f09141dde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.795+0000 7f0912ffd640 1 -- 172.21.15.161:0/3603386688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f091413cbb0 msgr2=0x7f09140b5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:59.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.795+0000 7f0912ffd640 1 --2- 172.21.15.161:0/3603386688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f091413cbb0 0x7f09140b5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.795+0000 7f0912ffd640 1 -- 172.21.15.161:0/3603386688 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09141e1070 con 0x7f08fc003ef0 2024-02-02T13:03:59.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.795+0000 7f09137fe640 1 --2- 172.21.15.161:0/3603386688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09141dd990 0x7f09141dde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:03:59.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.795+0000 7f09127fc640 1 --2- 172.21.15.161:0/3603386688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f091413cbb0 0x7f09140b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T13:03:59.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.795+0000 7f0912ffd640 1 --2- 172.21.15.161:0/3603386688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc003ef0 0x7f09140bd980 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f090400d910 tx=0x7f090400ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:03:59.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.795+0000 7f08fb7fe640 1 -- 172.21.15.161:0/3603386688 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09040074e0 con 0x7f08fc003ef0 2024-02-02T13:03:59.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.795+0000 7f08fb7fe640 1 -- 172.21.15.161:0/3603386688 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0904007640 con 0x7f08fc003ef0 2024-02-02T13:03:59.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.795+0000 7f09192d9640 1 -- 172.21.15.161:0/3603386688 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09141e1350 con 0x7f08fc003ef0 2024-02-02T13:03:59.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.795+0000 7f08fb7fe640 1 -- 172.21.15.161:0/3603386688 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09040049f0 con 0x7f08fc003ef0 2024-02-02T13:03:59.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.795+0000 7f09192d9640 1 -- 172.21.15.161:0/3603386688 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09141e1910 con 0x7f08fc003ef0 2024-02-02T13:03:59.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.795+0000 7f09192d9640 1 -- 172.21.15.161:0/3603386688 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09140b62e0 con 0x7f08fc003ef0 2024-02-02T13:03:59.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.795+0000 7f08fb7fe640 1 -- 172.21.15.161:0/3603386688 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0904004b50 con 0x7f08fc003ef0 2024-02-02T13:03:59.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.795+0000 7f08fb7fe640 1 --2- 172.21.15.161:0/3603386688 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0900065a90 0x7f0900067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:03:59.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.795+0000 7f09127fc640 1 --2- 172.21.15.161:0/3603386688 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0900065a90 0x7f0900067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:03:59.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.795+0000 7f08fb7fe640 1 -- 172.21.15.161:0/3603386688 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0904082ed0 con 0x7f08fc003ef0 2024-02-02T13:03:59.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.795+0000 7f09127fc640 1 --2- 172.21.15.161:0/3603386688 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0900065a90 0x7f0900067f50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f09080af000 tx=0x7f09080046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:03:59.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.799+0000 7f08fb7fe640 1 -- 172.21.15.161:0/3603386688 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0904050890 con 0x7f08fc003ef0 2024-02-02T13:03:59.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.991+0000 7f09192d9640 1 -- 172.21.15.161:0/3603386688 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f091404e000 con 0x7f08fc003ef0 2024-02-02T13:03:59.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.991+0000 7f08fb7fe640 1 -- 172.21.15.161:0/3603386688 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3958 (secure 0 0 0) 0x7f0904053eb0 con 0x7f08fc003ef0 2024-02-02T13:03:59.995 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T13:03:59.995 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4535,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/236294405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":236294405},{"type":"v1","addr":"172.21.15.162:6833","nonce":236294405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3772183556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3772183556},{"type":"v1","addr":"172.21.15.161:6835","nonce":3772183556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-02T11:49:31.833135+0000","modified":"2024-02-02T11:49:34.491389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/1621598548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1621598548},{"type":"v1","addr":"172.21.15.161:6837","nonce":1621598548}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-02T13:03:59.995 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 14 2024-02-02T13:03:59.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.991+0000 7f09192d9640 1 -- 172.21.15.161:0/3603386688 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0900065a90 msgr2=0x7f0900067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:59.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.991+0000 7f09192d9640 1 --2- 172.21.15.161:0/3603386688 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0900065a90 0x7f0900067f50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f09080af000 tx=0x7f09080046d0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.991+0000 7f09192d9640 1 -- 172.21.15.161:0/3603386688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc003ef0 msgr2=0x7f09140bd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:03:59.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.991+0000 7f09192d9640 1 --2- 172.21.15.161:0/3603386688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc003ef0 0x7f09140bd980 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f090400d910 tx=0x7f090400ddd0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.995+0000 7f09192d9640 1 -- 172.21.15.161:0/3603386688 shutdown_connections 2024-02-02T13:03:59.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.995+0000 7f09192d9640 1 --2- 172.21.15.161:0/3603386688 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0900065a90 0x7f0900067f50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.995+0000 7f09192d9640 1 --2- 172.21.15.161:0/3603386688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09141dd990 0x7f09141dde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.995+0000 7f09192d9640 1 --2- 172.21.15.161:0/3603386688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f091413cbb0 0x7f09140b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.995+0000 7f09192d9640 1 --2- 172.21.15.161:0/3603386688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc003ef0 0x7f09140bd980 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:03:59.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.995+0000 7f09192d9640 1 -- 172.21.15.161:0/3603386688 >> 172.21.15.161:0/3603386688 conn(0x7f09140be150 msgr2=0x7f09141d4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:03:59.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.995+0000 7f09192d9640 1 -- 172.21.15.161:0/3603386688 shutdown_connections 2024-02-02T13:03:59.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:03:59.995+0000 7f09192d9640 1 -- 172.21.15.161:0/3603386688 wait complete. 2024-02-02T13:04:00.016 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T13:04:00.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.131+0000 7ff99ac44640 1 Processor -- start 2024-02-02T13:04:00.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.131+0000 7ff99ac44640 1 -- start start 2024-02-02T13:04:00.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.131+0000 7ff99ac44640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff9940b9900 0x7ff9940b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:00.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.131+0000 7ff99ac44640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff9941429f0 0x7ff994153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:00.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.131+0000 7ff99ac44640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9940b3c40 con 0x7ff994071160 2024-02-02T13:04:00.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.131+0000 7ff99ac44640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9940b5140 con 0x7ff9941429f0 2024-02-02T13:04:00.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.131+0000 7ff99ac44640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9940b9d50 con 0x7ff9940b9900 2024-02-02T13:04:00.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.131+0000 7ff9991e1640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff9941429f0 0x7ff994153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:00.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.131+0000 7ff9991e1640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff9941429f0 0x7ff994153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:50364/0 (socket says 172.21.15.161:50364) 2024-02-02T13:04:00.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.131+0000 7ff9991e1640 1 -- 172.21.15.161:0/2353312146 learned_addr learned my addr 172.21.15.161:0/2353312146 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:00.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.131+0000 7ff9989e0640 1 --1- 172.21.15.161:0/2353312146 >> v1:172.21.15.161:6789/0 conn(0x7ff994071160 0x7ff9940b8ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50464/0 (socket says 172.21.15.161:50464) 2024-02-02T13:04:00.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.131+0000 7ff993fff640 1 --2- 172.21.15.161:0/2353312146 >> v2:172.21.15.162:3300/0 conn(0x7ff9940b9900 0x7ff9940b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:00.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.131+0000 7ff9991e1640 1 -- 172.21.15.161:0/2353312146 >> v2:172.21.15.162:3300/0 conn(0x7ff9940b9900 msgr2=0x7ff9940b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:00.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.131+0000 7ff9991e1640 1 --2- 172.21.15.161:0/2353312146 >> v2:172.21.15.162:3300/0 conn(0x7ff9940b9900 0x7ff9940b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.131+0000 7ff9991e1640 1 -- 172.21.15.161:0/2353312146 >> v1:172.21.15.161:6789/0 conn(0x7ff994071160 legacy=0x7ff9940b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:00.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.131+0000 7ff9991e1640 1 -- 172.21.15.161:0/2353312146 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9940b9f60 con 0x7ff9941429f0 2024-02-02T13:04:00.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.131+0000 7ff9937fe640 1 -- 172.21.15.161:0/2353312146 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453197453 0 0) 0x7ff9940b3c40 con 0x7ff994071160 2024-02-02T13:04:00.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff9991e1640 1 --2- 172.21.15.161:0/2353312146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9941429f0 0x7ff994153260 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7ff9940bbca0 tx=0x7ff98c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf9e5d280d9f561 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:00.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff9937fe640 1 -- 172.21.15.161:0/2353312146 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c0a5800 con 0x7ff9941429f0 2024-02-02T13:04:00.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff9937fe640 1 -- 172.21.15.161:0/2353312146 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c0a5960 con 0x7ff9941429f0 2024-02-02T13:04:00.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff9937fe640 1 -- 172.21.15.161:0/2353312146 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c0a5cf0 con 0x7ff9941429f0 2024-02-02T13:04:00.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff99ac44640 1 -- 172.21.15.161:0/2353312146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9941429f0 msgr2=0x7ff994153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:00.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff99ac44640 1 --2- 172.21.15.161:0/2353312146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9941429f0 0x7ff994153260 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7ff9940bbca0 tx=0x7ff98c01c940 comp rx=0 tx=0).stop 2024-02-02T13:04:00.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff99ac44640 1 -- 172.21.15.161:0/2353312146 shutdown_connections 2024-02-02T13:04:00.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff99ac44640 1 --2- 172.21.15.161:0/2353312146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9941429f0 0x7ff994153260 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff99ac44640 1 --2- 172.21.15.161:0/2353312146 >> v2:172.21.15.162:3300/0 conn(0x7ff9940b9900 0x7ff9940b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff99ac44640 1 -- 172.21.15.161:0/2353312146 >> 172.21.15.161:0/2353312146 conn(0x7ff9940be150 msgr2=0x7ff9940be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:00.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff99ac44640 1 -- 172.21.15.161:0/2353312146 shutdown_connections 2024-02-02T13:04:00.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff99ac44640 1 -- 172.21.15.161:0/2353312146 wait complete. 2024-02-02T13:04:00.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff99ac44640 1 Processor -- start 2024-02-02T13:04:00.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff99ac44640 1 -- start start 2024-02-02T13:04:00.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff99ac44640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff994071160 0x7ff994134e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:00.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff99ac44640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9940b9900 0x7ff99413d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:00.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff99ac44640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9941429f0 0x7ff9941e4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:00.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff99ac44640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99413dd70 con 0x7ff9940b9900 2024-02-02T13:04:00.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff99ac44640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9941e4a10 con 0x7ff9941429f0 2024-02-02T13:04:00.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff99ac44640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99413f260 con 0x7ff994071160 2024-02-02T13:04:00.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff993fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9940b9900 0x7ff99413d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:00.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff993fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9940b9900 0x7ff99413d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:50374/0 (socket says 172.21.15.161:50374) 2024-02-02T13:04:00.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff993fff640 1 -- 172.21.15.161:0/2002493772 learned_addr learned my addr 172.21.15.161:0/2002493772 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:00.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff993fff640 1 -- 172.21.15.161:0/2002493772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff994071160 msgr2=0x7ff994134e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:00.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff993fff640 1 --2- 172.21.15.161:0/2002493772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff994071160 0x7ff994134e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff993fff640 1 -- 172.21.15.161:0/2002493772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9941429f0 msgr2=0x7ff9941e4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:00.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff993fff640 1 --2- 172.21.15.161:0/2002493772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9941429f0 0x7ff9941e4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff993fff640 1 -- 172.21.15.161:0/2002493772 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c009b30 con 0x7ff9940b9900 2024-02-02T13:04:00.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.135+0000 7ff993fff640 1 --2- 172.21.15.161:0/2002493772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9940b9900 0x7ff99413d0b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7ff98400d800 tx=0x7ff98400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:00.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.139+0000 7ff9917fa640 1 -- 172.21.15.161:0/2002493772 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98400b6c0 con 0x7ff9940b9900 2024-02-02T13:04:00.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.139+0000 7ff9917fa640 1 -- 172.21.15.161:0/2002493772 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98400b820 con 0x7ff9940b9900 2024-02-02T13:04:00.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.139+0000 7ff99ac44640 1 -- 172.21.15.161:0/2002493772 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99413f540 con 0x7ff9940b9900 2024-02-02T13:04:00.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.139+0000 7ff9917fa640 1 -- 172.21.15.161:0/2002493772 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98400bb90 con 0x7ff9940b9900 2024-02-02T13:04:00.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.139+0000 7ff99ac44640 1 -- 172.21.15.161:0/2002493772 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9940bdde0 con 0x7ff9940b9900 2024-02-02T13:04:00.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.139+0000 7ff99ac44640 1 -- 172.21.15.161:0/2002493772 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99404e000 con 0x7ff9940b9900 2024-02-02T13:04:00.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.139+0000 7ff9917fa640 1 -- 172.21.15.161:0/2002493772 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff98400bcf0 con 0x7ff9940b9900 2024-02-02T13:04:00.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.139+0000 7ff9917fa640 1 --2- 172.21.15.161:0/2002493772 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff980065a90 0x7ff980067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:00.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.139+0000 7ff9989e0640 1 --2- 172.21.15.161:0/2002493772 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff980065a90 0x7ff980067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:00.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.139+0000 7ff9917fa640 1 -- 172.21.15.161:0/2002493772 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9840836b0 con 0x7ff9940b9900 2024-02-02T13:04:00.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.139+0000 7ff9989e0640 1 --2- 172.21.15.161:0/2002493772 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff980065a90 0x7ff980067f50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff9880015a0 tx=0x7ff988007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:00.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.143+0000 7ff9917fa640 1 -- 172.21.15.161:0/2002493772 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff984051060 con 0x7ff9940b9900 2024-02-02T13:04:00.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.299+0000 7ff99ac44640 1 -- 172.21.15.161:0/2002493772 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9941e4b80 con 0x7ff9940b9900 2024-02-02T13:04:00.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.303+0000 7ff9917fa640 1 -- 172.21.15.161:0/2002493772 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16149 (secure 0 0 0) 0x7ff984054680 con 0x7ff9940b9900 2024-02-02T13:04:00.306 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T13:04:00.306 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":31,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:49:32.837266+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:49:30.264273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-02T11:49:30.811831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T13:04:00.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.303+0000 7ff99ac44640 1 -- 172.21.15.161:0/2002493772 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff980065a90 msgr2=0x7ff980067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:00.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.303+0000 7ff99ac44640 1 --2- 172.21.15.161:0/2002493772 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff980065a90 0x7ff980067f50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff9880015a0 tx=0x7ff988007970 comp rx=0 tx=0).stop 2024-02-02T13:04:00.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.303+0000 7ff99ac44640 1 -- 172.21.15.161:0/2002493772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9940b9900 msgr2=0x7ff99413d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:00.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.303+0000 7ff99ac44640 1 --2- 172.21.15.161:0/2002493772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9940b9900 0x7ff99413d0b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7ff98400d800 tx=0x7ff98400dcc0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.303+0000 7ff99ac44640 1 -- 172.21.15.161:0/2002493772 shutdown_connections 2024-02-02T13:04:00.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.303+0000 7ff99ac44640 1 --2- 172.21.15.161:0/2002493772 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff980065a90 0x7ff980067f50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.303+0000 7ff99ac44640 1 --2- 172.21.15.161:0/2002493772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9941429f0 0x7ff9941e4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.303+0000 7ff99ac44640 1 --2- 172.21.15.161:0/2002493772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9940b9900 0x7ff99413d0b0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.303+0000 7ff99ac44640 1 --2- 172.21.15.161:0/2002493772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff994071160 0x7ff994134e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.303+0000 7ff99ac44640 1 -- 172.21.15.161:0/2002493772 >> 172.21.15.161:0/2002493772 conn(0x7ff9940be150 msgr2=0x7ff9940bb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:00.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.303+0000 7ff99ac44640 1 -- 172.21.15.161:0/2002493772 shutdown_connections 2024-02-02T13:04:00.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.303+0000 7ff99ac44640 1 -- 172.21.15.161:0/2002493772 wait complete. 2024-02-02T13:04:00.325 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-02T11:48:40.330782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-02T11:49:30.264273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-02-02T11:49:30.811831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-02T13:04:00.326 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-02T13:04:00.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.443+0000 7f32c8512640 1 Processor -- start 2024-02-02T13:04:00.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.443+0000 7f32c8512640 1 -- start start 2024-02-02T13:04:00.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c8512640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f32c00b8df0 0x7f32c0142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:00.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c8512640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f32c00b8540 0x7f32c0148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:00.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c8512640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c0148a80 con 0x7f32c0142d80 2024-02-02T13:04:00.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c8512640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c00b3890 con 0x7f32c00b8540 2024-02-02T13:04:00.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c8512640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c00b3b70 con 0x7f32c00b8df0 2024-02-02T13:04:00.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c5aad640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f32c00b8540 0x7f32c0148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:00.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c6aaf640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f32c0142d80 0x7f32c00b5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50478/0 (socket says 172.21.15.161:50478) 2024-02-02T13:04:00.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c6aaf640 1 -- 172.21.15.161:0/331211145 learned_addr learned my addr 172.21.15.161:0/331211145 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:04:00.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c62ae640 1 --2- 172.21.15.161:0/331211145 >> v2:172.21.15.162:3300/0 conn(0x7f32c00b8df0 0x7f32c0142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:00.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c5aad640 1 -- 172.21.15.161:0/331211145 >> v2:172.21.15.162:3300/0 conn(0x7f32c00b8df0 msgr2=0x7f32c0142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:00.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c5aad640 1 --2- 172.21.15.161:0/331211145 >> v2:172.21.15.162:3300/0 conn(0x7f32c00b8df0 0x7f32c0142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c5aad640 1 -- 172.21.15.161:0/331211145 >> v1:172.21.15.161:6789/0 conn(0x7f32c0142d80 legacy=0x7f32c00b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:00.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c5aad640 1 -- 172.21.15.161:0/331211145 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c00b3e50 con 0x7f32c00b8540 2024-02-02T13:04:00.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c5aad640 1 --2- 172.21.15.161:0/331211145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32c00b8540 0x7f32c0148f10 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f32c00b9a80 tx=0x7f32b001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672fd267cc7f7a81 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:00.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c52ac640 1 -- 172.21.15.161:0/331211145 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0071930 con 0x7f32c00b8540 2024-02-02T13:04:00.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c52ac640 1 -- 172.21.15.161:0/331211145 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b00ab680 con 0x7f32c00b8540 2024-02-02T13:04:00.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c52ac640 1 -- 172.21.15.161:0/331211145 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b00aba10 con 0x7f32c00b8540 2024-02-02T13:04:00.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c8512640 1 -- 172.21.15.161:0/331211145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32c00b8540 msgr2=0x7f32c0148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:00.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c8512640 1 --2- 172.21.15.161:0/331211145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32c00b8540 0x7f32c0148f10 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f32c00b9a80 tx=0x7f32b001c460 comp rx=0 tx=0).stop 2024-02-02T13:04:00.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c8512640 1 -- 172.21.15.161:0/331211145 shutdown_connections 2024-02-02T13:04:00.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c8512640 1 --2- 172.21.15.161:0/331211145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32c00b8540 0x7f32c0148f10 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.447+0000 7f32c8512640 1 --2- 172.21.15.161:0/331211145 >> v2:172.21.15.162:3300/0 conn(0x7f32c00b8df0 0x7f32c0142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c8512640 1 -- 172.21.15.161:0/331211145 >> 172.21.15.161:0/331211145 conn(0x7f32c006a120 msgr2=0x7f32c006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:00.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c8512640 1 -- 172.21.15.161:0/331211145 shutdown_connections 2024-02-02T13:04:00.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c8512640 1 -- 172.21.15.161:0/331211145 wait complete. 2024-02-02T13:04:00.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c8512640 1 Processor -- start 2024-02-02T13:04:00.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c8512640 1 -- start start 2024-02-02T13:04:00.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c8512640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32c00b8540 0x7f32c0139c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:00.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c8512640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32c00b8df0 0x7f32c014a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:00.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c8512640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32c0142d80 0x7f32c01367b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:00.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c8512640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c0136cf0 con 0x7f32c00b8df0 2024-02-02T13:04:00.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c8512640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c013eb80 con 0x7f32c0142d80 2024-02-02T13:04:00.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c8512640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c013a2a0 con 0x7f32c00b8540 2024-02-02T13:04:00.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c5aad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32c00b8df0 0x7f32c014a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:00.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c5aad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32c00b8df0 0x7f32c014a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:50388/0 (socket says 172.21.15.161:50388) 2024-02-02T13:04:00.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c5aad640 1 -- 172.21.15.161:0/2430657231 learned_addr learned my addr 172.21.15.161:0/2430657231 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:00.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c62ae640 1 --2- 172.21.15.161:0/2430657231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32c00b8540 0x7f32c0139c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:00.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c6aaf640 1 --2- 172.21.15.161:0/2430657231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32c0142d80 0x7f32c01367b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:00.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c5aad640 1 -- 172.21.15.161:0/2430657231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32c00b8540 msgr2=0x7f32c0139c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:00.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c5aad640 1 --2- 172.21.15.161:0/2430657231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32c00b8540 0x7f32c0139c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c5aad640 1 -- 172.21.15.161:0/2430657231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32c0142d80 msgr2=0x7f32c01367b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:00.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c5aad640 1 --2- 172.21.15.161:0/2430657231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32c0142d80 0x7f32c01367b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c5aad640 1 -- 172.21.15.161:0/2430657231 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b0009420 con 0x7f32c00b8df0 2024-02-02T13:04:00.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c5aad640 1 --2- 172.21.15.161:0/2430657231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32c00b8df0 0x7f32c014a330 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f32b001ab10 tx=0x7f32b001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:00.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32b6ffd640 1 -- 172.21.15.161:0/2430657231 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b00b5810 con 0x7f32c00b8df0 2024-02-02T13:04:00.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32b6ffd640 1 -- 172.21.15.161:0/2430657231 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b00b5970 con 0x7f32c00b8df0 2024-02-02T13:04:00.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c8512640 1 -- 172.21.15.161:0/2430657231 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c013ed90 con 0x7f32c00b8df0 2024-02-02T13:04:00.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32b6ffd640 1 -- 172.21.15.161:0/2430657231 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b00b5ce0 con 0x7f32c00b8df0 2024-02-02T13:04:00.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c8512640 1 -- 172.21.15.161:0/2430657231 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c0149f10 con 0x7f32c00b8df0 2024-02-02T13:04:00.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.451+0000 7f32c8512640 1 -- 172.21.15.161:0/2430657231 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c0153fc0 con 0x7f32c00b8df0 2024-02-02T13:04:00.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.455+0000 7f32b6ffd640 1 -- 172.21.15.161:0/2430657231 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f32b00b4390 con 0x7f32c00b8df0 2024-02-02T13:04:00.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.455+0000 7f32b6ffd640 1 --2- 172.21.15.161:0/2430657231 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f32a4065a60 0x7f32a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:00.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.455+0000 7f32b6ffd640 1 -- 172.21.15.161:0/2430657231 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32b011db70 con 0x7f32c00b8df0 2024-02-02T13:04:00.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.455+0000 7f32c62ae640 1 --2- 172.21.15.161:0/2430657231 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f32a4065a60 0x7f32a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:00.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.455+0000 7f32c62ae640 1 --2- 172.21.15.161:0/2430657231 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f32a4065a60 0x7f32a4067f20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f32b8003fd0 tx=0x7f32b80039a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:00.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.459+0000 7f32b6ffd640 1 -- 172.21.15.161:0/2430657231 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f32c0153fc0 con 0x7f32c00b8df0 2024-02-02T13:04:00.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.611+0000 7f32c8512640 1 -- 172.21.15.161:0/2430657231 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32c0153fc0 con 0x7f32c00b8df0 2024-02-02T13:04:00.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.611+0000 7f32b6ffd640 1 -- 172.21.15.161:0/2430657231 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32c0153fc0 con 0x7f32c00b8df0 2024-02-02T13:04:00.616 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2024-02-02T13:04:00.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.615+0000 7f32c8512640 1 -- 172.21.15.161:0/2430657231 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f32a4065a60 msgr2=0x7f32a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:00.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.615+0000 7f32c8512640 1 --2- 172.21.15.161:0/2430657231 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f32a4065a60 0x7f32a4067f20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f32b8003fd0 tx=0x7f32b80039a0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.615+0000 7f32c8512640 1 -- 172.21.15.161:0/2430657231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32c00b8df0 msgr2=0x7f32c014a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:00.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.615+0000 7f32c8512640 1 --2- 172.21.15.161:0/2430657231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32c00b8df0 0x7f32c014a330 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f32b001ab10 tx=0x7f32b001aca0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.615+0000 7f32c8512640 1 -- 172.21.15.161:0/2430657231 shutdown_connections 2024-02-02T13:04:00.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.615+0000 7f32c8512640 1 --2- 172.21.15.161:0/2430657231 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f32a4065a60 0x7f32a4067f20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.615+0000 7f32c8512640 1 --2- 172.21.15.161:0/2430657231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32c0142d80 0x7f32c01367b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.615+0000 7f32c8512640 1 --2- 172.21.15.161:0/2430657231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32c00b8df0 0x7f32c014a330 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.615+0000 7f32c8512640 1 --2- 172.21.15.161:0/2430657231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32c00b8540 0x7f32c0139c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.615+0000 7f32c8512640 1 -- 172.21.15.161:0/2430657231 >> 172.21.15.161:0/2430657231 conn(0x7f32c006a120 msgr2=0x7f32c0137080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:00.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.615+0000 7f32c8512640 1 -- 172.21.15.161:0/2430657231 shutdown_connections 2024-02-02T13:04:00.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.615+0000 7f32c8512640 1 -- 172.21.15.161:0/2430657231 wait complete. 2024-02-02T13:04:00.636 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-02T13:04:00.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.755+0000 7f30dbc7d640 1 Processor -- start 2024-02-02T13:04:00.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.759+0000 7f30dbc7d640 1 -- start start 2024-02-02T13:04:00.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.759+0000 7f30dbc7d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f30d40b8df0 0x7f30d4142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:00.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.759+0000 7f30dbc7d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f30d4142d80 0x7f30d41531b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:00.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.759+0000 7f30dbc7d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d4148a80 con 0x7f30d40b8540 2024-02-02T13:04:00.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.759+0000 7f30dbc7d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d40b3890 con 0x7f30d40b8df0 2024-02-02T13:04:00.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.759+0000 7f30dbc7d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d40b3b70 con 0x7f30d4142d80 2024-02-02T13:04:00.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.759+0000 7f30d9a19640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f30d40b8df0 0x7f30d4142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:00.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.759+0000 7f30d9a19640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f30d40b8df0 0x7f30d4142840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:50398/0 (socket says 172.21.15.161:50398) 2024-02-02T13:04:00.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.759+0000 7f30d9a19640 1 -- 172.21.15.161:0/510776403 learned_addr learned my addr 172.21.15.161:0/510776403 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:00.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.759+0000 7f30da21a640 1 --2- 172.21.15.161:0/510776403 >> v2:172.21.15.162:3300/0 conn(0x7f30d4142d80 0x7f30d41531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:00.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.759+0000 7f30d9a19640 1 -- 172.21.15.161:0/510776403 >> v2:172.21.15.162:3300/0 conn(0x7f30d4142d80 msgr2=0x7f30d41531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:00.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.759+0000 7f30d9a19640 1 --2- 172.21.15.161:0/510776403 >> v2:172.21.15.162:3300/0 conn(0x7f30d4142d80 0x7f30d41531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.759+0000 7f30d9a19640 1 -- 172.21.15.161:0/510776403 >> v1:172.21.15.162:6789/0 conn(0x7f30d40b8540 legacy=0x7f30d4148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:00.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.759+0000 7f30d9a19640 1 -- 172.21.15.161:0/510776403 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d40b3e50 con 0x7f30d40b8df0 2024-02-02T13:04:00.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.759+0000 7f30da21a640 1 --2- 172.21.15.161:0/510776403 >> v2:172.21.15.162:3300/0 conn(0x7f30d4142d80 0x7f30d41531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:00.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.759+0000 7f30d9a19640 1 --2- 172.21.15.161:0/510776403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30d40b8df0 0x7f30d4142840 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f30d40b9a50 tx=0x7f30cc01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7abde59b2764b799 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:00.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.759+0000 7f30d8a17640 1 -- 172.21.15.161:0/510776403 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d4071930 con 0x7f30d40b8df0 2024-02-02T13:04:00.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.759+0000 7f30d8a17640 1 -- 172.21.15.161:0/510776403 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30cc0a5870 con 0x7f30d40b8df0 2024-02-02T13:04:00.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.759+0000 7f30d8a17640 1 -- 172.21.15.161:0/510776403 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc0a5c00 con 0x7f30d40b8df0 2024-02-02T13:04:00.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30dbc7d640 1 -- 172.21.15.161:0/510776403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30d40b8df0 msgr2=0x7f30d4142840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:00.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30dbc7d640 1 --2- 172.21.15.161:0/510776403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30d40b8df0 0x7f30d4142840 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f30d40b9a50 tx=0x7f30cc01c990 comp rx=0 tx=0).stop 2024-02-02T13:04:00.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30dbc7d640 1 -- 172.21.15.161:0/510776403 shutdown_connections 2024-02-02T13:04:00.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30dbc7d640 1 --2- 172.21.15.161:0/510776403 >> v2:172.21.15.162:3300/0 conn(0x7f30d4142d80 0x7f30d41531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30dbc7d640 1 --2- 172.21.15.161:0/510776403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30d40b8df0 0x7f30d4142840 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30dbc7d640 1 -- 172.21.15.161:0/510776403 >> 172.21.15.161:0/510776403 conn(0x7f30d406a120 msgr2=0x7f30d406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:00.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30dbc7d640 1 -- 172.21.15.161:0/510776403 shutdown_connections 2024-02-02T13:04:00.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30dbc7d640 1 -- 172.21.15.161:0/510776403 wait complete. 2024-02-02T13:04:00.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30dbc7d640 1 Processor -- start 2024-02-02T13:04:00.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30dbc7d640 1 -- start start 2024-02-02T13:04:00.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30dbc7d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30d40b8540 0x7f30d40bca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:00.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30dbc7d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30d40b8df0 0x7f30d4136860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:00.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30dbc7d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30d4142d80 0x7f30d414b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:00.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30dbc7d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d4136da0 con 0x7f30d40b8df0 2024-02-02T13:04:00.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30dbc7d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d41376a0 con 0x7f30d4142d80 2024-02-02T13:04:00.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30dbc7d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d4138080 con 0x7f30d40b8540 2024-02-02T13:04:00.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30d9218640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30d40b8df0 0x7f30d4136860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:00.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30d9218640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30d40b8df0 0x7f30d4136860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:50410/0 (socket says 172.21.15.161:50410) 2024-02-02T13:04:00.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30d9218640 1 -- 172.21.15.161:0/2248897485 learned_addr learned my addr 172.21.15.161:0/2248897485 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:00.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30d9a19640 1 --2- 172.21.15.161:0/2248897485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30d40b8540 0x7f30d40bca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:00.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30da21a640 1 --2- 172.21.15.161:0/2248897485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30d4142d80 0x7f30d414b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:00.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30d9218640 1 -- 172.21.15.161:0/2248897485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30d40b8540 msgr2=0x7f30d40bca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:00.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30d9218640 1 --2- 172.21.15.161:0/2248897485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30d40b8540 0x7f30d40bca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30d9218640 1 -- 172.21.15.161:0/2248897485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30d4142d80 msgr2=0x7f30d414b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:00.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30d9218640 1 --2- 172.21.15.161:0/2248897485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30d4142d80 0x7f30d414b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30d9218640 1 -- 172.21.15.161:0/2248897485 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc009b30 con 0x7f30d40b8df0 2024-02-02T13:04:00.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30d9a19640 1 --2- 172.21.15.161:0/2248897485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30d40b8540 0x7f30d40bca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:00.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30da21a640 1 --2- 172.21.15.161:0/2248897485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30d4142d80 0x7f30d414b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:00.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30d9218640 1 --2- 172.21.15.161:0/2248897485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30d40b8df0 0x7f30d4136860 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f30c400c450 tx=0x7f30c400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:00.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30ca7fc640 1 -- 172.21.15.161:0/2248897485 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4012830 con 0x7f30d40b8df0 2024-02-02T13:04:00.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30ca7fc640 1 -- 172.21.15.161:0/2248897485 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c40129b0 con 0x7f30d40b8df0 2024-02-02T13:04:00.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30ca7fc640 1 -- 172.21.15.161:0/2248897485 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4012d60 con 0x7f30d40b8df0 2024-02-02T13:04:00.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30dbc7d640 1 -- 172.21.15.161:0/2248897485 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d4149fb0 con 0x7f30d40b8df0 2024-02-02T13:04:00.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.763+0000 7f30dbc7d640 1 -- 172.21.15.161:0/2248897485 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d413c900 con 0x7f30d40b8df0 2024-02-02T13:04:00.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.767+0000 7f30dbc7d640 1 -- 172.21.15.161:0/2248897485 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d4137ee0 con 0x7f30d40b8df0 2024-02-02T13:04:00.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.767+0000 7f30ca7fc640 1 -- 172.21.15.161:0/2248897485 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f30c401c460 con 0x7f30d40b8df0 2024-02-02T13:04:00.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.767+0000 7f30ca7fc640 1 --2- 172.21.15.161:0/2248897485 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f30b8065a60 0x7f30b8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:00.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.767+0000 7f30ca7fc640 1 -- 172.21.15.161:0/2248897485 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30c4082f90 con 0x7f30d40b8df0 2024-02-02T13:04:00.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.767+0000 7f30d9a19640 1 --2- 172.21.15.161:0/2248897485 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f30b8065a60 0x7f30b8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:00.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.767+0000 7f30d9a19640 1 --2- 172.21.15.161:0/2248897485 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f30b8065a60 0x7f30b8067f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0ae000 tx=0x7f30cc0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:00.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.771+0000 7f30ca7fc640 1 -- 172.21.15.161:0/2248897485 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f30c40b40a0 con 0x7f30d40b8df0 2024-02-02T13:04:00.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.927+0000 7f30dbc7d640 1 -- 172.21.15.161:0/2248897485 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f30d404e000 con 0x7f30d40b8df0 2024-02-02T13:04:00.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.927+0000 7f30ca7fc640 1 -- 172.21.15.161:0/2248897485 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f30d4137ee0 con 0x7f30d40b8df0 2024-02-02T13:04:00.930 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2024-02-02T13:04:00.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.927+0000 7f30dbc7d640 1 -- 172.21.15.161:0/2248897485 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f30b8065a60 msgr2=0x7f30b8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:00.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.927+0000 7f30dbc7d640 1 --2- 172.21.15.161:0/2248897485 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f30b8065a60 0x7f30b8067f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0ae000 tx=0x7f30cc0a7070 comp rx=0 tx=0).stop 2024-02-02T13:04:00.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.927+0000 7f30dbc7d640 1 -- 172.21.15.161:0/2248897485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30d40b8df0 msgr2=0x7f30d4136860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:00.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.927+0000 7f30dbc7d640 1 --2- 172.21.15.161:0/2248897485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30d40b8df0 0x7f30d4136860 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f30c400c450 tx=0x7f30c400c910 comp rx=0 tx=0).stop 2024-02-02T13:04:00.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.927+0000 7f30dbc7d640 1 -- 172.21.15.161:0/2248897485 shutdown_connections 2024-02-02T13:04:00.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.927+0000 7f30dbc7d640 1 --2- 172.21.15.161:0/2248897485 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f30b8065a60 0x7f30b8067f20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.927+0000 7f30dbc7d640 1 --2- 172.21.15.161:0/2248897485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30d4142d80 0x7f30d414b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.927+0000 7f30dbc7d640 1 --2- 172.21.15.161:0/2248897485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30d40b8df0 0x7f30d4136860 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.927+0000 7f30dbc7d640 1 --2- 172.21.15.161:0/2248897485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30d40b8540 0x7f30d40bca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:00.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.927+0000 7f30dbc7d640 1 -- 172.21.15.161:0/2248897485 >> 172.21.15.161:0/2248897485 conn(0x7f30d406a120 msgr2=0x7f30d40b5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:00.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.927+0000 7f30dbc7d640 1 -- 172.21.15.161:0/2248897485 shutdown_connections 2024-02-02T13:04:00.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:00.927+0000 7f30dbc7d640 1 -- 172.21.15.161:0/2248897485 wait complete. 2024-02-02T13:04:00.952 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-02T13:04:01.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.071+0000 7fa67094e640 1 Processor -- start 2024-02-02T13:04:01.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.071+0000 7fa67094e640 1 -- start start 2024-02-02T13:04:01.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.075+0000 7fa67094e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa66c0b8b40 0x7fa66c0b8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.075+0000 7fa67094e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa66c144a80 0x7fa66c14ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.075+0000 7fa67094e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c0b6e80 con 0x7fa66c144ee0 2024-02-02T13:04:01.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.075+0000 7fa67094e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa66c0b7160 con 0x7fa66c144a80 2024-02-02T13:04:01.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.075+0000 7fa67094e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0bc6c0 con 0x7fa66c0b8b40 2024-02-02T13:04:01.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.075+0000 7fa669d9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa66c144a80 0x7fa66c14ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.075+0000 7fa669d9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa66c144a80 0x7fa66c14ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:50414/0 (socket says 172.21.15.161:50414) 2024-02-02T13:04:01.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.075+0000 7fa669d9b640 1 -- 172.21.15.161:0/2228968162 learned_addr learned my addr 172.21.15.161:0/2228968162 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:01.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.075+0000 7fa66a59c640 1 --2- 172.21.15.161:0/2228968162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa66c0b8b40 0x7fa66c0b8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.075+0000 7fa669d9b640 1 -- 172.21.15.161:0/2228968162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa66c0b8b40 msgr2=0x7fa66c0b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:01.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.075+0000 7fa669d9b640 1 --2- 172.21.15.161:0/2228968162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa66c0b8b40 0x7fa66c0b8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.075+0000 7fa669d9b640 1 -- 172.21.15.161:0/2228968162 >> v1:172.21.15.162:6789/0 conn(0x7fa66c144ee0 legacy=0x7fa66c14dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:01.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.075+0000 7fa669d9b640 1 -- 172.21.15.161:0/2228968162 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c0bc9a0 con 0x7fa66c144a80 2024-02-02T13:04:01.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.075+0000 7fa669d9b640 1 --2- 172.21.15.161:0/2228968162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa66c144a80 0x7fa66c14ac60 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fa660009870 tx=0x7fa66001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d529494f3e764a9f server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:01.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.075+0000 7fa66959a640 1 -- 172.21.15.161:0/2228968162 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6600a8a30 con 0x7fa66c144a80 2024-02-02T13:04:01.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.075+0000 7fa66959a640 1 -- 172.21.15.161:0/2228968162 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6600a8b90 con 0x7fa66c144a80 2024-02-02T13:04:01.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.075+0000 7fa66959a640 1 -- 172.21.15.161:0/2228968162 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6600b0440 con 0x7fa66c144a80 2024-02-02T13:04:01.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa67094e640 1 -- 172.21.15.161:0/2228968162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa66c144a80 msgr2=0x7fa66c14ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:01.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa67094e640 1 --2- 172.21.15.161:0/2228968162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa66c144a80 0x7fa66c14ac60 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fa660009870 tx=0x7fa66001ed30 comp rx=0 tx=0).stop 2024-02-02T13:04:01.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa67094e640 1 -- 172.21.15.161:0/2228968162 shutdown_connections 2024-02-02T13:04:01.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa67094e640 1 --2- 172.21.15.161:0/2228968162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa66c144a80 0x7fa66c14ac60 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa67094e640 1 --2- 172.21.15.161:0/2228968162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa66c0b8b40 0x7fa66c0b8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa67094e640 1 -- 172.21.15.161:0/2228968162 >> 172.21.15.161:0/2228968162 conn(0x7fa66c0c02f0 msgr2=0x7fa66c0c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:01.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa67094e640 1 -- 172.21.15.161:0/2228968162 shutdown_connections 2024-02-02T13:04:01.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa67094e640 1 -- 172.21.15.161:0/2228968162 wait complete. 2024-02-02T13:04:01.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa67094e640 1 Processor -- start 2024-02-02T13:04:01.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa67094e640 1 -- start start 2024-02-02T13:04:01.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa67094e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa66c0b8b40 0x7fa66c1477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa67094e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa66c144a80 0x7fa66c1d5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa67094e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa66c144ee0 0x7fa66c1d3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa67094e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c147d20 con 0x7fa66c144a80 2024-02-02T13:04:01.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa67094e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c14a150 con 0x7fa66c0b8b40 2024-02-02T13:04:01.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa67094e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c1d54a0 con 0x7fa66c144ee0 2024-02-02T13:04:01.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa669d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa66c144a80 0x7fa66c1d5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa669d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa66c144a80 0x7fa66c1d5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:50420/0 (socket says 172.21.15.161:50420) 2024-02-02T13:04:01.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa669d9b640 1 -- 172.21.15.161:0/2026505277 learned_addr learned my addr 172.21.15.161:0/2026505277 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:01.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa66a59c640 1 --2- 172.21.15.161:0/2026505277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa66c0b8b40 0x7fa66c1477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa66ad9d640 1 --2- 172.21.15.161:0/2026505277 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa66c144ee0 0x7fa66c1d3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa669d9b640 1 -- 172.21.15.161:0/2026505277 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa66c144ee0 msgr2=0x7fa66c1d3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:01.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa669d9b640 1 --2- 172.21.15.161:0/2026505277 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa66c144ee0 0x7fa66c1d3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa669d9b640 1 -- 172.21.15.161:0/2026505277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa66c0b8b40 msgr2=0x7fa66c1477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:01.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa669d9b640 1 --2- 172.21.15.161:0/2026505277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa66c0b8b40 0x7fa66c1477e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa669d9b640 1 -- 172.21.15.161:0/2026505277 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6600094d0 con 0x7fa66c144a80 2024-02-02T13:04:01.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa669d9b640 1 --2- 172.21.15.161:0/2026505277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa66c144a80 0x7fa66c1d5f80 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fa6600b3040 tx=0x7fa66001bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:01.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa65affd640 1 -- 172.21.15.161:0/2026505277 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6600b0d70 con 0x7fa66c144a80 2024-02-02T13:04:01.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa65affd640 1 -- 172.21.15.161:0/2026505277 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6600bb470 con 0x7fa66c144a80 2024-02-02T13:04:01.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa67094e640 1 -- 172.21.15.161:0/2026505277 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66c1d5780 con 0x7fa66c144a80 2024-02-02T13:04:01.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa65affd640 1 -- 172.21.15.161:0/2026505277 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6600bb820 con 0x7fa66c144a80 2024-02-02T13:04:01.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.079+0000 7fa67094e640 1 -- 172.21.15.161:0/2026505277 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66c1d51b0 con 0x7fa66c144a80 2024-02-02T13:04:01.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.083+0000 7fa67094e640 1 -- 172.21.15.161:0/2026505277 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66c04e000 con 0x7fa66c144a80 2024-02-02T13:04:01.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.083+0000 7fa65affd640 1 -- 172.21.15.161:0/2026505277 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa6600b7070 con 0x7fa66c144a80 2024-02-02T13:04:01.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.083+0000 7fa65affd640 1 --2- 172.21.15.161:0/2026505277 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa64c065a60 0x7fa64c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.083+0000 7fa66a59c640 1 --2- 172.21.15.161:0/2026505277 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa64c065a60 0x7fa64c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.083+0000 7fa65affd640 1 -- 172.21.15.161:0/2026505277 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa660121380 con 0x7fa66c144a80 2024-02-02T13:04:01.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.083+0000 7fa66a59c640 1 --2- 172.21.15.161:0/2026505277 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa64c065a60 0x7fa64c067f20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa65c009af0 tx=0x7fa65c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:01.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.087+0000 7fa65affd640 1 -- 172.21.15.161:0/2026505277 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa6600eedd0 con 0x7fa66c144a80 2024-02-02T13:04:01.243 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.239+0000 7fa67094e640 1 -- 172.21.15.161:0/2026505277 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa66c1d5c30 con 0x7fa66c144a80 2024-02-02T13:04:01.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.239+0000 7fa65affd640 1 -- 172.21.15.161:0/2026505277 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa6600b50a0 con 0x7fa66c144a80 2024-02-02T13:04:01.244 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2024-02-02T13:04:01.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.243+0000 7fa67094e640 1 -- 172.21.15.161:0/2026505277 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa64c065a60 msgr2=0x7fa64c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:01.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.243+0000 7fa67094e640 1 --2- 172.21.15.161:0/2026505277 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa64c065a60 0x7fa64c067f20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa65c009af0 tx=0x7fa65c008040 comp rx=0 tx=0).stop 2024-02-02T13:04:01.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.243+0000 7fa67094e640 1 -- 172.21.15.161:0/2026505277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa66c144a80 msgr2=0x7fa66c1d5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:01.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.243+0000 7fa67094e640 1 --2- 172.21.15.161:0/2026505277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa66c144a80 0x7fa66c1d5f80 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fa6600b3040 tx=0x7fa66001bad0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.243+0000 7fa67094e640 1 -- 172.21.15.161:0/2026505277 shutdown_connections 2024-02-02T13:04:01.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.243+0000 7fa67094e640 1 --2- 172.21.15.161:0/2026505277 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa64c065a60 0x7fa64c067f20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.243+0000 7fa67094e640 1 --2- 172.21.15.161:0/2026505277 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa66c144ee0 0x7fa66c1d3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.243+0000 7fa67094e640 1 --2- 172.21.15.161:0/2026505277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa66c144a80 0x7fa66c1d5f80 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.243+0000 7fa67094e640 1 --2- 172.21.15.161:0/2026505277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa66c0b8b40 0x7fa66c1477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.243+0000 7fa67094e640 1 -- 172.21.15.161:0/2026505277 >> 172.21.15.161:0/2026505277 conn(0x7fa66c0c02f0 msgr2=0x7fa66c0bcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:01.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.243+0000 7fa67094e640 1 -- 172.21.15.161:0/2026505277 shutdown_connections 2024-02-02T13:04:01.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.243+0000 7fa67094e640 1 -- 172.21.15.161:0/2026505277 wait complete. 2024-02-02T13:04:01.264 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-02T13:04:01.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.375+0000 7f0f8f099640 1 Processor -- start 2024-02-02T13:04:01.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.379+0000 7f0f8f099640 1 -- start start 2024-02-02T13:04:01.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.379+0000 7f0f8f099640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f880bc340 0x7f0f881415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.379+0000 7f0f8f099640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0f880b8020 0x7f0f88151f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.379+0000 7f0f8f099640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f88071550 con 0x7f0f88141b30 2024-02-02T13:04:01.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.379+0000 7f0f8f099640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f88071810 con 0x7f0f880b8020 2024-02-02T13:04:01.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.379+0000 7f0f8f099640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f88071950 con 0x7f0f880bc340 2024-02-02T13:04:01.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.379+0000 7f0f8d636640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0f880b8020 0x7f0f88151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.379+0000 7f0f87fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0f88141b30 0x7f0f88147c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50492/0 (socket says 172.21.15.161:50492) 2024-02-02T13:04:01.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.379+0000 7f0f87fff640 1 -- 172.21.15.161:0/4257104151 learned_addr learned my addr 172.21.15.161:0/4257104151 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:04:01.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.379+0000 7f0f8ce35640 1 --2- 172.21.15.161:0/4257104151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f880bc340 0x7f0f881415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.379+0000 7f0f8d636640 1 -- 172.21.15.161:0/4257104151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f880bc340 msgr2=0x7f0f881415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:01.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.379+0000 7f0f8d636640 1 --2- 172.21.15.161:0/4257104151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f880bc340 0x7f0f881415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.379+0000 7f0f8d636640 1 -- 172.21.15.161:0/4257104151 >> v1:172.21.15.161:6789/0 conn(0x7f0f88141b30 legacy=0x7f0f88147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:01.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.379+0000 7f0f8d636640 1 -- 172.21.15.161:0/4257104151 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f880bc720 con 0x7f0f880b8020 2024-02-02T13:04:01.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.379+0000 7f0f877fe640 1 -- 172.21.15.161:0/4257104151 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116209295 0 0) 0x7f0f88071550 con 0x7f0f88141b30 2024-02-02T13:04:01.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.379+0000 7f0f8ce35640 1 --2- 172.21.15.161:0/4257104151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f880bc340 0x7f0f881415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T13:04:01.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.379+0000 7f0f8d636640 1 --2- 172.21.15.161:0/4257104151 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f880b8020 0x7f0f88151f60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009d90 tx=0x7f0f8001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68774fd74059cc8c server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:01.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f877fe640 1 -- 172.21.15.161:0/4257104151 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f800a5780 con 0x7f0f880b8020 2024-02-02T13:04:01.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f877fe640 1 -- 172.21.15.161:0/4257104151 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f800a58e0 con 0x7f0f880b8020 2024-02-02T13:04:01.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f877fe640 1 -- 172.21.15.161:0/4257104151 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f800a5c70 con 0x7f0f880b8020 2024-02-02T13:04:01.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8f099640 1 -- 172.21.15.161:0/4257104151 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f880b8020 msgr2=0x7f0f88151f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:01.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8f099640 1 --2- 172.21.15.161:0/4257104151 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f880b8020 0x7f0f88151f60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009d90 tx=0x7f0f8001c8c0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8f099640 1 -- 172.21.15.161:0/4257104151 shutdown_connections 2024-02-02T13:04:01.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8f099640 1 --2- 172.21.15.161:0/4257104151 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f880b8020 0x7f0f88151f60 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8f099640 1 --2- 172.21.15.161:0/4257104151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f880bc340 0x7f0f881415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8f099640 1 -- 172.21.15.161:0/4257104151 >> 172.21.15.161:0/4257104151 conn(0x7f0f88069ef0 msgr2=0x7f0f8806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:01.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8f099640 1 -- 172.21.15.161:0/4257104151 shutdown_connections 2024-02-02T13:04:01.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8f099640 1 -- 172.21.15.161:0/4257104151 wait complete. 2024-02-02T13:04:01.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8f099640 1 Processor -- start 2024-02-02T13:04:01.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8f099640 1 -- start start 2024-02-02T13:04:01.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8f099640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f880b8020 0x7f0f8813df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8f099640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f880bc340 0x7f0f88137a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8f099640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f88141b30 0x7f0f880bb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8f099640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f88138c50 con 0x7f0f880b8020 2024-02-02T13:04:01.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8f099640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8813e4b0 con 0x7f0f880bc340 2024-02-02T13:04:01.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8f099640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8813eaf0 con 0x7f0f88141b30 2024-02-02T13:04:01.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8ce35640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f880b8020 0x7f0f8813df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8ce35640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f880b8020 0x7f0f8813df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:50440/0 (socket says 172.21.15.161:50440) 2024-02-02T13:04:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8ce35640 1 -- 172.21.15.161:0/3316752482 learned_addr learned my addr 172.21.15.161:0/3316752482 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f87fff640 1 --2- 172.21.15.161:0/3316752482 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f880bc340 0x7f0f88137a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8d636640 1 --2- 172.21.15.161:0/3316752482 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f88141b30 0x7f0f880bb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8ce35640 1 -- 172.21.15.161:0/3316752482 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f88141b30 msgr2=0x7f0f880bb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8ce35640 1 --2- 172.21.15.161:0/3316752482 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f88141b30 0x7f0f880bb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8ce35640 1 -- 172.21.15.161:0/3316752482 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f880bc340 msgr2=0x7f0f88137a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8ce35640 1 --2- 172.21.15.161:0/3316752482 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f880bc340 0x7f0f88137a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8ce35640 1 -- 172.21.15.161:0/3316752482 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f80009a70 con 0x7f0f880b8020 2024-02-02T13:04:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f87fff640 1 --2- 172.21.15.161:0/3316752482 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f880bc340 0x7f0f88137a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8ce35640 1 --2- 172.21.15.161:0/3316752482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f880b8020 0x7f0f8813df70 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800e810 tx=0x7f0f7800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f857fa640 1 -- 172.21.15.161:0/3316752482 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7800c8d0 con 0x7f0f880b8020 2024-02-02T13:04:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f857fa640 1 -- 172.21.15.161:0/3316752482 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7800ca30 con 0x7f0f880b8020 2024-02-02T13:04:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8f099640 1 -- 172.21.15.161:0/3316752482 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f881e5dd0 con 0x7f0f880b8020 2024-02-02T13:04:01.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f857fa640 1 -- 172.21.15.161:0/3316752482 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7800cdc0 con 0x7f0f880b8020 2024-02-02T13:04:01.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.383+0000 7f0f8f099640 1 -- 172.21.15.161:0/3316752482 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f881e6950 con 0x7f0f880b8020 2024-02-02T13:04:01.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.387+0000 7f0f8f099640 1 -- 172.21.15.161:0/3316752482 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f8804e000 con 0x7f0f880b8020 2024-02-02T13:04:01.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.387+0000 7f0f857fa640 1 -- 172.21.15.161:0/3316752482 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0f78013410 con 0x7f0f880b8020 2024-02-02T13:04:01.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.387+0000 7f0f857fa640 1 --2- 172.21.15.161:0/3316752482 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0f74065a90 0x7f0f74067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.387+0000 7f0f857fa640 1 -- 172.21.15.161:0/3316752482 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f78082ed0 con 0x7f0f880b8020 2024-02-02T13:04:01.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.387+0000 7f0f87fff640 1 --2- 172.21.15.161:0/3316752482 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0f74065a90 0x7f0f74067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.387+0000 7f0f87fff640 1 --2- 172.21.15.161:0/3316752482 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0f74065a90 0x7f0f74067f50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0f88139220 tx=0x7f0f7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:01.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.391+0000 7f0f857fa640 1 -- 172.21.15.161:0/3316752482 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0f780508a0 con 0x7f0f880b8020 2024-02-02T13:04:01.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.579+0000 7f0f8f099640 1 -- 172.21.15.161:0/3316752482 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f88140230 con 0x7f0f880b8020 2024-02-02T13:04:01.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.579+0000 7f0f857fa640 1 -- 172.21.15.161:0/3316752482 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3958 (secure 0 0 0) 0x7f0f78009480 con 0x7f0f880b8020 2024-02-02T13:04:01.585 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T13:04:01.585 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4535,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/236294405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":236294405},{"type":"v1","addr":"172.21.15.162:6833","nonce":236294405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3772183556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3772183556},{"type":"v1","addr":"172.21.15.161:6835","nonce":3772183556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-02T11:49:31.833135+0000","modified":"2024-02-02T11:49:34.491389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/1621598548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1621598548},{"type":"v1","addr":"172.21.15.161:6837","nonce":1621598548}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-02T13:04:01.585 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 14 2024-02-02T13:04:01.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.583+0000 7f0f8f099640 1 -- 172.21.15.161:0/3316752482 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0f74065a90 msgr2=0x7f0f74067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:01.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.583+0000 7f0f8f099640 1 --2- 172.21.15.161:0/3316752482 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0f74065a90 0x7f0f74067f50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0f88139220 tx=0x7f0f7c009040 comp rx=0 tx=0).stop 2024-02-02T13:04:01.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.583+0000 7f0f8f099640 1 -- 172.21.15.161:0/3316752482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f880b8020 msgr2=0x7f0f8813df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:01.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.583+0000 7f0f8f099640 1 --2- 172.21.15.161:0/3316752482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f880b8020 0x7f0f8813df70 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800e810 tx=0x7f0f7800ecd0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.583+0000 7f0f8f099640 1 -- 172.21.15.161:0/3316752482 shutdown_connections 2024-02-02T13:04:01.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.583+0000 7f0f8f099640 1 --2- 172.21.15.161:0/3316752482 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f0f74065a90 0x7f0f74067f50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.583+0000 7f0f8f099640 1 --2- 172.21.15.161:0/3316752482 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f88141b30 0x7f0f880bb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.583+0000 7f0f8f099640 1 --2- 172.21.15.161:0/3316752482 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f880bc340 0x7f0f88137a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.583+0000 7f0f8f099640 1 --2- 172.21.15.161:0/3316752482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f880b8020 0x7f0f8813df70 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.583+0000 7f0f8f099640 1 -- 172.21.15.161:0/3316752482 >> 172.21.15.161:0/3316752482 conn(0x7f0f88069ef0 msgr2=0x7f0f88147b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:01.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.583+0000 7f0f8f099640 1 -- 172.21.15.161:0/3316752482 shutdown_connections 2024-02-02T13:04:01.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.583+0000 7f0f8f099640 1 -- 172.21.15.161:0/3316752482 wait complete. 2024-02-02T13:04:01.605 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T13:04:01.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a6ca42640 1 Processor -- start 2024-02-02T13:04:01.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a6ca42640 1 -- start start 2024-02-02T13:04:01.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a6ca42640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6a6806a4c0 0x7f6a6806a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a6ca42640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a681532f0 0x7f6a681556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a6ca42640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a680bb370 con 0x7f6a6814b540 2024-02-02T13:04:01.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a6ca42640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6806ae40 con 0x7f6a6806a4c0 2024-02-02T13:04:01.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a6ca42640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a680bc320 con 0x7f6a681532f0 2024-02-02T13:04:01.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a6659c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6a6814b540 0x7f6a680bac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50508/0 (socket says 172.21.15.161:50508) 2024-02-02T13:04:01.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a6659c640 1 -- 172.21.15.161:0/2744673211 learned_addr learned my addr 172.21.15.161:0/2744673211 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:04:01.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a66d9d640 1 --2- 172.21.15.161:0/2744673211 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a681532f0 0x7f6a681556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a5dd9b640 1 --2- 172.21.15.161:0/2744673211 >> v2:172.21.15.162:3300/0 conn(0x7f6a6806a4c0 0x7f6a6806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a65d9b640 1 -- 172.21.15.161:0/2744673211 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107103436 0 0) 0x7f6a680bb370 con 0x7f6a6814b540 2024-02-02T13:04:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a65d9b640 1 -- 172.21.15.161:0/2744673211 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a54003530 con 0x7f6a6814b540 2024-02-02T13:04:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a65d9b640 1 -- 172.21.15.161:0/2744673211 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2598287682 0 0) 0x7f6a54003530 con 0x7f6a6814b540 2024-02-02T13:04:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a65d9b640 1 -- 172.21.15.161:0/2744673211 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a681532f0 msgr2=0x7f6a681556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a65d9b640 1 --2- 172.21.15.161:0/2744673211 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a681532f0 0x7f6a681556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a65d9b640 1 -- 172.21.15.161:0/2744673211 >> v2:172.21.15.162:3300/0 conn(0x7f6a6806a4c0 msgr2=0x7f6a6806a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a65d9b640 1 --2- 172.21.15.161:0/2744673211 >> v2:172.21.15.162:3300/0 conn(0x7f6a6806a4c0 0x7f6a6806a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a65d9b640 1 -- 172.21.15.161:0/2744673211 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a680bc590 con 0x7f6a6814b540 2024-02-02T13:04:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a65d9b640 1 -- 172.21.15.161:0/2744673211 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f6a58001680 con 0x7f6a6814b540 2024-02-02T13:04:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a5dd9b640 1 --2- 172.21.15.161:0/2744673211 >> v2:172.21.15.162:3300/0 conn(0x7f6a6806a4c0 0x7f6a6806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T13:04:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a65d9b640 1 -- 172.21.15.161:0/2744673211 >> v1:172.21.15.161:6789/0 conn(0x7f6a6814b540 legacy=0x7f6a680bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a65d9b640 1 --2- 172.21.15.161:0/2744673211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a54003980 0x7f6a54003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a65d9b640 1 --2- 172.21.15.161:0/2744673211 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a681532f0 0x7f6a540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a65d9b640 1 --2- 172.21.15.161:0/2744673211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a54004d10 0x7f6a54005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a65d9b640 1 -- 172.21.15.161:0/2744673211 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6806ae40 con 0x7f6a54004d10 2024-02-02T13:04:01.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a65d9b640 1 -- 172.21.15.161:0/2744673211 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5400ba20 con 0x7f6a54003980 2024-02-02T13:04:01.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a65d9b640 1 -- 172.21.15.161:0/2744673211 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5400bb90 con 0x7f6a681532f0 2024-02-02T13:04:01.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a66d9d640 1 --2- 172.21.15.161:0/2744673211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a54004d10 0x7f6a54005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a6659c640 1 --2- 172.21.15.161:0/2744673211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a54003980 0x7f6a54003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a5dd9b640 1 --2- 172.21.15.161:0/2744673211 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a681532f0 0x7f6a540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a66d9d640 1 -- 172.21.15.161:0/2744673211 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a681532f0 msgr2=0x7f6a540047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:01.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a66d9d640 1 --2- 172.21.15.161:0/2744673211 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a681532f0 0x7f6a540047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a66d9d640 1 -- 172.21.15.161:0/2744673211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a54003980 msgr2=0x7f6a54003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:01.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a66d9d640 1 --2- 172.21.15.161:0/2744673211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a54003980 0x7f6a54003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.727+0000 7f6a66d9d640 1 -- 172.21.15.161:0/2744673211 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a54003530 con 0x7f6a54004d10 2024-02-02T13:04:01.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a66d9d640 1 --2- 172.21.15.161:0/2744673211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a54004d10 0x7f6a54005190 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6a60009f90 tx=0x7f6a6001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e418c14a9b3c27 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:01.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a65d9b640 1 -- 172.21.15.161:0/2744673211 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a600a5c30 con 0x7f6a54004d10 2024-02-02T13:04:01.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a65d9b640 1 -- 172.21.15.161:0/2744673211 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6000f040 con 0x7f6a54004d10 2024-02-02T13:04:01.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a65d9b640 1 -- 172.21.15.161:0/2744673211 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a600ad440 con 0x7f6a54004d10 2024-02-02T13:04:01.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a6ca42640 1 -- 172.21.15.161:0/2744673211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a54004d10 msgr2=0x7f6a54005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:01.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a6ca42640 1 --2- 172.21.15.161:0/2744673211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a54004d10 0x7f6a54005190 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6a60009f90 tx=0x7f6a6001cc20 comp rx=0 tx=0).stop 2024-02-02T13:04:01.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a66d9d640 1 -- 172.21.15.161:0/2744673211 reap_dead start 2024-02-02T13:04:01.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a6ca42640 1 -- 172.21.15.161:0/2744673211 shutdown_connections 2024-02-02T13:04:01.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a6ca42640 1 -- 172.21.15.161:0/2744673211 >> 172.21.15.161:0/2744673211 conn(0x7f6a680c02e0 msgr2=0x7f6a680c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:01.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a6ca42640 1 -- 172.21.15.161:0/2744673211 shutdown_connections 2024-02-02T13:04:01.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a6ca42640 1 -- 172.21.15.161:0/2744673211 wait complete. 2024-02-02T13:04:01.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a6ca42640 1 Processor -- start 2024-02-02T13:04:01.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a6ca42640 1 -- start start 2024-02-02T13:04:01.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a6ca42640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a681e2ac0 0x7f6a680b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a6ca42640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a681e2ea0 0x7f6a680b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a6ca42640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a680b4240 0x7f6a680b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a6ca42640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a681e3a10 con 0x7f6a681e2ac0 2024-02-02T13:04:01.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a6ca42640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a68153130 con 0x7f6a680b4240 2024-02-02T13:04:01.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a6ca42640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a680b4be0 con 0x7f6a681e2ea0 2024-02-02T13:04:01.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a6659c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a681e2ac0 0x7f6a680b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a6659c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a681e2ac0 0x7f6a680b2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:50462/0 (socket says 172.21.15.161:50462) 2024-02-02T13:04:01.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.731+0000 7f6a6659c640 1 -- 172.21.15.161:0/2876032314 learned_addr learned my addr 172.21.15.161:0/2876032314 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:01.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.735+0000 7f6a5dd9b640 1 --2- 172.21.15.161:0/2876032314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a681e2ea0 0x7f6a680b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.735+0000 7f6a66d9d640 1 --2- 172.21.15.161:0/2876032314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a680b4240 0x7f6a680b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.735+0000 7f6a6659c640 1 -- 172.21.15.161:0/2876032314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a681e2ea0 msgr2=0x7f6a680b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.735+0000 7f6a6659c640 1 --2- 172.21.15.161:0/2876032314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a681e2ea0 0x7f6a680b2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.735+0000 7f6a6659c640 1 -- 172.21.15.161:0/2876032314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a680b4240 msgr2=0x7f6a680b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.735+0000 7f6a6659c640 1 --2- 172.21.15.161:0/2876032314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a680b4240 0x7f6a680b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.735+0000 7f6a6659c640 1 -- 172.21.15.161:0/2876032314 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a680b6010 con 0x7f6a681e2ac0 2024-02-02T13:04:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.735+0000 7f6a6659c640 1 --2- 172.21.15.161:0/2876032314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a681e2ac0 0x7f6a680b2540 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800eaf0 tx=0x7f6a580016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.735+0000 7f6a5f7fe640 1 -- 172.21.15.161:0/2876032314 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5800c850 con 0x7f6a681e2ac0 2024-02-02T13:04:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.735+0000 7f6a5f7fe640 1 -- 172.21.15.161:0/2876032314 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5800c9b0 con 0x7f6a681e2ac0 2024-02-02T13:04:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.735+0000 7f6a6ca42640 1 -- 172.21.15.161:0/2876032314 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a681458d0 con 0x7f6a681e2ac0 2024-02-02T13:04:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.735+0000 7f6a5f7fe640 1 -- 172.21.15.161:0/2876032314 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5800cd60 con 0x7f6a681e2ac0 2024-02-02T13:04:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.735+0000 7f6a6ca42640 1 -- 172.21.15.161:0/2876032314 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a681e3730 con 0x7f6a681e2ac0 2024-02-02T13:04:01.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.735+0000 7f6a6ca42640 1 -- 172.21.15.161:0/2876032314 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6804e000 con 0x7f6a681e2ac0 2024-02-02T13:04:01.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.735+0000 7f6a5f7fe640 1 -- 172.21.15.161:0/2876032314 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6a5801d460 con 0x7f6a681e2ac0 2024-02-02T13:04:01.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.735+0000 7f6a5f7fe640 1 --2- 172.21.15.161:0/2876032314 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6a48065a60 0x7f6a48067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:01.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.735+0000 7f6a5f7fe640 1 -- 172.21.15.161:0/2876032314 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a580831e0 con 0x7f6a681e2ac0 2024-02-02T13:04:01.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.735+0000 7f6a5dd9b640 1 --2- 172.21.15.161:0/2876032314 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6a48065a60 0x7f6a48067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:01.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.735+0000 7f6a5dd9b640 1 --2- 172.21.15.161:0/2876032314 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6a48065a60 0x7f6a48067f20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6a680a1d00 tx=0x7f6a50008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:01.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.739+0000 7f6a5f7fe640 1 -- 172.21.15.161:0/2876032314 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6a58050c30 con 0x7f6a681e2ac0 2024-02-02T13:04:01.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.891+0000 7f6a6ca42640 1 -- 172.21.15.161:0/2876032314 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a680a6260 con 0x7f6a681e2ac0 2024-02-02T13:04:01.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.895+0000 7f6a5f7fe640 1 -- 172.21.15.161:0/2876032314 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16149 (secure 0 0 0) 0x7f6a58054250 con 0x7f6a681e2ac0 2024-02-02T13:04:01.898 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T13:04:01.898 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":31,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:49:32.837266+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:49:30.264273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-02T11:49:30.811831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T13:04:01.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.895+0000 7f6a6ca42640 1 -- 172.21.15.161:0/2876032314 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6a48065a60 msgr2=0x7f6a48067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:01.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.895+0000 7f6a6ca42640 1 --2- 172.21.15.161:0/2876032314 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6a48065a60 0x7f6a48067f20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6a680a1d00 tx=0x7f6a50008040 comp rx=0 tx=0).stop 2024-02-02T13:04:01.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.895+0000 7f6a6ca42640 1 -- 172.21.15.161:0/2876032314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a681e2ac0 msgr2=0x7f6a680b2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:01.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.895+0000 7f6a6ca42640 1 --2- 172.21.15.161:0/2876032314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a681e2ac0 0x7f6a680b2540 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800eaf0 tx=0x7f6a580016f0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.895+0000 7f6a6ca42640 1 -- 172.21.15.161:0/2876032314 shutdown_connections 2024-02-02T13:04:01.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.895+0000 7f6a6ca42640 1 --2- 172.21.15.161:0/2876032314 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6a48065a60 0x7f6a48067f20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.895+0000 7f6a6ca42640 1 --2- 172.21.15.161:0/2876032314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a680b4240 0x7f6a680b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.895+0000 7f6a6ca42640 1 --2- 172.21.15.161:0/2876032314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a681e2ea0 0x7f6a680b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.895+0000 7f6a6ca42640 1 --2- 172.21.15.161:0/2876032314 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a681e2ac0 0x7f6a680b2540 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:01.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.895+0000 7f6a6ca42640 1 -- 172.21.15.161:0/2876032314 >> 172.21.15.161:0/2876032314 conn(0x7f6a680c02e0 msgr2=0x7f6a681460c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:01.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.895+0000 7f6a6ca42640 1 -- 172.21.15.161:0/2876032314 shutdown_connections 2024-02-02T13:04:01.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:01.895+0000 7f6a6ca42640 1 -- 172.21.15.161:0/2876032314 wait complete. 2024-02-02T13:04:01.916 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-02T13:04:01.916 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-02T13:04:02.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.031+0000 7fa7d666f640 1 Processor -- start 2024-02-02T13:04:02.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.031+0000 7fa7d666f640 1 -- start start 2024-02-02T13:04:02.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.035+0000 7fa7d666f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa7d006a4c0 0x7fa7d006a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.035+0000 7fa7d666f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa7d01532f0 0x7fa7d01556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.035+0000 7fa7d666f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d00bb370 con 0x7fa7d014b540 2024-02-02T13:04:02.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.035+0000 7fa7d666f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d006ae40 con 0x7fa7d01532f0 2024-02-02T13:04:02.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.035+0000 7fa7d666f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d00bc320 con 0x7fa7d006a4c0 2024-02-02T13:04:02.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.035+0000 7fa7cffff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fa7d014b540 0x7fa7d00bac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50522/0 (socket says 172.21.15.161:50522) 2024-02-02T13:04:02.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.035+0000 7fa7cffff640 1 -- 172.21.15.161:0/3835451245 learned_addr learned my addr 172.21.15.161:0/3835451245 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:04:02.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.035+0000 7fa7d4c0c640 1 --2- 172.21.15.161:0/3835451245 >> v2:172.21.15.161:3300/0 conn(0x7fa7d01532f0 0x7fa7d01556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.035+0000 7fa7cf7fe640 1 --2- 172.21.15.161:0/3835451245 >> v2:172.21.15.162:3300/0 conn(0x7fa7d006a4c0 0x7fa7d006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.035+0000 7fa7d4c0c640 1 -- 172.21.15.161:0/3835451245 >> v2:172.21.15.162:3300/0 conn(0x7fa7d006a4c0 msgr2=0x7fa7d006a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:02.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.035+0000 7fa7d4c0c640 1 --2- 172.21.15.161:0/3835451245 >> v2:172.21.15.162:3300/0 conn(0x7fa7d006a4c0 0x7fa7d006a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.035+0000 7fa7d4c0c640 1 -- 172.21.15.161:0/3835451245 >> v1:172.21.15.161:6789/0 conn(0x7fa7d014b540 legacy=0x7fa7d00bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:02.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.035+0000 7fa7d4c0c640 1 -- 172.21.15.161:0/3835451245 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d00bc590 con 0x7fa7d01532f0 2024-02-02T13:04:02.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.035+0000 7fa7ceffd640 1 -- 172.21.15.161:0/3835451245 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182921605 0 0) 0x7fa7d00bb370 con 0x7fa7d014b540 2024-02-02T13:04:02.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.035+0000 7fa7d4c0c640 1 --2- 172.21.15.161:0/3835451245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7d01532f0 0x7fa7d01556e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00c1040 tx=0x7fa7c801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24c4d309591ec31 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:02.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.035+0000 7fa7ceffd640 1 -- 172.21.15.161:0/3835451245 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80ab600 con 0x7fa7d01532f0 2024-02-02T13:04:02.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.035+0000 7fa7ceffd640 1 -- 172.21.15.161:0/3835451245 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c80a7050 con 0x7fa7d01532f0 2024-02-02T13:04:02.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.035+0000 7fa7ceffd640 1 -- 172.21.15.161:0/3835451245 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80ab980 con 0x7fa7d01532f0 2024-02-02T13:04:02.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d666f640 1 -- 172.21.15.161:0/3835451245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7d01532f0 msgr2=0x7fa7d01556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:02.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d666f640 1 --2- 172.21.15.161:0/3835451245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7d01532f0 0x7fa7d01556e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00c1040 tx=0x7fa7c801c460 comp rx=0 tx=0).stop 2024-02-02T13:04:02.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d666f640 1 -- 172.21.15.161:0/3835451245 shutdown_connections 2024-02-02T13:04:02.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d666f640 1 --2- 172.21.15.161:0/3835451245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7d01532f0 0x7fa7d01556e0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d666f640 1 --2- 172.21.15.161:0/3835451245 >> v2:172.21.15.162:3300/0 conn(0x7fa7d006a4c0 0x7fa7d006a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d666f640 1 -- 172.21.15.161:0/3835451245 >> 172.21.15.161:0/3835451245 conn(0x7fa7d00c02e0 msgr2=0x7fa7d00c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:02.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d666f640 1 -- 172.21.15.161:0/3835451245 shutdown_connections 2024-02-02T13:04:02.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d666f640 1 -- 172.21.15.161:0/3835451245 wait complete. 2024-02-02T13:04:02.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d666f640 1 Processor -- start 2024-02-02T13:04:02.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d666f640 1 -- start start 2024-02-02T13:04:02.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d666f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7d006a4c0 0x7fa7d00b6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d666f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7d014b540 0x7fa7d01e4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d666f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7d01532f0 0x7fa7d01e4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d666f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00b6c00 con 0x7fa7d014b540 2024-02-02T13:04:02.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d666f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00b44c0 con 0x7fa7d006a4c0 2024-02-02T13:04:02.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d666f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00b4760 con 0x7fa7d01532f0 2024-02-02T13:04:02.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7cf7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7d014b540 0x7fa7d01e4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7cf7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7d014b540 0x7fa7d01e4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:50474/0 (socket says 172.21.15.161:50474) 2024-02-02T13:04:02.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7cf7fe640 1 -- 172.21.15.161:0/2545870007 learned_addr learned my addr 172.21.15.161:0/2545870007 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:02.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7cffff640 1 --2- 172.21.15.161:0/2545870007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7d006a4c0 0x7fa7d00b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7cf7fe640 1 -- 172.21.15.161:0/2545870007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7d01532f0 msgr2=0x7fa7d01e4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:02.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d4c0c640 1 --2- 172.21.15.161:0/2545870007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7d01532f0 0x7fa7d01e4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7cf7fe640 1 --2- 172.21.15.161:0/2545870007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7d01532f0 0x7fa7d01e4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7cf7fe640 1 -- 172.21.15.161:0/2545870007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7d006a4c0 msgr2=0x7fa7d00b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:02.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7cf7fe640 1 --2- 172.21.15.161:0/2545870007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7d006a4c0 0x7fa7d00b6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7cf7fe640 1 -- 172.21.15.161:0/2545870007 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c8009420 con 0x7fa7d014b540 2024-02-02T13:04:02.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7cffff640 1 --2- 172.21.15.161:0/2545870007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7d006a4c0 0x7fa7d00b6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:02.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7cf7fe640 1 --2- 172.21.15.161:0/2545870007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7d014b540 0x7fa7d01e4100 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800c7f0 tx=0x7fa7b800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:02.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7ccff9640 1 -- 172.21.15.161:0/2545870007 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8004220 con 0x7fa7d014b540 2024-02-02T13:04:02.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7ccff9640 1 -- 172.21.15.161:0/2545870007 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b80043a0 con 0x7fa7d014b540 2024-02-02T13:04:02.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7ccff9640 1 -- 172.21.15.161:0/2545870007 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8004510 con 0x7fa7d014b540 2024-02-02T13:04:02.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d666f640 1 -- 172.21.15.161:0/2545870007 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d00b4ad0 con 0x7fa7d014b540 2024-02-02T13:04:02.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d666f640 1 -- 172.21.15.161:0/2545870007 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d00b6860 con 0x7fa7d014b540 2024-02-02T13:04:02.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.039+0000 7fa7d666f640 1 -- 172.21.15.161:0/2545870007 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d00b4920 con 0x7fa7d014b540 2024-02-02T13:04:02.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.043+0000 7fa7ccff9640 1 -- 172.21.15.161:0/2545870007 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa7b8003a70 con 0x7fa7d014b540 2024-02-02T13:04:02.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.043+0000 7fa7ccff9640 1 --2- 172.21.15.161:0/2545870007 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa7b0065a60 0x7fa7b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.043+0000 7fa7ccff9640 1 -- 172.21.15.161:0/2545870007 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7b8083100 con 0x7fa7d014b540 2024-02-02T13:04:02.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.043+0000 7fa7cffff640 1 --2- 172.21.15.161:0/2545870007 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa7b0065a60 0x7fa7b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.043+0000 7fa7cffff640 1 --2- 172.21.15.161:0/2545870007 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa7b0065a60 0x7fa7b0067f20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0007fd0 tx=0x7fa7c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:02.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.047+0000 7fa7ccff9640 1 -- 172.21.15.161:0/2545870007 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa7b8050b50 con 0x7fa7d014b540 2024-02-02T13:04:02.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.231+0000 7fa7d666f640 1 -- 172.21.15.161:0/2545870007 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7d00b42f0 con 0x7fa7d014b540 2024-02-02T13:04:02.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.235+0000 7fa7ccff9640 1 -- 172.21.15.161:0/2545870007 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3958 (secure 0 0 0) 0x7fa7b8054170 con 0x7fa7d014b540 2024-02-02T13:04:02.238 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T13:04:02.238 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4535,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/236294405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":236294405},{"type":"v1","addr":"172.21.15.162:6833","nonce":236294405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3772183556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3772183556},{"type":"v1","addr":"172.21.15.161:6835","nonce":3772183556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-02T11:49:31.833135+0000","modified":"2024-02-02T11:49:34.491389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/1621598548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1621598548},{"type":"v1","addr":"172.21.15.161:6837","nonce":1621598548}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-02T13:04:02.238 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 14 2024-02-02T13:04:02.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.235+0000 7fa7d666f640 1 -- 172.21.15.161:0/2545870007 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa7b0065a60 msgr2=0x7fa7b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:02.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.235+0000 7fa7d666f640 1 --2- 172.21.15.161:0/2545870007 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa7b0065a60 0x7fa7b0067f20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0007fd0 tx=0x7fa7c0009040 comp rx=0 tx=0).stop 2024-02-02T13:04:02.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.235+0000 7fa7d666f640 1 -- 172.21.15.161:0/2545870007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7d014b540 msgr2=0x7fa7d01e4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:02.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.235+0000 7fa7d666f640 1 --2- 172.21.15.161:0/2545870007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7d014b540 0x7fa7d01e4100 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800c7f0 tx=0x7fa7b800ccb0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.235+0000 7fa7d666f640 1 -- 172.21.15.161:0/2545870007 shutdown_connections 2024-02-02T13:04:02.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.235+0000 7fa7d666f640 1 --2- 172.21.15.161:0/2545870007 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa7b0065a60 0x7fa7b0067f20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.235+0000 7fa7d666f640 1 --2- 172.21.15.161:0/2545870007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7d01532f0 0x7fa7d01e4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.235+0000 7fa7d666f640 1 --2- 172.21.15.161:0/2545870007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7d014b540 0x7fa7d01e4100 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.235+0000 7fa7d666f640 1 --2- 172.21.15.161:0/2545870007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7d006a4c0 0x7fa7d00b6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.235+0000 7fa7d666f640 1 -- 172.21.15.161:0/2545870007 >> 172.21.15.161:0/2545870007 conn(0x7fa7d00c02e0 msgr2=0x7fa7d00bab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:02.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.235+0000 7fa7d666f640 1 -- 172.21.15.161:0/2545870007 shutdown_connections 2024-02-02T13:04:02.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.235+0000 7fa7d666f640 1 -- 172.21.15.161:0/2545870007 wait complete. 2024-02-02T13:04:02.256 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-02T13:04:02.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb76494640 1 Processor -- start 2024-02-02T13:04:02.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb76494640 1 -- start start 2024-02-02T13:04:02.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb76494640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffb700bc340 0x7ffb70142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb76494640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb70149470 0x7ffb70153110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb76494640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb70071770 con 0x7ffb70142d50 2024-02-02T13:04:02.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb76494640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb700b37e0 con 0x7ffb700bc340 2024-02-02T13:04:02.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb76494640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700b3ac0 con 0x7ffb70149470 2024-02-02T13:04:02.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb67fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ffb70142d50 0x7ffb70148d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50534/0 (socket says 172.21.15.161:50534) 2024-02-02T13:04:02.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb67fff640 1 -- 172.21.15.161:0/3335470125 learned_addr learned my addr 172.21.15.161:0/3335470125 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:04:02.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb74a31640 1 --2- 172.21.15.161:0/3335470125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb70149470 0x7ffb70153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb6ffff640 1 --2- 172.21.15.161:0/3335470125 >> v2:172.21.15.162:3300/0 conn(0x7ffb700bc340 0x7ffb70142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb6f7fe640 1 -- 172.21.15.161:0/3335470125 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678477084 0 0) 0x7ffb70071770 con 0x7ffb70142d50 2024-02-02T13:04:02.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb6f7fe640 1 -- 172.21.15.161:0/3335470125 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb5c003530 con 0x7ffb70142d50 2024-02-02T13:04:02.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb6f7fe640 1 -- 172.21.15.161:0/3335470125 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2851158493 0 0) 0x7ffb5c003530 con 0x7ffb70142d50 2024-02-02T13:04:02.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb6f7fe640 1 -- 172.21.15.161:0/3335470125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb70149470 msgr2=0x7ffb70153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:02.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb6f7fe640 1 --2- 172.21.15.161:0/3335470125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb70149470 0x7ffb70153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb6f7fe640 1 -- 172.21.15.161:0/3335470125 >> v2:172.21.15.162:3300/0 conn(0x7ffb700bc340 msgr2=0x7ffb70142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:02.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb6f7fe640 1 --2- 172.21.15.161:0/3335470125 >> v2:172.21.15.162:3300/0 conn(0x7ffb700bc340 0x7ffb70142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb6f7fe640 1 -- 172.21.15.161:0/3335470125 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb700b3da0 con 0x7ffb70142d50 2024-02-02T13:04:02.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb6f7fe640 1 -- 172.21.15.161:0/3335470125 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7ffb58001680 con 0x7ffb70142d50 2024-02-02T13:04:02.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb6f7fe640 1 -- 172.21.15.161:0/3335470125 >> v1:172.21.15.161:6789/0 conn(0x7ffb70142d50 legacy=0x7ffb70148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:02.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb6f7fe640 1 --2- 172.21.15.161:0/3335470125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb5c003980 0x7ffb5c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb6f7fe640 1 --2- 172.21.15.161:0/3335470125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb5c0047d0 0x7ffb5c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb6f7fe640 1 --2- 172.21.15.161:0/3335470125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb70149470 0x7ffb5c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb6f7fe640 1 -- 172.21.15.161:0/3335470125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700b37e0 con 0x7ffb5c0047d0 2024-02-02T13:04:02.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb6f7fe640 1 -- 172.21.15.161:0/3335470125 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700b3ac0 con 0x7ffb5c003980 2024-02-02T13:04:02.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb6f7fe640 1 -- 172.21.15.161:0/3335470125 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c00b990 con 0x7ffb70149470 2024-02-02T13:04:02.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb67fff640 1 --2- 172.21.15.161:0/3335470125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb5c0047d0 0x7ffb5c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb6ffff640 1 --2- 172.21.15.161:0/3335470125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb5c003980 0x7ffb5c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb74a31640 1 --2- 172.21.15.161:0/3335470125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb70149470 0x7ffb5c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb67fff640 1 -- 172.21.15.161:0/3335470125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb70149470 msgr2=0x7ffb5c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:02.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb67fff640 1 --2- 172.21.15.161:0/3335470125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb70149470 0x7ffb5c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb67fff640 1 -- 172.21.15.161:0/3335470125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb5c003980 msgr2=0x7ffb5c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:02.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb67fff640 1 --2- 172.21.15.161:0/3335470125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb5c003980 0x7ffb5c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.367+0000 7ffb67fff640 1 -- 172.21.15.161:0/3335470125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5c003530 con 0x7ffb5c0047d0 2024-02-02T13:04:02.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb67fff640 1 --2- 172.21.15.161:0/3335470125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb5c0047d0 0x7ffb5c004c50 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800c210 tx=0x7ffb5801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b167af27d69cdcba server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:02.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb6f7fe640 1 -- 172.21.15.161:0/3335470125 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb580058e0 con 0x7ffb5c0047d0 2024-02-02T13:04:02.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb6f7fe640 1 -- 172.21.15.161:0/3335470125 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb58005a40 con 0x7ffb5c0047d0 2024-02-02T13:04:02.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb6f7fe640 1 -- 172.21.15.161:0/3335470125 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb58005df0 con 0x7ffb5c0047d0 2024-02-02T13:04:02.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb76494640 1 -- 172.21.15.161:0/3335470125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb5c0047d0 msgr2=0x7ffb5c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:02.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb76494640 1 --2- 172.21.15.161:0/3335470125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb5c0047d0 0x7ffb5c004c50 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800c210 tx=0x7ffb5801cc40 comp rx=0 tx=0).stop 2024-02-02T13:04:02.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb74a31640 1 -- 172.21.15.161:0/3335470125 reap_dead start 2024-02-02T13:04:02.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb76494640 1 -- 172.21.15.161:0/3335470125 shutdown_connections 2024-02-02T13:04:02.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb76494640 1 -- 172.21.15.161:0/3335470125 >> 172.21.15.161:0/3335470125 conn(0x7ffb70069ef0 msgr2=0x7ffb7006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:02.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb76494640 1 -- 172.21.15.161:0/3335470125 shutdown_connections 2024-02-02T13:04:02.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb76494640 1 -- 172.21.15.161:0/3335470125 wait complete. 2024-02-02T13:04:02.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb76494640 1 Processor -- start 2024-02-02T13:04:02.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb76494640 1 -- start start 2024-02-02T13:04:02.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb76494640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb5c0047d0 0x7ffb70147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb76494640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb70145530 0x7ffb70145990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb76494640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb70143f70 0x7ffb701443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb76494640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb70144910 con 0x7ffb5c0047d0 2024-02-02T13:04:02.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb76494640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb70147f60 con 0x7ffb70145530 2024-02-02T13:04:02.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb76494640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7006f760 con 0x7ffb70143f70 2024-02-02T13:04:02.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb6ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb5c0047d0 0x7ffb70147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb6ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb5c0047d0 0x7ffb70147a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:50494/0 (socket says 172.21.15.161:50494) 2024-02-02T13:04:02.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb6ffff640 1 -- 172.21.15.161:0/2064423510 learned_addr learned my addr 172.21.15.161:0/2064423510 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:02.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb67fff640 1 --2- 172.21.15.161:0/2064423510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb70145530 0x7ffb70145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb74a31640 1 --2- 172.21.15.161:0/2064423510 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb70143f70 0x7ffb701443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb6ffff640 1 -- 172.21.15.161:0/2064423510 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb70143f70 msgr2=0x7ffb701443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:02.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb6ffff640 1 --2- 172.21.15.161:0/2064423510 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb70143f70 0x7ffb701443d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb6ffff640 1 -- 172.21.15.161:0/2064423510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb70145530 msgr2=0x7ffb70145990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:02.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb6ffff640 1 --2- 172.21.15.161:0/2064423510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb70145530 0x7ffb70145990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb6ffff640 1 -- 172.21.15.161:0/2064423510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb70143140 con 0x7ffb5c0047d0 2024-02-02T13:04:02.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb67fff640 1 --2- 172.21.15.161:0/2064423510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb70145530 0x7ffb70145990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:02.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb6ffff640 1 --2- 172.21.15.161:0/2064423510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb5c0047d0 0x7ffb70147a20 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ffb60011560 tx=0x7ffb60011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:02.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb6d7fa640 1 -- 172.21.15.161:0/2064423510 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb60015930 con 0x7ffb5c0047d0 2024-02-02T13:04:02.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb6d7fa640 1 -- 172.21.15.161:0/2064423510 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb60015a90 con 0x7ffb5c0047d0 2024-02-02T13:04:02.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb76494640 1 -- 172.21.15.161:0/2064423510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb70143c70 con 0x7ffb5c0047d0 2024-02-02T13:04:02.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb6d7fa640 1 -- 172.21.15.161:0/2064423510 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb60015e20 con 0x7ffb5c0047d0 2024-02-02T13:04:02.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.371+0000 7ffb76494640 1 -- 172.21.15.161:0/2064423510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb701438c0 con 0x7ffb5c0047d0 2024-02-02T13:04:02.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.375+0000 7ffb76494640 1 -- 172.21.15.161:0/2064423510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb70144dd0 con 0x7ffb5c0047d0 2024-02-02T13:04:02.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.375+0000 7ffb6d7fa640 1 -- 172.21.15.161:0/2064423510 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffb6000f460 con 0x7ffb5c0047d0 2024-02-02T13:04:02.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.375+0000 7ffb6d7fa640 1 --2- 172.21.15.161:0/2064423510 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ffb50065a60 0x7ffb50067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.375+0000 7ffb6d7fa640 1 -- 172.21.15.161:0/2064423510 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb60083920 con 0x7ffb5c0047d0 2024-02-02T13:04:02.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.375+0000 7ffb67fff640 1 --2- 172.21.15.161:0/2064423510 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ffb50065a60 0x7ffb50067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.375+0000 7ffb67fff640 1 --2- 172.21.15.161:0/2064423510 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ffb50065a60 0x7ffb50067f20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ffb580aa000 tx=0x7ffb58000ff0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:02.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.379+0000 7ffb6d7fa640 1 -- 172.21.15.161:0/2064423510 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffb70144dd0 con 0x7ffb5c0047d0 2024-02-02T13:04:02.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.551+0000 7ffb76494640 1 -- 172.21.15.161:0/2064423510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb70144dd0 con 0x7ffb5c0047d0 2024-02-02T13:04:02.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.551+0000 7ffb6d7fa640 1 -- 172.21.15.161:0/2064423510 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3958 (secure 0 0 0) 0x7ffb70144dd0 con 0x7ffb5c0047d0 2024-02-02T13:04:02.556 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T13:04:02.557 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4535,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/236294405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":236294405},{"type":"v1","addr":"172.21.15.162:6833","nonce":236294405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3772183556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3772183556},{"type":"v1","addr":"172.21.15.161:6835","nonce":3772183556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-02T11:49:31.833135+0000","modified":"2024-02-02T11:49:34.491389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/1621598548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":1621598548},{"type":"v1","addr":"172.21.15.161:6837","nonce":1621598548}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-02T13:04:02.557 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 14 2024-02-02T13:04:02.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.555+0000 7ffb76494640 1 -- 172.21.15.161:0/2064423510 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ffb50065a60 msgr2=0x7ffb50067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:02.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.555+0000 7ffb76494640 1 --2- 172.21.15.161:0/2064423510 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ffb50065a60 0x7ffb50067f20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ffb580aa000 tx=0x7ffb58000ff0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.555+0000 7ffb76494640 1 -- 172.21.15.161:0/2064423510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb5c0047d0 msgr2=0x7ffb70147a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:02.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.555+0000 7ffb76494640 1 --2- 172.21.15.161:0/2064423510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb5c0047d0 0x7ffb70147a20 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ffb60011560 tx=0x7ffb60011a20 comp rx=0 tx=0).stop 2024-02-02T13:04:02.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.555+0000 7ffb76494640 1 -- 172.21.15.161:0/2064423510 shutdown_connections 2024-02-02T13:04:02.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.555+0000 7ffb76494640 1 --2- 172.21.15.161:0/2064423510 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ffb50065a60 0x7ffb50067f20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.555+0000 7ffb76494640 1 --2- 172.21.15.161:0/2064423510 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb70143f70 0x7ffb701443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.555+0000 7ffb76494640 1 --2- 172.21.15.161:0/2064423510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb70145530 0x7ffb70145990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.555+0000 7ffb76494640 1 --2- 172.21.15.161:0/2064423510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb5c0047d0 0x7ffb70147a20 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.555+0000 7ffb76494640 1 -- 172.21.15.161:0/2064423510 >> 172.21.15.161:0/2064423510 conn(0x7ffb70069ef0 msgr2=0x7ffb70140ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:02.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.555+0000 7ffb76494640 1 -- 172.21.15.161:0/2064423510 shutdown_connections 2024-02-02T13:04:02.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.555+0000 7ffb76494640 1 -- 172.21.15.161:0/2064423510 wait complete. 2024-02-02T13:04:02.574 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T13:04:02.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.687+0000 7f63e9b75640 1 Processor -- start 2024-02-02T13:04:02.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.687+0000 7f63e9b75640 1 -- start start 2024-02-02T13:04:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e9b75640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63e40bc340 0x7f63e4142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e9b75640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f63e4142d50 0x7f63e4148d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e9b75640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e4071770 con 0x7f63e41492a0 2024-02-02T13:04:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e9b75640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e41496d0 con 0x7f63e4142d50 2024-02-02T13:04:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e9b75640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e40b37e0 con 0x7f63e40bc340 2024-02-02T13:04:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e3fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f63e41492a0 0x7f63e40b53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:41200/0 (socket says 172.21.15.161:41200) 2024-02-02T13:04:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e3fff640 1 -- 172.21.15.161:0/1453455380 learned_addr learned my addr 172.21.15.161:0/1453455380 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:04:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e37fe640 1 --2- 172.21.15.161:0/1453455380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63e40bc340 0x7f63e4142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e2ffd640 1 --2- 172.21.15.161:0/1453455380 >> v2:172.21.15.162:3300/0 conn(0x7f63e4142d50 0x7f63e4148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e27fc640 1 -- 172.21.15.161:0/1453455380 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3092244657 0 0) 0x7f63e4071770 con 0x7f63e41492a0 2024-02-02T13:04:02.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e27fc640 1 -- 172.21.15.161:0/1453455380 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63cc003530 con 0x7f63e41492a0 2024-02-02T13:04:02.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e27fc640 1 -- 172.21.15.161:0/1453455380 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3355865298 0 0) 0x7f63cc003530 con 0x7f63e41492a0 2024-02-02T13:04:02.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e27fc640 1 -- 172.21.15.161:0/1453455380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63e40bc340 msgr2=0x7f63e4142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:02.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e27fc640 1 --2- 172.21.15.161:0/1453455380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63e40bc340 0x7f63e4142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e27fc640 1 -- 172.21.15.161:0/1453455380 >> v2:172.21.15.162:3300/0 conn(0x7f63e4142d50 msgr2=0x7f63e4148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:02.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e27fc640 1 --2- 172.21.15.161:0/1453455380 >> v2:172.21.15.162:3300/0 conn(0x7f63e4142d50 0x7f63e4148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e27fc640 1 -- 172.21.15.161:0/1453455380 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e40b3ac0 con 0x7f63e41492a0 2024-02-02T13:04:02.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e27fc640 1 -- 172.21.15.161:0/1453455380 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f63d4001a00 con 0x7f63e41492a0 2024-02-02T13:04:02.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e27fc640 1 -- 172.21.15.161:0/1453455380 >> v1:172.21.15.161:6789/0 conn(0x7f63e41492a0 legacy=0x7f63e40b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:02.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e27fc640 1 --2- 172.21.15.161:0/1453455380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63cc003980 0x7f63cc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e27fc640 1 --2- 172.21.15.161:0/1453455380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63e40bc340 0x7f63cc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e27fc640 1 --2- 172.21.15.161:0/1453455380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63cc004d10 0x7f63cc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e27fc640 1 -- 172.21.15.161:0/1453455380 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e41496d0 con 0x7f63cc004d10 2024-02-02T13:04:02.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e27fc640 1 -- 172.21.15.161:0/1453455380 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e40b37e0 con 0x7f63cc003980 2024-02-02T13:04:02.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e27fc640 1 -- 172.21.15.161:0/1453455380 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc00b990 con 0x7f63e40bc340 2024-02-02T13:04:02.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e3fff640 1 --2- 172.21.15.161:0/1453455380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63cc004d10 0x7f63cc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e2ffd640 1 --2- 172.21.15.161:0/1453455380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63e40bc340 0x7f63cc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e37fe640 1 --2- 172.21.15.161:0/1453455380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63cc003980 0x7f63cc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e3fff640 1 -- 172.21.15.161:0/1453455380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63e40bc340 msgr2=0x7f63cc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:02.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e3fff640 1 --2- 172.21.15.161:0/1453455380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63e40bc340 0x7f63cc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e3fff640 1 -- 172.21.15.161:0/1453455380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63cc003980 msgr2=0x7f63cc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:02.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e3fff640 1 --2- 172.21.15.161:0/1453455380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63cc003980 0x7f63cc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e3fff640 1 -- 172.21.15.161:0/1453455380 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63cc003530 con 0x7f63cc004d10 2024-02-02T13:04:02.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e37fe640 1 --2- 172.21.15.161:0/1453455380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63cc003980 0x7f63cc003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:02.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e3fff640 1 --2- 172.21.15.161:0/1453455380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63cc004d10 0x7f63cc005190 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f63d400a830 tx=0x7f63d401d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bc3fe35f1c478b server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:02.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e27fc640 1 -- 172.21.15.161:0/1453455380 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d40ad630 con 0x7f63cc004d10 2024-02-02T13:04:02.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e27fc640 1 -- 172.21.15.161:0/1453455380 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d40a8070 con 0x7f63cc004d10 2024-02-02T13:04:02.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.691+0000 7f63e27fc640 1 -- 172.21.15.161:0/1453455380 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d40ad9d0 con 0x7f63cc004d10 2024-02-02T13:04:02.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e9b75640 1 -- 172.21.15.161:0/1453455380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63cc004d10 msgr2=0x7f63cc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:02.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e9b75640 1 --2- 172.21.15.161:0/1453455380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63cc004d10 0x7f63cc005190 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f63d400a830 tx=0x7f63d401d340 comp rx=0 tx=0).stop 2024-02-02T13:04:02.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e3fff640 1 -- 172.21.15.161:0/1453455380 reap_dead start 2024-02-02T13:04:02.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e9b75640 1 -- 172.21.15.161:0/1453455380 shutdown_connections 2024-02-02T13:04:02.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e9b75640 1 -- 172.21.15.161:0/1453455380 >> 172.21.15.161:0/1453455380 conn(0x7f63e4069ef0 msgr2=0x7f63e406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:02.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e9b75640 1 -- 172.21.15.161:0/1453455380 shutdown_connections 2024-02-02T13:04:02.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e9b75640 1 -- 172.21.15.161:0/1453455380 wait complete. 2024-02-02T13:04:02.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e9b75640 1 Processor -- start 2024-02-02T13:04:02.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e9b75640 1 -- start start 2024-02-02T13:04:02.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e9b75640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63e406fcb0 0x7f63e41e7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e9b75640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63e41e7ec0 0x7f63e4144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e9b75640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63e4144890 0x7f63e4143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e9b75640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e41460a0 con 0x7f63e406fcb0 2024-02-02T13:04:02.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e9b75640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e41e8320 con 0x7f63e41e7ec0 2024-02-02T13:04:02.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e9b75640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e41450d0 con 0x7f63e4144890 2024-02-02T13:04:02.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e37fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63e406fcb0 0x7f63e41e7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e37fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63e406fcb0 0x7f63e41e7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46482/0 (socket says 172.21.15.161:46482) 2024-02-02T13:04:02.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e37fe640 1 -- 172.21.15.161:0/4081414135 learned_addr learned my addr 172.21.15.161:0/4081414135 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:02.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e3fff640 1 --2- 172.21.15.161:0/4081414135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63e4144890 0x7f63e4143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e2ffd640 1 --2- 172.21.15.161:0/4081414135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63e41e7ec0 0x7f63e4144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e37fe640 1 -- 172.21.15.161:0/4081414135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63e4144890 msgr2=0x7f63e4143140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:02.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e37fe640 1 --2- 172.21.15.161:0/4081414135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63e4144890 0x7f63e4143140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e37fe640 1 -- 172.21.15.161:0/4081414135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63e41e7ec0 msgr2=0x7f63e4144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:02.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e37fe640 1 --2- 172.21.15.161:0/4081414135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63e41e7ec0 0x7f63e4144350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e37fe640 1 -- 172.21.15.161:0/4081414135 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e406ee20 con 0x7f63e406fcb0 2024-02-02T13:04:02.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e3fff640 1 --2- 172.21.15.161:0/4081414135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63e4144890 0x7f63e4143140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:02.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e37fe640 1 --2- 172.21.15.161:0/4081414135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63e406fcb0 0x7f63e41e7980 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0108d0 tx=0x7f63dc010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:02.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63cbfff640 1 -- 172.21.15.161:0/4081414135 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc004220 con 0x7f63e406fcb0 2024-02-02T13:04:02.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63cbfff640 1 -- 172.21.15.161:0/4081414135 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63dc004380 con 0x7f63e406fcb0 2024-02-02T13:04:02.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e9b75640 1 -- 172.21.15.161:0/4081414135 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e4145dc0 con 0x7f63e406fcb0 2024-02-02T13:04:02.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63cbfff640 1 -- 172.21.15.161:0/4081414135 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc00eba0 con 0x7f63e406fcb0 2024-02-02T13:04:02.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e9b75640 1 -- 172.21.15.161:0/4081414135 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e4070090 con 0x7f63e406fcb0 2024-02-02T13:04:02.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.695+0000 7f63e9b75640 1 -- 172.21.15.161:0/4081414135 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e404e000 con 0x7f63e406fcb0 2024-02-02T13:04:02.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.699+0000 7f63cbfff640 1 -- 172.21.15.161:0/4081414135 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f63dc00ed00 con 0x7f63e406fcb0 2024-02-02T13:04:02.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.699+0000 7f63cbfff640 1 --2- 172.21.15.161:0/4081414135 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f63d0065a60 0x7f63d0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:02.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.699+0000 7f63cbfff640 1 -- 172.21.15.161:0/4081414135 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63dc083070 con 0x7f63e406fcb0 2024-02-02T13:04:02.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.699+0000 7f63e2ffd640 1 --2- 172.21.15.161:0/4081414135 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f63d0065a60 0x7f63d0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:02.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.699+0000 7f63e2ffd640 1 --2- 172.21.15.161:0/4081414135 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f63d0065a60 0x7f63d0067f20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f63e413e4b0 tx=0x7f63d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:02.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.703+0000 7f63cbfff640 1 -- 172.21.15.161:0/4081414135 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f63dc050ac0 con 0x7f63e406fcb0 2024-02-02T13:04:02.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.859+0000 7f63e9b75640 1 -- 172.21.15.161:0/4081414135 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63e41e75a0 con 0x7f63e406fcb0 2024-02-02T13:04:02.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.859+0000 7f63cbfff640 1 -- 172.21.15.161:0/4081414135 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16149 (secure 0 0 0) 0x7f63dc0540e0 con 0x7f63e406fcb0 2024-02-02T13:04:02.865 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T13:04:02.865 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":31,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T11:49:32.837266+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-02T11:49:30.264273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-02T11:49:30.811831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T13:04:02.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.863+0000 7f63e9b75640 1 -- 172.21.15.161:0/4081414135 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f63d0065a60 msgr2=0x7f63d0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:02.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.863+0000 7f63e9b75640 1 --2- 172.21.15.161:0/4081414135 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f63d0065a60 0x7f63d0067f20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f63e413e4b0 tx=0x7f63d8008040 comp rx=0 tx=0).stop 2024-02-02T13:04:02.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.863+0000 7f63e9b75640 1 -- 172.21.15.161:0/4081414135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63e406fcb0 msgr2=0x7f63e41e7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:02.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.863+0000 7f63e9b75640 1 --2- 172.21.15.161:0/4081414135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63e406fcb0 0x7f63e41e7980 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0108d0 tx=0x7f63dc010d90 comp rx=0 tx=0).stop 2024-02-02T13:04:02.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.863+0000 7f63e9b75640 1 -- 172.21.15.161:0/4081414135 shutdown_connections 2024-02-02T13:04:02.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.863+0000 7f63e9b75640 1 --2- 172.21.15.161:0/4081414135 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f63d0065a60 0x7f63d0067f20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.863+0000 7f63e9b75640 1 --2- 172.21.15.161:0/4081414135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63e4144890 0x7f63e4143140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.863+0000 7f63e9b75640 1 --2- 172.21.15.161:0/4081414135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63e41e7ec0 0x7f63e4144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.863+0000 7f63e9b75640 1 --2- 172.21.15.161:0/4081414135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63e406fcb0 0x7f63e41e7980 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:02.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.863+0000 7f63e9b75640 1 -- 172.21.15.161:0/4081414135 >> 172.21.15.161:0/4081414135 conn(0x7f63e4069ef0 msgr2=0x7f63e40b7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:02.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.863+0000 7f63e9b75640 1 -- 172.21.15.161:0/4081414135 shutdown_connections 2024-02-02T13:04:02.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.863+0000 7f63e9b75640 1 -- 172.21.15.161:0/4081414135 wait complete. 2024-02-02T13:04:02.885 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-02-02T13:04:03.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.999+0000 7f46f74de640 1 Processor -- start 2024-02-02T13:04:03.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.999+0000 7f46f74de640 1 -- start start 2024-02-02T13:04:03.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.999+0000 7f46f74de640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f46f00b9f20 0x7f46f00b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:03.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.999+0000 7f46f74de640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f46f00ba300 0x7f46f006c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:03.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.999+0000 7f46f74de640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f00b9b30 con 0x7f46f006c5f0 2024-02-02T13:04:03.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.999+0000 7f46f74de640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f0071760 con 0x7f46f00ba300 2024-02-02T13:04:03.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.999+0000 7f46f74de640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f00710a0 con 0x7f46f00b9f20 2024-02-02T13:04:03.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.999+0000 7f46f4a79640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f46f00ba300 0x7f46f006c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:03.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.999+0000 7f46f4a79640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f46f00ba300 0x7f46f006c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46494/0 (socket says 172.21.15.161:46494) 2024-02-02T13:04:03.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.999+0000 7f46f4a79640 1 -- 172.21.15.161:0/2952461818 learned_addr learned my addr 172.21.15.161:0/2952461818 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:03.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.999+0000 7f46f527a640 1 --2- 172.21.15.161:0/2952461818 >> v2:172.21.15.162:3300/0 conn(0x7f46f00b9f20 0x7f46f00b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:03.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.999+0000 7f46f4a79640 1 -- 172.21.15.161:0/2952461818 >> v2:172.21.15.162:3300/0 conn(0x7f46f00b9f20 msgr2=0x7f46f00b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:03.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.999+0000 7f46f4a79640 1 --2- 172.21.15.161:0/2952461818 >> v2:172.21.15.162:3300/0 conn(0x7f46f00b9f20 0x7f46f00b95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:03.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.999+0000 7f46f4a79640 1 -- 172.21.15.161:0/2952461818 >> v1:172.21.15.162:6789/0 conn(0x7f46f006c5f0 legacy=0x7f46f014e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:03.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:02.999+0000 7f46f4a79640 1 -- 172.21.15.161:0/2952461818 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f0071380 con 0x7f46f00ba300 2024-02-02T13:04:03.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f4a79640 1 --2- 172.21.15.161:0/2952461818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46f00ba300 0x7f46f006c0b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f46f006e930 tx=0x7f46ec01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae90e2d69a1387 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:03.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46e7fff640 1 -- 172.21.15.161:0/2952461818 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec0ab640 con 0x7f46f00ba300 2024-02-02T13:04:03.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46e7fff640 1 -- 172.21.15.161:0/2952461818 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ec0a7070 con 0x7f46f00ba300 2024-02-02T13:04:03.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46e7fff640 1 -- 172.21.15.161:0/2952461818 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec0ab9c0 con 0x7f46f00ba300 2024-02-02T13:04:03.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f74de640 1 -- 172.21.15.161:0/2952461818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46f00ba300 msgr2=0x7f46f006c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:03.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f74de640 1 --2- 172.21.15.161:0/2952461818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46f00ba300 0x7f46f006c0b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f46f006e930 tx=0x7f46ec01c500 comp rx=0 tx=0).stop 2024-02-02T13:04:03.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f74de640 1 -- 172.21.15.161:0/2952461818 shutdown_connections 2024-02-02T13:04:03.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f74de640 1 --2- 172.21.15.161:0/2952461818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46f00ba300 0x7f46f006c0b0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:03.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f74de640 1 --2- 172.21.15.161:0/2952461818 >> v2:172.21.15.162:3300/0 conn(0x7f46f00b9f20 0x7f46f00b95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:03.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f74de640 1 -- 172.21.15.161:0/2952461818 >> 172.21.15.161:0/2952461818 conn(0x7f46f00be150 msgr2=0x7f46f00be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:03.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f74de640 1 -- 172.21.15.161:0/2952461818 shutdown_connections 2024-02-02T13:04:03.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f74de640 1 -- 172.21.15.161:0/2952461818 wait complete. 2024-02-02T13:04:03.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f74de640 1 Processor -- start 2024-02-02T13:04:03.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f74de640 1 -- start start 2024-02-02T13:04:03.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f74de640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46f006c5f0 0x7f46f013e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:03.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f74de640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46f00b9f20 0x7f46f009e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:03.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f74de640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46f00ba300 0x7f46f01e6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:03.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f74de640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f013ecc0 con 0x7f46f006c5f0 2024-02-02T13:04:03.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f74de640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f00a1370 con 0x7f46f00ba300 2024-02-02T13:04:03.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f74de640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f009ed10 con 0x7f46f00b9f20 2024-02-02T13:04:03.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f527a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46f006c5f0 0x7f46f013e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:03.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f527a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46f006c5f0 0x7f46f013e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46506/0 (socket says 172.21.15.161:46506) 2024-02-02T13:04:03.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f527a640 1 -- 172.21.15.161:0/4180646024 learned_addr learned my addr 172.21.15.161:0/4180646024 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:03.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.003+0000 7f46f4a79640 1 --2- 172.21.15.161:0/4180646024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46f00b9f20 0x7f46f009e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:03.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.007+0000 7f46f5a7b640 1 --2- 172.21.15.161:0/4180646024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46f00ba300 0x7f46f01e6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:03.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.007+0000 7f46f527a640 1 -- 172.21.15.161:0/4180646024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46f00b9f20 msgr2=0x7f46f009e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:03.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.007+0000 7f46f527a640 1 --2- 172.21.15.161:0/4180646024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46f00b9f20 0x7f46f009e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:03.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.007+0000 7f46f527a640 1 -- 172.21.15.161:0/4180646024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46f00ba300 msgr2=0x7f46f01e6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:03.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.007+0000 7f46f527a640 1 --2- 172.21.15.161:0/4180646024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46f00ba300 0x7f46f01e6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:03.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.007+0000 7f46f527a640 1 -- 172.21.15.161:0/4180646024 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec0094d0 con 0x7f46f006c5f0 2024-02-02T13:04:03.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.007+0000 7f46f527a640 1 --2- 172.21.15.161:0/4180646024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46f006c5f0 0x7f46f013e780 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f46e000d830 tx=0x7f46e000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:03.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.007+0000 7f46e5ffb640 1 -- 172.21.15.161:0/4180646024 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e000b6c0 con 0x7f46f006c5f0 2024-02-02T13:04:03.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.007+0000 7f46e5ffb640 1 -- 172.21.15.161:0/4180646024 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e000b860 con 0x7f46f006c5f0 2024-02-02T13:04:03.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.007+0000 7f46e5ffb640 1 -- 172.21.15.161:0/4180646024 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e000bc10 con 0x7f46f006c5f0 2024-02-02T13:04:03.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.007+0000 7f46f74de640 1 -- 172.21.15.161:0/4180646024 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f009d5b0 con 0x7f46f006c5f0 2024-02-02T13:04:03.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.007+0000 7f46f74de640 1 -- 172.21.15.161:0/4180646024 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f009ea20 con 0x7f46f006c5f0 2024-02-02T13:04:03.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.007+0000 7f46f74de640 1 -- 172.21.15.161:0/4180646024 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f009d410 con 0x7f46f006c5f0 2024-02-02T13:04:03.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.007+0000 7f46e5ffb640 1 -- 172.21.15.161:0/4180646024 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f46e001e460 con 0x7f46f006c5f0 2024-02-02T13:04:03.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.007+0000 7f46e5ffb640 1 --2- 172.21.15.161:0/4180646024 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f46d4065a60 0x7f46d4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:03.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.007+0000 7f46e5ffb640 1 -- 172.21.15.161:0/4180646024 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46e0083920 con 0x7f46f006c5f0 2024-02-02T13:04:03.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.007+0000 7f46f4a79640 1 --2- 172.21.15.161:0/4180646024 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f46d4065a60 0x7f46d4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:03.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.007+0000 7f46f4a79640 1 --2- 172.21.15.161:0/4180646024 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f46d4065a60 0x7f46d4067f20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0af000 tx=0x7f46ec004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:03.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.011+0000 7f46e5ffb640 1 -- 172.21.15.161:0/4180646024 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f46f009d410 con 0x7f46f006c5f0 2024-02-02T13:04:03.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.199+0000 7f46f74de640 1 -- 172.21.15.161:0/4180646024 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f46f009d410 con 0x7f46f006c5f0 2024-02-02T13:04:03.231 INFO:tasks.ceph.mon.a.smithi161.stderr:2024-02-02T13:04:03.227+0000 7fa514f4b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-02T13:04:03.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.247+0000 7f46e5ffb640 1 -- 172.21.15.161:0/4180646024 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) v1 ==== 161+0+0 (secure 0 0 0) 0x7f46f009d410 con 0x7f46f006c5f0 2024-02-02T13:04:03.252 INFO:teuthology.orchestra.run.smithi161.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-02T13:04:03.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.251+0000 7f46f74de640 1 -- 172.21.15.161:0/4180646024 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f46d4065a60 msgr2=0x7f46d4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:03.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.251+0000 7f46f74de640 1 --2- 172.21.15.161:0/4180646024 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f46d4065a60 0x7f46d4067f20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0af000 tx=0x7f46ec004740 comp rx=0 tx=0).stop 2024-02-02T13:04:03.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.251+0000 7f46f74de640 1 -- 172.21.15.161:0/4180646024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46f006c5f0 msgr2=0x7f46f013e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:03.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.251+0000 7f46f74de640 1 --2- 172.21.15.161:0/4180646024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46f006c5f0 0x7f46f013e780 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f46e000d830 tx=0x7f46e000dcf0 comp rx=0 tx=0).stop 2024-02-02T13:04:03.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.251+0000 7f46f74de640 1 -- 172.21.15.161:0/4180646024 shutdown_connections 2024-02-02T13:04:03.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.251+0000 7f46f74de640 1 --2- 172.21.15.161:0/4180646024 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f46d4065a60 0x7f46d4067f20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:03.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.251+0000 7f46f74de640 1 --2- 172.21.15.161:0/4180646024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46f00ba300 0x7f46f01e6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:03.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.251+0000 7f46f74de640 1 --2- 172.21.15.161:0/4180646024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46f00b9f20 0x7f46f009e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:03.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.251+0000 7f46f74de640 1 --2- 172.21.15.161:0/4180646024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46f006c5f0 0x7f46f013e780 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:03.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.251+0000 7f46f74de640 1 -- 172.21.15.161:0/4180646024 >> 172.21.15.161:0/4180646024 conn(0x7f46f00be150 msgr2=0x7f46f00be530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:03.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.251+0000 7f46f74de640 1 -- 172.21.15.161:0/4180646024 shutdown_connections 2024-02-02T13:04:03.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.251+0000 7f46f74de640 1 -- 172.21.15.161:0/4180646024 wait complete. 2024-02-02T13:04:03.277 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-02-02T13:04:03.351 INFO:tasks.ceph.mds.c.smithi161.stdout:starting mds.c at 2024-02-02T13:04:03.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.391+0000 7fc369b68640 1 Processor -- start 2024-02-02T13:04:03.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.391+0000 7fc369b68640 1 -- start start 2024-02-02T13:04:03.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.391+0000 7fc369b68640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc364144a80 0x7fc36414ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:03.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.391+0000 7fc369b68640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3640b6e80 con 0x7fc3640b8b40 2024-02-02T13:04:03.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.391+0000 7fc369b68640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3640b7160 con 0x7fc364144f10 2024-02-02T13:04:03.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.391+0000 7fc369b68640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3640bc6c0 con 0x7fc364144a80 2024-02-02T13:04:03.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.391+0000 7fc362ffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc364144a80 0x7fc36414ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:03.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.391+0000 7fc3637fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc3640b8b40 0x7fc3640b8f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:41226/0 (socket says 172.21.15.161:41226) 2024-02-02T13:04:03.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.391+0000 7fc3637fe640 1 -- 172.21.15.161:0/1630536794 learned_addr learned my addr 172.21.15.161:0/1630536794 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:04:03.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.391+0000 7fc362ffd640 1 -- 172.21.15.161:0/1630536794 >> v1:172.21.15.162:6789/0 conn(0x7fc364144f10 legacy=0x7fc3641552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:03.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.391+0000 7fc362ffd640 1 -- 172.21.15.161:0/1630536794 >> v1:172.21.15.161:6789/0 conn(0x7fc3640b8b40 legacy=0x7fc3640b8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:03.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.391+0000 7fc3627fc640 1 -- 172.21.15.161:0/1630536794 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488089243 0 0) 0x7fc3640b6e80 con 0x7fc3640b8b40 2024-02-02T13:04:03.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.391+0000 7fc362ffd640 1 -- 172.21.15.161:0/1630536794 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3640bc9a0 con 0x7fc364144a80 2024-02-02T13:04:03.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.395+0000 7fc362ffd640 1 --2- 172.21.15.161:0/1630536794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc364144a80 0x7fc36414ac60 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fc3580097c0 tx=0x7fc35801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4c28455a9fe761 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:03.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.395+0000 7fc3627fc640 1 -- 172.21.15.161:0/1630536794 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3580a8930 con 0x7fc364144a80 2024-02-02T13:04:03.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.395+0000 7fc3627fc640 1 -- 172.21.15.161:0/1630536794 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3580a8a90 con 0x7fc364144a80 2024-02-02T13:04:03.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.395+0000 7fc3627fc640 1 -- 172.21.15.161:0/1630536794 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3580a8e20 con 0x7fc364144a80 2024-02-02T13:04:03.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.395+0000 7fc369b68640 1 -- 172.21.15.161:0/1630536794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc364144a80 msgr2=0x7fc36414ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:03.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.395+0000 7fc369b68640 1 --2- 172.21.15.161:0/1630536794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc364144a80 0x7fc36414ac60 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fc3580097c0 tx=0x7fc35801ec30 comp rx=0 tx=0).stop 2024-02-02T13:04:03.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.395+0000 7fc369b68640 1 -- 172.21.15.161:0/1630536794 shutdown_connections 2024-02-02T13:04:03.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.395+0000 7fc369b68640 1 --2- 172.21.15.161:0/1630536794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc364144a80 0x7fc36414ac60 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:03.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.395+0000 7fc369b68640 1 -- 172.21.15.161:0/1630536794 >> 172.21.15.161:0/1630536794 conn(0x7fc3640c02f0 msgr2=0x7fc3640c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:03.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.395+0000 7fc369b68640 1 -- 172.21.15.161:0/1630536794 shutdown_connections 2024-02-02T13:04:03.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.395+0000 7fc369b68640 1 -- 172.21.15.161:0/1630536794 wait complete. 2024-02-02T13:04:03.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.395+0000 7fc369b68640 1 Processor -- start 2024-02-02T13:04:03.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.395+0000 7fc369b68640 1 -- start start 2024-02-02T13:04:03.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc369b68640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3640b8b40 0x7fc364148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:03.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc369b68640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc364144a80 0x7fc364147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:03.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc369b68640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc364144f10 0x7fc3641d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:03.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc369b68640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3641d1260 con 0x7fc364144a80 2024-02-02T13:04:03.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc369b68640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc364146a40 con 0x7fc364144f10 2024-02-02T13:04:03.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc369b68640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc364146d20 con 0x7fc3640b8b40 2024-02-02T13:04:03.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc362ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc364144a80 0x7fc364147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:03.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc362ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc364144a80 0x7fc364147800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46542/0 (socket says 172.21.15.161:46542) 2024-02-02T13:04:03.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc362ffd640 1 -- 172.21.15.161:0/2678227133 learned_addr learned my addr 172.21.15.161:0/2678227133 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:03.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc3637fe640 1 --2- 172.21.15.161:0/2678227133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3640b8b40 0x7fc364148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:03.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc362ffd640 1 -- 172.21.15.161:0/2678227133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3640b8b40 msgr2=0x7fc364148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:03.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc362ffd640 1 --2- 172.21.15.161:0/2678227133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3640b8b40 0x7fc364148090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:03.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc362ffd640 1 -- 172.21.15.161:0/2678227133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc364144f10 msgr2=0x7fc3641d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:03.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc363fff640 1 --2- 172.21.15.161:0/2678227133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc364144f10 0x7fc3641d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:03.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc362ffd640 1 --2- 172.21.15.161:0/2678227133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc364144f10 0x7fc3641d0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:03.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc362ffd640 1 -- 172.21.15.161:0/2678227133 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc358009420 con 0x7fc364144a80 2024-02-02T13:04:03.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc362ffd640 1 --2- 172.21.15.161:0/2678227133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc364144a80 0x7fc364147800 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fc35801b840 tx=0x7fc35801b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:03.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc34bfff640 1 -- 172.21.15.161:0/2678227133 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3580b0ea0 con 0x7fc364144a80 2024-02-02T13:04:03.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc34bfff640 1 -- 172.21.15.161:0/2678227133 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc358004020 con 0x7fc364144a80 2024-02-02T13:04:03.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc369b68640 1 -- 172.21.15.161:0/2678227133 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc364147000 con 0x7fc364144a80 2024-02-02T13:04:03.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc34bfff640 1 -- 172.21.15.161:0/2678227133 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358004390 con 0x7fc364144a80 2024-02-02T13:04:03.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc369b68640 1 -- 172.21.15.161:0/2678227133 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3640b5b40 con 0x7fc364144a80 2024-02-02T13:04:03.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc369b68640 1 -- 172.21.15.161:0/2678227133 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36404e000 con 0x7fc364144a80 2024-02-02T13:04:03.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc34bfff640 1 -- 172.21.15.161:0/2678227133 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc3580b7040 con 0x7fc364144a80 2024-02-02T13:04:03.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc34bfff640 1 --2- 172.21.15.161:0/2678227133 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc350065a60 0x7fc350067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:03.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc3637fe640 1 --2- 172.21.15.161:0/2678227133 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc350065a60 0x7fc350067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:03.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc34bfff640 1 -- 172.21.15.161:0/2678227133 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc3581207b0 con 0x7fc364144a80 2024-02-02T13:04:03.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.399+0000 7fc3637fe640 1 --2- 172.21.15.161:0/2678227133 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc350065a60 0x7fc350067f20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc354000f70 tx=0x7fc354009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:03.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.403+0000 7fc34bfff640 1 -- 172.21.15.161:0/2678227133 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc3580ee280 con 0x7fc364144a80 2024-02-02T13:04:03.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:03.587+0000 7fc369b68640 1 -- 172.21.15.161:0/2678227133 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc3641474b0 con 0x7fc364144a80 2024-02-02T13:04:04.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.251+0000 7fc34bfff640 1 -- 172.21.15.161:0/2678227133 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc3580044f0 con 0x7fc364144a80 2024-02-02T13:04:04.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.255+0000 7fc369b68640 1 -- 172.21.15.161:0/2678227133 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc350065a60 msgr2=0x7fc350067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:04.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.255+0000 7fc369b68640 1 --2- 172.21.15.161:0/2678227133 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc350065a60 0x7fc350067f20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc354000f70 tx=0x7fc354009040 comp rx=0 tx=0).stop 2024-02-02T13:04:04.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.255+0000 7fc369b68640 1 -- 172.21.15.161:0/2678227133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc364144a80 msgr2=0x7fc364147800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:04.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.255+0000 7fc369b68640 1 --2- 172.21.15.161:0/2678227133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc364144a80 0x7fc364147800 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fc35801b840 tx=0x7fc35801b9d0 comp rx=0 tx=0).stop 2024-02-02T13:04:04.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.255+0000 7fc369b68640 1 -- 172.21.15.161:0/2678227133 shutdown_connections 2024-02-02T13:04:04.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.255+0000 7fc369b68640 1 --2- 172.21.15.161:0/2678227133 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fc350065a60 0x7fc350067f20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:04.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.255+0000 7fc369b68640 1 --2- 172.21.15.161:0/2678227133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc364144f10 0x7fc3641d0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:04.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.255+0000 7fc369b68640 1 --2- 172.21.15.161:0/2678227133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc364144a80 0x7fc364147800 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:04.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.255+0000 7fc369b68640 1 --2- 172.21.15.161:0/2678227133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3640b8b40 0x7fc364148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:04.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.255+0000 7fc369b68640 1 -- 172.21.15.161:0/2678227133 >> 172.21.15.161:0/2678227133 conn(0x7fc3640c02f0 msgr2=0x7fc3640bd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:04.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.255+0000 7fc369b68640 1 -- 172.21.15.161:0/2678227133 shutdown_connections 2024-02-02T13:04:04.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.255+0000 7fc369b68640 1 -- 172.21.15.161:0/2678227133 wait complete. 2024-02-02T13:04:04.278 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-02-02T13:04:04.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.399+0000 7efcbdba5640 1 Processor -- start 2024-02-02T13:04:04.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.399+0000 7efcbdba5640 1 -- start start 2024-02-02T13:04:04.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.399+0000 7efcbdba5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efcb80b9b50 0x7efcb80b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:04.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.399+0000 7efcbdba5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcb8147640 0x7efcb81414f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:04.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.399+0000 7efcbdba5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb806fc40 con 0x7efcb80b3dd0 2024-02-02T13:04:04.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.399+0000 7efcbdba5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb80706d0 con 0x7efcb80b9b50 2024-02-02T13:04:04.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.399+0000 7efcbdba5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb806ff20 con 0x7efcb8147640 2024-02-02T13:04:04.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.399+0000 7efcb77fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efcb80b9b50 0x7efcb80b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:04.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.399+0000 7efcb77fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efcb80b9b50 0x7efcb80b81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46552/0 (socket says 172.21.15.161:46552) 2024-02-02T13:04:04.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.399+0000 7efcb77fe640 1 -- 172.21.15.161:0/1775702622 learned_addr learned my addr 172.21.15.161:0/1775702622 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:04.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.399+0000 7efcb6ffd640 1 --2- 172.21.15.161:0/1775702622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcb8147640 0x7efcb81414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:04.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.399+0000 7efcb77fe640 1 -- 172.21.15.161:0/1775702622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcb8147640 msgr2=0x7efcb81414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:04.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.399+0000 7efcb77fe640 1 --2- 172.21.15.161:0/1775702622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcb8147640 0x7efcb81414f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:04.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.399+0000 7efcb77fe640 1 -- 172.21.15.161:0/1775702622 >> v1:172.21.15.162:6789/0 conn(0x7efcb80b3dd0 legacy=0x7efcb8070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:04.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.399+0000 7efcb77fe640 1 -- 172.21.15.161:0/1775702622 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb8070200 con 0x7efcb80b9b50 2024-02-02T13:04:04.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcb77fe640 1 --2- 172.21.15.161:0/1775702622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcb80b9b50 0x7efcb80b81b0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009e50 tx=0x7efcb001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90048847f30e9c15 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:04.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcb67fc640 1 -- 172.21.15.161:0/1775702622 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb00a57d0 con 0x7efcb80b9b50 2024-02-02T13:04:04.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcb67fc640 1 -- 172.21.15.161:0/1775702622 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb00a5930 con 0x7efcb80b9b50 2024-02-02T13:04:04.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcb67fc640 1 -- 172.21.15.161:0/1775702622 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb00a5cc0 con 0x7efcb80b9b50 2024-02-02T13:04:04.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcbdba5640 1 -- 172.21.15.161:0/1775702622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcb80b9b50 msgr2=0x7efcb80b81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:04.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcbdba5640 1 --2- 172.21.15.161:0/1775702622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcb80b9b50 0x7efcb80b81b0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009e50 tx=0x7efcb001ca10 comp rx=0 tx=0).stop 2024-02-02T13:04:04.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcbdba5640 1 -- 172.21.15.161:0/1775702622 shutdown_connections 2024-02-02T13:04:04.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcbdba5640 1 --2- 172.21.15.161:0/1775702622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcb8147640 0x7efcb81414f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:04.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcbdba5640 1 --2- 172.21.15.161:0/1775702622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcb80b9b50 0x7efcb80b81b0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:04.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcbdba5640 1 -- 172.21.15.161:0/1775702622 >> 172.21.15.161:0/1775702622 conn(0x7efcb80bcf70 msgr2=0x7efcb80bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:04.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcbdba5640 1 -- 172.21.15.161:0/1775702622 shutdown_connections 2024-02-02T13:04:04.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcbdba5640 1 -- 172.21.15.161:0/1775702622 wait complete. 2024-02-02T13:04:04.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcbdba5640 1 Processor -- start 2024-02-02T13:04:04.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcbdba5640 1 -- start start 2024-02-02T13:04:04.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcbdba5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcb80b3dd0 0x7efcb80bc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:04.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcbdba5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcb80b9b50 0x7efcb813da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:04.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcbdba5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcb813dfd0 0x7efcb81421d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:04.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcbdba5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb8148950 con 0x7efcb813dfd0 2024-02-02T13:04:04.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcbdba5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb80bca90 con 0x7efcb80b9b50 2024-02-02T13:04:04.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.403+0000 7efcbdba5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb814ba90 con 0x7efcb80b3dd0 2024-02-02T13:04:04.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efcb7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcb813dfd0 0x7efcb81421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:04.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efcb7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcb813dfd0 0x7efcb81421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46564/0 (socket says 172.21.15.161:46564) 2024-02-02T13:04:04.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efcb7fff640 1 -- 172.21.15.161:0/1185538390 learned_addr learned my addr 172.21.15.161:0/1185538390 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:04.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efcb6ffd640 1 --2- 172.21.15.161:0/1185538390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcb80b9b50 0x7efcb813da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:04.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efcb77fe640 1 --2- 172.21.15.161:0/1185538390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcb80b3dd0 0x7efcb80bc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:04.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efcb7fff640 1 -- 172.21.15.161:0/1185538390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcb80b3dd0 msgr2=0x7efcb80bc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:04.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efcb7fff640 1 --2- 172.21.15.161:0/1185538390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcb80b3dd0 0x7efcb80bc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:04.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efcb7fff640 1 -- 172.21.15.161:0/1185538390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcb80b9b50 msgr2=0x7efcb813da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:04.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efcb7fff640 1 --2- 172.21.15.161:0/1185538390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcb80b9b50 0x7efcb813da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:04.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efcb7fff640 1 -- 172.21.15.161:0/1185538390 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb0009b30 con 0x7efcb813dfd0 2024-02-02T13:04:04.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efcb7fff640 1 --2- 172.21.15.161:0/1185538390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcb813dfd0 0x7efcb81421d0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7efca800c460 tx=0x7efca800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:04.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efc9ffff640 1 -- 172.21.15.161:0/1185538390 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca8005220 con 0x7efcb813dfd0 2024-02-02T13:04:04.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efc9ffff640 1 -- 172.21.15.161:0/1185538390 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca8005380 con 0x7efcb813dfd0 2024-02-02T13:04:04.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efc9ffff640 1 -- 172.21.15.161:0/1185538390 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca8007270 con 0x7efcb813dfd0 2024-02-02T13:04:04.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efcbdba5640 1 -- 172.21.15.161:0/1185538390 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb80b7160 con 0x7efcb813dfd0 2024-02-02T13:04:04.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efcbdba5640 1 -- 172.21.15.161:0/1185538390 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb8143550 con 0x7efcb813dfd0 2024-02-02T13:04:04.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efcbdba5640 1 -- 172.21.15.161:0/1185538390 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb8141f90 con 0x7efcb813dfd0 2024-02-02T13:04:04.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efc9ffff640 1 -- 172.21.15.161:0/1185538390 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efca80073d0 con 0x7efcb813dfd0 2024-02-02T13:04:04.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efc9ffff640 1 --2- 172.21.15.161:0/1185538390 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7efca4065a60 0x7efca4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:04.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efc9ffff640 1 -- 172.21.15.161:0/1185538390 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5795+0+0 (secure 0 0 0) 0x7efca8082a30 con 0x7efcb813dfd0 2024-02-02T13:04:04.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efcb77fe640 1 --2- 172.21.15.161:0/1185538390 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7efca4065a60 0x7efca4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:04.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.407+0000 7efcb77fe640 1 --2- 172.21.15.161:0/1185538390 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7efca4065a60 0x7efca4067f20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efcb00ae000 tx=0x7efcb00a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:04.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.411+0000 7efc9ffff640 1 -- 172.21.15.161:0/1185538390 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efca8050400 con 0x7efcb813dfd0 2024-02-02T13:04:04.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:04.567+0000 7efcbdba5640 1 -- 172.21.15.161:0/1185538390 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efcb804e000 con 0x7efcb813dfd0 2024-02-02T13:04:04.816 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:04:04.819 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:04:04.822 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:04:05.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.411+0000 7efc9ffff640 1 -- 172.21.15.161:0/1185538390 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7efca8053a20 con 0x7efcb813dfd0 2024-02-02T13:04:05.418 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_metadata' removed 2024-02-02T13:04:05.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.419+0000 7efcbdba5640 1 -- 172.21.15.161:0/1185538390 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7efca4065a60 msgr2=0x7efca4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:05.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.419+0000 7efcbdba5640 1 --2- 172.21.15.161:0/1185538390 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7efca4065a60 0x7efca4067f20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efcb00ae000 tx=0x7efcb00a7070 comp rx=0 tx=0).stop 2024-02-02T13:04:05.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.419+0000 7efcbdba5640 1 -- 172.21.15.161:0/1185538390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcb813dfd0 msgr2=0x7efcb81421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:05.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.419+0000 7efcbdba5640 1 --2- 172.21.15.161:0/1185538390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcb813dfd0 0x7efcb81421d0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7efca800c460 tx=0x7efca800c920 comp rx=0 tx=0).stop 2024-02-02T13:04:05.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.419+0000 7efcbdba5640 1 -- 172.21.15.161:0/1185538390 shutdown_connections 2024-02-02T13:04:05.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.419+0000 7efcbdba5640 1 --2- 172.21.15.161:0/1185538390 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7efca4065a60 0x7efca4067f20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:05.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.419+0000 7efcbdba5640 1 --2- 172.21.15.161:0/1185538390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcb813dfd0 0x7efcb81421d0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:05.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.419+0000 7efcbdba5640 1 --2- 172.21.15.161:0/1185538390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcb80b9b50 0x7efcb813da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:05.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.419+0000 7efcbdba5640 1 --2- 172.21.15.161:0/1185538390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcb80b3dd0 0x7efcb80bc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:05.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.419+0000 7efcbdba5640 1 -- 172.21.15.161:0/1185538390 >> 172.21.15.161:0/1185538390 conn(0x7efcb80bcf70 msgr2=0x7efcb8146830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:05.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.423+0000 7efcbdba5640 1 -- 172.21.15.161:0/1185538390 shutdown_connections 2024-02-02T13:04:05.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.423+0000 7efcbdba5640 1 -- 172.21.15.161:0/1185538390 wait complete. 2024-02-02T13:04:05.498 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-02-02T13:04:05.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.679+0000 7fb6764a4640 1 Processor -- start 2024-02-02T13:04:05.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.679+0000 7fb6764a4640 1 -- start start 2024-02-02T13:04:05.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.679+0000 7fb6764a4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6700b6880 0x7fb6700b90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:05.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.679+0000 7fb6764a4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb6700ba190 0x7fb6700b7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:05.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.679+0000 7fb6764a4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6700b8690 con 0x7fb670070cc0 2024-02-02T13:04:05.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.679+0000 7fb6764a4640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6700b7e50 con 0x7fb6700ba190 2024-02-02T13:04:05.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.679+0000 7fb6764a4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6700ba5d0 con 0x7fb6700b6880 2024-02-02T13:04:05.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.679+0000 7fb66f7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb6700ba190 0x7fb6700b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:05.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.679+0000 7fb66f7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb6700ba190 0x7fb6700b7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46574/0 (socket says 172.21.15.161:46574) 2024-02-02T13:04:05.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.679+0000 7fb66f7fe640 1 -- 172.21.15.161:0/808153066 learned_addr learned my addr 172.21.15.161:0/808153066 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:05.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.679+0000 7fb66ffff640 1 --2- 172.21.15.161:0/808153066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6700b6880 0x7fb6700b90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:05.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.679+0000 7fb66f7fe640 1 -- 172.21.15.161:0/808153066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6700b6880 msgr2=0x7fb6700b90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:05.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.679+0000 7fb66f7fe640 1 --2- 172.21.15.161:0/808153066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6700b6880 0x7fb6700b90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:05.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.679+0000 7fb66f7fe640 1 -- 172.21.15.161:0/808153066 >> v1:172.21.15.162:6789/0 conn(0x7fb670070cc0 legacy=0x7fb670142590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:05.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.679+0000 7fb66f7fe640 1 -- 172.21.15.161:0/808153066 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6700b80c0 con 0x7fb6700ba190 2024-02-02T13:04:05.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.683+0000 7fb66f7fe640 1 --2- 172.21.15.161:0/808153066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6700ba190 0x7fb6700b7910 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb664009870 tx=0x7fb66401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a995c1c0a7723e49 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:05.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.683+0000 7fb66effd640 1 -- 172.21.15.161:0/808153066 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640aa670 con 0x7fb6700ba190 2024-02-02T13:04:05.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.683+0000 7fb66effd640 1 -- 172.21.15.161:0/808153066 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6640aa7d0 con 0x7fb6700ba190 2024-02-02T13:04:05.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.683+0000 7fb66effd640 1 -- 172.21.15.161:0/808153066 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640aab60 con 0x7fb6700ba190 2024-02-02T13:04:05.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.683+0000 7fb6764a4640 1 -- 172.21.15.161:0/808153066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6700ba190 msgr2=0x7fb6700b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:05.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.683+0000 7fb6764a4640 1 --2- 172.21.15.161:0/808153066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6700ba190 0x7fb6700b7910 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb664009870 tx=0x7fb66401c510 comp rx=0 tx=0).stop 2024-02-02T13:04:05.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.683+0000 7fb6764a4640 1 -- 172.21.15.161:0/808153066 shutdown_connections 2024-02-02T13:04:05.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.683+0000 7fb6764a4640 1 --2- 172.21.15.161:0/808153066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6700ba190 0x7fb6700b7910 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:05.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.683+0000 7fb6764a4640 1 --2- 172.21.15.161:0/808153066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6700b6880 0x7fb6700b90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:05.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.683+0000 7fb6764a4640 1 -- 172.21.15.161:0/808153066 >> 172.21.15.161:0/808153066 conn(0x7fb6700bcf70 msgr2=0x7fb6700bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:05.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.683+0000 7fb6764a4640 1 -- 172.21.15.161:0/808153066 shutdown_connections 2024-02-02T13:04:05.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.683+0000 7fb6764a4640 1 -- 172.21.15.161:0/808153066 wait complete. 2024-02-02T13:04:05.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb6764a4640 1 Processor -- start 2024-02-02T13:04:05.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb6764a4640 1 -- start start 2024-02-02T13:04:05.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb6764a4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb670070cc0 0x7fb67013f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:05.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb6764a4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6700b6880 0x7fb670148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:05.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb6764a4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6700ba190 0x7fb6701388a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:05.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb6764a4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67013f7b0 con 0x7fb670070cc0 2024-02-02T13:04:05.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb6764a4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb670144670 con 0x7fb6700b6880 2024-02-02T13:04:05.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb6764a4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb670143dd0 con 0x7fb6700ba190 2024-02-02T13:04:05.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb66ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb670070cc0 0x7fb67013f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:05.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb66ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb670070cc0 0x7fb67013f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46580/0 (socket says 172.21.15.161:46580) 2024-02-02T13:04:05.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb66ffff640 1 -- 172.21.15.161:0/3330785764 learned_addr learned my addr 172.21.15.161:0/3330785764 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:05.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb66f7fe640 1 --2- 172.21.15.161:0/3330785764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6700b6880 0x7fb670148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:05.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb674a41640 1 --2- 172.21.15.161:0/3330785764 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6700ba190 0x7fb6701388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:05.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb66ffff640 1 -- 172.21.15.161:0/3330785764 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6700ba190 msgr2=0x7fb6701388a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:05.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb66ffff640 1 --2- 172.21.15.161:0/3330785764 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6700ba190 0x7fb6701388a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:05.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb66ffff640 1 -- 172.21.15.161:0/3330785764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6700b6880 msgr2=0x7fb670148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:05.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb66ffff640 1 --2- 172.21.15.161:0/3330785764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6700b6880 0x7fb670148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:05.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb66ffff640 1 -- 172.21.15.161:0/3330785764 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6640094d0 con 0x7fb670070cc0 2024-02-02T13:04:05.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb66ffff640 1 --2- 172.21.15.161:0/3330785764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb670070cc0 0x7fb67013f270 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fb66000d800 tx=0x7fb66000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:05.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb66cff9640 1 -- 172.21.15.161:0/3330785764 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66000b6c0 con 0x7fb670070cc0 2024-02-02T13:04:05.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb66cff9640 1 -- 172.21.15.161:0/3330785764 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66000b820 con 0x7fb670070cc0 2024-02-02T13:04:05.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb6764a4640 1 -- 172.21.15.161:0/3330785764 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6701440b0 con 0x7fb670070cc0 2024-02-02T13:04:05.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb66cff9640 1 -- 172.21.15.161:0/3330785764 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66000bb90 con 0x7fb670070cc0 2024-02-02T13:04:05.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb6764a4640 1 -- 172.21.15.161:0/3330785764 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6701434f0 con 0x7fb670070cc0 2024-02-02T13:04:05.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb6764a4640 1 -- 172.21.15.161:0/3330785764 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb670143350 con 0x7fb670070cc0 2024-02-02T13:04:05.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb66cff9640 1 -- 172.21.15.161:0/3330785764 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb66000bcf0 con 0x7fb670070cc0 2024-02-02T13:04:05.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb66cff9640 1 --2- 172.21.15.161:0/3330785764 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb65c065a60 0x7fb65c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:05.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb66f7fe640 1 --2- 172.21.15.161:0/3330785764 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb65c065a60 0x7fb65c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:05.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.687+0000 7fb66cff9640 1 -- 172.21.15.161:0/3330785764 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fb660083650 con 0x7fb670070cc0 2024-02-02T13:04:05.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.691+0000 7fb66f7fe640 1 --2- 172.21.15.161:0/3330785764 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb65c065a60 0x7fb65c067f20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb6640ae000 tx=0x7fb6640a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:05.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.695+0000 7fb66cff9640 1 -- 172.21.15.161:0/3330785764 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb670143350 con 0x7fb670070cc0 2024-02-02T13:04:05.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:05.839+0000 7fb6764a4640 1 -- 172.21.15.161:0/3330785764 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb670143350 con 0x7fb670070cc0 2024-02-02T13:04:06.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.423+0000 7fb66cff9640 1 -- 172.21.15.161:0/3330785764 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb670143350 con 0x7fb670070cc0 2024-02-02T13:04:06.428 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data' removed 2024-02-02T13:04:06.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.427+0000 7fb6764a4640 1 -- 172.21.15.161:0/3330785764 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb65c065a60 msgr2=0x7fb65c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:06.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.427+0000 7fb6764a4640 1 --2- 172.21.15.161:0/3330785764 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb65c065a60 0x7fb65c067f20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb6640ae000 tx=0x7fb6640a7000 comp rx=0 tx=0).stop 2024-02-02T13:04:06.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.427+0000 7fb6764a4640 1 -- 172.21.15.161:0/3330785764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb670070cc0 msgr2=0x7fb67013f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:06.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.427+0000 7fb6764a4640 1 --2- 172.21.15.161:0/3330785764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb670070cc0 0x7fb67013f270 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fb66000d800 tx=0x7fb66000dcc0 comp rx=0 tx=0).stop 2024-02-02T13:04:06.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.427+0000 7fb6764a4640 1 -- 172.21.15.161:0/3330785764 shutdown_connections 2024-02-02T13:04:06.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.427+0000 7fb6764a4640 1 --2- 172.21.15.161:0/3330785764 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb65c065a60 0x7fb65c067f20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:06.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.427+0000 7fb6764a4640 1 --2- 172.21.15.161:0/3330785764 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6700ba190 0x7fb6701388a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:06.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.427+0000 7fb6764a4640 1 --2- 172.21.15.161:0/3330785764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6700b6880 0x7fb670148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:06.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.427+0000 7fb6764a4640 1 --2- 172.21.15.161:0/3330785764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb670070cc0 0x7fb67013f270 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:06.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.427+0000 7fb6764a4640 1 -- 172.21.15.161:0/3330785764 >> 172.21.15.161:0/3330785764 conn(0x7fb6700bcf70 msgr2=0x7fb67006ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:06.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.427+0000 7fb6764a4640 1 -- 172.21.15.161:0/3330785764 shutdown_connections 2024-02-02T13:04:06.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.427+0000 7fb6764a4640 1 -- 172.21.15.161:0/3330785764 wait complete. 2024-02-02T13:04:06.471 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-02-02T13:04:06.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.667+0000 7f06202d3640 1 Processor -- start 2024-02-02T13:04:06.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.667+0000 7f06202d3640 1 -- start start 2024-02-02T13:04:06.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.667+0000 7f06202d3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06181492b0 0x7f061806fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:06.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.667+0000 7f06202d3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f06180b2d20 0x7f061814f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:06.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.667+0000 7f06202d3640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f061806ec30 0x7f0618152380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:06.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.667+0000 7f06202d3640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061814f320 con 0x7f06180b2d20 2024-02-02T13:04:06.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.667+0000 7f06202d3640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061806e4a0 con 0x7f061806ec30 2024-02-02T13:04:06.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.667+0000 7f06202d3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0618070420 con 0x7f06181492b0 2024-02-02T13:04:06.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.667+0000 7f061d86e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f06180b2d20 0x7f061814f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:06.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.667+0000 7f061e870640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f061806ec30 0x7f0618152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:06.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.667+0000 7f061e870640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f061806ec30 0x7f0618152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.161:47234/0 (socket says 172.21.15.161:47234) 2024-02-02T13:04:06.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.667+0000 7f061e870640 1 -- 172.21.15.161:0/941318382 learned_addr learned my addr 172.21.15.161:0/941318382 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:06.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.667+0000 7f061d86e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f06180b2d20 0x7f061814f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46588/0 (socket says 172.21.15.161:46588) 2024-02-02T13:04:06.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.667+0000 7f061e06f640 1 --2- 172.21.15.161:0/941318382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06181492b0 0x7f061806fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:06.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.667+0000 7f061e870640 1 -- 172.21.15.161:0/941318382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06181492b0 msgr2=0x7f061806fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:06.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.667+0000 7f061e870640 1 --2- 172.21.15.161:0/941318382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06181492b0 0x7f061806fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:06.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.667+0000 7f061e870640 1 -- 172.21.15.161:0/941318382 >> v2:172.21.15.161:3300/0 conn(0x7f06180b2d20 msgr2=0x7f061814f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:06.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.667+0000 7f061e870640 1 --2- 172.21.15.161:0/941318382 >> v2:172.21.15.161:3300/0 conn(0x7f06180b2d20 0x7f061814f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:06.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.667+0000 7f061e870640 1 -- 172.21.15.161:0/941318382 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061814efb0 con 0x7f061806ec30 2024-02-02T13:04:06.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.671+0000 7f061e870640 1 --2- 172.21.15.161:0/941318382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f061806ec30 0x7f0618152380 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f061806fca0 tx=0x7f061001d380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9337e2f1a74b90dc server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:06.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.671+0000 7f061d06d640 1 -- 172.21.15.161:0/941318382 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06100a57e0 con 0x7f061806ec30 2024-02-02T13:04:06.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.671+0000 7f061d06d640 1 -- 172.21.15.161:0/941318382 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06100a5940 con 0x7f061806ec30 2024-02-02T13:04:06.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.671+0000 7f06202d3640 1 -- 172.21.15.161:0/941318382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f061806ec30 msgr2=0x7f0618152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:06.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.671+0000 7f06202d3640 1 --2- 172.21.15.161:0/941318382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f061806ec30 0x7f0618152380 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f061806fca0 tx=0x7f061001d380 comp rx=0 tx=0).stop 2024-02-02T13:04:06.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.671+0000 7f06202d3640 1 -- 172.21.15.161:0/941318382 shutdown_connections 2024-02-02T13:04:06.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.671+0000 7f06202d3640 1 --2- 172.21.15.161:0/941318382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f061806ec30 0x7f0618152380 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:06.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.671+0000 7f06202d3640 1 --2- 172.21.15.161:0/941318382 >> v2:172.21.15.161:3300/0 conn(0x7f06180b2d20 0x7f061814f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:06.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.671+0000 7f06202d3640 1 --2- 172.21.15.161:0/941318382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06181492b0 0x7f061806fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:06.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.671+0000 7f06202d3640 1 -- 172.21.15.161:0/941318382 >> 172.21.15.161:0/941318382 conn(0x7f06180bbee0 msgr2=0x7f06180bc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:06.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.671+0000 7f06202d3640 1 -- 172.21.15.161:0/941318382 shutdown_connections 2024-02-02T13:04:06.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.671+0000 7f06202d3640 1 -- 172.21.15.161:0/941318382 wait complete. 2024-02-02T13:04:06.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f06202d3640 1 Processor -- start 2024-02-02T13:04:06.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f06202d3640 1 -- start start 2024-02-02T13:04:06.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f06202d3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f061806ec30 0x7f06180b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:06.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f06202d3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06180b2d20 0x7f06180bb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:06.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f06202d3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06181492b0 0x7f061814dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:06.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f06202d3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06180bb5e0 con 0x7f06180b2d20 2024-02-02T13:04:06.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f06202d3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061814d720 con 0x7f06181492b0 2024-02-02T13:04:06.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f06202d3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061814e0f0 con 0x7f061806ec30 2024-02-02T13:04:06.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f061e870640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06181492b0 0x7f061814dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:06.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f061e870640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06181492b0 0x7f061814dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.161:47240/0 (socket says 172.21.15.161:47240) 2024-02-02T13:04:06.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f061e870640 1 -- 172.21.15.161:0/3357831308 learned_addr learned my addr 172.21.15.161:0/3357831308 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:06.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f061e06f640 1 --2- 172.21.15.161:0/3357831308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f061806ec30 0x7f06180b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:06.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f061d86e640 1 --2- 172.21.15.161:0/3357831308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06180b2d20 0x7f06180bb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:06.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f061e870640 1 -- 172.21.15.161:0/3357831308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f061806ec30 msgr2=0x7f06180b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:06.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f061e870640 1 --2- 172.21.15.161:0/3357831308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f061806ec30 0x7f06180b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:06.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f061e870640 1 -- 172.21.15.161:0/3357831308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06180b2d20 msgr2=0x7f06180bb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:06.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f061e870640 1 --2- 172.21.15.161:0/3357831308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06180b2d20 0x7f06180bb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:06.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f061e870640 1 -- 172.21.15.161:0/3357831308 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0610009b30 con 0x7f06181492b0 2024-02-02T13:04:06.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f061e870640 1 --2- 172.21.15.161:0/3357831308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06181492b0 0x7f061814dbb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f061001afd0 tx=0x7f06100196c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:06.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.675+0000 7f060effd640 1 -- 172.21.15.161:0/3357831308 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06100090d0 con 0x7f06181492b0 2024-02-02T13:04:06.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.679+0000 7f060effd640 1 -- 172.21.15.161:0/3357831308 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0610009270 con 0x7f06181492b0 2024-02-02T13:04:06.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.679+0000 7f060effd640 1 -- 172.21.15.161:0/3357831308 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0610007e10 con 0x7f06181492b0 2024-02-02T13:04:06.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.679+0000 7f06202d3640 1 -- 172.21.15.161:0/3357831308 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06180b3550 con 0x7f06181492b0 2024-02-02T13:04:06.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.679+0000 7f06202d3640 1 -- 172.21.15.161:0/3357831308 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06180b3b10 con 0x7f06181492b0 2024-02-02T13:04:06.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.679+0000 7f06202d3640 1 -- 172.21.15.161:0/3357831308 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f061814d8d0 con 0x7f06181492b0 2024-02-02T13:04:06.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.679+0000 7f060effd640 1 -- 172.21.15.161:0/3357831308 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f06100a59f0 con 0x7f06181492b0 2024-02-02T13:04:06.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.679+0000 7f060effd640 1 --2- 172.21.15.161:0/3357831308 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f05fc065ab0 0x7f05fc067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:06.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.679+0000 7f060effd640 1 -- 172.21.15.161:0/3357831308 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f061011e910 con 0x7f06181492b0 2024-02-02T13:04:06.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.679+0000 7f061e06f640 1 --2- 172.21.15.161:0/3357831308 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f05fc065ab0 0x7f05fc067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:06.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.683+0000 7f061e06f640 1 --2- 172.21.15.161:0/3357831308 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f05fc065ab0 0x7f05fc067f70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f060800b990 tx=0x7f0608008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:06.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:06.687+0000 7f060effd640 1 -- 172.21.15.161:0/3357831308 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f06100ec5b0 con 0x7f06181492b0 2024-02-02T13:04:07.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:07.295+0000 7f06202d3640 1 -- 172.21.15.161:0/3357831308 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f061814d8d0 con 0x7f06181492b0 2024-02-02T13:04:07.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:07.303+0000 7f060effd640 1 -- 172.21.15.161:0/3357831308 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f061814d8d0 con 0x7f06181492b0 2024-02-02T13:04:07.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:07.331+0000 7f06202d3640 1 -- 172.21.15.161:0/3357831308 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f05fc065ab0 msgr2=0x7f05fc067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:07.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:07.331+0000 7f06202d3640 1 --2- 172.21.15.161:0/3357831308 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f05fc065ab0 0x7f05fc067f70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f060800b990 tx=0x7f0608008040 comp rx=0 tx=0).stop 2024-02-02T13:04:07.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:07.331+0000 7f06202d3640 1 -- 172.21.15.161:0/3357831308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06181492b0 msgr2=0x7f061814dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:07.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:07.331+0000 7f06202d3640 1 --2- 172.21.15.161:0/3357831308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06181492b0 0x7f061814dbb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f061001afd0 tx=0x7f06100196c0 comp rx=0 tx=0).stop 2024-02-02T13:04:07.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:07.339+0000 7f06202d3640 1 -- 172.21.15.161:0/3357831308 shutdown_connections 2024-02-02T13:04:07.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:07.339+0000 7f06202d3640 1 --2- 172.21.15.161:0/3357831308 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f05fc065ab0 0x7f05fc067f70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:07.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:07.339+0000 7f06202d3640 1 --2- 172.21.15.161:0/3357831308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06181492b0 0x7f061814dbb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:07.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:07.339+0000 7f06202d3640 1 --2- 172.21.15.161:0/3357831308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06180b2d20 0x7f06180bb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:07.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:07.339+0000 7f06202d3640 1 --2- 172.21.15.161:0/3357831308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f061806ec30 0x7f06180b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:07.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:07.339+0000 7f06202d3640 1 -- 172.21.15.161:0/3357831308 >> 172.21.15.161:0/3357831308 conn(0x7f06180bbee0 msgr2=0x7f061813b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:07.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:07.339+0000 7f06202d3640 1 -- 172.21.15.161:0/3357831308 shutdown_connections 2024-02-02T13:04:07.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:07.339+0000 7f06202d3640 1 -- 172.21.15.161:0/3357831308 wait complete. 2024-02-02T13:04:07.396 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2024-02-02T13:04:08.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.027+0000 7f9c8d3f0640 1 Processor -- start 2024-02-02T13:04:08.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.027+0000 7f9c8d3f0640 1 -- start start 2024-02-02T13:04:08.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.027+0000 7f9c8d3f0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9c880b5e50 0x7f9c88149f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:08.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.027+0000 7f9c8d3f0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8814a470 con 0x7f9c8806f900 2024-02-02T13:04:08.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.027+0000 7f9c8d3f0640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c880bcb90 con 0x7f9c880b84b0 2024-02-02T13:04:08.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.027+0000 7f9c8d3f0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c88070c40 con 0x7f9c880b5e50 2024-02-02T13:04:08.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.027+0000 7f9c877fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f9c8806f900 0x7f9c880bc480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:41242/0 (socket says 172.21.15.161:41242) 2024-02-02T13:04:08.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.027+0000 7f9c877fe640 1 -- 172.21.15.161:0/906655267 learned_addr learned my addr 172.21.15.161:0/906655267 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:04:08.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.027+0000 7f9c86ffd640 1 --2- 172.21.15.161:0/906655267 >> v2:172.21.15.161:3300/0 conn(0x7f9c880b5e50 0x7f9c88149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:08.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.027+0000 7f9c86ffd640 1 -- 172.21.15.161:0/906655267 >> v1:172.21.15.162:6789/0 conn(0x7f9c880b84b0 legacy=0x7f9c88070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:08.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.027+0000 7f9c86ffd640 1 -- 172.21.15.161:0/906655267 >> v1:172.21.15.161:6789/0 conn(0x7f9c8806f900 legacy=0x7f9c880bc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:08.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.027+0000 7f9c86ffd640 1 -- 172.21.15.161:0/906655267 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c88070960 con 0x7f9c880b5e50 2024-02-02T13:04:08.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.031+0000 7f9c86ffd640 1 --2- 172.21.15.161:0/906655267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c880b5e50 0x7f9c88149f30 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009fd0 tx=0x7f9c7c01c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57528fe07d7ed890 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:08.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.031+0000 7f9c85ffb640 1 -- 172.21.15.161:0/906655267 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c0ac440 con 0x7f9c880b5e50 2024-02-02T13:04:08.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.031+0000 7f9c85ffb640 1 -- 172.21.15.161:0/906655267 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c0ac5a0 con 0x7f9c880b5e50 2024-02-02T13:04:08.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.031+0000 7f9c85ffb640 1 -- 172.21.15.161:0/906655267 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c0ac930 con 0x7f9c880b5e50 2024-02-02T13:04:08.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.031+0000 7f9c8d3f0640 1 -- 172.21.15.161:0/906655267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c880b5e50 msgr2=0x7f9c88149f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:08.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.031+0000 7f9c8d3f0640 1 --2- 172.21.15.161:0/906655267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c880b5e50 0x7f9c88149f30 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009fd0 tx=0x7f9c7c01c710 comp rx=0 tx=0).stop 2024-02-02T13:04:08.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.039+0000 7f9c8d3f0640 1 -- 172.21.15.161:0/906655267 shutdown_connections 2024-02-02T13:04:08.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.039+0000 7f9c8d3f0640 1 --2- 172.21.15.161:0/906655267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c880b5e50 0x7f9c88149f30 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:08.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.039+0000 7f9c8d3f0640 1 -- 172.21.15.161:0/906655267 >> 172.21.15.161:0/906655267 conn(0x7f9c88069d20 msgr2=0x7f9c8806a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:08.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.039+0000 7f9c8d3f0640 1 -- 172.21.15.161:0/906655267 shutdown_connections 2024-02-02T13:04:08.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.039+0000 7f9c8d3f0640 1 -- 172.21.15.161:0/906655267 wait complete. 2024-02-02T13:04:08.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.039+0000 7f9c8d3f0640 1 Processor -- start 2024-02-02T13:04:08.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.039+0000 7f9c8d3f0640 1 -- start start 2024-02-02T13:04:08.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.043+0000 7f9c8d3f0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8806f900 0x7f9c881497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:08.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.043+0000 7f9c8d3f0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c880b5e50 0x7f9c88147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:08.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.043+0000 7f9c8d3f0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c880b84b0 0x7f9c881399a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:08.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.043+0000 7f9c8d3f0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8814a000 con 0x7f9c8806f900 2024-02-02T13:04:08.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.043+0000 7f9c8d3f0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c88149200 con 0x7f9c880b5e50 2024-02-02T13:04:08.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.043+0000 7f9c8d3f0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c88149cf0 con 0x7f9c880b84b0 2024-02-02T13:04:08.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.043+0000 7f9c86ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8806f900 0x7f9c881497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:08.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.043+0000 7f9c86ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8806f900 0x7f9c881497b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46628/0 (socket says 172.21.15.161:46628) 2024-02-02T13:04:08.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.043+0000 7f9c86ffd640 1 -- 172.21.15.161:0/193010555 learned_addr learned my addr 172.21.15.161:0/193010555 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:08.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.043+0000 7f9c867fc640 1 --2- 172.21.15.161:0/193010555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c880b5e50 0x7f9c88147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:08.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.043+0000 7f9c86ffd640 1 -- 172.21.15.161:0/193010555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c880b84b0 msgr2=0x7f9c881399a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:08.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.043+0000 7f9c86ffd640 1 --2- 172.21.15.161:0/193010555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c880b84b0 0x7f9c881399a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:08.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.043+0000 7f9c86ffd640 1 -- 172.21.15.161:0/193010555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c880b5e50 msgr2=0x7f9c88147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:08.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.043+0000 7f9c86ffd640 1 --2- 172.21.15.161:0/193010555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c880b5e50 0x7f9c88147fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:08.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.043+0000 7f9c86ffd640 1 -- 172.21.15.161:0/193010555 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c009cb0 con 0x7f9c8806f900 2024-02-02T13:04:08.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.043+0000 7f9c86ffd640 1 --2- 172.21.15.161:0/193010555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8806f900 0x7f9c881497b0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0af040 tx=0x7f9c7c019800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:08.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.055+0000 7f9c777fe640 1 -- 172.21.15.161:0/193010555 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c0bb070 con 0x7f9c8806f900 2024-02-02T13:04:08.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.055+0000 7f9c8d3f0640 1 -- 172.21.15.161:0/193010555 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c88148860 con 0x7f9c8806f900 2024-02-02T13:04:08.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.055+0000 7f9c8d3f0640 1 -- 172.21.15.161:0/193010555 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c88148e20 con 0x7f9c8806f900 2024-02-02T13:04:08.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.055+0000 7f9c777fe640 1 -- 172.21.15.161:0/193010555 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c0aca60 con 0x7f9c8806f900 2024-02-02T13:04:08.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.055+0000 7f9c777fe640 1 -- 172.21.15.161:0/193010555 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c0acdf0 con 0x7f9c8806f900 2024-02-02T13:04:08.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.055+0000 7f9c777fe640 1 -- 172.21.15.161:0/193010555 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9c7c0b3070 con 0x7f9c8806f900 2024-02-02T13:04:08.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.055+0000 7f9c777fe640 1 --2- 172.21.15.161:0/193010555 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9c6c065b80 0x7f9c6c068040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:08.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.055+0000 7f9c867fc640 1 --2- 172.21.15.161:0/193010555 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9c6c065b80 0x7f9c6c068040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:08.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.059+0000 7f9c867fc640 1 --2- 172.21.15.161:0/193010555 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9c6c065b80 0x7f9c6c068040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9c88073c80 tx=0x7f9c80009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:08.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.059+0000 7f9c777fe640 1 -- 172.21.15.161:0/193010555 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9c7c11c860 con 0x7f9c8806f900 2024-02-02T13:04:08.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.091+0000 7f9c8d3f0640 1 -- 172.21.15.161:0/193010555 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c64005260 con 0x7f9c8806f900 2024-02-02T13:04:08.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.099+0000 7f9c777fe640 1 -- 172.21.15.161:0/193010555 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9c7c0ea590 con 0x7f9c8806f900 2024-02-02T13:04:08.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:08.647+0000 7f9c8d3f0640 1 -- 172.21.15.161:0/193010555 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f9c64005510 con 0x7f9c8806f900 2024-02-02T13:04:09.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:09.427+0000 7f9c777fe640 1 -- 172.21.15.161:0/193010555 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v2316) v1 ==== 163+0+0 (secure 0 0 0) 0x7f9c7c0b1020 con 0x7f9c8806f900 2024-02-02T13:04:09.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:09.431+0000 7f9c8d3f0640 1 -- 172.21.15.161:0/193010555 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9c6c065b80 msgr2=0x7f9c6c068040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:09.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:09.431+0000 7f9c8d3f0640 1 --2- 172.21.15.161:0/193010555 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9c6c065b80 0x7f9c6c068040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9c88073c80 tx=0x7f9c80009040 comp rx=0 tx=0).stop 2024-02-02T13:04:09.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:09.431+0000 7f9c8d3f0640 1 -- 172.21.15.161:0/193010555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8806f900 msgr2=0x7f9c881497b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:09.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:09.431+0000 7f9c8d3f0640 1 --2- 172.21.15.161:0/193010555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8806f900 0x7f9c881497b0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0af040 tx=0x7f9c7c019800 comp rx=0 tx=0).stop 2024-02-02T13:04:09.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:09.431+0000 7f9c8d3f0640 1 -- 172.21.15.161:0/193010555 shutdown_connections 2024-02-02T13:04:09.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:09.431+0000 7f9c8d3f0640 1 --2- 172.21.15.161:0/193010555 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f9c6c065b80 0x7f9c6c068040 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:09.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:09.431+0000 7f9c8d3f0640 1 --2- 172.21.15.161:0/193010555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c880b84b0 0x7f9c881399a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:09.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:09.431+0000 7f9c8d3f0640 1 --2- 172.21.15.161:0/193010555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c880b5e50 0x7f9c88147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:09.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:09.431+0000 7f9c8d3f0640 1 --2- 172.21.15.161:0/193010555 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c8806f900 0x7f9c881497b0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:09.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:09.431+0000 7f9c8d3f0640 1 -- 172.21.15.161:0/193010555 >> 172.21.15.161:0/193010555 conn(0x7f9c88069d20 msgr2=0x7f9c8813b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:09.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:09.431+0000 7f9c8d3f0640 1 -- 172.21.15.161:0/193010555 shutdown_connections 2024-02-02T13:04:09.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:09.431+0000 7f9c8d3f0640 1 -- 172.21.15.161:0/193010555 wait complete. 2024-02-02T13:04:09.459 INFO:tasks.cephfs_test_runner:test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) ... FAIL 2024-02-02T13:04:09.459 INFO:tasks.cephfs_test_runner: 2024-02-02T13:04:09.459 INFO:tasks.cephfs_test_runner:====================================================================== 2024-02-02T13:04:09.459 INFO:tasks.cephfs_test_runner:FAIL: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-02-02T13:04:09.459 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-02-02T13:04:09.460 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-02-02T13:04:09.460 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0fb327883c124fd83155c94db0804f823b805a12/qa/tasks/cephfs/test_fscrypt.py", line 76, in test_fscrypt_dummy_encryption_with_quick_group 2024-02-02T13:04:09.460 INFO:tasks.cephfs_test_runner: self.assertEqual(proc.returncode, 0) 2024-02-02T13:04:09.460 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2024-02-02T13:04:09.460 INFO:tasks.cephfs_test_runner: 2024-02-02T13:04:09.460 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-02-02T13:04:09.460 INFO:tasks.cephfs_test_runner:Ran 1 test in 4493.668s 2024-02-02T13:04:09.460 INFO:tasks.cephfs_test_runner: 2024-02-02T13:04:09.460 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-02-02T13:04:09.460 INFO:tasks.cephfs_test_runner: 2024-02-02T13:04:09.460 INFO:tasks.cephfs_test_runner:====================================================================== 2024-02-02T13:04:09.460 INFO:tasks.cephfs_test_runner:FAIL: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-02-02T13:04:09.460 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-02-02T13:04:09.460 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-02-02T13:04:09.461 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0fb327883c124fd83155c94db0804f823b805a12/qa/tasks/cephfs/test_fscrypt.py", line 76, in test_fscrypt_dummy_encryption_with_quick_group 2024-02-02T13:04:09.461 INFO:tasks.cephfs_test_runner: self.assertEqual(proc.returncode, 0) 2024-02-02T13:04:09.461 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2024-02-02T13:04:09.461 INFO:tasks.cephfs_test_runner: 2024-02-02T13:04:09.461 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_0fb327883c124fd83155c94db0804f823b805a12/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-02-02T13:04:09.697 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9d3b6b039e6d4ec3a4d1e3734a04e98c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_0fb327883c124fd83155c94db0804f823b805a12/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-02-02T13:04:09.699 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-02-02T13:04:09.707 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-02-02T13:04:09.727 INFO:tasks.kclient:Unmounting kernel clients... 2024-02-02T13:04:09.727 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-02-02T13:04:09.727 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-02T13:04:09.749 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354484k,nr_inodes=4088621,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275344k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1776 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275340k,nr_inodes=818835,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275344k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-02-02T13:04:09.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T13:04:09.750 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-02-02T13:04:09.842 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-02T13:04:09.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T13:04:09.843 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-02T13:04:09.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-02T13:04:09.866 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2024-02-02T13:04:10.057 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-02T13:04:10.066 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-02T13:04:10.066 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-02T13:04:10.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.171+0000 7fce5c0f5640 1 Processor -- start 2024-02-02T13:04:10.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.171+0000 7fce5c0f5640 1 -- start start 2024-02-02T13:04:10.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.171+0000 7fce5c0f5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce540ba1d0 0x7fce540b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:10.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.171+0000 7fce5c0f5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fce54148760 0x7fce54148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:10.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.171+0000 7fce5c0f5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce5414c740 con 0x7fce540b6880 2024-02-02T13:04:10.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.171+0000 7fce5c0f5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce540b9b90 con 0x7fce54148760 2024-02-02T13:04:10.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.171+0000 7fce5c0f5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce540ba5f0 con 0x7fce540ba1d0 2024-02-02T13:04:10.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.171+0000 7fce5a692640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fce54148760 0x7fce54148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:10.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.171+0000 7fce5a692640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fce54148760 0x7fce54148bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46644/0 (socket says 172.21.15.161:46644) 2024-02-02T13:04:10.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.171+0000 7fce59e91640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fce540b6880 0x7fce541425f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:41256/0 (socket says 172.21.15.161:41256) 2024-02-02T13:04:10.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.171+0000 7fce5a692640 1 -- 172.21.15.161:0/1319144026 learned_addr learned my addr 172.21.15.161:0/1319144026 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:10.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.171+0000 7fce5a692640 1 -- 172.21.15.161:0/1319144026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce540ba1d0 msgr2=0x7fce540b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:10.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.171+0000 7fce59690640 1 --2- 172.21.15.161:0/1319144026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce540ba1d0 0x7fce540b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:10.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.171+0000 7fce58e8f640 1 -- 172.21.15.161:0/1319144026 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895579893 0 0) 0x7fce5414c740 con 0x7fce540b6880 2024-02-02T13:04:10.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.171+0000 7fce5a692640 1 --2- 172.21.15.161:0/1319144026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce540ba1d0 0x7fce540b7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.171+0000 7fce5a692640 1 -- 172.21.15.161:0/1319144026 >> v1:172.21.15.161:6789/0 conn(0x7fce540b6880 legacy=0x7fce541425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:10.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.171+0000 7fce5a692640 1 -- 172.21.15.161:0/1319144026 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5414be10 con 0x7fce54148760 2024-02-02T13:04:10.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.175+0000 7fce5a692640 1 --2- 172.21.15.161:0/1319144026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce54148760 0x7fce54148bf0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009e80 tx=0x7fce4c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e1aad98dab7720 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:10.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.175+0000 7fce58e8f640 1 -- 172.21.15.161:0/1319144026 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c0a5710 con 0x7fce54148760 2024-02-02T13:04:10.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.175+0000 7fce58e8f640 1 -- 172.21.15.161:0/1319144026 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4c0a5870 con 0x7fce54148760 2024-02-02T13:04:10.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.175+0000 7fce58e8f640 1 -- 172.21.15.161:0/1319144026 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c0a5c00 con 0x7fce54148760 2024-02-02T13:04:10.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.175+0000 7fce5c0f5640 1 -- 172.21.15.161:0/1319144026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce54148760 msgr2=0x7fce54148bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:10.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.175+0000 7fce5c0f5640 1 --2- 172.21.15.161:0/1319144026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce54148760 0x7fce54148bf0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009e80 tx=0x7fce4c01c960 comp rx=0 tx=0).stop 2024-02-02T13:04:10.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.175+0000 7fce5c0f5640 1 -- 172.21.15.161:0/1319144026 shutdown_connections 2024-02-02T13:04:10.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.175+0000 7fce5c0f5640 1 --2- 172.21.15.161:0/1319144026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce54148760 0x7fce54148bf0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.175+0000 7fce5c0f5640 1 --2- 172.21.15.161:0/1319144026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce540ba1d0 0x7fce540b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.175+0000 7fce5c0f5640 1 -- 172.21.15.161:0/1319144026 >> 172.21.15.161:0/1319144026 conn(0x7fce5406ae30 msgr2=0x7fce5406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:10.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.175+0000 7fce5c0f5640 1 -- 172.21.15.161:0/1319144026 shutdown_connections 2024-02-02T13:04:10.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.175+0000 7fce5c0f5640 1 -- 172.21.15.161:0/1319144026 wait complete. 2024-02-02T13:04:10.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.175+0000 7fce5c0f5640 1 Processor -- start 2024-02-02T13:04:10.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.175+0000 7fce5c0f5640 1 -- start start 2024-02-02T13:04:10.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce5c0f5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce540b6880 0x7fce541411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:10.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce5c0f5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce540ba1d0 0x7fce541331d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:10.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce5c0f5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce54148760 0x7fce54133710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:10.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce5c0f5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce54141700 con 0x7fce54148760 2024-02-02T13:04:10.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce5c0f5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce540b4020 con 0x7fce540b6880 2024-02-02T13:04:10.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce5c0f5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce54139d70 con 0x7fce540ba1d0 2024-02-02T13:04:10.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce5a692640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce54148760 0x7fce54133710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:10.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce5a692640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce54148760 0x7fce54133710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46650/0 (socket says 172.21.15.161:46650) 2024-02-02T13:04:10.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce5a692640 1 -- 172.21.15.161:0/496777541 learned_addr learned my addr 172.21.15.161:0/496777541 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:10.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce59690640 1 --2- 172.21.15.161:0/496777541 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce540ba1d0 0x7fce541331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:10.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce59e91640 1 --2- 172.21.15.161:0/496777541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce540b6880 0x7fce541411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:10.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce5a692640 1 -- 172.21.15.161:0/496777541 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce540ba1d0 msgr2=0x7fce541331d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:10.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce5a692640 1 --2- 172.21.15.161:0/496777541 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce540ba1d0 0x7fce541331d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce5a692640 1 -- 172.21.15.161:0/496777541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce540b6880 msgr2=0x7fce541411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:10.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce5a692640 1 --2- 172.21.15.161:0/496777541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce540b6880 0x7fce541411c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce5a692640 1 -- 172.21.15.161:0/496777541 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c009b30 con 0x7fce54148760 2024-02-02T13:04:10.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce5a692640 1 --2- 172.21.15.161:0/496777541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce54148760 0x7fce54133710 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0af040 tx=0x7fce4c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:10.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce4a7fc640 1 -- 172.21.15.161:0/496777541 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c0b8670 con 0x7fce54148760 2024-02-02T13:04:10.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce4a7fc640 1 -- 172.21.15.161:0/496777541 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4c0b87f0 con 0x7fce54148760 2024-02-02T13:04:10.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce5c0f5640 1 -- 172.21.15.161:0/496777541 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce541462d0 con 0x7fce54148760 2024-02-02T13:04:10.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce4a7fc640 1 -- 172.21.15.161:0/496777541 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c0b8ba0 con 0x7fce54148760 2024-02-02T13:04:10.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce5c0f5640 1 -- 172.21.15.161:0/496777541 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce54139a00 con 0x7fce54148760 2024-02-02T13:04:10.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce5c0f5640 1 -- 172.21.15.161:0/496777541 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce54149440 con 0x7fce54148760 2024-02-02T13:04:10.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce4a7fc640 1 -- 172.21.15.161:0/496777541 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fce4c0b8d00 con 0x7fce54148760 2024-02-02T13:04:10.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.179+0000 7fce4a7fc640 1 --2- 172.21.15.161:0/496777541 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fce38065a60 0x7fce38067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:10.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.183+0000 7fce4a7fc640 1 -- 172.21.15.161:0/496777541 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fce4c11eda0 con 0x7fce54148760 2024-02-02T13:04:10.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.183+0000 7fce59e91640 1 --2- 172.21.15.161:0/496777541 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fce38065a60 0x7fce38067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:10.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.183+0000 7fce59e91640 1 --2- 172.21.15.161:0/496777541 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fce38065a60 0x7fce38067f20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fce44000f70 tx=0x7fce44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:10.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.183+0000 7fce4a7fc640 1 -- 172.21.15.161:0/496777541 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fce4c0ecbd0 con 0x7fce54148760 2024-02-02T13:04:10.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.343+0000 7fce5c0f5640 1 -- 172.21.15.161:0/496777541 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce540b6c60 con 0x7fce38065a60 2024-02-02T13:04:10.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.351+0000 7fce4a7fc640 1 -- 172.21.15.161:0/496777541 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49636 (secure 0 0 0) 0x7fce44001c80 con 0x7fce38065a60 2024-02-02T13:04:10.355 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T13:04:10.355 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-02-02T13:04:10.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.351+0000 7fce5c0f5640 1 -- 172.21.15.161:0/496777541 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fce38065a60 msgr2=0x7fce38067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:10.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.351+0000 7fce5c0f5640 1 --2- 172.21.15.161:0/496777541 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fce38065a60 0x7fce38067f20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fce44000f70 tx=0x7fce44009040 comp rx=0 tx=0).stop 2024-02-02T13:04:10.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.351+0000 7fce5c0f5640 1 -- 172.21.15.161:0/496777541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce54148760 msgr2=0x7fce54133710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:10.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.351+0000 7fce5c0f5640 1 --2- 172.21.15.161:0/496777541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce54148760 0x7fce54133710 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0af040 tx=0x7fce4c019700 comp rx=0 tx=0).stop 2024-02-02T13:04:10.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.351+0000 7fce5c0f5640 1 -- 172.21.15.161:0/496777541 shutdown_connections 2024-02-02T13:04:10.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.351+0000 7fce5c0f5640 1 --2- 172.21.15.161:0/496777541 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fce38065a60 0x7fce38067f20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.351+0000 7fce5c0f5640 1 --2- 172.21.15.161:0/496777541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce54148760 0x7fce54133710 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.351+0000 7fce5c0f5640 1 --2- 172.21.15.161:0/496777541 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce540ba1d0 0x7fce541331d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.351+0000 7fce5c0f5640 1 --2- 172.21.15.161:0/496777541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce540b6880 0x7fce541411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.351+0000 7fce5c0f5640 1 -- 172.21.15.161:0/496777541 >> 172.21.15.161:0/496777541 conn(0x7fce5406ae30 msgr2=0x7fce54070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:10.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.351+0000 7fce5c0f5640 1 -- 172.21.15.161:0/496777541 shutdown_connections 2024-02-02T13:04:10.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.351+0000 7fce5c0f5640 1 -- 172.21.15.161:0/496777541 wait complete. 2024-02-02T13:04:10.372 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":2291,"stamp":"2024-02-02T13:04:09.754224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10891568,"kb_used_data":1475664,"kb_used_omap":13,"kb_used_meta":9415794,"kb_avail":744083152,"statfs":{"total":773094113280,"available":761941147648,"internally_reserved":0,"allocated":1511079936,"data_stored":1509249090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":9641773144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-753489098,"num_objects":-1458,"num_object_clones":0,"num_object_copies":-2916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1458,"num_whiteouts":0,"num_read":-57533,"num_read_kb":-53488764,"num_write":-1473612,"num_write_kb":-59671884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.517695"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":209,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T13:03:00.900627+0000","last_change":"2024-02-02T11:48:41.563754+0000","last_active":"2024-02-02T13:03:00.900627+0000","last_peered":"2024-02-02T13:03:00.900627+0000","last_clean":"2024-02-02T13:03:00.900627+0000","last_became_active":"2024-02-02T11:48:41.562629+0000","last_became_peered":"2024-02-02T11:48:41.562629+0000","last_unstale":"2024-02-02T13:03:00.900627+0000","last_undegraded":"2024-02-02T13:03:00.900627+0000","last_fullsized":"2024-02-02T13:03:00.900627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_clean_scrub_stamp":"2024-02-02T11:48:40.536978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:22:02.923582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575758,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1595608,"kb_used_data":174220,"kb_used_omap":1,"kb_used_meta":1421374,"kb_avail":92776232,"statfs":{"total":96636764160,"available":95002861568,"internally_reserved":0,"allocated":178401280,"data_stored":178172840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1455487243},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71199999999999997,"15min":0.86599999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.27900000000000003},"max":{"1min":1.006,"5min":1.1399999999999999,"15min":20.102},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.73399999999999999,"15min":0.91200000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.24299999999999999},"max":{"1min":1.109,"5min":1.169,"15min":26.815999999999999},"last":0.85399999999999998}]},{"osd":1,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":0.85499999999999998,"15min":0.94199999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.26600000000000001},"max":{"1min":3.5990000000000002,"5min":3.5990000000000002,"15min":20.135000000000002},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.82799999999999996,"15min":0.95599999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.26600000000000001},"max":{"1min":1.1619999999999999,"5min":1.4330000000000001,"15min":20.567},"last":0.99099999999999999}]},{"osd":2,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76500000000000001,"15min":0.96299999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.33000000000000002},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":21.614999999999998},"last":1.03},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.871,"15min":0.97399999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.375},"max":{"1min":1.093,"5min":1.3,"15min":26.887},"last":1.056}]},{"osd":3,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.85299999999999998,"15min":1.125},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.1200000000000001,"5min":1.2330000000000001,"15min":56.085999999999999},"last":1.085},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.94299999999999995,"15min":1.0669999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.314},"max":{"1min":1.2669999999999999,"5min":1.3939999999999999,"15min":26.713999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.98899999999999999,"15min":1.02},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.249},"max":{"1min":1.1080000000000001,"5min":1.5589999999999999,"15min":22.013999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.99199999999999999,"15min":1.0449999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.28499999999999998},"max":{"1min":1.105,"5min":1.728,"15min":18.449000000000002},"last":0.92100000000000004}]},{"osd":5,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.071,"15min":1.1559999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.315},"max":{"1min":1.3340000000000001,"5min":1.8180000000000001,"15min":20.161000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0960000000000001,"15min":1.1339999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.29199999999999998},"max":{"1min":1.2210000000000001,"5min":1.7789999999999999,"15min":20.526},"last":1.246}]},{"osd":6,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.139,"15min":1.2969999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.33300000000000002},"max":{"1min":1.3109999999999999,"5min":1.6339999999999999,"15min":30.931999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.091,"15min":1.175},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.313},"max":{"1min":1.3939999999999999,"5min":1.587,"15min":19.991},"last":1.171}]}]},{"osd":6,"up_from":13,"seq":55834575757,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":999852,"kb_used_data":138016,"kb_used_omap":1,"kb_used_meta":861822,"kb_avail":93371988,"statfs":{"total":96636764160,"available":95612915712,"internally_reserved":0,"allocated":141328384,"data_stored":141097231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":882505995},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.70799999999999996,"15min":0.73299999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27000000000000002},"max":{"1min":1.2130000000000001,"5min":1.238,"15min":3.9910000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77500000000000002,"15min":0.79300000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":3.548},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.79700000000000004,"15min":0.82199999999999995},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":5.383,"5min":5.383,"15min":7.3819999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.79400000000000004,"15min":0.85399999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":1.093,"5min":1.4199999999999999,"15min":8.9719999999999995},"last":0.88}]},{"osd":2,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79600000000000004,"15min":0.89800000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":25.451000000000001},"last":1.121},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.88,"15min":1.0049999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.32700000000000001},"max":{"1min":5.4500000000000002,"5min":5.4500000000000002,"15min":25.044},"last":0.82299999999999995}]},{"osd":3,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":0.99299999999999999,"15min":1.139},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":8.4290000000000003,"5min":8.4290000000000003,"15min":21.263000000000002},"last":0.747},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.96099999999999997,"15min":1.1140000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.371},"max":{"1min":1.3959999999999999,"5min":1.5189999999999999,"15min":21.361999999999998},"last":0.996}]},{"osd":4,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":1.034,"15min":0.996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26600000000000001},"max":{"1min":1.5669999999999999,"5min":1.579,"15min":3.7480000000000002},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.0840000000000001,"15min":1.0509999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":5.4219999999999997,"5min":5.4219999999999997,"15min":7.548},"last":0.93500000000000005}]},{"osd":5,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.0409999999999999,"15min":1.0740000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.253},"max":{"1min":1.623,"5min":1.623,"15min":15.833},"last":1.181},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1399999999999999,"15min":1.2070000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.312},"max":{"1min":5.8029999999999999,"5min":5.8029999999999999,"15min":14.234},"last":1.0900000000000001}]},{"osd":7,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.1100000000000001,"15min":1.143},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":13.936},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.996,"5min":1.1080000000000001,"15min":1.1319999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.32400000000000001},"max":{"1min":1.542,"5min":1.542,"15min":13.904999999999999},"last":1.2290000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575756,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1370060,"kb_used_data":205376,"kb_used_omap":1,"kb_used_meta":1164670,"kb_avail":93001780,"statfs":{"total":96636764160,"available":95233822720,"internally_reserved":0,"allocated":210305024,"data_stored":210077399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1192622347},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.753,"15min":0.76300000000000001},"min":{"1min":0.40600000000000003,"5min":0.248,"15min":0.23300000000000001},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.804},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.84399999999999997,"15min":0.84899999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.40500000000000003},"max":{"1min":1.5129999999999999,"5min":3.492,"15min":4.2759999999999998},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.98699999999999999,"15min":0.89200000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.308},"max":{"1min":1.1899999999999999,"5min":18.481999999999999,"15min":18.481999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.80000000000000004,"15min":0.83599999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.26500000000000001},"max":{"1min":1.2310000000000001,"5min":1.252,"15min":4.8380000000000001},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.89300000000000002,"15min":0.89600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.41599999999999998},"max":{"1min":1.214,"5min":4.1280000000000001,"15min":4.3090000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90000000000000002,"15min":0.89400000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.369,"5min":4.1820000000000004,"15min":4.1820000000000004},"last":0.78500000000000003}]},{"osd":3,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.032,"15min":0.999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.48,"5min":8.6809999999999992,"15min":8.6809999999999992},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":1.0229999999999999,"15min":0.98799999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32300000000000001},"max":{"1min":1.304,"5min":5.2430000000000003,"15min":5.2430000000000003},"last":0.85999999999999999}]},{"osd":4,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.96199999999999997,"15min":0.96299999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.415,"5min":1.415,"15min":3.4500000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.0900000000000001,"15min":1.089},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.2989999999999999,"5min":3.5960000000000001,"15min":4.2119999999999997},"last":1.085}]},{"osd":6,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.071,"15min":1.0589999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.253},"max":{"1min":1.367,"5min":1.5880000000000001,"15min":3.5339999999999998},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.0760000000000001,"15min":1.0649999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.33300000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.488},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3640000000000001,"5min":3.5670000000000002,"15min":4.25},"last":1.196},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.161,"15min":1.153},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.4179999999999999,"5min":1.6830000000000001,"15min":3.6589999999999998},"last":1.1719999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575756,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1620192,"kb_used_data":207700,"kb_used_omap":1,"kb_used_meta":1412478,"kb_avail":92751648,"statfs":{"total":96636764160,"available":94977687552,"internally_reserved":0,"allocated":212684800,"data_stored":212453135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1446377739},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.72899999999999998,"15min":0.871},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.97399999999999998,"5min":1.1259999999999999,"15min":9.5009999999999994},"last":1.194},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.73299999999999998,"15min":0.82699999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27600000000000002},"max":{"1min":0.92400000000000004,"5min":1.121,"15min":7.2229999999999999},"last":0.77900000000000003}]},{"osd":1,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.79200000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.25700000000000001},"max":{"1min":1.0900000000000001,"5min":1.2509999999999999,"15min":3.1480000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82399999999999995,"15min":0.95499999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.26500000000000001},"max":{"1min":1.109,"5min":1.222,"15min":8.9450000000000003},"last":0.96499999999999997}]},{"osd":2,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.875,"15min":0.92200000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.307},"max":{"1min":3.754,"5min":3.754,"15min":9.0619999999999994},"last":1.095},{"interface":"front","average":{"1min":0.875,"5min":0.86599999999999999,"15min":0.998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.372},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":11.909000000000001},"last":1.125}]},{"osd":3,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86199999999999999,"15min":0.90400000000000003},"min":{"1min":0.54100000000000004,"5min":0.47999999999999998,"15min":0.33600000000000002},"max":{"1min":1.1759999999999999,"5min":1.2909999999999999,"15min":4.093},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.93300000000000005,"15min":0.97399999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4490000000000001,"5min":1.4930000000000001,"15min":9.0250000000000004},"last":1.2170000000000001}]},{"osd":5,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.98299999999999998,"15min":1.036},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.27900000000000003},"max":{"1min":1.2609999999999999,"5min":1.401,"15min":9.5329999999999995},"last":1.248},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0189999999999999,"15min":0.98599999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.32600000000000001},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":3.2650000000000001},"last":1.056}]},{"osd":6,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0669999999999999,"15min":1.0629999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.30599999999999999},"max":{"1min":1.526,"5min":1.649,"15min":12.382999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.103,"15min":1.1639999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.32000000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":12.513999999999999},"last":1.3080000000000001}]},{"osd":7,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0800000000000001,"15min":1.0609999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.36499999999999999},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":3.2010000000000001},"last":1.165},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.127,"15min":1.1299999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.33800000000000002},"max":{"1min":1.4910000000000001,"5min":1.7350000000000001,"15min":9.1199999999999992},"last":1.2809999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575757,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1654828,"kb_used_data":207008,"kb_used_omap":1,"kb_used_meta":1447806,"kb_avail":92717012,"statfs":{"total":96636764160,"available":94942220288,"internally_reserved":0,"allocated":211976192,"data_stored":211743716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1482553611},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.505,"15min":0.59299999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.218},"max":{"1min":0.873,"5min":0.88700000000000001,"15min":6.1349999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52700000000000002,"15min":0.65300000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":7.6520000000000001},"last":0.89900000000000002}]},{"osd":1,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.69599999999999995},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.223},"max":{"1min":1.002,"5min":1.002,"15min":17.678000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56499999999999995,"15min":0.64200000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.167},"last":0.96099999999999997}]},{"osd":2,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65400000000000003,"15min":0.77700000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.143,"5min":1.143,"15min":7.6100000000000003},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.746,"15min":0.89800000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":7.6289999999999996},"last":1.1200000000000001}]},{"osd":4,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.84699999999999998,"15min":0.91800000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.309},"max":{"1min":1.766,"5min":1.766,"15min":5.96},"last":1.149},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.90100000000000002,"15min":1.044},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.438},"max":{"1min":1.411,"5min":1.411,"15min":18.291},"last":1.232}]},{"osd":5,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.88900000000000001,"15min":1.0269999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.32700000000000001},"max":{"1min":1.2509999999999999,"5min":1.343,"15min":9.2940000000000005},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89500000000000002,"15min":0.96599999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.31900000000000001},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":5.9199999999999999},"last":1.387}]},{"osd":6,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.95199999999999996,"15min":1.2490000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.32800000000000001},"max":{"1min":1.341,"5min":1.3919999999999999,"15min":55.201999999999998},"last":1.266},{"interface":"front","average":{"1min":0.876,"5min":0.97899999999999998,"15min":1.329},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":57.195},"last":1.7549999999999999}]},{"osd":7,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.95299999999999996,"15min":1.1120000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.482,"5min":1.482,"15min":8.0370000000000008},"last":1.8620000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.91800000000000004,"15min":1.03},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":5.9829999999999997},"last":1.54}]}]},{"osd":2,"up_from":13,"seq":55834575756,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1132612,"kb_used_data":154168,"kb_used_omap":1,"kb_used_meta":978430,"kb_avail":93239228,"statfs":{"total":96636764160,"available":95476969472,"internally_reserved":0,"allocated":157868032,"data_stored":157643901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1001912587},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.53600000000000003,"15min":0.68100000000000005},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.215},"max":{"1min":0.77200000000000002,"5min":0.86099999999999999,"15min":12.688000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.61299999999999999,"15min":0.73699999999999999},"min":{"1min":0.28199999999999997,"5min":0.24099999999999999,"15min":0.23499999999999999},"max":{"1min":4.1520000000000001,"5min":4.1520000000000001,"15min":16.814},"last":0.76100000000000001}]},{"osd":1,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56799999999999995,"15min":0.67700000000000005},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.216},"max":{"1min":0.83999999999999997,"5min":1.0820000000000001,"15min":3.234},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.68899999999999995,"15min":0.90500000000000003},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":5.4660000000000002,"5min":5.4660000000000002,"15min":62.295999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54200000000000004,"15min":0.68899999999999995},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.88700000000000001,"5min":1.1459999999999999,"15min":11.23},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.68300000000000005,"15min":0.82299999999999995},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.04,"5min":1.04,"15min":10.968},"last":1.014}]},{"osd":4,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.88100000000000001,"15min":1.0489999999999999},"min":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.33500000000000002},"max":{"1min":3.7490000000000001,"5min":3.7490000000000001,"15min":18.731999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.258,"5min":0.98199999999999998,"15min":1.028},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.33700000000000002},"max":{"1min":5.9589999999999996,"5min":5.9589999999999996,"15min":10.101000000000001},"last":0.98999999999999999}]},{"osd":5,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":0.94299999999999995,"15min":1.1140000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":4.218,"5min":4.218,"15min":22.279},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.84799999999999998,"15min":0.95599999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.36199999999999999},"max":{"1min":1.171,"5min":1.4059999999999999,"15min":5.8479999999999999},"last":1.044}]},{"osd":6,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.86799999999999999,"15min":1.0429999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0820000000000001,"5min":1.474,"15min":20.545000000000002},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.96199999999999997,"15min":1.1519999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.6749999999999998,"5min":3.6749999999999998,"15min":32.533000000000001},"last":1.242}]},{"osd":7,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.99399999999999999,"15min":1.095},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.437},"max":{"1min":4.242,"5min":4.242,"15min":5.7220000000000004},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.91800000000000004,"15min":1.1040000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.433},"max":{"1min":1.8,"5min":1.8,"15min":20.5},"last":1.137}]}]},{"osd":1,"up_from":13,"seq":55834575757,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1562732,"kb_used_data":267360,"kb_used_omap":1,"kb_used_meta":1295358,"kb_avail":92809108,"statfs":{"total":96636764160,"available":95036526592,"internally_reserved":0,"allocated":273776640,"data_stored":273544941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1326446859},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.73299999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.189},"max":{"1min":1.621,"5min":1.621,"15min":34.694000000000003},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.55500000000000005,"15min":0.68600000000000005},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.217},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":10.916},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51700000000000002,"15min":0.67200000000000004},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":14.744999999999999},"last":0.309},{"interface":"front","average":{"1min":0.629,"5min":0.60599999999999998,"15min":0.83899999999999997},"min":{"1min":0.28899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":38.899000000000001},"last":0.35499999999999998}]},{"osd":3,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65200000000000002,"15min":0.91700000000000004},"min":{"1min":0.35499999999999998,"5min":0.30499999999999999,"15min":0.29099999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":38.932000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.63700000000000001,"15min":0.81499999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.24299999999999999},"max":{"1min":2.621,"5min":2.621,"15min":12.385},"last":0.39800000000000002}]},{"osd":4,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.83599999999999997,"15min":1.2969999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.34499999999999997},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":97.268000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.878,"15min":1.2909999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.317},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":97.442999999999998},"last":0.59499999999999997}]},{"osd":5,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88400000000000001,"15min":1.0089999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.7149999999999999,"5min":2.7149999999999999,"15min":8.9849999999999994},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.85799999999999998,"15min":1.046},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.34699999999999998},"max":{"1min":1.3620000000000001,"5min":1.492,"15min":14.776999999999999},"last":0.60499999999999998}]},{"osd":6,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91500000000000004,"15min":1.3100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":68.975999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93000000000000005,"15min":1.119},"min":{"1min":0.44,"5min":0.44,"15min":0.40899999999999997},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":20.527999999999999},"last":0.80900000000000005}]},{"osd":7,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.92500000000000004,"15min":1.1160000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":12.547000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.89200000000000002,"15min":1.0860000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.38100000000000001},"max":{"1min":1.379,"5min":1.5780000000000001,"15min":14.808},"last":0.70099999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575756,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":955684,"kb_used_data":121816,"kb_used_omap":1,"kb_used_meta":833854,"kb_avail":93416156,"statfs":{"total":96636764160,"available":95658143744,"internally_reserved":0,"allocated":124739584,"data_stored":124515927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":853866763},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.57099999999999995,"15min":0.69299999999999995},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.255},"max":{"1min":0.73199999999999998,"5min":0.88900000000000001,"15min":21.370999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56999999999999995,"15min":0.69499999999999995},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.21099999999999999},"max":{"1min":0.93500000000000005,"5min":1.01,"15min":10.538},"last":0.61899999999999999}]},{"osd":2,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.61699999999999999,"15min":0.77200000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27300000000000002},"max":{"1min":4.2919999999999998,"5min":4.2919999999999998,"15min":21.431000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.145,"5min":0.69299999999999995,"15min":0.78200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.29499999999999998},"max":{"1min":10.978999999999999,"5min":10.978999999999999,"15min":11.412000000000001},"last":0.54700000000000004}]},{"osd":3,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.53900000000000003,"15min":0.63500000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":3.25},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.65000000000000002,"15min":0.752},"min":{"1min":0.316,"5min":0.316,"15min":0.245},"max":{"1min":1.2170000000000001,"5min":1.46,"15min":4.0359999999999996},"last":0.84099999999999997}]},{"osd":4,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.84399999999999997,"15min":0.91600000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":4.4589999999999996},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.81599999999999995,"15min":0.871},"min":{"1min":0.502,"5min":0.48399999999999999,"15min":0.41199999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":2.6030000000000002},"last":1.0589999999999999}]},{"osd":5,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.89300000000000002,"15min":0.97299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.361,"5min":1.415,"15min":3.9790000000000001},"last":1.139},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.90300000000000002,"15min":1.0189999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":7.2619999999999996},"last":1.1140000000000001}]},{"osd":6,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.85499999999999998,"15min":0.93899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.371},"max":{"1min":1.26,"5min":1.2729999999999999,"15min":2.573},"last":1.157},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.95199999999999996,"15min":1.0309999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.41599999999999998},"max":{"1min":1.4370000000000001,"5min":1.5289999999999999,"15min":4.008},"last":0.997}]},{"osd":7,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93700000000000006,"15min":1.0269999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.6429999999999998,"5min":3.6429999999999998,"15min":4.4290000000000003},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.94399999999999995,"15min":1.0009999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.40200000000000002},"max":{"1min":3.7290000000000001,"5min":3.7290000000000001,"15min":3.7290000000000001},"last":1.016}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-02T13:04:10.374 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-02T13:04:10.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.487+0000 7f32dbfdc640 1 Processor -- start 2024-02-02T13:04:10.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.487+0000 7f32dbfdc640 1 -- start start 2024-02-02T13:04:10.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.487+0000 7f32dbfdc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f32d40bc340 0x7f32d4142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:10.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.487+0000 7f32dbfdc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f32d4149470 0x7f32d4153110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:10.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.487+0000 7f32dbfdc640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d4071770 con 0x7f32d4142d50 2024-02-02T13:04:10.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.487+0000 7f32dbfdc640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d40b37e0 con 0x7f32d4149470 2024-02-02T13:04:10.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.487+0000 7f32dbfdc640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d40b3ac0 con 0x7f32d40bc340 2024-02-02T13:04:10.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.487+0000 7f32da579640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f32d4149470 0x7f32d4153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:10.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.487+0000 7f32da579640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f32d4149470 0x7f32d4153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46658/0 (socket says 172.21.15.161:46658) 2024-02-02T13:04:10.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.487+0000 7f32da579640 1 -- 172.21.15.161:0/1371014345 learned_addr learned my addr 172.21.15.161:0/1371014345 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:10.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.487+0000 7f32da579640 1 -- 172.21.15.161:0/1371014345 >> v2:172.21.15.162:3300/0 conn(0x7f32d40bc340 msgr2=0x7f32d4142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:10.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.487+0000 7f32d9d78640 1 --2- 172.21.15.161:0/1371014345 >> v2:172.21.15.162:3300/0 conn(0x7f32d40bc340 0x7f32d4142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:10.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.487+0000 7f32da579640 1 --2- 172.21.15.161:0/1371014345 >> v2:172.21.15.162:3300/0 conn(0x7f32d40bc340 0x7f32d4142810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.487+0000 7f32da579640 1 -- 172.21.15.161:0/1371014345 >> v1:172.21.15.162:6789/0 conn(0x7f32d4142d50 legacy=0x7f32d4148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:10.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.487+0000 7f32da579640 1 -- 172.21.15.161:0/1371014345 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d40b3da0 con 0x7f32d4149470 2024-02-02T13:04:10.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32da579640 1 --2- 172.21.15.161:0/1371014345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32d4149470 0x7f32d4153110 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f32d406d110 tx=0x7f32cc01f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0da239c1f75ecd server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:10.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32d8d76640 1 -- 172.21.15.161:0/1371014345 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc0af400 con 0x7f32d4149470 2024-02-02T13:04:10.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32d8d76640 1 -- 172.21.15.161:0/1371014345 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32cc0ab050 con 0x7f32d4149470 2024-02-02T13:04:10.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32d8d76640 1 -- 172.21.15.161:0/1371014345 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc0af780 con 0x7f32d4149470 2024-02-02T13:04:10.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32dbfdc640 1 -- 172.21.15.161:0/1371014345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32d4149470 msgr2=0x7f32d4153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:10.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32dbfdc640 1 --2- 172.21.15.161:0/1371014345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32d4149470 0x7f32d4153110 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f32d406d110 tx=0x7f32cc01f180 comp rx=0 tx=0).stop 2024-02-02T13:04:10.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32dbfdc640 1 -- 172.21.15.161:0/1371014345 shutdown_connections 2024-02-02T13:04:10.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32dbfdc640 1 --2- 172.21.15.161:0/1371014345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32d4149470 0x7f32d4153110 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32dbfdc640 1 --2- 172.21.15.161:0/1371014345 >> v2:172.21.15.162:3300/0 conn(0x7f32d40bc340 0x7f32d4142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32dbfdc640 1 -- 172.21.15.161:0/1371014345 >> 172.21.15.161:0/1371014345 conn(0x7f32d4069ef0 msgr2=0x7f32d406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:10.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32dbfdc640 1 -- 172.21.15.161:0/1371014345 shutdown_connections 2024-02-02T13:04:10.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32dbfdc640 1 -- 172.21.15.161:0/1371014345 wait complete. 2024-02-02T13:04:10.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32dbfdc640 1 Processor -- start 2024-02-02T13:04:10.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32dbfdc640 1 -- start start 2024-02-02T13:04:10.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32dbfdc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32d40bc340 0x7f32d4135550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:10.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32dbfdc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32d4149470 0x7f32d4146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:10.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32dbfdc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32d41473c0 0x7f32d41402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:10.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32dbfdc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d41350e0 con 0x7f32d41473c0 2024-02-02T13:04:10.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32dbfdc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d4146790 con 0x7f32d40bc340 2024-02-02T13:04:10.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32dbfdc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d4141b00 con 0x7f32d4149470 2024-02-02T13:04:10.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32da579640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32d41473c0 0x7f32d41402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:10.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32da579640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32d41473c0 0x7f32d41402a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46664/0 (socket says 172.21.15.161:46664) 2024-02-02T13:04:10.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32da579640 1 -- 172.21.15.161:0/2956068798 learned_addr learned my addr 172.21.15.161:0/2956068798 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:10.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32da579640 1 -- 172.21.15.161:0/2956068798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32d4149470 msgr2=0x7f32d4146e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:10.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32d9577640 1 --2- 172.21.15.161:0/2956068798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32d4149470 0x7f32d4146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:10.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32d9d78640 1 --2- 172.21.15.161:0/2956068798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32d40bc340 0x7f32d4135550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:10.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32da579640 1 --2- 172.21.15.161:0/2956068798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32d4149470 0x7f32d4146e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32da579640 1 -- 172.21.15.161:0/2956068798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32d40bc340 msgr2=0x7f32d4135550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:10.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32da579640 1 --2- 172.21.15.161:0/2956068798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32d40bc340 0x7f32d4135550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32da579640 1 -- 172.21.15.161:0/2956068798 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc009b30 con 0x7f32d41473c0 2024-02-02T13:04:10.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32da579640 1 --2- 172.21.15.161:0/2956068798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32d41473c0 0x7f32d41402a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f32cc01cdb0 tx=0x7f32cc01bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:10.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32ca7fc640 1 -- 172.21.15.161:0/2956068798 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc0afe00 con 0x7f32d41473c0 2024-02-02T13:04:10.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32ca7fc640 1 -- 172.21.15.161:0/2956068798 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32cc009510 con 0x7f32d41473c0 2024-02-02T13:04:10.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32ca7fc640 1 -- 172.21.15.161:0/2956068798 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc0ba660 con 0x7f32d41473c0 2024-02-02T13:04:10.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32dbfdc640 1 -- 172.21.15.161:0/2956068798 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d4141de0 con 0x7f32d41473c0 2024-02-02T13:04:10.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.491+0000 7f32dbfdc640 1 -- 172.21.15.161:0/2956068798 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d4141790 con 0x7f32d41473c0 2024-02-02T13:04:10.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.495+0000 7f32dbfdc640 1 -- 172.21.15.161:0/2956068798 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d404e000 con 0x7f32d41473c0 2024-02-02T13:04:10.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.495+0000 7f32ca7fc640 1 -- 172.21.15.161:0/2956068798 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f32cc0b6040 con 0x7f32d41473c0 2024-02-02T13:04:10.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.495+0000 7f32ca7fc640 1 --2- 172.21.15.161:0/2956068798 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f32b8065a60 0x7f32b8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:10.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.495+0000 7f32d9d78640 1 --2- 172.21.15.161:0/2956068798 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f32b8065a60 0x7f32b8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:10.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.495+0000 7f32ca7fc640 1 -- 172.21.15.161:0/2956068798 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f32cc121110 con 0x7f32d41473c0 2024-02-02T13:04:10.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.495+0000 7f32d9d78640 1 --2- 172.21.15.161:0/2956068798 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f32b8065a60 0x7f32b8067f20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f32d000b800 tx=0x7f32d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:10.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.499+0000 7f32ca7fc640 1 -- 172.21.15.161:0/2956068798 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f32cc0eee60 con 0x7f32d41473c0 2024-02-02T13:04:10.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.639+0000 7f32dbfdc640 1 -- 172.21.15.161:0/2956068798 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32d40bc720 con 0x7f32b8065a60 2024-02-02T13:04:10.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.643+0000 7f32ca7fc640 1 -- 172.21.15.161:0/2956068798 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49636 (secure 0 0 0) 0x7f32d000c040 con 0x7f32b8065a60 2024-02-02T13:04:10.649 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T13:04:10.649 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-02-02T13:04:10.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.647+0000 7f32dbfdc640 1 -- 172.21.15.161:0/2956068798 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f32b8065a60 msgr2=0x7f32b8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:10.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.647+0000 7f32dbfdc640 1 --2- 172.21.15.161:0/2956068798 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f32b8065a60 0x7f32b8067f20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f32d000b800 tx=0x7f32d0008040 comp rx=0 tx=0).stop 2024-02-02T13:04:10.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.647+0000 7f32dbfdc640 1 -- 172.21.15.161:0/2956068798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32d41473c0 msgr2=0x7f32d41402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:10.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.647+0000 7f32dbfdc640 1 --2- 172.21.15.161:0/2956068798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32d41473c0 0x7f32d41402a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f32cc01cdb0 tx=0x7f32cc01bf20 comp rx=0 tx=0).stop 2024-02-02T13:04:10.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.647+0000 7f32dbfdc640 1 -- 172.21.15.161:0/2956068798 shutdown_connections 2024-02-02T13:04:10.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.647+0000 7f32dbfdc640 1 --2- 172.21.15.161:0/2956068798 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f32b8065a60 0x7f32b8067f20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.647+0000 7f32dbfdc640 1 --2- 172.21.15.161:0/2956068798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32d41473c0 0x7f32d41402a0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.647+0000 7f32dbfdc640 1 --2- 172.21.15.161:0/2956068798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f32d4149470 0x7f32d4146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.647+0000 7f32dbfdc640 1 --2- 172.21.15.161:0/2956068798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32d40bc340 0x7f32d4135550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.647+0000 7f32dbfdc640 1 -- 172.21.15.161:0/2956068798 >> 172.21.15.161:0/2956068798 conn(0x7f32d4069ef0 msgr2=0x7f32d40b8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:10.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.647+0000 7f32dbfdc640 1 -- 172.21.15.161:0/2956068798 shutdown_connections 2024-02-02T13:04:10.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.647+0000 7f32dbfdc640 1 -- 172.21.15.161:0/2956068798 wait complete. 2024-02-02T13:04:10.666 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":2291,"stamp":"2024-02-02T13:04:09.754224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10891568,"kb_used_data":1475664,"kb_used_omap":13,"kb_used_meta":9415794,"kb_avail":744083152,"statfs":{"total":773094113280,"available":761941147648,"internally_reserved":0,"allocated":1511079936,"data_stored":1509249090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":9641773144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-753489098,"num_objects":-1458,"num_object_clones":0,"num_object_copies":-2916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1458,"num_whiteouts":0,"num_read":-57533,"num_read_kb":-53488764,"num_write":-1473612,"num_write_kb":-59671884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.517695"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":209,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T13:03:00.900627+0000","last_change":"2024-02-02T11:48:41.563754+0000","last_active":"2024-02-02T13:03:00.900627+0000","last_peered":"2024-02-02T13:03:00.900627+0000","last_clean":"2024-02-02T13:03:00.900627+0000","last_became_active":"2024-02-02T11:48:41.562629+0000","last_became_peered":"2024-02-02T11:48:41.562629+0000","last_unstale":"2024-02-02T13:03:00.900627+0000","last_undegraded":"2024-02-02T13:03:00.900627+0000","last_fullsized":"2024-02-02T13:03:00.900627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_clean_scrub_stamp":"2024-02-02T11:48:40.536978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:22:02.923582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575758,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1595608,"kb_used_data":174220,"kb_used_omap":1,"kb_used_meta":1421374,"kb_avail":92776232,"statfs":{"total":96636764160,"available":95002861568,"internally_reserved":0,"allocated":178401280,"data_stored":178172840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1455487243},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71199999999999997,"15min":0.86599999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.27900000000000003},"max":{"1min":1.006,"5min":1.1399999999999999,"15min":20.102},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.73399999999999999,"15min":0.91200000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.24299999999999999},"max":{"1min":1.109,"5min":1.169,"15min":26.815999999999999},"last":0.85399999999999998}]},{"osd":1,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":0.85499999999999998,"15min":0.94199999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.26600000000000001},"max":{"1min":3.5990000000000002,"5min":3.5990000000000002,"15min":20.135000000000002},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.82799999999999996,"15min":0.95599999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.26600000000000001},"max":{"1min":1.1619999999999999,"5min":1.4330000000000001,"15min":20.567},"last":0.99099999999999999}]},{"osd":2,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76500000000000001,"15min":0.96299999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.33000000000000002},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":21.614999999999998},"last":1.03},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.871,"15min":0.97399999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.375},"max":{"1min":1.093,"5min":1.3,"15min":26.887},"last":1.056}]},{"osd":3,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.85299999999999998,"15min":1.125},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.1200000000000001,"5min":1.2330000000000001,"15min":56.085999999999999},"last":1.085},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.94299999999999995,"15min":1.0669999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.314},"max":{"1min":1.2669999999999999,"5min":1.3939999999999999,"15min":26.713999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.98899999999999999,"15min":1.02},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.249},"max":{"1min":1.1080000000000001,"5min":1.5589999999999999,"15min":22.013999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.99199999999999999,"15min":1.0449999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.28499999999999998},"max":{"1min":1.105,"5min":1.728,"15min":18.449000000000002},"last":0.92100000000000004}]},{"osd":5,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.071,"15min":1.1559999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.315},"max":{"1min":1.3340000000000001,"5min":1.8180000000000001,"15min":20.161000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0960000000000001,"15min":1.1339999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.29199999999999998},"max":{"1min":1.2210000000000001,"5min":1.7789999999999999,"15min":20.526},"last":1.246}]},{"osd":6,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.139,"15min":1.2969999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.33300000000000002},"max":{"1min":1.3109999999999999,"5min":1.6339999999999999,"15min":30.931999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.091,"15min":1.175},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.313},"max":{"1min":1.3939999999999999,"5min":1.587,"15min":19.991},"last":1.171}]}]},{"osd":6,"up_from":13,"seq":55834575757,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":999852,"kb_used_data":138016,"kb_used_omap":1,"kb_used_meta":861822,"kb_avail":93371988,"statfs":{"total":96636764160,"available":95612915712,"internally_reserved":0,"allocated":141328384,"data_stored":141097231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":882505995},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.70799999999999996,"15min":0.73299999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27000000000000002},"max":{"1min":1.2130000000000001,"5min":1.238,"15min":3.9910000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77500000000000002,"15min":0.79300000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":3.548},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.79700000000000004,"15min":0.82199999999999995},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":5.383,"5min":5.383,"15min":7.3819999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.79400000000000004,"15min":0.85399999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":1.093,"5min":1.4199999999999999,"15min":8.9719999999999995},"last":0.88}]},{"osd":2,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79600000000000004,"15min":0.89800000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":25.451000000000001},"last":1.121},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.88,"15min":1.0049999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.32700000000000001},"max":{"1min":5.4500000000000002,"5min":5.4500000000000002,"15min":25.044},"last":0.82299999999999995}]},{"osd":3,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":0.99299999999999999,"15min":1.139},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":8.4290000000000003,"5min":8.4290000000000003,"15min":21.263000000000002},"last":0.747},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.96099999999999997,"15min":1.1140000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.371},"max":{"1min":1.3959999999999999,"5min":1.5189999999999999,"15min":21.361999999999998},"last":0.996}]},{"osd":4,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":1.034,"15min":0.996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26600000000000001},"max":{"1min":1.5669999999999999,"5min":1.579,"15min":3.7480000000000002},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.0840000000000001,"15min":1.0509999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":5.4219999999999997,"5min":5.4219999999999997,"15min":7.548},"last":0.93500000000000005}]},{"osd":5,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.0409999999999999,"15min":1.0740000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.253},"max":{"1min":1.623,"5min":1.623,"15min":15.833},"last":1.181},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1399999999999999,"15min":1.2070000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.312},"max":{"1min":5.8029999999999999,"5min":5.8029999999999999,"15min":14.234},"last":1.0900000000000001}]},{"osd":7,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.1100000000000001,"15min":1.143},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":13.936},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.996,"5min":1.1080000000000001,"15min":1.1319999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.32400000000000001},"max":{"1min":1.542,"5min":1.542,"15min":13.904999999999999},"last":1.2290000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575756,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1370060,"kb_used_data":205376,"kb_used_omap":1,"kb_used_meta":1164670,"kb_avail":93001780,"statfs":{"total":96636764160,"available":95233822720,"internally_reserved":0,"allocated":210305024,"data_stored":210077399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1192622347},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.753,"15min":0.76300000000000001},"min":{"1min":0.40600000000000003,"5min":0.248,"15min":0.23300000000000001},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.804},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.84399999999999997,"15min":0.84899999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.40500000000000003},"max":{"1min":1.5129999999999999,"5min":3.492,"15min":4.2759999999999998},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.98699999999999999,"15min":0.89200000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.308},"max":{"1min":1.1899999999999999,"5min":18.481999999999999,"15min":18.481999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.80000000000000004,"15min":0.83599999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.26500000000000001},"max":{"1min":1.2310000000000001,"5min":1.252,"15min":4.8380000000000001},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.89300000000000002,"15min":0.89600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.41599999999999998},"max":{"1min":1.214,"5min":4.1280000000000001,"15min":4.3090000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90000000000000002,"15min":0.89400000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.369,"5min":4.1820000000000004,"15min":4.1820000000000004},"last":0.78500000000000003}]},{"osd":3,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.032,"15min":0.999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.48,"5min":8.6809999999999992,"15min":8.6809999999999992},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":1.0229999999999999,"15min":0.98799999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32300000000000001},"max":{"1min":1.304,"5min":5.2430000000000003,"15min":5.2430000000000003},"last":0.85999999999999999}]},{"osd":4,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.96199999999999997,"15min":0.96299999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.415,"5min":1.415,"15min":3.4500000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.0900000000000001,"15min":1.089},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.2989999999999999,"5min":3.5960000000000001,"15min":4.2119999999999997},"last":1.085}]},{"osd":6,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.071,"15min":1.0589999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.253},"max":{"1min":1.367,"5min":1.5880000000000001,"15min":3.5339999999999998},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.0760000000000001,"15min":1.0649999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.33300000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.488},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3640000000000001,"5min":3.5670000000000002,"15min":4.25},"last":1.196},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.161,"15min":1.153},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.4179999999999999,"5min":1.6830000000000001,"15min":3.6589999999999998},"last":1.1719999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575756,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1620192,"kb_used_data":207700,"kb_used_omap":1,"kb_used_meta":1412478,"kb_avail":92751648,"statfs":{"total":96636764160,"available":94977687552,"internally_reserved":0,"allocated":212684800,"data_stored":212453135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1446377739},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.72899999999999998,"15min":0.871},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.97399999999999998,"5min":1.1259999999999999,"15min":9.5009999999999994},"last":1.194},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.73299999999999998,"15min":0.82699999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27600000000000002},"max":{"1min":0.92400000000000004,"5min":1.121,"15min":7.2229999999999999},"last":0.77900000000000003}]},{"osd":1,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.79200000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.25700000000000001},"max":{"1min":1.0900000000000001,"5min":1.2509999999999999,"15min":3.1480000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82399999999999995,"15min":0.95499999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.26500000000000001},"max":{"1min":1.109,"5min":1.222,"15min":8.9450000000000003},"last":0.96499999999999997}]},{"osd":2,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.875,"15min":0.92200000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.307},"max":{"1min":3.754,"5min":3.754,"15min":9.0619999999999994},"last":1.095},{"interface":"front","average":{"1min":0.875,"5min":0.86599999999999999,"15min":0.998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.372},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":11.909000000000001},"last":1.125}]},{"osd":3,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86199999999999999,"15min":0.90400000000000003},"min":{"1min":0.54100000000000004,"5min":0.47999999999999998,"15min":0.33600000000000002},"max":{"1min":1.1759999999999999,"5min":1.2909999999999999,"15min":4.093},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.93300000000000005,"15min":0.97399999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4490000000000001,"5min":1.4930000000000001,"15min":9.0250000000000004},"last":1.2170000000000001}]},{"osd":5,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.98299999999999998,"15min":1.036},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.27900000000000003},"max":{"1min":1.2609999999999999,"5min":1.401,"15min":9.5329999999999995},"last":1.248},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0189999999999999,"15min":0.98599999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.32600000000000001},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":3.2650000000000001},"last":1.056}]},{"osd":6,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0669999999999999,"15min":1.0629999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.30599999999999999},"max":{"1min":1.526,"5min":1.649,"15min":12.382999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.103,"15min":1.1639999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.32000000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":12.513999999999999},"last":1.3080000000000001}]},{"osd":7,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0800000000000001,"15min":1.0609999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.36499999999999999},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":3.2010000000000001},"last":1.165},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.127,"15min":1.1299999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.33800000000000002},"max":{"1min":1.4910000000000001,"5min":1.7350000000000001,"15min":9.1199999999999992},"last":1.2809999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575757,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1654828,"kb_used_data":207008,"kb_used_omap":1,"kb_used_meta":1447806,"kb_avail":92717012,"statfs":{"total":96636764160,"available":94942220288,"internally_reserved":0,"allocated":211976192,"data_stored":211743716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1482553611},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.505,"15min":0.59299999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.218},"max":{"1min":0.873,"5min":0.88700000000000001,"15min":6.1349999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52700000000000002,"15min":0.65300000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":7.6520000000000001},"last":0.89900000000000002}]},{"osd":1,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.69599999999999995},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.223},"max":{"1min":1.002,"5min":1.002,"15min":17.678000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56499999999999995,"15min":0.64200000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.167},"last":0.96099999999999997}]},{"osd":2,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65400000000000003,"15min":0.77700000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.143,"5min":1.143,"15min":7.6100000000000003},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.746,"15min":0.89800000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":7.6289999999999996},"last":1.1200000000000001}]},{"osd":4,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.84699999999999998,"15min":0.91800000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.309},"max":{"1min":1.766,"5min":1.766,"15min":5.96},"last":1.149},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.90100000000000002,"15min":1.044},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.438},"max":{"1min":1.411,"5min":1.411,"15min":18.291},"last":1.232}]},{"osd":5,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.88900000000000001,"15min":1.0269999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.32700000000000001},"max":{"1min":1.2509999999999999,"5min":1.343,"15min":9.2940000000000005},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89500000000000002,"15min":0.96599999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.31900000000000001},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":5.9199999999999999},"last":1.387}]},{"osd":6,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.95199999999999996,"15min":1.2490000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.32800000000000001},"max":{"1min":1.341,"5min":1.3919999999999999,"15min":55.201999999999998},"last":1.266},{"interface":"front","average":{"1min":0.876,"5min":0.97899999999999998,"15min":1.329},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":57.195},"last":1.7549999999999999}]},{"osd":7,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.95299999999999996,"15min":1.1120000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.482,"5min":1.482,"15min":8.0370000000000008},"last":1.8620000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.91800000000000004,"15min":1.03},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":5.9829999999999997},"last":1.54}]}]},{"osd":2,"up_from":13,"seq":55834575756,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1132612,"kb_used_data":154168,"kb_used_omap":1,"kb_used_meta":978430,"kb_avail":93239228,"statfs":{"total":96636764160,"available":95476969472,"internally_reserved":0,"allocated":157868032,"data_stored":157643901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1001912587},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.53600000000000003,"15min":0.68100000000000005},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.215},"max":{"1min":0.77200000000000002,"5min":0.86099999999999999,"15min":12.688000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.61299999999999999,"15min":0.73699999999999999},"min":{"1min":0.28199999999999997,"5min":0.24099999999999999,"15min":0.23499999999999999},"max":{"1min":4.1520000000000001,"5min":4.1520000000000001,"15min":16.814},"last":0.76100000000000001}]},{"osd":1,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56799999999999995,"15min":0.67700000000000005},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.216},"max":{"1min":0.83999999999999997,"5min":1.0820000000000001,"15min":3.234},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.68899999999999995,"15min":0.90500000000000003},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":5.4660000000000002,"5min":5.4660000000000002,"15min":62.295999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54200000000000004,"15min":0.68899999999999995},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.88700000000000001,"5min":1.1459999999999999,"15min":11.23},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.68300000000000005,"15min":0.82299999999999995},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.04,"5min":1.04,"15min":10.968},"last":1.014}]},{"osd":4,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.88100000000000001,"15min":1.0489999999999999},"min":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.33500000000000002},"max":{"1min":3.7490000000000001,"5min":3.7490000000000001,"15min":18.731999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.258,"5min":0.98199999999999998,"15min":1.028},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.33700000000000002},"max":{"1min":5.9589999999999996,"5min":5.9589999999999996,"15min":10.101000000000001},"last":0.98999999999999999}]},{"osd":5,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":0.94299999999999995,"15min":1.1140000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":4.218,"5min":4.218,"15min":22.279},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.84799999999999998,"15min":0.95599999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.36199999999999999},"max":{"1min":1.171,"5min":1.4059999999999999,"15min":5.8479999999999999},"last":1.044}]},{"osd":6,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.86799999999999999,"15min":1.0429999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0820000000000001,"5min":1.474,"15min":20.545000000000002},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.96199999999999997,"15min":1.1519999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.6749999999999998,"5min":3.6749999999999998,"15min":32.533000000000001},"last":1.242}]},{"osd":7,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.99399999999999999,"15min":1.095},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.437},"max":{"1min":4.242,"5min":4.242,"15min":5.7220000000000004},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.91800000000000004,"15min":1.1040000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.433},"max":{"1min":1.8,"5min":1.8,"15min":20.5},"last":1.137}]}]},{"osd":1,"up_from":13,"seq":55834575757,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1562732,"kb_used_data":267360,"kb_used_omap":1,"kb_used_meta":1295358,"kb_avail":92809108,"statfs":{"total":96636764160,"available":95036526592,"internally_reserved":0,"allocated":273776640,"data_stored":273544941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1326446859},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.73299999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.189},"max":{"1min":1.621,"5min":1.621,"15min":34.694000000000003},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.55500000000000005,"15min":0.68600000000000005},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.217},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":10.916},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51700000000000002,"15min":0.67200000000000004},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":14.744999999999999},"last":0.309},{"interface":"front","average":{"1min":0.629,"5min":0.60599999999999998,"15min":0.83899999999999997},"min":{"1min":0.28899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":38.899000000000001},"last":0.35499999999999998}]},{"osd":3,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65200000000000002,"15min":0.91700000000000004},"min":{"1min":0.35499999999999998,"5min":0.30499999999999999,"15min":0.29099999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":38.932000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.63700000000000001,"15min":0.81499999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.24299999999999999},"max":{"1min":2.621,"5min":2.621,"15min":12.385},"last":0.39800000000000002}]},{"osd":4,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.83599999999999997,"15min":1.2969999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.34499999999999997},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":97.268000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.878,"15min":1.2909999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.317},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":97.442999999999998},"last":0.59499999999999997}]},{"osd":5,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88400000000000001,"15min":1.0089999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.7149999999999999,"5min":2.7149999999999999,"15min":8.9849999999999994},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.85799999999999998,"15min":1.046},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.34699999999999998},"max":{"1min":1.3620000000000001,"5min":1.492,"15min":14.776999999999999},"last":0.60499999999999998}]},{"osd":6,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91500000000000004,"15min":1.3100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":68.975999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93000000000000005,"15min":1.119},"min":{"1min":0.44,"5min":0.44,"15min":0.40899999999999997},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":20.527999999999999},"last":0.80900000000000005}]},{"osd":7,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.92500000000000004,"15min":1.1160000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":12.547000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.89200000000000002,"15min":1.0860000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.38100000000000001},"max":{"1min":1.379,"5min":1.5780000000000001,"15min":14.808},"last":0.70099999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575756,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":955684,"kb_used_data":121816,"kb_used_omap":1,"kb_used_meta":833854,"kb_avail":93416156,"statfs":{"total":96636764160,"available":95658143744,"internally_reserved":0,"allocated":124739584,"data_stored":124515927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":853866763},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.57099999999999995,"15min":0.69299999999999995},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.255},"max":{"1min":0.73199999999999998,"5min":0.88900000000000001,"15min":21.370999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56999999999999995,"15min":0.69499999999999995},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.21099999999999999},"max":{"1min":0.93500000000000005,"5min":1.01,"15min":10.538},"last":0.61899999999999999}]},{"osd":2,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.61699999999999999,"15min":0.77200000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27300000000000002},"max":{"1min":4.2919999999999998,"5min":4.2919999999999998,"15min":21.431000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.145,"5min":0.69299999999999995,"15min":0.78200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.29499999999999998},"max":{"1min":10.978999999999999,"5min":10.978999999999999,"15min":11.412000000000001},"last":0.54700000000000004}]},{"osd":3,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.53900000000000003,"15min":0.63500000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":3.25},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.65000000000000002,"15min":0.752},"min":{"1min":0.316,"5min":0.316,"15min":0.245},"max":{"1min":1.2170000000000001,"5min":1.46,"15min":4.0359999999999996},"last":0.84099999999999997}]},{"osd":4,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.84399999999999997,"15min":0.91600000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":4.4589999999999996},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.81599999999999995,"15min":0.871},"min":{"1min":0.502,"5min":0.48399999999999999,"15min":0.41199999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":2.6030000000000002},"last":1.0589999999999999}]},{"osd":5,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.89300000000000002,"15min":0.97299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.361,"5min":1.415,"15min":3.9790000000000001},"last":1.139},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.90300000000000002,"15min":1.0189999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":7.2619999999999996},"last":1.1140000000000001}]},{"osd":6,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.85499999999999998,"15min":0.93899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.371},"max":{"1min":1.26,"5min":1.2729999999999999,"15min":2.573},"last":1.157},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.95199999999999996,"15min":1.0309999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.41599999999999998},"max":{"1min":1.4370000000000001,"5min":1.5289999999999999,"15min":4.008},"last":0.997}]},{"osd":7,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93700000000000006,"15min":1.0269999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.6429999999999998,"5min":3.6429999999999998,"15min":4.4290000000000003},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.94399999999999995,"15min":1.0009999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.40200000000000002},"max":{"1min":3.7290000000000001,"5min":3.7290000000000001,"15min":3.7290000000000001},"last":1.016}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-02T13:04:10.668 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-02T13:04:10.668 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-02T13:04:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.783+0000 7f4c0a33d640 1 Processor -- start 2024-02-02T13:04:10.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.783+0000 7f4c0a33d640 1 -- start start 2024-02-02T13:04:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.783+0000 7f4c0a33d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4c040b8020 0x7f4c04147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.783+0000 7f4c0a33d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4c04070980 0x7f4c041481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.783+0000 7f4c0a33d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c04071550 con 0x7f4c040bc340 2024-02-02T13:04:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.783+0000 7f4c0a33d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c04141d00 con 0x7f4c040b8020 2024-02-02T13:04:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.783+0000 7f4c0a33d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c04071810 con 0x7f4c04070980 2024-02-02T13:04:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.783+0000 7f4bfbfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4c040b8020 0x7f4c04147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.783+0000 7f4c03fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f4c040bc340 0x7f4c041415f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:41258/0 (socket says 172.21.15.161:41258) 2024-02-02T13:04:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.783+0000 7f4c03fff640 1 -- 172.21.15.161:0/135847898 learned_addr learned my addr 172.21.15.161:0/135847898 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:04:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.783+0000 7f4c088da640 1 --2- 172.21.15.161:0/135847898 >> v2:172.21.15.162:3300/0 conn(0x7f4c04070980 0x7f4c041481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.783+0000 7f4bfbfff640 1 -- 172.21.15.161:0/135847898 >> v2:172.21.15.162:3300/0 conn(0x7f4c04070980 msgr2=0x7f4c041481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.783+0000 7f4bfbfff640 1 --2- 172.21.15.161:0/135847898 >> v2:172.21.15.162:3300/0 conn(0x7f4c04070980 0x7f4c041481a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.783+0000 7f4bfbfff640 1 -- 172.21.15.161:0/135847898 >> v1:172.21.15.161:6789/0 conn(0x7f4c040bc340 legacy=0x7f4c041415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.783+0000 7f4bfbfff640 1 -- 172.21.15.161:0/135847898 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c040bc720 con 0x7f4c040b8020 2024-02-02T13:04:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.783+0000 7f4c037fe640 1 -- 172.21.15.161:0/135847898 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614767548 0 0) 0x7f4c04071550 con 0x7f4c040bc340 2024-02-02T13:04:10.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.783+0000 7f4bfbfff640 1 --2- 172.21.15.161:0/135847898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c040b8020 0x7f4c04147c60 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f4c04070590 tx=0x7f4bf401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c92f629d673fb49 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:10.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.783+0000 7f4c037fe640 1 -- 172.21.15.161:0/135847898 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf40ab600 con 0x7f4c040b8020 2024-02-02T13:04:10.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.783+0000 7f4c037fe640 1 -- 172.21.15.161:0/135847898 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf40a7050 con 0x7f4c040b8020 2024-02-02T13:04:10.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c037fe640 1 -- 172.21.15.161:0/135847898 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf40ab980 con 0x7f4c040b8020 2024-02-02T13:04:10.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c0a33d640 1 -- 172.21.15.161:0/135847898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c040b8020 msgr2=0x7f4c04147c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:10.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c0a33d640 1 --2- 172.21.15.161:0/135847898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c040b8020 0x7f4c04147c60 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f4c04070590 tx=0x7f4bf401c3d0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c0a33d640 1 -- 172.21.15.161:0/135847898 shutdown_connections 2024-02-02T13:04:10.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c0a33d640 1 --2- 172.21.15.161:0/135847898 >> v2:172.21.15.162:3300/0 conn(0x7f4c04070980 0x7f4c041481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c0a33d640 1 --2- 172.21.15.161:0/135847898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c040b8020 0x7f4c04147c60 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c0a33d640 1 -- 172.21.15.161:0/135847898 >> 172.21.15.161:0/135847898 conn(0x7f4c04069ef0 msgr2=0x7f4c0406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:10.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c0a33d640 1 -- 172.21.15.161:0/135847898 shutdown_connections 2024-02-02T13:04:10.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c0a33d640 1 -- 172.21.15.161:0/135847898 wait complete. 2024-02-02T13:04:10.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c0a33d640 1 Processor -- start 2024-02-02T13:04:10.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c0a33d640 1 -- start start 2024-02-02T13:04:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c0a33d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c04070980 0x7f4c040b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c0a33d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c040b8020 0x7f4c041e2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c0a33d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c040bc340 0x7f4c040bb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c0a33d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c040bb5d0 con 0x7f4c040bc340 2024-02-02T13:04:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c0a33d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c040b4990 con 0x7f4c04070980 2024-02-02T13:04:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c0a33d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0413b110 con 0x7f4c040b8020 2024-02-02T13:04:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c088da640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c040bc340 0x7f4c040bb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c088da640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c040bc340 0x7f4c040bb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46688/0 (socket says 172.21.15.161:46688) 2024-02-02T13:04:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c088da640 1 -- 172.21.15.161:0/2585948440 learned_addr learned my addr 172.21.15.161:0/2585948440 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c03fff640 1 --2- 172.21.15.161:0/2585948440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c04070980 0x7f4c040b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:10.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4bfbfff640 1 --2- 172.21.15.161:0/2585948440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c040b8020 0x7f4c041e2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:10.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c088da640 1 -- 172.21.15.161:0/2585948440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c040b8020 msgr2=0x7f4c041e2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:10.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c088da640 1 --2- 172.21.15.161:0/2585948440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c040b8020 0x7f4c041e2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c088da640 1 -- 172.21.15.161:0/2585948440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c04070980 msgr2=0x7f4c040b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:10.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c088da640 1 --2- 172.21.15.161:0/2585948440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c04070980 0x7f4c040b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c088da640 1 -- 172.21.15.161:0/2585948440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf4009420 con 0x7f4c040bc340 2024-02-02T13:04:10.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c03fff640 1 --2- 172.21.15.161:0/2585948440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c04070980 0x7f4c040b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:10.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c088da640 1 --2- 172.21.15.161:0/2585948440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c040bc340 0x7f4c040bb090 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc00cda0 tx=0x7f4bfc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:10.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c017fa640 1 -- 172.21.15.161:0/2585948440 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc003ba0 con 0x7f4c040bc340 2024-02-02T13:04:10.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c017fa640 1 -- 172.21.15.161:0/2585948440 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc003d00 con 0x7f4c040bc340 2024-02-02T13:04:10.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c0a33d640 1 -- 172.21.15.161:0/2585948440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c040b4340 con 0x7f4c040bc340 2024-02-02T13:04:10.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c017fa640 1 -- 172.21.15.161:0/2585948440 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc004240 con 0x7f4c040bc340 2024-02-02T13:04:10.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c0a33d640 1 -- 172.21.15.161:0/2585948440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c04141470 con 0x7f4c040bc340 2024-02-02T13:04:10.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.787+0000 7f4c0a33d640 1 -- 172.21.15.161:0/2585948440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0404e000 con 0x7f4c040bc340 2024-02-02T13:04:10.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.791+0000 7f4c017fa640 1 -- 172.21.15.161:0/2585948440 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4bfc0043a0 con 0x7f4c040bc340 2024-02-02T13:04:10.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.791+0000 7f4c017fa640 1 --2- 172.21.15.161:0/2585948440 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4be4065a90 0x7f4be4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:10.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.791+0000 7f4c03fff640 1 --2- 172.21.15.161:0/2585948440 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4be4065a90 0x7f4be4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:10.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.791+0000 7f4c017fa640 1 -- 172.21.15.161:0/2585948440 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4bfc012070 con 0x7f4c040bc340 2024-02-02T13:04:10.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.791+0000 7f4c03fff640 1 --2- 172.21.15.161:0/2585948440 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4be4065a90 0x7f4be4067f50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4bec007fd0 tx=0x7f4bec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:10.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.795+0000 7f4c017fa640 1 -- 172.21.15.161:0/2585948440 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4bfc051540 con 0x7f4c040bc340 2024-02-02T13:04:10.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.935+0000 7f4c0a33d640 1 -- 172.21.15.161:0/2585948440 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4c0413fb30 con 0x7f4be4065a90 2024-02-02T13:04:10.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.935+0000 7f4c017fa640 1 -- 172.21.15.161:0/2585948440 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49636 (secure 0 0 0) 0x7f4c0413fb30 con 0x7f4be4065a90 2024-02-02T13:04:10.941 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T13:04:10.942 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-02-02T13:04:10.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.939+0000 7f4c0a33d640 1 -- 172.21.15.161:0/2585948440 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4be4065a90 msgr2=0x7f4be4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:10.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.939+0000 7f4c0a33d640 1 --2- 172.21.15.161:0/2585948440 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4be4065a90 0x7f4be4067f50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4bec007fd0 tx=0x7f4bec009040 comp rx=0 tx=0).stop 2024-02-02T13:04:10.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.939+0000 7f4c0a33d640 1 -- 172.21.15.161:0/2585948440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c040bc340 msgr2=0x7f4c040bb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:10.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.939+0000 7f4c0a33d640 1 --2- 172.21.15.161:0/2585948440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c040bc340 0x7f4c040bb090 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc00cda0 tx=0x7f4bfc00a660 comp rx=0 tx=0).stop 2024-02-02T13:04:10.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.939+0000 7f4c0a33d640 1 -- 172.21.15.161:0/2585948440 shutdown_connections 2024-02-02T13:04:10.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.939+0000 7f4c0a33d640 1 --2- 172.21.15.161:0/2585948440 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4be4065a90 0x7f4be4067f50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.939+0000 7f4c0a33d640 1 --2- 172.21.15.161:0/2585948440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c040bc340 0x7f4c040bb090 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.939+0000 7f4c0a33d640 1 --2- 172.21.15.161:0/2585948440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c040b8020 0x7f4c041e2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.939+0000 7f4c0a33d640 1 --2- 172.21.15.161:0/2585948440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c04070980 0x7f4c040b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:10.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.939+0000 7f4c0a33d640 1 -- 172.21.15.161:0/2585948440 >> 172.21.15.161:0/2585948440 conn(0x7f4c04069ef0 msgr2=0x7f4c0406eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:10.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.939+0000 7f4c0a33d640 1 -- 172.21.15.161:0/2585948440 shutdown_connections 2024-02-02T13:04:10.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:10.939+0000 7f4c0a33d640 1 -- 172.21.15.161:0/2585948440 wait complete. 2024-02-02T13:04:10.958 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":2291,"stamp":"2024-02-02T13:04:09.754224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10891568,"kb_used_data":1475664,"kb_used_omap":13,"kb_used_meta":9415794,"kb_avail":744083152,"statfs":{"total":773094113280,"available":761941147648,"internally_reserved":0,"allocated":1511079936,"data_stored":1509249090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":9641773144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-753489098,"num_objects":-1458,"num_object_clones":0,"num_object_copies":-2916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1458,"num_whiteouts":0,"num_read":-57533,"num_read_kb":-53488764,"num_write":-1473612,"num_write_kb":-59671884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.517695"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":209,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-02T13:03:00.900627+0000","last_change":"2024-02-02T11:48:41.563754+0000","last_active":"2024-02-02T13:03:00.900627+0000","last_peered":"2024-02-02T13:03:00.900627+0000","last_clean":"2024-02-02T13:03:00.900627+0000","last_became_active":"2024-02-02T11:48:41.562629+0000","last_became_peered":"2024-02-02T11:48:41.562629+0000","last_unstale":"2024-02-02T13:03:00.900627+0000","last_undegraded":"2024-02-02T13:03:00.900627+0000","last_fullsized":"2024-02-02T13:03:00.900627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_clean_scrub_stamp":"2024-02-02T11:48:40.536978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:22:02.923582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575758,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1595608,"kb_used_data":174220,"kb_used_omap":1,"kb_used_meta":1421374,"kb_avail":92776232,"statfs":{"total":96636764160,"available":95002861568,"internally_reserved":0,"allocated":178401280,"data_stored":178172840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1455487243},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71199999999999997,"15min":0.86599999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.27900000000000003},"max":{"1min":1.006,"5min":1.1399999999999999,"15min":20.102},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.73399999999999999,"15min":0.91200000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.24299999999999999},"max":{"1min":1.109,"5min":1.169,"15min":26.815999999999999},"last":0.85399999999999998}]},{"osd":1,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":0.85499999999999998,"15min":0.94199999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.26600000000000001},"max":{"1min":3.5990000000000002,"5min":3.5990000000000002,"15min":20.135000000000002},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.82799999999999996,"15min":0.95599999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.26600000000000001},"max":{"1min":1.1619999999999999,"5min":1.4330000000000001,"15min":20.567},"last":0.99099999999999999}]},{"osd":2,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76500000000000001,"15min":0.96299999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.33000000000000002},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":21.614999999999998},"last":1.03},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.871,"15min":0.97399999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.375},"max":{"1min":1.093,"5min":1.3,"15min":26.887},"last":1.056}]},{"osd":3,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.85299999999999998,"15min":1.125},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.1200000000000001,"5min":1.2330000000000001,"15min":56.085999999999999},"last":1.085},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.94299999999999995,"15min":1.0669999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.314},"max":{"1min":1.2669999999999999,"5min":1.3939999999999999,"15min":26.713999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.98899999999999999,"15min":1.02},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.249},"max":{"1min":1.1080000000000001,"5min":1.5589999999999999,"15min":22.013999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.99199999999999999,"15min":1.0449999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.28499999999999998},"max":{"1min":1.105,"5min":1.728,"15min":18.449000000000002},"last":0.92100000000000004}]},{"osd":5,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.071,"15min":1.1559999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.315},"max":{"1min":1.3340000000000001,"5min":1.8180000000000001,"15min":20.161000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0960000000000001,"15min":1.1339999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.29199999999999998},"max":{"1min":1.2210000000000001,"5min":1.7789999999999999,"15min":20.526},"last":1.246}]},{"osd":6,"last update":"Fri Feb 2 13:03:08 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.139,"15min":1.2969999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.33300000000000002},"max":{"1min":1.3109999999999999,"5min":1.6339999999999999,"15min":30.931999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.091,"15min":1.175},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.313},"max":{"1min":1.3939999999999999,"5min":1.587,"15min":19.991},"last":1.171}]}]},{"osd":6,"up_from":13,"seq":55834575757,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":999852,"kb_used_data":138016,"kb_used_omap":1,"kb_used_meta":861822,"kb_avail":93371988,"statfs":{"total":96636764160,"available":95612915712,"internally_reserved":0,"allocated":141328384,"data_stored":141097231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":882505995},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.70799999999999996,"15min":0.73299999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27000000000000002},"max":{"1min":1.2130000000000001,"5min":1.238,"15min":3.9910000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77500000000000002,"15min":0.79300000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":3.548},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.79700000000000004,"15min":0.82199999999999995},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":5.383,"5min":5.383,"15min":7.3819999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.79400000000000004,"15min":0.85399999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":1.093,"5min":1.4199999999999999,"15min":8.9719999999999995},"last":0.88}]},{"osd":2,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79600000000000004,"15min":0.89800000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":25.451000000000001},"last":1.121},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.88,"15min":1.0049999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.32700000000000001},"max":{"1min":5.4500000000000002,"5min":5.4500000000000002,"15min":25.044},"last":0.82299999999999995}]},{"osd":3,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":0.99299999999999999,"15min":1.139},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":8.4290000000000003,"5min":8.4290000000000003,"15min":21.263000000000002},"last":0.747},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.96099999999999997,"15min":1.1140000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.371},"max":{"1min":1.3959999999999999,"5min":1.5189999999999999,"15min":21.361999999999998},"last":0.996}]},{"osd":4,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":1.034,"15min":0.996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26600000000000001},"max":{"1min":1.5669999999999999,"5min":1.579,"15min":3.7480000000000002},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.0840000000000001,"15min":1.0509999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":5.4219999999999997,"5min":5.4219999999999997,"15min":7.548},"last":0.93500000000000005}]},{"osd":5,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.0409999999999999,"15min":1.0740000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.253},"max":{"1min":1.623,"5min":1.623,"15min":15.833},"last":1.181},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1399999999999999,"15min":1.2070000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.312},"max":{"1min":5.8029999999999999,"5min":5.8029999999999999,"15min":14.234},"last":1.0900000000000001}]},{"osd":7,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.1100000000000001,"15min":1.143},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":13.936},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.996,"5min":1.1080000000000001,"15min":1.1319999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.32400000000000001},"max":{"1min":1.542,"5min":1.542,"15min":13.904999999999999},"last":1.2290000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575756,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1370060,"kb_used_data":205376,"kb_used_omap":1,"kb_used_meta":1164670,"kb_avail":93001780,"statfs":{"total":96636764160,"available":95233822720,"internally_reserved":0,"allocated":210305024,"data_stored":210077399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1192622347},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.753,"15min":0.76300000000000001},"min":{"1min":0.40600000000000003,"5min":0.248,"15min":0.23300000000000001},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.804},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.84399999999999997,"15min":0.84899999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.40500000000000003},"max":{"1min":1.5129999999999999,"5min":3.492,"15min":4.2759999999999998},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.98699999999999999,"15min":0.89200000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.308},"max":{"1min":1.1899999999999999,"5min":18.481999999999999,"15min":18.481999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.80000000000000004,"15min":0.83599999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.26500000000000001},"max":{"1min":1.2310000000000001,"5min":1.252,"15min":4.8380000000000001},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.89300000000000002,"15min":0.89600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.41599999999999998},"max":{"1min":1.214,"5min":4.1280000000000001,"15min":4.3090000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90000000000000002,"15min":0.89400000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.369,"5min":4.1820000000000004,"15min":4.1820000000000004},"last":0.78500000000000003}]},{"osd":3,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.032,"15min":0.999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.48,"5min":8.6809999999999992,"15min":8.6809999999999992},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":1.0229999999999999,"15min":0.98799999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32300000000000001},"max":{"1min":1.304,"5min":5.2430000000000003,"15min":5.2430000000000003},"last":0.85999999999999999}]},{"osd":4,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.96199999999999997,"15min":0.96299999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.415,"5min":1.415,"15min":3.4500000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.0900000000000001,"15min":1.089},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.2989999999999999,"5min":3.5960000000000001,"15min":4.2119999999999997},"last":1.085}]},{"osd":6,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.071,"15min":1.0589999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.253},"max":{"1min":1.367,"5min":1.5880000000000001,"15min":3.5339999999999998},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.0760000000000001,"15min":1.0649999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.33300000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.488},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3640000000000001,"5min":3.5670000000000002,"15min":4.25},"last":1.196},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.161,"15min":1.153},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.4179999999999999,"5min":1.6830000000000001,"15min":3.6589999999999998},"last":1.1719999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575756,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1620192,"kb_used_data":207700,"kb_used_omap":1,"kb_used_meta":1412478,"kb_avail":92751648,"statfs":{"total":96636764160,"available":94977687552,"internally_reserved":0,"allocated":212684800,"data_stored":212453135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1446377739},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.72899999999999998,"15min":0.871},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.97399999999999998,"5min":1.1259999999999999,"15min":9.5009999999999994},"last":1.194},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.73299999999999998,"15min":0.82699999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27600000000000002},"max":{"1min":0.92400000000000004,"5min":1.121,"15min":7.2229999999999999},"last":0.77900000000000003}]},{"osd":1,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.79200000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.25700000000000001},"max":{"1min":1.0900000000000001,"5min":1.2509999999999999,"15min":3.1480000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82399999999999995,"15min":0.95499999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.26500000000000001},"max":{"1min":1.109,"5min":1.222,"15min":8.9450000000000003},"last":0.96499999999999997}]},{"osd":2,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.875,"15min":0.92200000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.307},"max":{"1min":3.754,"5min":3.754,"15min":9.0619999999999994},"last":1.095},{"interface":"front","average":{"1min":0.875,"5min":0.86599999999999999,"15min":0.998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.372},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":11.909000000000001},"last":1.125}]},{"osd":3,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86199999999999999,"15min":0.90400000000000003},"min":{"1min":0.54100000000000004,"5min":0.47999999999999998,"15min":0.33600000000000002},"max":{"1min":1.1759999999999999,"5min":1.2909999999999999,"15min":4.093},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.93300000000000005,"15min":0.97399999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4490000000000001,"5min":1.4930000000000001,"15min":9.0250000000000004},"last":1.2170000000000001}]},{"osd":5,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.98299999999999998,"15min":1.036},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.27900000000000003},"max":{"1min":1.2609999999999999,"5min":1.401,"15min":9.5329999999999995},"last":1.248},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0189999999999999,"15min":0.98599999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.32600000000000001},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":3.2650000000000001},"last":1.056}]},{"osd":6,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0669999999999999,"15min":1.0629999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.30599999999999999},"max":{"1min":1.526,"5min":1.649,"15min":12.382999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.103,"15min":1.1639999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.32000000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":12.513999999999999},"last":1.3080000000000001}]},{"osd":7,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0800000000000001,"15min":1.0609999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.36499999999999999},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":3.2010000000000001},"last":1.165},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.127,"15min":1.1299999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.33800000000000002},"max":{"1min":1.4910000000000001,"5min":1.7350000000000001,"15min":9.1199999999999992},"last":1.2809999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575757,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1654828,"kb_used_data":207008,"kb_used_omap":1,"kb_used_meta":1447806,"kb_avail":92717012,"statfs":{"total":96636764160,"available":94942220288,"internally_reserved":0,"allocated":211976192,"data_stored":211743716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1482553611},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.505,"15min":0.59299999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.218},"max":{"1min":0.873,"5min":0.88700000000000001,"15min":6.1349999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52700000000000002,"15min":0.65300000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":7.6520000000000001},"last":0.89900000000000002}]},{"osd":1,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.69599999999999995},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.223},"max":{"1min":1.002,"5min":1.002,"15min":17.678000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56499999999999995,"15min":0.64200000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.167},"last":0.96099999999999997}]},{"osd":2,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65400000000000003,"15min":0.77700000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.143,"5min":1.143,"15min":7.6100000000000003},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.746,"15min":0.89800000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":7.6289999999999996},"last":1.1200000000000001}]},{"osd":4,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.84699999999999998,"15min":0.91800000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.309},"max":{"1min":1.766,"5min":1.766,"15min":5.96},"last":1.149},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.90100000000000002,"15min":1.044},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.438},"max":{"1min":1.411,"5min":1.411,"15min":18.291},"last":1.232}]},{"osd":5,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.88900000000000001,"15min":1.0269999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.32700000000000001},"max":{"1min":1.2509999999999999,"5min":1.343,"15min":9.2940000000000005},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89500000000000002,"15min":0.96599999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.31900000000000001},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":5.9199999999999999},"last":1.387}]},{"osd":6,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.95199999999999996,"15min":1.2490000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.32800000000000001},"max":{"1min":1.341,"5min":1.3919999999999999,"15min":55.201999999999998},"last":1.266},{"interface":"front","average":{"1min":0.876,"5min":0.97899999999999998,"15min":1.329},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":57.195},"last":1.7549999999999999}]},{"osd":7,"last update":"Fri Feb 2 13:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.95299999999999996,"15min":1.1120000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.482,"5min":1.482,"15min":8.0370000000000008},"last":1.8620000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.91800000000000004,"15min":1.03},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":5.9829999999999997},"last":1.54}]}]},{"osd":2,"up_from":13,"seq":55834575756,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1132612,"kb_used_data":154168,"kb_used_omap":1,"kb_used_meta":978430,"kb_avail":93239228,"statfs":{"total":96636764160,"available":95476969472,"internally_reserved":0,"allocated":157868032,"data_stored":157643901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1001912587},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.53600000000000003,"15min":0.68100000000000005},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.215},"max":{"1min":0.77200000000000002,"5min":0.86099999999999999,"15min":12.688000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.61299999999999999,"15min":0.73699999999999999},"min":{"1min":0.28199999999999997,"5min":0.24099999999999999,"15min":0.23499999999999999},"max":{"1min":4.1520000000000001,"5min":4.1520000000000001,"15min":16.814},"last":0.76100000000000001}]},{"osd":1,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56799999999999995,"15min":0.67700000000000005},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.216},"max":{"1min":0.83999999999999997,"5min":1.0820000000000001,"15min":3.234},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.68899999999999995,"15min":0.90500000000000003},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":5.4660000000000002,"5min":5.4660000000000002,"15min":62.295999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54200000000000004,"15min":0.68899999999999995},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.88700000000000001,"5min":1.1459999999999999,"15min":11.23},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.68300000000000005,"15min":0.82299999999999995},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.04,"5min":1.04,"15min":10.968},"last":1.014}]},{"osd":4,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.88100000000000001,"15min":1.0489999999999999},"min":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.33500000000000002},"max":{"1min":3.7490000000000001,"5min":3.7490000000000001,"15min":18.731999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.258,"5min":0.98199999999999998,"15min":1.028},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.33700000000000002},"max":{"1min":5.9589999999999996,"5min":5.9589999999999996,"15min":10.101000000000001},"last":0.98999999999999999}]},{"osd":5,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":0.94299999999999995,"15min":1.1140000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":4.218,"5min":4.218,"15min":22.279},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.84799999999999998,"15min":0.95599999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.36199999999999999},"max":{"1min":1.171,"5min":1.4059999999999999,"15min":5.8479999999999999},"last":1.044}]},{"osd":6,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.86799999999999999,"15min":1.0429999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0820000000000001,"5min":1.474,"15min":20.545000000000002},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.96199999999999997,"15min":1.1519999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.6749999999999998,"5min":3.6749999999999998,"15min":32.533000000000001},"last":1.242}]},{"osd":7,"last update":"Fri Feb 2 13:03:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.99399999999999999,"15min":1.095},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.437},"max":{"1min":4.242,"5min":4.242,"15min":5.7220000000000004},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.91800000000000004,"15min":1.1040000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.433},"max":{"1min":1.8,"5min":1.8,"15min":20.5},"last":1.137}]}]},{"osd":1,"up_from":13,"seq":55834575757,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1562732,"kb_used_data":267360,"kb_used_omap":1,"kb_used_meta":1295358,"kb_avail":92809108,"statfs":{"total":96636764160,"available":95036526592,"internally_reserved":0,"allocated":273776640,"data_stored":273544941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1326446859},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.73299999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.189},"max":{"1min":1.621,"5min":1.621,"15min":34.694000000000003},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.55500000000000005,"15min":0.68600000000000005},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.217},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":10.916},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51700000000000002,"15min":0.67200000000000004},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":14.744999999999999},"last":0.309},{"interface":"front","average":{"1min":0.629,"5min":0.60599999999999998,"15min":0.83899999999999997},"min":{"1min":0.28899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":38.899000000000001},"last":0.35499999999999998}]},{"osd":3,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65200000000000002,"15min":0.91700000000000004},"min":{"1min":0.35499999999999998,"5min":0.30499999999999999,"15min":0.29099999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":38.932000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.63700000000000001,"15min":0.81499999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.24299999999999999},"max":{"1min":2.621,"5min":2.621,"15min":12.385},"last":0.39800000000000002}]},{"osd":4,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.83599999999999997,"15min":1.2969999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.34499999999999997},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":97.268000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.878,"15min":1.2909999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.317},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":97.442999999999998},"last":0.59499999999999997}]},{"osd":5,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88400000000000001,"15min":1.0089999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.7149999999999999,"5min":2.7149999999999999,"15min":8.9849999999999994},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.85799999999999998,"15min":1.046},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.34699999999999998},"max":{"1min":1.3620000000000001,"5min":1.492,"15min":14.776999999999999},"last":0.60499999999999998}]},{"osd":6,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91500000000000004,"15min":1.3100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":68.975999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93000000000000005,"15min":1.119},"min":{"1min":0.44,"5min":0.44,"15min":0.40899999999999997},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":20.527999999999999},"last":0.80900000000000005}]},{"osd":7,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.92500000000000004,"15min":1.1160000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":12.547000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.89200000000000002,"15min":1.0860000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.38100000000000001},"max":{"1min":1.379,"5min":1.5780000000000001,"15min":14.808},"last":0.70099999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575756,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":955684,"kb_used_data":121816,"kb_used_omap":1,"kb_used_meta":833854,"kb_avail":93416156,"statfs":{"total":96636764160,"available":95658143744,"internally_reserved":0,"allocated":124739584,"data_stored":124515927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":853866763},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.57099999999999995,"15min":0.69299999999999995},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.255},"max":{"1min":0.73199999999999998,"5min":0.88900000000000001,"15min":21.370999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56999999999999995,"15min":0.69499999999999995},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.21099999999999999},"max":{"1min":0.93500000000000005,"5min":1.01,"15min":10.538},"last":0.61899999999999999}]},{"osd":2,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.61699999999999999,"15min":0.77200000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27300000000000002},"max":{"1min":4.2919999999999998,"5min":4.2919999999999998,"15min":21.431000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.145,"5min":0.69299999999999995,"15min":0.78200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.29499999999999998},"max":{"1min":10.978999999999999,"5min":10.978999999999999,"15min":11.412000000000001},"last":0.54700000000000004}]},{"osd":3,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.53900000000000003,"15min":0.63500000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":3.25},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.65000000000000002,"15min":0.752},"min":{"1min":0.316,"5min":0.316,"15min":0.245},"max":{"1min":1.2170000000000001,"5min":1.46,"15min":4.0359999999999996},"last":0.84099999999999997}]},{"osd":4,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.84399999999999997,"15min":0.91600000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":4.4589999999999996},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.81599999999999995,"15min":0.871},"min":{"1min":0.502,"5min":0.48399999999999999,"15min":0.41199999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":2.6030000000000002},"last":1.0589999999999999}]},{"osd":5,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.89300000000000002,"15min":0.97299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.361,"5min":1.415,"15min":3.9790000000000001},"last":1.139},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.90300000000000002,"15min":1.0189999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":7.2619999999999996},"last":1.1140000000000001}]},{"osd":6,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.85499999999999998,"15min":0.93899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.371},"max":{"1min":1.26,"5min":1.2729999999999999,"15min":2.573},"last":1.157},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.95199999999999996,"15min":1.0309999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.41599999999999998},"max":{"1min":1.4370000000000001,"5min":1.5289999999999999,"15min":4.008},"last":0.997}]},{"osd":7,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93700000000000006,"15min":1.0269999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.6429999999999998,"5min":3.6429999999999998,"15min":4.4290000000000003},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.94399999999999995,"15min":1.0009999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.40200000000000002},"max":{"1min":3.7290000000000001,"5min":3.7290000000000001,"15min":3.7290000000000001},"last":1.016}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-02T13:04:10.960 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-02T13:04:11.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.071+0000 7f2b01451640 1 Processor -- start 2024-02-02T13:04:11.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.071+0000 7f2b01451640 1 -- start start 2024-02-02T13:04:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.071+0000 7f2b01451640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2afc0bc340 0x7f2afc1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.071+0000 7f2b01451640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2afc141b30 0x7f2afc147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.071+0000 7f2b01451640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2afc071550 con 0x7f2afc0b8020 2024-02-02T13:04:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.071+0000 7f2b01451640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2afc071810 con 0x7f2afc0bc340 2024-02-02T13:04:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.071+0000 7f2b01451640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc071950 con 0x7f2afc141b30 2024-02-02T13:04:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.071+0000 7f2afaffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2afc0bc340 0x7f2afc1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.071+0000 7f2afaffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2afc0bc340 0x7f2afc1415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46690/0 (socket says 172.21.15.161:46690) 2024-02-02T13:04:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.071+0000 7f2afaffd640 1 -- 172.21.15.161:0/346320963 learned_addr learned my addr 172.21.15.161:0/346320963 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.071+0000 7f2afaffd640 1 -- 172.21.15.161:0/346320963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2afc141b30 msgr2=0x7f2afc147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.071+0000 7f2af27fc640 1 --2- 172.21.15.161:0/346320963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2afc141b30 0x7f2afc147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.071+0000 7f2afaffd640 1 --2- 172.21.15.161:0/346320963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2afc141b30 0x7f2afc147c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.071+0000 7f2afaffd640 1 -- 172.21.15.161:0/346320963 >> v1:172.21.15.162:6789/0 conn(0x7f2afc0b8020 legacy=0x7f2afc14abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:11.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.071+0000 7f2afaffd640 1 -- 172.21.15.161:0/346320963 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc0bc720 con 0x7f2afc0bc340 2024-02-02T13:04:11.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.071+0000 7f2afaffd640 1 --2- 172.21.15.161:0/346320963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2afc0bc340 0x7f2afc1415f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009870 tx=0x7f2aec01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c333858fce003d server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:11.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.071+0000 7f2afa7fc640 1 -- 172.21.15.161:0/346320963 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec0ab600 con 0x7f2afc0bc340 2024-02-02T13:04:11.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.071+0000 7f2afa7fc640 1 -- 172.21.15.161:0/346320963 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec0a7050 con 0x7f2afc0bc340 2024-02-02T13:04:11.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.071+0000 7f2afa7fc640 1 -- 172.21.15.161:0/346320963 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec0ab980 con 0x7f2afc0bc340 2024-02-02T13:04:11.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2b01451640 1 -- 172.21.15.161:0/346320963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2afc0bc340 msgr2=0x7f2afc1415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:11.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2b01451640 1 --2- 172.21.15.161:0/346320963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2afc0bc340 0x7f2afc1415f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009870 tx=0x7f2aec01c470 comp rx=0 tx=0).stop 2024-02-02T13:04:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2b01451640 1 -- 172.21.15.161:0/346320963 shutdown_connections 2024-02-02T13:04:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2b01451640 1 --2- 172.21.15.161:0/346320963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2afc141b30 0x7f2afc147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2b01451640 1 --2- 172.21.15.161:0/346320963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2afc0bc340 0x7f2afc1415f0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2b01451640 1 -- 172.21.15.161:0/346320963 >> 172.21.15.161:0/346320963 conn(0x7f2afc069ef0 msgr2=0x7f2afc06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2b01451640 1 -- 172.21.15.161:0/346320963 shutdown_connections 2024-02-02T13:04:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2b01451640 1 -- 172.21.15.161:0/346320963 wait complete. 2024-02-02T13:04:11.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2b01451640 1 Processor -- start 2024-02-02T13:04:11.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2b01451640 1 -- start start 2024-02-02T13:04:11.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2b01451640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2afc0b8020 0x7f2afc0b9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:11.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2b01451640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2afc0bc340 0x7f2afc0baaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:11.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2b01451640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2afc141b30 0x7f2afc13d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:11.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2b01451640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0bafe0 con 0x7f2afc141b30 2024-02-02T13:04:11.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2b01451640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0bb610 con 0x7f2afc0b8020 2024-02-02T13:04:11.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2b01451640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc139390 con 0x7f2afc0bc340 2024-02-02T13:04:11.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2afb7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2afc141b30 0x7f2afc13d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:11.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2afb7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2afc141b30 0x7f2afc13d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46694/0 (socket says 172.21.15.161:46694) 2024-02-02T13:04:11.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2afb7fe640 1 -- 172.21.15.161:0/2212039772 learned_addr learned my addr 172.21.15.161:0/2212039772 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:11.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2afaffd640 1 --2- 172.21.15.161:0/2212039772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2afc0b8020 0x7f2afc0b9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:11.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2af27fc640 1 --2- 172.21.15.161:0/2212039772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2afc0bc340 0x7f2afc0baaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:11.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2afb7fe640 1 -- 172.21.15.161:0/2212039772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2afc0bc340 msgr2=0x7f2afc0baaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:11.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2afb7fe640 1 --2- 172.21.15.161:0/2212039772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2afc0bc340 0x7f2afc0baaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:11.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2afb7fe640 1 -- 172.21.15.161:0/2212039772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2afc0b8020 msgr2=0x7f2afc0b9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:11.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2afb7fe640 1 --2- 172.21.15.161:0/2212039772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2afc0b8020 0x7f2afc0b9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:11.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2afb7fe640 1 -- 172.21.15.161:0/2212039772 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec0094d0 con 0x7f2afc141b30 2024-02-02T13:04:11.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2afb7fe640 1 --2- 172.21.15.161:0/2212039772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2afc141b30 0x7f2afc13d740 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f2af400c780 tx=0x7f2af400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:11.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2af3fff640 1 -- 172.21.15.161:0/2212039772 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af400aa50 con 0x7f2afc141b30 2024-02-02T13:04:11.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2af3fff640 1 -- 172.21.15.161:0/2212039772 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af400abf0 con 0x7f2afc141b30 2024-02-02T13:04:11.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2b01451640 1 -- 172.21.15.161:0/2212039772 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2afc13b010 con 0x7f2afc141b30 2024-02-02T13:04:11.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2af3fff640 1 -- 172.21.15.161:0/2212039772 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af400ce30 con 0x7f2afc141b30 2024-02-02T13:04:11.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2b01451640 1 -- 172.21.15.161:0/2212039772 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2afc0b5f10 con 0x7f2afc141b30 2024-02-02T13:04:11.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.075+0000 7f2b01451640 1 -- 172.21.15.161:0/2212039772 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2afc0b6130 con 0x7f2afc141b30 2024-02-02T13:04:11.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.079+0000 7f2af3fff640 1 -- 172.21.15.161:0/2212039772 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2af4012420 con 0x7f2afc141b30 2024-02-02T13:04:11.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.079+0000 7f2af3fff640 1 --2- 172.21.15.161:0/2212039772 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ae0065a90 0x7f2ae0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:11.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.079+0000 7f2af3fff640 1 -- 172.21.15.161:0/2212039772 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2af40832e0 con 0x7f2afc141b30 2024-02-02T13:04:11.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.079+0000 7f2afaffd640 1 --2- 172.21.15.161:0/2212039772 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ae0065a90 0x7f2ae0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:11.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.079+0000 7f2afaffd640 1 --2- 172.21.15.161:0/2212039772 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ae0065a90 0x7f2ae0067f50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0ad000 tx=0x7f2aec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:11.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.083+0000 7f2af3fff640 1 -- 172.21.15.161:0/2212039772 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2af4051030 con 0x7f2afc141b30 2024-02-02T13:04:11.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.227+0000 7f2b01451640 1 -- 172.21.15.161:0/2212039772 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2afc147f80 con 0x7f2afc141b30 2024-02-02T13:04:11.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.227+0000 7f2af3fff640 1 -- 172.21.15.161:0/2212039772 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+12568 (secure 0 0 0) 0x7f2af4003eb0 con 0x7f2afc141b30 2024-02-02T13:04:11.231 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T13:04:11.232 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":34,"fsid":"6072f293-dbe3-404b-82f1-eb0e17d96787","created":"2024-02-02T11:48:27.686590+0000","modified":"2024-02-02T13:04:06.404873+0000","last_up_change":"2024-02-02T11:48:39.533380+0000","last_in_change":"2024-02-02T11:48:29.921989+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-02T11:48:40.330782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"073e0356-beb2-40f5-95b1-bc66245b728e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":27681},{"type":"v1","addr":"172.21.15.161:6809","nonce":27681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":27681},{"type":"v1","addr":"172.21.15.161:6811","nonce":27681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":27681},{"type":"v1","addr":"172.21.15.161:6815","nonce":27681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":27681},{"type":"v1","addr":"172.21.15.161:6813","nonce":27681}]},"public_addr":"172.21.15.161:6809/27681","cluster_addr":"172.21.15.161:6811/27681","heartbeat_back_addr":"172.21.15.161:6815/27681","heartbeat_front_addr":"172.21.15.161:6813/27681","state":["exists","up"]},{"osd":1,"uuid":"847c3fa7-2db2-484c-b7f5-e0fceeb194fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":27682},{"type":"v1","addr":"172.21.15.161:6801","nonce":27682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":27682},{"type":"v1","addr":"172.21.15.161:6803","nonce":27682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":27682},{"type":"v1","addr":"172.21.15.161:6807","nonce":27682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":27682},{"type":"v1","addr":"172.21.15.161:6805","nonce":27682}]},"public_addr":"172.21.15.161:6801/27682","cluster_addr":"172.21.15.161:6803/27682","heartbeat_back_addr":"172.21.15.161:6807/27682","heartbeat_front_addr":"172.21.15.161:6805/27682","state":["exists","up"]},{"osd":2,"uuid":"d0ce696a-711f-4e5c-a5c0-d78822b8f46e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":27683},{"type":"v1","addr":"172.21.15.161:6817","nonce":27683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":27683},{"type":"v1","addr":"172.21.15.161:6819","nonce":27683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":27683},{"type":"v1","addr":"172.21.15.161:6823","nonce":27683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":27683},{"type":"v1","addr":"172.21.15.161:6821","nonce":27683}]},"public_addr":"172.21.15.161:6817/27683","cluster_addr":"172.21.15.161:6819/27683","heartbeat_back_addr":"172.21.15.161:6823/27683","heartbeat_front_addr":"172.21.15.161:6821/27683","state":["exists","up"]},{"osd":3,"uuid":"3ea1d08e-1e28-47d1-b218-74439c663087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":27684},{"type":"v1","addr":"172.21.15.161:6825","nonce":27684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":27684},{"type":"v1","addr":"172.21.15.161:6827","nonce":27684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":27684},{"type":"v1","addr":"172.21.15.161:6831","nonce":27684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":27684},{"type":"v1","addr":"172.21.15.161:6829","nonce":27684}]},"public_addr":"172.21.15.161:6825/27684","cluster_addr":"172.21.15.161:6827/27684","heartbeat_back_addr":"172.21.15.161:6831/27684","heartbeat_front_addr":"172.21.15.161:6829/27684","state":["exists","up"]},{"osd":4,"uuid":"4ee8a347-b3a8-4fc4-839d-85cac3becc12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":27912},{"type":"v1","addr":"172.21.15.162:6817","nonce":27912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":27912},{"type":"v1","addr":"172.21.15.162:6819","nonce":27912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":27912},{"type":"v1","addr":"172.21.15.162:6823","nonce":27912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":27912},{"type":"v1","addr":"172.21.15.162:6821","nonce":27912}]},"public_addr":"172.21.15.162:6817/27912","cluster_addr":"172.21.15.162:6819/27912","heartbeat_back_addr":"172.21.15.162:6823/27912","heartbeat_front_addr":"172.21.15.162:6821/27912","state":["exists","up"]},{"osd":5,"uuid":"a5309408-4099-458b-a625-d25fc567c9be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":27913},{"type":"v1","addr":"172.21.15.162:6825","nonce":27913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":27913},{"type":"v1","addr":"172.21.15.162:6827","nonce":27913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":27913},{"type":"v1","addr":"172.21.15.162:6831","nonce":27913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":27913},{"type":"v1","addr":"172.21.15.162:6829","nonce":27913}]},"public_addr":"172.21.15.162:6825/27913","cluster_addr":"172.21.15.162:6827/27913","heartbeat_back_addr":"172.21.15.162:6831/27913","heartbeat_front_addr":"172.21.15.162:6829/27913","state":["exists","up"]},{"osd":6,"uuid":"1e0f58c5-83a1-414e-9698-f3abd6c77545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":27910},{"type":"v1","addr":"172.21.15.162:6801","nonce":27910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":27910},{"type":"v1","addr":"172.21.15.162:6803","nonce":27910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":27910},{"type":"v1","addr":"172.21.15.162:6807","nonce":27910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":27910},{"type":"v1","addr":"172.21.15.162:6805","nonce":27910}]},"public_addr":"172.21.15.162:6801/27910","cluster_addr":"172.21.15.162:6803/27910","heartbeat_back_addr":"172.21.15.162:6807/27910","heartbeat_front_addr":"172.21.15.162:6805/27910","state":["exists","up"]},{"osd":7,"uuid":"cafcd8f5-d580-4eed-9049-631d35259e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":27911},{"type":"v1","addr":"172.21.15.162:6809","nonce":27911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":27911},{"type":"v1","addr":"172.21.15.162:6811","nonce":27911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":27911},{"type":"v1","addr":"172.21.15.162:6815","nonce":27911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":27911},{"type":"v1","addr":"172.21.15.162:6813","nonce":27911}]},"public_addr":"172.21.15.162:6809/27911","cluster_addr":"172.21.15.162:6811/27911","heartbeat_back_addr":"172.21.15.162:6815/27911","heartbeat_front_addr":"172.21.15.162:6813/27911","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.350576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.425326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.473381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.591360+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.493439+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.593012+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.419590+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-02T11:48:35.499237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:6837/1621598548":"2024-02-03T13:04:03.206465+0000","172.21.15.161:6836/1621598548":"2024-02-03T13:04:03.206465+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-02T13:04:11.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.231+0000 7f2b01451640 1 -- 172.21.15.161:0/2212039772 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ae0065a90 msgr2=0x7f2ae0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:11.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.231+0000 7f2b01451640 1 --2- 172.21.15.161:0/2212039772 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ae0065a90 0x7f2ae0067f50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0ad000 tx=0x7f2aec008040 comp rx=0 tx=0).stop 2024-02-02T13:04:11.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.231+0000 7f2b01451640 1 -- 172.21.15.161:0/2212039772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2afc141b30 msgr2=0x7f2afc13d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:11.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.231+0000 7f2b01451640 1 --2- 172.21.15.161:0/2212039772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2afc141b30 0x7f2afc13d740 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f2af400c780 tx=0x7f2af400cc40 comp rx=0 tx=0).stop 2024-02-02T13:04:11.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.231+0000 7f2b01451640 1 -- 172.21.15.161:0/2212039772 shutdown_connections 2024-02-02T13:04:11.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.231+0000 7f2b01451640 1 --2- 172.21.15.161:0/2212039772 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ae0065a90 0x7f2ae0067f50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:11.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.231+0000 7f2b01451640 1 --2- 172.21.15.161:0/2212039772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2afc141b30 0x7f2afc13d740 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:11.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.231+0000 7f2b01451640 1 --2- 172.21.15.161:0/2212039772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2afc0bc340 0x7f2afc0baaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:11.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.231+0000 7f2b01451640 1 --2- 172.21.15.161:0/2212039772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2afc0b8020 0x7f2afc0b9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:11.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.231+0000 7f2b01451640 1 -- 172.21.15.161:0/2212039772 >> 172.21.15.161:0/2212039772 conn(0x7f2afc069ef0 msgr2=0x7f2afc146520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:11.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.231+0000 7f2b01451640 1 -- 172.21.15.161:0/2212039772 shutdown_connections 2024-02-02T13:04:11.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:11.231+0000 7f2b01451640 1 -- 172.21.15.161:0/2212039772 wait complete. 2024-02-02T13:04:12.250 INFO:tasks.ceph:Scrubbing osd.0 2024-02-02T13:04:12.250 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-02-02T13:04:12.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.383+0000 7fca40eb9640 1 Processor -- start 2024-02-02T13:04:12.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.383+0000 7fca40eb9640 1 -- start start 2024-02-02T13:04:12.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.383+0000 7fca40eb9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca3c0b8540 0x7fca3c148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.383+0000 7fca40eb9640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fca3c0b3320 0x7fca3c149450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.383+0000 7fca40eb9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3c148a80 con 0x7fca3c0b8df0 2024-02-02T13:04:12.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.383+0000 7fca40eb9640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3c0b3890 con 0x7fca3c0b3320 2024-02-02T13:04:12.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.383+0000 7fca40eb9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0b3b70 con 0x7fca3c0b8540 2024-02-02T13:04:12.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.383+0000 7fca31d9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca3c0b8540 0x7fca3c148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.383+0000 7fca3ad9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fca3c0b3320 0x7fca3c149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.383+0000 7fca3a59c640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fca3c0b8df0 0x7fca3c142840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.161:52972/0 (socket says 172.21.15.161:52972) 2024-02-02T13:04:12.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.383+0000 7fca3a59c640 1 -- 172.21.15.161:0/615365448 learned_addr learned my addr 172.21.15.161:0/615365448 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:04:12.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.383+0000 7fca39d9b640 1 -- 172.21.15.161:0/615365448 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152482037 0 0) 0x7fca3c148a80 con 0x7fca3c0b8df0 2024-02-02T13:04:12.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.383+0000 7fca39d9b640 1 -- 172.21.15.161:0/615365448 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca28003530 con 0x7fca3c0b8df0 2024-02-02T13:04:12.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.383+0000 7fca31d9b640 1 -- 172.21.15.161:0/615365448 >> v2:172.21.15.162:3300/0 conn(0x7fca3c0b3320 msgr2=0x7fca3c149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:12.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.383+0000 7fca31d9b640 1 --2- 172.21.15.161:0/615365448 >> v2:172.21.15.162:3300/0 conn(0x7fca3c0b3320 0x7fca3c149450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.383+0000 7fca31d9b640 1 -- 172.21.15.161:0/615365448 >> v1:172.21.15.162:6789/0 conn(0x7fca3c0b8df0 legacy=0x7fca3c142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.383+0000 7fca31d9b640 1 -- 172.21.15.161:0/615365448 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3c0b3e50 con 0x7fca3c0b8540 2024-02-02T13:04:12.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.387+0000 7fca31d9b640 1 --2- 172.21.15.161:0/615365448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca3c0b8540 0x7fca3c148f10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fca240097c0 tx=0x7fca2401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14d59cc354f7b209 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:12.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.387+0000 7fca39d9b640 1 -- 172.21.15.161:0/615365448 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca240ab620 con 0x7fca3c0b8540 2024-02-02T13:04:12.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.387+0000 7fca39d9b640 1 -- 172.21.15.161:0/615365448 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca240ab780 con 0x7fca3c0b8540 2024-02-02T13:04:12.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.387+0000 7fca39d9b640 1 -- 172.21.15.161:0/615365448 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca240abb10 con 0x7fca3c0b8540 2024-02-02T13:04:12.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.387+0000 7fca40eb9640 1 -- 172.21.15.161:0/615365448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca3c0b8540 msgr2=0x7fca3c148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.387+0000 7fca40eb9640 1 --2- 172.21.15.161:0/615365448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca3c0b8540 0x7fca3c148f10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fca240097c0 tx=0x7fca2401c480 comp rx=0 tx=0).stop 2024-02-02T13:04:12.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.387+0000 7fca40eb9640 1 -- 172.21.15.161:0/615365448 shutdown_connections 2024-02-02T13:04:12.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.387+0000 7fca40eb9640 1 --2- 172.21.15.161:0/615365448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca3c0b8540 0x7fca3c148f10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.387+0000 7fca40eb9640 1 --2- 172.21.15.161:0/615365448 >> v2:172.21.15.162:3300/0 conn(0x7fca3c0b3320 0x7fca3c149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.387+0000 7fca40eb9640 1 -- 172.21.15.161:0/615365448 >> 172.21.15.161:0/615365448 conn(0x7fca3c06a120 msgr2=0x7fca3c06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:12.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.387+0000 7fca40eb9640 1 -- 172.21.15.161:0/615365448 shutdown_connections 2024-02-02T13:04:12.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.387+0000 7fca40eb9640 1 -- 172.21.15.161:0/615365448 wait complete. 2024-02-02T13:04:12.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca40eb9640 1 Processor -- start 2024-02-02T13:04:12.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca40eb9640 1 -- start start 2024-02-02T13:04:12.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca40eb9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca3c0b3320 0x7fca3c0bc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca40eb9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca3c0b8540 0x7fca3c147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca40eb9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca3c0b8df0 0x7fca3c1e09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca40eb9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0bac60 con 0x7fca3c0b3320 2024-02-02T13:04:12.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca40eb9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c148160 con 0x7fca3c0b8df0 2024-02-02T13:04:12.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca40eb9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c134530 con 0x7fca3c0b8540 2024-02-02T13:04:12.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca31d9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca3c0b8540 0x7fca3c147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca3a59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca3c0b3320 0x7fca3c0bc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca31d9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca3c0b8540 0x7fca3c147c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.161:46914/0 (socket says 172.21.15.161:46914) 2024-02-02T13:04:12.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca31d9b640 1 -- 172.21.15.161:0/3011179022 learned_addr learned my addr 172.21.15.161:0/3011179022 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:12.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca3a59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca3c0b3320 0x7fca3c0bc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46710/0 (socket says 172.21.15.161:46710) 2024-02-02T13:04:12.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca3ad9d640 1 --2- 172.21.15.161:0/3011179022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca3c0b8df0 0x7fca3c1e09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca3a59c640 1 -- 172.21.15.161:0/3011179022 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca3c0b8540 msgr2=0x7fca3c147c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca3a59c640 1 --2- 172.21.15.161:0/3011179022 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca3c0b8540 0x7fca3c147c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca3a59c640 1 -- 172.21.15.161:0/3011179022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca3c0b8df0 msgr2=0x7fca3c1e09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca3a59c640 1 --2- 172.21.15.161:0/3011179022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca3c0b8df0 0x7fca3c1e09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca3a59c640 1 -- 172.21.15.161:0/3011179022 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca24009420 con 0x7fca3c0b3320 2024-02-02T13:04:12.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca3a59c640 1 --2- 172.21.15.161:0/3011179022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca3c0b3320 0x7fca3c0bc900 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fca2c00c390 tx=0x7fca2c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:12.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca337fe640 1 -- 172.21.15.161:0/3011179022 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c005cf0 con 0x7fca3c0b3320 2024-02-02T13:04:12.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca337fe640 1 -- 172.21.15.161:0/3011179022 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c005e50 con 0x7fca3c0b3320 2024-02-02T13:04:12.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca40eb9640 1 -- 172.21.15.161:0/3011179022 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca3c0ba2c0 con 0x7fca3c0b3320 2024-02-02T13:04:12.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca337fe640 1 -- 172.21.15.161:0/3011179022 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c0072d0 con 0x7fca3c0b3320 2024-02-02T13:04:12.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca40eb9640 1 -- 172.21.15.161:0/3011179022 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca3c0ba880 con 0x7fca3c0b3320 2024-02-02T13:04:12.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.391+0000 7fca40eb9640 1 -- 172.21.15.161:0/3011179022 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fca3c1559d0 con 0x7fca3c0b3320 2024-02-02T13:04:12.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.395+0000 7fca337fe640 1 -- 172.21.15.161:0/3011179022 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fca2c007430 con 0x7fca3c0b3320 2024-02-02T13:04:12.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.395+0000 7fca337fe640 1 --2- 172.21.15.161:0/3011179022 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fca1c065a60 0x7fca1c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.395+0000 7fca337fe640 1 -- 172.21.15.161:0/3011179022 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fca2c082ae0 con 0x7fca3c0b3320 2024-02-02T13:04:12.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.395+0000 7fca31d9b640 1 --2- 172.21.15.161:0/3011179022 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fca1c065a60 0x7fca1c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.395+0000 7fca337fe640 1 --2- 172.21.15.161:0/3011179022 >> [v2:172.21.15.161:6808/27681,v1:172.21.15.161:6809/27681] conn(0x7fca1c06b8c0 0x7fca1c06dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.395+0000 7fca337fe640 1 -- 172.21.15.161:0/3011179022 --> [v2:172.21.15.161:6808/27681,v1:172.21.15.161:6809/27681] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca1c06e390 con 0x7fca1c06b8c0 2024-02-02T13:04:12.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.395+0000 7fca337fe640 1 -- 172.21.15.161:0/3011179022 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca2c082f30 con 0x7fca3c0b3320 2024-02-02T13:04:12.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.395+0000 7fca3ad9d640 1 --2- 172.21.15.161:0/3011179022 >> [v2:172.21.15.161:6808/27681,v1:172.21.15.161:6809/27681] conn(0x7fca1c06b8c0 0x7fca1c06dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.395+0000 7fca31d9b640 1 --2- 172.21.15.161:0/3011179022 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fca1c065a60 0x7fca1c067f20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fca240097c0 tx=0x7fca240a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:12.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.395+0000 7fca3ad9d640 1 --2- 172.21.15.161:0/3011179022 >> [v2:172.21.15.161:6808/27681,v1:172.21.15.161:6809/27681] conn(0x7fca1c06b8c0 0x7fca1c06dce0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:12.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.395+0000 7fca337fe640 1 -- 172.21.15.161:0/3011179022 <== osd.0 v2:172.21.15.161:6808/27681 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fca1c06e390 con 0x7fca1c06b8c0 2024-02-02T13:04:12.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.407+0000 7fca40eb9640 1 -- 172.21.15.161:0/3011179022 --> [v2:172.21.15.161:6808/27681,v1:172.21.15.161:6809/27681] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fca3c04e000 con 0x7fca1c06b8c0 2024-02-02T13:04:12.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.407+0000 7fca337fe640 1 -- 172.21.15.161:0/3011179022 <== osd.0 v2:172.21.15.161:6808/27681 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fca3c04e000 con 0x7fca1c06b8c0 2024-02-02T13:04:12.412 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-02-02T13:04:12.413 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-02-02T13:04:12.413 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-02-02T13:04:12.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.407+0000 7fca40eb9640 1 -- 172.21.15.161:0/3011179022 >> [v2:172.21.15.161:6808/27681,v1:172.21.15.161:6809/27681] conn(0x7fca1c06b8c0 msgr2=0x7fca1c06dce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.407+0000 7fca40eb9640 1 --2- 172.21.15.161:0/3011179022 >> [v2:172.21.15.161:6808/27681,v1:172.21.15.161:6809/27681] conn(0x7fca1c06b8c0 0x7fca1c06dce0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.407+0000 7fca40eb9640 1 -- 172.21.15.161:0/3011179022 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fca1c065a60 msgr2=0x7fca1c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.407+0000 7fca40eb9640 1 --2- 172.21.15.161:0/3011179022 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fca1c065a60 0x7fca1c067f20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fca240097c0 tx=0x7fca240a7000 comp rx=0 tx=0).stop 2024-02-02T13:04:12.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.407+0000 7fca40eb9640 1 -- 172.21.15.161:0/3011179022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca3c0b3320 msgr2=0x7fca3c0bc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.407+0000 7fca40eb9640 1 --2- 172.21.15.161:0/3011179022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca3c0b3320 0x7fca3c0bc900 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fca2c00c390 tx=0x7fca2c00c850 comp rx=0 tx=0).stop 2024-02-02T13:04:12.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.407+0000 7fca3ad9d640 1 -- 172.21.15.161:0/3011179022 reap_dead start 2024-02-02T13:04:12.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.407+0000 7fca40eb9640 1 -- 172.21.15.161:0/3011179022 shutdown_connections 2024-02-02T13:04:12.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.407+0000 7fca40eb9640 1 -- 172.21.15.161:0/3011179022 >> 172.21.15.161:0/3011179022 conn(0x7fca3c06a120 msgr2=0x7fca3c13b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:12.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.407+0000 7fca40eb9640 1 -- 172.21.15.161:0/3011179022 shutdown_connections 2024-02-02T13:04:12.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.407+0000 7fca40eb9640 1 -- 172.21.15.161:0/3011179022 wait complete. 2024-02-02T13:04:12.428 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-02-02T13:04:12.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.539+0000 7eff1317a640 1 Processor -- start 2024-02-02T13:04:12.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.539+0000 7eff1317a640 1 -- start start 2024-02-02T13:04:12.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.539+0000 7eff1317a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7eff0c0bc340 0x7eff0c1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.539+0000 7eff1317a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7eff0c0b8020 0x7eff0c151f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.539+0000 7eff1317a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0c071550 con 0x7eff0c141b30 2024-02-02T13:04:12.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.539+0000 7eff1317a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0c071810 con 0x7eff0c0b8020 2024-02-02T13:04:12.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.539+0000 7eff1317a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0c071950 con 0x7eff0c0bc340 2024-02-02T13:04:12.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.539+0000 7eff11717640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7eff0c0b8020 0x7eff0c151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.539+0000 7eff0bfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7eff0c141b30 0x7eff0c147c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47392/0 (socket says 172.21.15.161:47392) 2024-02-02T13:04:12.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.539+0000 7eff0bfff640 1 -- 172.21.15.161:0/1914063089 learned_addr learned my addr 172.21.15.161:0/1914063089 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:04:12.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.539+0000 7eff10f16640 1 --2- 172.21.15.161:0/1914063089 >> v2:172.21.15.162:3300/0 conn(0x7eff0c0bc340 0x7eff0c1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.539+0000 7eff11717640 1 -- 172.21.15.161:0/1914063089 >> v2:172.21.15.162:3300/0 conn(0x7eff0c0bc340 msgr2=0x7eff0c1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:12.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.539+0000 7eff11717640 1 --2- 172.21.15.161:0/1914063089 >> v2:172.21.15.162:3300/0 conn(0x7eff0c0bc340 0x7eff0c1415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.539+0000 7eff11717640 1 -- 172.21.15.161:0/1914063089 >> v1:172.21.15.161:6789/0 conn(0x7eff0c141b30 legacy=0x7eff0c147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.539+0000 7eff0b7fe640 1 -- 172.21.15.161:0/1914063089 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178359270 0 0) 0x7eff0c071550 con 0x7eff0c141b30 2024-02-02T13:04:12.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.539+0000 7eff11717640 1 -- 172.21.15.161:0/1914063089 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c0bc720 con 0x7eff0c0b8020 2024-02-02T13:04:12.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.539+0000 7eff11717640 1 --2- 172.21.15.161:0/1914063089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff0c0b8020 0x7eff0c151f60 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7eff0c06d0c0 tx=0x7eff0401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11745f299856120d server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:12.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff0b7fe640 1 -- 172.21.15.161:0/1914063089 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff040a5740 con 0x7eff0c0b8020 2024-02-02T13:04:12.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff0b7fe640 1 -- 172.21.15.161:0/1914063089 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff040a58a0 con 0x7eff0c0b8020 2024-02-02T13:04:12.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff0b7fe640 1 -- 172.21.15.161:0/1914063089 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff040a5c30 con 0x7eff0c0b8020 2024-02-02T13:04:12.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff1317a640 1 -- 172.21.15.161:0/1914063089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff0c0b8020 msgr2=0x7eff0c151f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff1317a640 1 --2- 172.21.15.161:0/1914063089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff0c0b8020 0x7eff0c151f60 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7eff0c06d0c0 tx=0x7eff0401c880 comp rx=0 tx=0).stop 2024-02-02T13:04:12.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff1317a640 1 -- 172.21.15.161:0/1914063089 shutdown_connections 2024-02-02T13:04:12.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff1317a640 1 --2- 172.21.15.161:0/1914063089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff0c0b8020 0x7eff0c151f60 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff1317a640 1 --2- 172.21.15.161:0/1914063089 >> v2:172.21.15.162:3300/0 conn(0x7eff0c0bc340 0x7eff0c1415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff1317a640 1 -- 172.21.15.161:0/1914063089 >> 172.21.15.161:0/1914063089 conn(0x7eff0c069ef0 msgr2=0x7eff0c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:12.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff1317a640 1 -- 172.21.15.161:0/1914063089 shutdown_connections 2024-02-02T13:04:12.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff1317a640 1 -- 172.21.15.161:0/1914063089 wait complete. 2024-02-02T13:04:12.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff1317a640 1 Processor -- start 2024-02-02T13:04:12.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff1317a640 1 -- start start 2024-02-02T13:04:12.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff1317a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff0c0b8020 0x7eff0c13f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff1317a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff0c0bc340 0x7eff0c149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff1317a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff0c141b30 0x7eff0c137270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff1317a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c13fcb0 con 0x7eff0c0bc340 2024-02-02T13:04:12.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff1317a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c1e4f10 con 0x7eff0c0b8020 2024-02-02T13:04:12.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff1317a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c149ad0 con 0x7eff0c141b30 2024-02-02T13:04:12.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff0bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff0c0bc340 0x7eff0c149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff0bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff0c0bc340 0x7eff0c149ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46844/0 (socket says 172.21.15.161:46844) 2024-02-02T13:04:12.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff0bfff640 1 -- 172.21.15.161:0/2507454362 learned_addr learned my addr 172.21.15.161:0/2507454362 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:12.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff10f16640 1 --2- 172.21.15.161:0/2507454362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff0c0b8020 0x7eff0c13f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff11717640 1 --2- 172.21.15.161:0/2507454362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff0c141b30 0x7eff0c137270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff0bfff640 1 -- 172.21.15.161:0/2507454362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff0c141b30 msgr2=0x7eff0c137270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff0bfff640 1 --2- 172.21.15.161:0/2507454362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff0c141b30 0x7eff0c137270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff0bfff640 1 -- 172.21.15.161:0/2507454362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff0c0b8020 msgr2=0x7eff0c13f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff0bfff640 1 --2- 172.21.15.161:0/2507454362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff0c0b8020 0x7eff0c13f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff0bfff640 1 -- 172.21.15.161:0/2507454362 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff04009a70 con 0x7eff0c0bc340 2024-02-02T13:04:12.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff0bfff640 1 --2- 172.21.15.161:0/2507454362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff0c0bc340 0x7eff0c149ef0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7eff000011f0 tx=0x7eff0000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:12.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff097fa640 1 -- 172.21.15.161:0/2507454362 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff000074e0 con 0x7eff0c0bc340 2024-02-02T13:04:12.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff097fa640 1 -- 172.21.15.161:0/2507454362 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff00007640 con 0x7eff0c0bc340 2024-02-02T13:04:12.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff1317a640 1 -- 172.21.15.161:0/2507454362 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0c1487a0 con 0x7eff0c0bc340 2024-02-02T13:04:12.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff097fa640 1 -- 172.21.15.161:0/2507454362 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00004a10 con 0x7eff0c0bc340 2024-02-02T13:04:12.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.543+0000 7eff1317a640 1 -- 172.21.15.161:0/2507454362 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0c1e49f0 con 0x7eff0c0bc340 2024-02-02T13:04:12.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.547+0000 7eff1317a640 1 -- 172.21.15.161:0/2507454362 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0c1489e0 con 0x7eff0c0bc340 2024-02-02T13:04:12.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.547+0000 7eff097fa640 1 -- 172.21.15.161:0/2507454362 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7eff00004b70 con 0x7eff0c0bc340 2024-02-02T13:04:12.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.547+0000 7eff097fa640 1 --2- 172.21.15.161:0/2507454362 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7efef8065a60 0x7efef8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.547+0000 7eff10f16640 1 --2- 172.21.15.161:0/2507454362 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7efef8065a60 0x7efef8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.547+0000 7eff097fa640 1 -- 172.21.15.161:0/2507454362 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7eff00082180 con 0x7eff0c0bc340 2024-02-02T13:04:12.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.547+0000 7eff10f16640 1 --2- 172.21.15.161:0/2507454362 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7efef8065a60 0x7efef8067f20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efefc00b9d0 tx=0x7efefc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:12.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.551+0000 7eff097fa640 1 -- 172.21.15.161:0/2507454362 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7eff0c1489e0 con 0x7eff0c0bc340 2024-02-02T13:04:12.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.691+0000 7eff1317a640 1 -- 172.21.15.161:0/2507454362 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7eff0c148580 con 0x7efef8065a60 2024-02-02T13:04:12.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.695+0000 7eff097fa640 1 -- 172.21.15.161:0/2507454362 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efefc00b670 con 0x7efef8065a60 2024-02-02T13:04:12.697 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 0 to deep-scrub 2024-02-02T13:04:12.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.695+0000 7eff1317a640 1 -- 172.21.15.161:0/2507454362 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7efef8065a60 msgr2=0x7efef8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.695+0000 7eff1317a640 1 --2- 172.21.15.161:0/2507454362 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7efef8065a60 0x7efef8067f20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efefc00b9d0 tx=0x7efefc008040 comp rx=0 tx=0).stop 2024-02-02T13:04:12.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.695+0000 7eff1317a640 1 -- 172.21.15.161:0/2507454362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff0c0bc340 msgr2=0x7eff0c149ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.695+0000 7eff1317a640 1 --2- 172.21.15.161:0/2507454362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff0c0bc340 0x7eff0c149ef0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7eff000011f0 tx=0x7eff0000c9b0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.695+0000 7eff1317a640 1 -- 172.21.15.161:0/2507454362 shutdown_connections 2024-02-02T13:04:12.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.695+0000 7eff1317a640 1 --2- 172.21.15.161:0/2507454362 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7efef8065a60 0x7efef8067f20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.695+0000 7eff1317a640 1 --2- 172.21.15.161:0/2507454362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff0c141b30 0x7eff0c137270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.695+0000 7eff1317a640 1 --2- 172.21.15.161:0/2507454362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff0c0bc340 0x7eff0c149ef0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.695+0000 7eff1317a640 1 --2- 172.21.15.161:0/2507454362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff0c0b8020 0x7eff0c13f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.695+0000 7eff1317a640 1 -- 172.21.15.161:0/2507454362 >> 172.21.15.161:0/2507454362 conn(0x7eff0c069ef0 msgr2=0x7eff0c0b7120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:12.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.695+0000 7eff1317a640 1 -- 172.21.15.161:0/2507454362 shutdown_connections 2024-02-02T13:04:12.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.695+0000 7eff1317a640 1 -- 172.21.15.161:0/2507454362 wait complete. 2024-02-02T13:04:12.716 INFO:tasks.ceph:Scrubbing osd.1 2024-02-02T13:04:12.716 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-02-02T13:04:12.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.831+0000 7f881eec8640 1 Processor -- start 2024-02-02T13:04:12.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.831+0000 7f881eec8640 1 -- start start 2024-02-02T13:04:12.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.831+0000 7f881eec8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8818147bc0 0x7f88180709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.831+0000 7f881eec8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8818070ef0 con 0x7f8818144100 2024-02-02T13:04:12.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.831+0000 7f881eec8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881806ecc0 con 0x7f881806fc30 2024-02-02T13:04:12.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.831+0000 7f881eec8640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8818071640 con 0x7f8818147bc0 2024-02-02T13:04:12.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.831+0000 7f8817fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8818147bc0 0x7f88180709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.831+0000 7f881d465640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f8818144100 0x7f88181445b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47400/0 (socket says 172.21.15.161:47400) 2024-02-02T13:04:12.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.831+0000 7f881d465640 1 -- 172.21.15.161:0/3360831603 learned_addr learned my addr 172.21.15.161:0/3360831603 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:04:12.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.831+0000 7f8817fff640 1 -- 172.21.15.161:0/3360831603 >> v1:172.21.15.162:6789/0 conn(0x7f881806fc30 legacy=0x7f88181474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:12.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.831+0000 7f8817fff640 1 -- 172.21.15.161:0/3360831603 >> v1:172.21.15.161:6789/0 conn(0x7f8818144100 legacy=0x7f88181445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.831+0000 7f88177fe640 1 -- 172.21.15.161:0/3360831603 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329175507 0 0) 0x7f8810001120 con 0x7f8818144100 2024-02-02T13:04:12.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.831+0000 7f8817fff640 1 -- 172.21.15.161:0/3360831603 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881806ef30 con 0x7f8818147bc0 2024-02-02T13:04:12.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.835+0000 7f8817fff640 1 --2- 172.21.15.161:0/3360831603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8818147bc0 0x7f88180709b0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f880c00a960 tx=0x7f880c01d7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a759e3335f417e97 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:12.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.835+0000 7f88177fe640 1 -- 172.21.15.161:0/3360831603 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0a6810 con 0x7f8818147bc0 2024-02-02T13:04:12.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.835+0000 7f88177fe640 1 -- 172.21.15.161:0/3360831603 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c0a6970 con 0x7f8818147bc0 2024-02-02T13:04:12.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.835+0000 7f88177fe640 1 -- 172.21.15.161:0/3360831603 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0a6d00 con 0x7f8818147bc0 2024-02-02T13:04:12.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.835+0000 7f881eec8640 1 -- 172.21.15.161:0/3360831603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8818147bc0 msgr2=0x7f88180709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.835+0000 7f881eec8640 1 --2- 172.21.15.161:0/3360831603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8818147bc0 0x7f88180709b0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f880c00a960 tx=0x7f880c01d7e0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.835+0000 7f881eec8640 1 -- 172.21.15.161:0/3360831603 shutdown_connections 2024-02-02T13:04:12.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.835+0000 7f881eec8640 1 --2- 172.21.15.161:0/3360831603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8818147bc0 0x7f88180709b0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.835+0000 7f881eec8640 1 -- 172.21.15.161:0/3360831603 >> 172.21.15.161:0/3360831603 conn(0x7f881806a120 msgr2=0x7f881806a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:12.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.835+0000 7f881eec8640 1 -- 172.21.15.161:0/3360831603 shutdown_connections 2024-02-02T13:04:12.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.835+0000 7f881eec8640 1 -- 172.21.15.161:0/3360831603 wait complete. 2024-02-02T13:04:12.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.835+0000 7f881eec8640 1 Processor -- start 2024-02-02T13:04:12.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.835+0000 7f881eec8640 1 -- start start 2024-02-02T13:04:12.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881eec8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f881806fc30 0x7f88181481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881eec8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8818144100 0x7f8818143350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881eec8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8818147bc0 0x7f88181e47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881eec8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8818134ff0 con 0x7f881806fc30 2024-02-02T13:04:12.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881eec8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8818143890 con 0x7f8818147bc0 2024-02-02T13:04:12.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881eec8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881813c140 con 0x7f8818144100 2024-02-02T13:04:12.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881cc64640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f881806fc30 0x7f88181481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881cc64640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f881806fc30 0x7f88181481c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46848/0 (socket says 172.21.15.161:46848) 2024-02-02T13:04:12.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881cc64640 1 -- 172.21.15.161:0/393467169 learned_addr learned my addr 172.21.15.161:0/393467169 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:12.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f8817fff640 1 --2- 172.21.15.161:0/393467169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8818144100 0x7f8818143350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881d465640 1 --2- 172.21.15.161:0/393467169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8818147bc0 0x7f88181e47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881cc64640 1 -- 172.21.15.161:0/393467169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8818144100 msgr2=0x7f8818143350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881cc64640 1 --2- 172.21.15.161:0/393467169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8818144100 0x7f8818143350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881cc64640 1 -- 172.21.15.161:0/393467169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8818147bc0 msgr2=0x7f88181e47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881cc64640 1 --2- 172.21.15.161:0/393467169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8818147bc0 0x7f88181e47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881cc64640 1 -- 172.21.15.161:0/393467169 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c00a5c0 con 0x7f881806fc30 2024-02-02T13:04:12.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f8817fff640 1 --2- 172.21.15.161:0/393467169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8818144100 0x7f8818143350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:12.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881d465640 1 --2- 172.21.15.161:0/393467169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8818147bc0 0x7f88181e47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:12.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881cc64640 1 --2- 172.21.15.161:0/393467169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f881806fc30 0x7f88181481c0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f880800c7c0 tx=0x7f880800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:12.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f88157fa640 1 -- 172.21.15.161:0/393467169 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880800aa50 con 0x7f881806fc30 2024-02-02T13:04:12.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f88157fa640 1 -- 172.21.15.161:0/393467169 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880800abb0 con 0x7f881806fc30 2024-02-02T13:04:12.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881eec8640 1 -- 172.21.15.161:0/393467169 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881813c420 con 0x7f881806fc30 2024-02-02T13:04:12.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f88157fa640 1 -- 172.21.15.161:0/393467169 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808012420 con 0x7f881806fc30 2024-02-02T13:04:12.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881eec8640 1 -- 172.21.15.161:0/393467169 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88181e42a0 con 0x7f881806fc30 2024-02-02T13:04:12.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881eec8640 1 -- 172.21.15.161:0/393467169 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8818070010 con 0x7f881806fc30 2024-02-02T13:04:12.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f88157fa640 1 -- 172.21.15.161:0/393467169 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8808012580 con 0x7f881806fc30 2024-02-02T13:04:12.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f88157fa640 1 --2- 172.21.15.161:0/393467169 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8804065a90 0x7f8804067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f88157fa640 1 -- 172.21.15.161:0/393467169 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8808083650 con 0x7f881806fc30 2024-02-02T13:04:12.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f8817fff640 1 --2- 172.21.15.161:0/393467169 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8804065a90 0x7f8804067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f88157fa640 1 --2- 172.21.15.161:0/393467169 >> [v2:172.21.15.161:6800/27682,v1:172.21.15.161:6801/27682] conn(0x7f880406b8f0 0x7f880406dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f88157fa640 1 -- 172.21.15.161:0/393467169 --> [v2:172.21.15.161:6800/27682,v1:172.21.15.161:6801/27682] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f880406e3c0 con 0x7f880406b8f0 2024-02-02T13:04:12.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f88157fa640 1 -- 172.21.15.161:0/393467169 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8808083aa0 con 0x7f881806fc30 2024-02-02T13:04:12.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881d465640 1 --2- 172.21.15.161:0/393467169 >> [v2:172.21.15.161:6800/27682,v1:172.21.15.161:6801/27682] conn(0x7f880406b8f0 0x7f880406dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f8817fff640 1 --2- 172.21.15.161:0/393467169 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8804065a90 0x7f8804067f50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f880c0b0000 tx=0x7f880c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:12.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.839+0000 7f881d465640 1 --2- 172.21.15.161:0/393467169 >> [v2:172.21.15.161:6800/27682,v1:172.21.15.161:6801/27682] conn(0x7f880406b8f0 0x7f880406dd10 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:12.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.843+0000 7f88157fa640 1 -- 172.21.15.161:0/393467169 <== osd.1 v2:172.21.15.161:6800/27682 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f880406e3c0 con 0x7f880406b8f0 2024-02-02T13:04:12.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.855+0000 7f881eec8640 1 -- 172.21.15.161:0/393467169 --> [v2:172.21.15.161:6800/27682,v1:172.21.15.161:6801/27682] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f88181e4490 con 0x7f880406b8f0 2024-02-02T13:04:12.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.855+0000 7f88157fa640 1 -- 172.21.15.161:0/393467169 <== osd.1 v2:172.21.15.161:6800/27682 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f88181e4490 con 0x7f880406b8f0 2024-02-02T13:04:12.858 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-02-02T13:04:12.858 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-02-02T13:04:12.859 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-02-02T13:04:12.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.855+0000 7f881eec8640 1 -- 172.21.15.161:0/393467169 >> [v2:172.21.15.161:6800/27682,v1:172.21.15.161:6801/27682] conn(0x7f880406b8f0 msgr2=0x7f880406dd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.855+0000 7f881eec8640 1 --2- 172.21.15.161:0/393467169 >> [v2:172.21.15.161:6800/27682,v1:172.21.15.161:6801/27682] conn(0x7f880406b8f0 0x7f880406dd10 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.855+0000 7f881eec8640 1 -- 172.21.15.161:0/393467169 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8804065a90 msgr2=0x7f8804067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.855+0000 7f881eec8640 1 --2- 172.21.15.161:0/393467169 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8804065a90 0x7f8804067f50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f880c0b0000 tx=0x7f880c008040 comp rx=0 tx=0).stop 2024-02-02T13:04:12.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.855+0000 7f881eec8640 1 -- 172.21.15.161:0/393467169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f881806fc30 msgr2=0x7f88181481c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.855+0000 7f881eec8640 1 --2- 172.21.15.161:0/393467169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f881806fc30 0x7f88181481c0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f880800c7c0 tx=0x7f880800cc80 comp rx=0 tx=0).stop 2024-02-02T13:04:12.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.855+0000 7f881d465640 1 -- 172.21.15.161:0/393467169 reap_dead start 2024-02-02T13:04:12.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.855+0000 7f881eec8640 1 -- 172.21.15.161:0/393467169 shutdown_connections 2024-02-02T13:04:12.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.855+0000 7f881eec8640 1 -- 172.21.15.161:0/393467169 >> 172.21.15.161:0/393467169 conn(0x7f881806a120 msgr2=0x7f881806a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:12.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.855+0000 7f881eec8640 1 -- 172.21.15.161:0/393467169 shutdown_connections 2024-02-02T13:04:12.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.855+0000 7f881eec8640 1 -- 172.21.15.161:0/393467169 wait complete. 2024-02-02T13:04:12.874 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-02-02T13:04:12.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc924d640 1 Processor -- start 2024-02-02T13:04:12.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc924d640 1 -- start start 2024-02-02T13:04:12.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc924d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2fc414b540 0x7f2fc40bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc924d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fc406a4c0 0x7f2fc406a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc924d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2fc414dfd0 0x7f2fc414e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc924d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc406ae40 con 0x7f2fc414dfd0 2024-02-02T13:04:12.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc924d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc40bc320 con 0x7f2fc414b540 2024-02-02T13:04:12.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc924d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc40bb650 con 0x7f2fc406a4c0 2024-02-02T13:04:12.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc359e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2fc414dfd0 0x7f2fc414e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc359e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2fc414dfd0 0x7f2fc414e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46856/0 (socket says 172.21.15.161:46856) 2024-02-02T13:04:12.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc359e640 1 -- 172.21.15.161:0/4206165094 learned_addr learned my addr 172.21.15.161:0/4206165094 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:12.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc359e640 1 -- 172.21.15.161:0/4206165094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fc406a4c0 msgr2=0x7f2fc406a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:12.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc359e640 1 --2- 172.21.15.161:0/4206165094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fc406a4c0 0x7f2fc406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc359e640 1 -- 172.21.15.161:0/4206165094 >> v2:172.21.15.162:3300/0 conn(0x7f2fc414b540 msgr2=0x7f2fc40bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:12.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc359e640 1 --2- 172.21.15.161:0/4206165094 >> v2:172.21.15.162:3300/0 conn(0x7f2fc414b540 0x7f2fc40bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc359e640 1 -- 172.21.15.161:0/4206165094 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc40bc590 con 0x7f2fc414dfd0 2024-02-02T13:04:12.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc359e640 1 --2- 172.21.15.161:0/4206165094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fc414dfd0 0x7f2fc414e440 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40be590 tx=0x7f2fbc01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efeedbb4957fbbc server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:12.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc259c640 1 -- 172.21.15.161:0/4206165094 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0af400 con 0x7f2fc414dfd0 2024-02-02T13:04:12.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc259c640 1 -- 172.21.15.161:0/4206165094 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc0ab050 con 0x7f2fc414dfd0 2024-02-02T13:04:12.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.975+0000 7f2fc259c640 1 -- 172.21.15.161:0/4206165094 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0af780 con 0x7f2fc414dfd0 2024-02-02T13:04:12.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 -- 172.21.15.161:0/4206165094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fc414dfd0 msgr2=0x7f2fc414e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 --2- 172.21.15.161:0/4206165094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fc414dfd0 0x7f2fc414e440 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40be590 tx=0x7f2fbc01f1c0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 -- 172.21.15.161:0/4206165094 shutdown_connections 2024-02-02T13:04:12.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 --2- 172.21.15.161:0/4206165094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fc406a4c0 0x7f2fc406a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 --2- 172.21.15.161:0/4206165094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fc414dfd0 0x7f2fc414e440 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 --2- 172.21.15.161:0/4206165094 >> v2:172.21.15.162:3300/0 conn(0x7f2fc414b540 0x7f2fc40bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 -- 172.21.15.161:0/4206165094 >> 172.21.15.161:0/4206165094 conn(0x7f2fc40c02e0 msgr2=0x7f2fc40c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:12.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 -- 172.21.15.161:0/4206165094 shutdown_connections 2024-02-02T13:04:12.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 -- 172.21.15.161:0/4206165094 wait complete. 2024-02-02T13:04:12.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 Processor -- start 2024-02-02T13:04:12.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 -- start start 2024-02-02T13:04:12.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fc406a4c0 0x7f2fc40ba2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fc414b540 0x7f2fc41d46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fc414dfd0 0x7f2fc41dfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc41d4c20 con 0x7f2fc414b540 2024-02-02T13:04:12.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc41dff60 con 0x7f2fc414dfd0 2024-02-02T13:04:12.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc40a3510 con 0x7f2fc406a4c0 2024-02-02T13:04:12.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fbbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fc414b540 0x7f2fc41d46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fbbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fc414b540 0x7f2fc41d46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46858/0 (socket says 172.21.15.161:46858) 2024-02-02T13:04:12.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fbbfff640 1 -- 172.21.15.161:0/75056556 learned_addr learned my addr 172.21.15.161:0/75056556 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:12.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc2d9d640 1 --2- 172.21.15.161:0/75056556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fc406a4c0 0x7f2fc40ba2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc359e640 1 --2- 172.21.15.161:0/75056556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fc414dfd0 0x7f2fc41dfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fbbfff640 1 -- 172.21.15.161:0/75056556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fc406a4c0 msgr2=0x7f2fc40ba2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fbbfff640 1 --2- 172.21.15.161:0/75056556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fc406a4c0 0x7f2fc40ba2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fbbfff640 1 -- 172.21.15.161:0/75056556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fc414dfd0 msgr2=0x7f2fc41dfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:12.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fbbfff640 1 --2- 172.21.15.161:0/75056556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fc414dfd0 0x7f2fc41dfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:12.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fbbfff640 1 -- 172.21.15.161:0/75056556 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc009b30 con 0x7f2fc414b540 2024-02-02T13:04:12.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fbbfff640 1 --2- 172.21.15.161:0/75056556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fc414b540 0x7f2fc41d46e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400b410 tx=0x7f2fb400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:12.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fbb7fe640 1 -- 172.21.15.161:0/75056556 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4011830 con 0x7f2fc414b540 2024-02-02T13:04:12.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fbb7fe640 1 -- 172.21.15.161:0/75056556 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb4011990 con 0x7f2fc414b540 2024-02-02T13:04:12.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 -- 172.21.15.161:0/75056556 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc406a940 con 0x7f2fc414b540 2024-02-02T13:04:12.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fbb7fe640 1 -- 172.21.15.161:0/75056556 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4011d40 con 0x7f2fc414b540 2024-02-02T13:04:12.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 -- 172.21.15.161:0/75056556 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc40b9ad0 con 0x7f2fc414b540 2024-02-02T13:04:12.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.979+0000 7f2fc924d640 1 -- 172.21.15.161:0/75056556 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc4067050 con 0x7f2fc414b540 2024-02-02T13:04:12.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.983+0000 7f2fbb7fe640 1 -- 172.21.15.161:0/75056556 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2fb401a400 con 0x7f2fc414b540 2024-02-02T13:04:12.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.983+0000 7f2fbb7fe640 1 --2- 172.21.15.161:0/75056556 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2fa4065a60 0x7f2fa4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:12.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.983+0000 7f2fbb7fe640 1 -- 172.21.15.161:0/75056556 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2fb4082f70 con 0x7f2fc414b540 2024-02-02T13:04:12.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.983+0000 7f2fc2d9d640 1 --2- 172.21.15.161:0/75056556 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2fa4065a60 0x7f2fa4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:12.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.983+0000 7f2fc2d9d640 1 --2- 172.21.15.161:0/75056556 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2fa4065a60 0x7f2fa4067f20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2fac006fd0 tx=0x7f2fac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:12.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:12.987+0000 7f2fbb7fe640 1 -- 172.21.15.161:0/75056556 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2fb40b40a0 con 0x7f2fc414b540 2024-02-02T13:04:13.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.127+0000 7f2fc924d640 1 -- 172.21.15.161:0/75056556 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fc40bfa00 con 0x7f2fa4065a60 2024-02-02T13:04:13.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.127+0000 7f2fbb7fe640 1 -- 172.21.15.161:0/75056556 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2fac009e20 con 0x7f2fa4065a60 2024-02-02T13:04:13.132 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 1 to deep-scrub 2024-02-02T13:04:13.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.131+0000 7f2fc924d640 1 -- 172.21.15.161:0/75056556 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2fa4065a60 msgr2=0x7f2fa4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.131+0000 7f2fc924d640 1 --2- 172.21.15.161:0/75056556 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2fa4065a60 0x7f2fa4067f20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2fac006fd0 tx=0x7f2fac008040 comp rx=0 tx=0).stop 2024-02-02T13:04:13.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.131+0000 7f2fc924d640 1 -- 172.21.15.161:0/75056556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fc414b540 msgr2=0x7f2fc41d46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.131+0000 7f2fc924d640 1 --2- 172.21.15.161:0/75056556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fc414b540 0x7f2fc41d46e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400b410 tx=0x7f2fb400b8d0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.131+0000 7f2fc924d640 1 -- 172.21.15.161:0/75056556 shutdown_connections 2024-02-02T13:04:13.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.131+0000 7f2fc924d640 1 --2- 172.21.15.161:0/75056556 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2fa4065a60 0x7f2fa4067f20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.131+0000 7f2fc924d640 1 --2- 172.21.15.161:0/75056556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fc414dfd0 0x7f2fc41dfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.131+0000 7f2fc924d640 1 --2- 172.21.15.161:0/75056556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fc414b540 0x7f2fc41d46e0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.131+0000 7f2fc924d640 1 --2- 172.21.15.161:0/75056556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fc406a4c0 0x7f2fc40ba2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.131+0000 7f2fc924d640 1 -- 172.21.15.161:0/75056556 >> 172.21.15.161:0/75056556 conn(0x7f2fc40c02e0 msgr2=0x7f2fc4148290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:13.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.131+0000 7f2fc924d640 1 -- 172.21.15.161:0/75056556 shutdown_connections 2024-02-02T13:04:13.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.131+0000 7f2fc924d640 1 -- 172.21.15.161:0/75056556 wait complete. 2024-02-02T13:04:13.150 INFO:tasks.ceph:Scrubbing osd.2 2024-02-02T13:04:13.150 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-02-02T13:04:13.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.263+0000 7f4b4af3f640 1 Processor -- start 2024-02-02T13:04:13.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.263+0000 7f4b4af3f640 1 -- start start 2024-02-02T13:04:13.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.267+0000 7f4b4af3f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b44147bc0 0x7f4b440709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.267+0000 7f4b4af3f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4b44144100 0x7f4b441445b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.267+0000 7f4b4af3f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b44070ef0 con 0x7f4b4406fc30 2024-02-02T13:04:13.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.267+0000 7f4b4af3f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b44071640 con 0x7f4b44144100 2024-02-02T13:04:13.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.267+0000 7f4b4af3f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4406ecc0 con 0x7f4b44147bc0 2024-02-02T13:04:13.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.267+0000 7f4b494dc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4b44144100 0x7f4b441445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.267+0000 7f4b494dc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4b44144100 0x7f4b441445b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46860/0 (socket says 172.21.15.161:46860) 2024-02-02T13:04:13.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.267+0000 7f4b494dc640 1 -- 172.21.15.161:0/1488809741 learned_addr learned my addr 172.21.15.161:0/1488809741 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:13.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.267+0000 7f4b3bfff640 1 --2- 172.21.15.161:0/1488809741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b44147bc0 0x7f4b440709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.267+0000 7f4b494dc640 1 -- 172.21.15.161:0/1488809741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b44147bc0 msgr2=0x7f4b440709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:13.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.267+0000 7f4b494dc640 1 --2- 172.21.15.161:0/1488809741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b44147bc0 0x7f4b440709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.267+0000 7f4b494dc640 1 -- 172.21.15.161:0/1488809741 >> v1:172.21.15.162:6789/0 conn(0x7f4b4406fc30 legacy=0x7f4b441474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:13.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.267+0000 7f4b494dc640 1 -- 172.21.15.161:0/1488809741 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4406ef30 con 0x7f4b44144100 2024-02-02T13:04:13.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.267+0000 7f4b494dc640 1 --2- 172.21.15.161:0/1488809741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b44144100 0x7f4b441445b0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c009e50 tx=0x7f4b3c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce478b163cddda70 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:13.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.267+0000 7f4b3b7fe640 1 -- 172.21.15.161:0/1488809741 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c0a5820 con 0x7f4b44144100 2024-02-02T13:04:13.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.267+0000 7f4b3b7fe640 1 -- 172.21.15.161:0/1488809741 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c0a5980 con 0x7f4b44144100 2024-02-02T13:04:13.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.267+0000 7f4b3b7fe640 1 -- 172.21.15.161:0/1488809741 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c0a5d10 con 0x7f4b44144100 2024-02-02T13:04:13.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b4af3f640 1 -- 172.21.15.161:0/1488809741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b44144100 msgr2=0x7f4b441445b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b4af3f640 1 --2- 172.21.15.161:0/1488809741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b44144100 0x7f4b441445b0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c009e50 tx=0x7f4b3c01c9a0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b4af3f640 1 -- 172.21.15.161:0/1488809741 shutdown_connections 2024-02-02T13:04:13.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b4af3f640 1 --2- 172.21.15.161:0/1488809741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b44147bc0 0x7f4b440709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b4af3f640 1 --2- 172.21.15.161:0/1488809741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b44144100 0x7f4b441445b0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b4af3f640 1 -- 172.21.15.161:0/1488809741 >> 172.21.15.161:0/1488809741 conn(0x7f4b4406a120 msgr2=0x7f4b4406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:13.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b4af3f640 1 -- 172.21.15.161:0/1488809741 shutdown_connections 2024-02-02T13:04:13.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b4af3f640 1 -- 172.21.15.161:0/1488809741 wait complete. 2024-02-02T13:04:13.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b4af3f640 1 Processor -- start 2024-02-02T13:04:13.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b4af3f640 1 -- start start 2024-02-02T13:04:13.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b4af3f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b4406fc30 0x7f4b44148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b4af3f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b44144100 0x7f4b441e4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b4af3f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b44147bc0 0x7f4b441370a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b4af3f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b440ba470 con 0x7f4b44144100 2024-02-02T13:04:13.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b4af3f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b44149270 con 0x7f4b4406fc30 2024-02-02T13:04:13.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b4af3f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b441e3cd0 con 0x7f4b44147bc0 2024-02-02T13:04:13.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b3bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b44144100 0x7f4b441e4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b3bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b44144100 0x7f4b441e4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46866/0 (socket says 172.21.15.161:46866) 2024-02-02T13:04:13.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b3bfff640 1 -- 172.21.15.161:0/3749875219 learned_addr learned my addr 172.21.15.161:0/3749875219 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:13.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b48cdb640 1 --2- 172.21.15.161:0/3749875219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b4406fc30 0x7f4b44148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b494dc640 1 --2- 172.21.15.161:0/3749875219 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b44147bc0 0x7f4b441370a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b3bfff640 1 -- 172.21.15.161:0/3749875219 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b44147bc0 msgr2=0x7f4b441370a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b3bfff640 1 --2- 172.21.15.161:0/3749875219 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b44147bc0 0x7f4b441370a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b3bfff640 1 -- 172.21.15.161:0/3749875219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b4406fc30 msgr2=0x7f4b44148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b3bfff640 1 --2- 172.21.15.161:0/3749875219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b4406fc30 0x7f4b44148d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b3bfff640 1 -- 172.21.15.161:0/3749875219 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c009b30 con 0x7f4b44144100 2024-02-02T13:04:13.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b48cdb640 1 --2- 172.21.15.161:0/3749875219 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b4406fc30 0x7f4b44148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:13.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b494dc640 1 --2- 172.21.15.161:0/3749875219 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b44147bc0 0x7f4b441370a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:13.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b3bfff640 1 --2- 172.21.15.161:0/3749875219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b44144100 0x7f4b441e4160 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400d5d0 tx=0x7f4b3400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:13.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b397fa640 1 -- 172.21.15.161:0/3749875219 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b34004240 con 0x7f4b44144100 2024-02-02T13:04:13.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b397fa640 1 -- 172.21.15.161:0/3749875219 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b340043a0 con 0x7f4b44144100 2024-02-02T13:04:13.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b4af3f640 1 -- 172.21.15.161:0/3749875219 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4414a980 con 0x7f4b44144100 2024-02-02T13:04:13.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b397fa640 1 -- 172.21.15.161:0/3749875219 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b34003840 con 0x7f4b44144100 2024-02-02T13:04:13.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b4af3f640 1 -- 172.21.15.161:0/3749875219 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b441e39f0 con 0x7f4b44144100 2024-02-02T13:04:13.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.271+0000 7f4b4af3f640 1 -- 172.21.15.161:0/3749875219 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4b44070010 con 0x7f4b44144100 2024-02-02T13:04:13.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.275+0000 7f4b397fa640 1 -- 172.21.15.161:0/3749875219 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4b340039a0 con 0x7f4b44144100 2024-02-02T13:04:13.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.275+0000 7f4b397fa640 1 --2- 172.21.15.161:0/3749875219 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4b30065a60 0x7f4b30067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.275+0000 7f4b397fa640 1 -- 172.21.15.161:0/3749875219 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4b34083a60 con 0x7f4b44144100 2024-02-02T13:04:13.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.275+0000 7f4b48cdb640 1 --2- 172.21.15.161:0/3749875219 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4b30065a60 0x7f4b30067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.275+0000 7f4b397fa640 1 --2- 172.21.15.161:0/3749875219 >> [v2:172.21.15.161:6816/27683,v1:172.21.15.161:6817/27683] conn(0x7f4b3006b8c0 0x7f4b3006dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.275+0000 7f4b397fa640 1 -- 172.21.15.161:0/3749875219 --> [v2:172.21.15.161:6816/27683,v1:172.21.15.161:6817/27683] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4b3006e390 con 0x7f4b3006b8c0 2024-02-02T13:04:13.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.275+0000 7f4b397fa640 1 -- 172.21.15.161:0/3749875219 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b34083eb0 con 0x7f4b44144100 2024-02-02T13:04:13.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.275+0000 7f4b494dc640 1 --2- 172.21.15.161:0/3749875219 >> [v2:172.21.15.161:6816/27683,v1:172.21.15.161:6817/27683] conn(0x7f4b3006b8c0 0x7f4b3006dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.275+0000 7f4b48cdb640 1 --2- 172.21.15.161:0/3749875219 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4b30065a60 0x7f4b30067f20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4b40003e40 tx=0x7f4b40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:13.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.275+0000 7f4b494dc640 1 --2- 172.21.15.161:0/3749875219 >> [v2:172.21.15.161:6816/27683,v1:172.21.15.161:6817/27683] conn(0x7f4b3006b8c0 0x7f4b3006dce0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:13.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.275+0000 7f4b397fa640 1 -- 172.21.15.161:0/3749875219 <== osd.2 v2:172.21.15.161:6816/27683 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4b3006e390 con 0x7f4b3006b8c0 2024-02-02T13:04:13.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.287+0000 7f4b4af3f640 1 -- 172.21.15.161:0/3749875219 --> [v2:172.21.15.161:6816/27683,v1:172.21.15.161:6817/27683] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4b44144af0 con 0x7f4b3006b8c0 2024-02-02T13:04:13.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.287+0000 7f4b397fa640 1 -- 172.21.15.161:0/3749875219 <== osd.2 v2:172.21.15.161:6816/27683 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4b3c009230 con 0x7f4b3006b8c0 2024-02-02T13:04:13.292 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-02-02T13:04:13.293 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-02-02T13:04:13.293 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-02-02T13:04:13.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.287+0000 7f4b4af3f640 1 -- 172.21.15.161:0/3749875219 >> [v2:172.21.15.161:6816/27683,v1:172.21.15.161:6817/27683] conn(0x7f4b3006b8c0 msgr2=0x7f4b3006dce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.287+0000 7f4b4af3f640 1 --2- 172.21.15.161:0/3749875219 >> [v2:172.21.15.161:6816/27683,v1:172.21.15.161:6817/27683] conn(0x7f4b3006b8c0 0x7f4b3006dce0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.287+0000 7f4b4af3f640 1 -- 172.21.15.161:0/3749875219 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4b30065a60 msgr2=0x7f4b30067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.287+0000 7f4b4af3f640 1 --2- 172.21.15.161:0/3749875219 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4b30065a60 0x7f4b30067f20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4b40003e40 tx=0x7f4b40009040 comp rx=0 tx=0).stop 2024-02-02T13:04:13.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.287+0000 7f4b4af3f640 1 -- 172.21.15.161:0/3749875219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b44144100 msgr2=0x7f4b441e4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.287+0000 7f4b4af3f640 1 --2- 172.21.15.161:0/3749875219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b44144100 0x7f4b441e4160 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400d5d0 tx=0x7f4b3400da90 comp rx=0 tx=0).stop 2024-02-02T13:04:13.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.287+0000 7f4b494dc640 1 -- 172.21.15.161:0/3749875219 reap_dead start 2024-02-02T13:04:13.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.287+0000 7f4b4af3f640 1 -- 172.21.15.161:0/3749875219 shutdown_connections 2024-02-02T13:04:13.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.287+0000 7f4b4af3f640 1 -- 172.21.15.161:0/3749875219 >> 172.21.15.161:0/3749875219 conn(0x7f4b4406a120 msgr2=0x7f4b44142110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:13.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.287+0000 7f4b4af3f640 1 -- 172.21.15.161:0/3749875219 shutdown_connections 2024-02-02T13:04:13.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.287+0000 7f4b4af3f640 1 -- 172.21.15.161:0/3749875219 wait complete. 2024-02-02T13:04:13.309 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-02-02T13:04:13.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc265a5640 1 Processor -- start 2024-02-02T13:04:13.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc265a5640 1 -- start start 2024-02-02T13:04:13.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc265a5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc200bc340 0x7fbc20142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc265a5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbc20142d50 0x7fbc20148d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc265a5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbc201492a0 0x7fbc200b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc265a5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc20071770 con 0x7fbc20142d50 2024-02-02T13:04:13.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc265a5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc201496d0 con 0x7fbc201492a0 2024-02-02T13:04:13.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc265a5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200b37e0 con 0x7fbc200bc340 2024-02-02T13:04:13.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc1f7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbc20142d50 0x7fbc20148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc1f7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbc20142d50 0x7fbc20148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46878/0 (socket says 172.21.15.161:46878) 2024-02-02T13:04:13.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc1f7fe640 1 -- 172.21.15.161:0/1900442959 learned_addr learned my addr 172.21.15.161:0/1900442959 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:13.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc24b42640 1 --2- 172.21.15.161:0/1900442959 >> v2:172.21.15.162:3300/0 conn(0x7fbc201492a0 0x7fbc200b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc1f7fe640 1 -- 172.21.15.161:0/1900442959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc200bc340 msgr2=0x7fbc20142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:13.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc1f7fe640 1 --2- 172.21.15.161:0/1900442959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc200bc340 0x7fbc20142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc1f7fe640 1 -- 172.21.15.161:0/1900442959 >> v2:172.21.15.162:3300/0 conn(0x7fbc201492a0 msgr2=0x7fbc200b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:13.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc1f7fe640 1 --2- 172.21.15.161:0/1900442959 >> v2:172.21.15.162:3300/0 conn(0x7fbc201492a0 0x7fbc200b53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc1f7fe640 1 -- 172.21.15.161:0/1900442959 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc200b3ac0 con 0x7fbc20142d50 2024-02-02T13:04:13.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc1f7fe640 1 --2- 172.21.15.161:0/1900442959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc20142d50 0x7fbc20148d60 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fbc200b9d60 tx=0x7fbc1401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b8e2f10b965c7b server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:13.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc1effd640 1 -- 172.21.15.161:0/1900442959 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc140a89b0 con 0x7fbc20142d50 2024-02-02T13:04:13.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc1effd640 1 -- 172.21.15.161:0/1900442959 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc140a8b10 con 0x7fbc20142d50 2024-02-02T13:04:13.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.415+0000 7fbc1effd640 1 -- 172.21.15.161:0/1900442959 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc140a8ea0 con 0x7fbc20142d50 2024-02-02T13:04:13.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc265a5640 1 -- 172.21.15.161:0/1900442959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc20142d50 msgr2=0x7fbc20148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc265a5640 1 --2- 172.21.15.161:0/1900442959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc20142d50 0x7fbc20148d60 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fbc200b9d60 tx=0x7fbc1401ecf0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc265a5640 1 -- 172.21.15.161:0/1900442959 shutdown_connections 2024-02-02T13:04:13.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc265a5640 1 --2- 172.21.15.161:0/1900442959 >> v2:172.21.15.162:3300/0 conn(0x7fbc201492a0 0x7fbc200b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc265a5640 1 --2- 172.21.15.161:0/1900442959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc20142d50 0x7fbc20148d60 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc265a5640 1 --2- 172.21.15.161:0/1900442959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc200bc340 0x7fbc20142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc265a5640 1 -- 172.21.15.161:0/1900442959 >> 172.21.15.161:0/1900442959 conn(0x7fbc20069ef0 msgr2=0x7fbc2006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:13.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc265a5640 1 -- 172.21.15.161:0/1900442959 shutdown_connections 2024-02-02T13:04:13.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc265a5640 1 -- 172.21.15.161:0/1900442959 wait complete. 2024-02-02T13:04:13.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc265a5640 1 Processor -- start 2024-02-02T13:04:13.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc265a5640 1 -- start start 2024-02-02T13:04:13.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc265a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc200bc340 0x7fbc201406b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc265a5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc201492a0 0x7fbc201de1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc265a5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc201de6e0 0x7fbc20136a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc265a5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc201ddd70 con 0x7fbc201492a0 2024-02-02T13:04:13.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc265a5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc20141e60 con 0x7fbc200bc340 2024-02-02T13:04:13.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc265a5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc201deb90 con 0x7fbc201de6e0 2024-02-02T13:04:13.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc1f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc201492a0 0x7fbc201de1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc1f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc201492a0 0x7fbc201de1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46886/0 (socket says 172.21.15.161:46886) 2024-02-02T13:04:13.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc1f7fe640 1 -- 172.21.15.161:0/127217088 learned_addr learned my addr 172.21.15.161:0/127217088 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:13.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc24b42640 1 --2- 172.21.15.161:0/127217088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc201de6e0 0x7fbc20136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc1ffff640 1 --2- 172.21.15.161:0/127217088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc200bc340 0x7fbc201406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc1f7fe640 1 -- 172.21.15.161:0/127217088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc201de6e0 msgr2=0x7fbc20136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc1f7fe640 1 --2- 172.21.15.161:0/127217088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc201de6e0 0x7fbc20136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc1f7fe640 1 -- 172.21.15.161:0/127217088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc200bc340 msgr2=0x7fbc201406b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc1f7fe640 1 --2- 172.21.15.161:0/127217088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc200bc340 0x7fbc201406b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc1f7fe640 1 -- 172.21.15.161:0/127217088 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc140094d0 con 0x7fbc201492a0 2024-02-02T13:04:13.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc1f7fe640 1 --2- 172.21.15.161:0/127217088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc201492a0 0x7fbc201de1a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fbc140b3040 tx=0x7fbc1401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:13.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc1cff9640 1 -- 172.21.15.161:0/127217088 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc140ba600 con 0x7fbc201492a0 2024-02-02T13:04:13.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc1cff9640 1 -- 172.21.15.161:0/127217088 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc140ba780 con 0x7fbc201492a0 2024-02-02T13:04:13.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc265a5640 1 -- 172.21.15.161:0/127217088 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc20140bf0 con 0x7fbc201492a0 2024-02-02T13:04:13.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc1cff9640 1 -- 172.21.15.161:0/127217088 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc140bab30 con 0x7fbc201492a0 2024-02-02T13:04:13.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.419+0000 7fbc265a5640 1 -- 172.21.15.161:0/127217088 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc20137750 con 0x7fbc201492a0 2024-02-02T13:04:13.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.423+0000 7fbc265a5640 1 -- 172.21.15.161:0/127217088 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc2006a370 con 0x7fbc201492a0 2024-02-02T13:04:13.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.423+0000 7fbc1cff9640 1 -- 172.21.15.161:0/127217088 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbc140bac90 con 0x7fbc201492a0 2024-02-02T13:04:13.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.423+0000 7fbc1cff9640 1 --2- 172.21.15.161:0/127217088 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbc0c065a90 0x7fbc0c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.423+0000 7fbc1cff9640 1 -- 172.21.15.161:0/127217088 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbc141215d0 con 0x7fbc201492a0 2024-02-02T13:04:13.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.423+0000 7fbc1ffff640 1 --2- 172.21.15.161:0/127217088 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbc0c065a90 0x7fbc0c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.423+0000 7fbc1ffff640 1 --2- 172.21.15.161:0/127217088 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbc0c065a90 0x7fbc0c067f50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000a830 tx=0x7fbc10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:13.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.427+0000 7fbc1cff9640 1 -- 172.21.15.161:0/127217088 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbc140ef440 con 0x7fbc201492a0 2024-02-02T13:04:13.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.579+0000 7fbc265a5640 1 -- 172.21.15.161:0/127217088 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc20148840 con 0x7fbc0c065a90 2024-02-02T13:04:13.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.579+0000 7fbc1cff9640 1 -- 172.21.15.161:0/127217088 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbc1000a420 con 0x7fbc0c065a90 2024-02-02T13:04:13.584 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 2 to deep-scrub 2024-02-02T13:04:13.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.583+0000 7fbc265a5640 1 -- 172.21.15.161:0/127217088 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbc0c065a90 msgr2=0x7fbc0c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.583+0000 7fbc265a5640 1 --2- 172.21.15.161:0/127217088 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbc0c065a90 0x7fbc0c067f50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000a830 tx=0x7fbc10008040 comp rx=0 tx=0).stop 2024-02-02T13:04:13.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.583+0000 7fbc265a5640 1 -- 172.21.15.161:0/127217088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc201492a0 msgr2=0x7fbc201de1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.583+0000 7fbc265a5640 1 --2- 172.21.15.161:0/127217088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc201492a0 0x7fbc201de1a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fbc140b3040 tx=0x7fbc1401ba90 comp rx=0 tx=0).stop 2024-02-02T13:04:13.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.583+0000 7fbc265a5640 1 -- 172.21.15.161:0/127217088 shutdown_connections 2024-02-02T13:04:13.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.583+0000 7fbc265a5640 1 --2- 172.21.15.161:0/127217088 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fbc0c065a90 0x7fbc0c067f50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.583+0000 7fbc265a5640 1 --2- 172.21.15.161:0/127217088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc201de6e0 0x7fbc20136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.583+0000 7fbc265a5640 1 --2- 172.21.15.161:0/127217088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc201492a0 0x7fbc201de1a0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.583+0000 7fbc265a5640 1 --2- 172.21.15.161:0/127217088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc200bc340 0x7fbc201406b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.583+0000 7fbc265a5640 1 -- 172.21.15.161:0/127217088 >> 172.21.15.161:0/127217088 conn(0x7fbc20069ef0 msgr2=0x7fbc200b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:13.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.583+0000 7fbc265a5640 1 -- 172.21.15.161:0/127217088 shutdown_connections 2024-02-02T13:04:13.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.583+0000 7fbc265a5640 1 -- 172.21.15.161:0/127217088 wait complete. 2024-02-02T13:04:13.603 INFO:tasks.ceph:Scrubbing osd.3 2024-02-02T13:04:13.603 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-02-02T13:04:13.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.715+0000 7fabcb1ee640 1 Processor -- start 2024-02-02T13:04:13.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.715+0000 7fabcb1ee640 1 -- start start 2024-02-02T13:04:13.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.715+0000 7fabcb1ee640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fabc40b8df0 0x7fabc4142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.715+0000 7fabcb1ee640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fabc40b8540 0x7fabc4148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.715+0000 7fabcb1ee640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc4148a80 con 0x7fabc4142d80 2024-02-02T13:04:13.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.715+0000 7fabcb1ee640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc40b3890 con 0x7fabc40b8540 2024-02-02T13:04:13.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.715+0000 7fabcb1ee640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc40b3b70 con 0x7fabc40b8df0 2024-02-02T13:04:13.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.715+0000 7fabc3fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fabc40b8540 0x7fabc4148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.715+0000 7fabc3fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fabc40b8540 0x7fabc4148f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46898/0 (socket says 172.21.15.161:46898) 2024-02-02T13:04:13.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.715+0000 7fabc3fff640 1 -- 172.21.15.161:0/101506542 learned_addr learned my addr 172.21.15.161:0/101506542 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:13.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.715+0000 7fabc8f8a640 1 --2- 172.21.15.161:0/101506542 >> v2:172.21.15.162:3300/0 conn(0x7fabc40b8df0 0x7fabc4142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.715+0000 7fabc3fff640 1 -- 172.21.15.161:0/101506542 >> v2:172.21.15.162:3300/0 conn(0x7fabc40b8df0 msgr2=0x7fabc4142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:13.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.715+0000 7fabc3fff640 1 --2- 172.21.15.161:0/101506542 >> v2:172.21.15.162:3300/0 conn(0x7fabc40b8df0 0x7fabc4142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.715+0000 7fabc3fff640 1 -- 172.21.15.161:0/101506542 >> v1:172.21.15.162:6789/0 conn(0x7fabc4142d80 legacy=0x7fabc40b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:13.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.715+0000 7fabc3fff640 1 -- 172.21.15.161:0/101506542 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc40b3e50 con 0x7fabc40b8540 2024-02-02T13:04:13.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.715+0000 7fabc8f8a640 1 --2- 172.21.15.161:0/101506542 >> v2:172.21.15.162:3300/0 conn(0x7fabc40b8df0 0x7fabc4142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:13.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.715+0000 7fabc3fff640 1 --2- 172.21.15.161:0/101506542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc40b8540 0x7fabc4148f10 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fabc40b9a80 tx=0x7fabb801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3062e79b991c3a61 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:13.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.715+0000 7fabc37fe640 1 -- 172.21.15.161:0/101506542 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc4071930 con 0x7fabc40b8540 2024-02-02T13:04:13.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.715+0000 7fabc37fe640 1 -- 172.21.15.161:0/101506542 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb80aa640 con 0x7fabc40b8540 2024-02-02T13:04:13.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabc37fe640 1 -- 172.21.15.161:0/101506542 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80aa9d0 con 0x7fabc40b8540 2024-02-02T13:04:13.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabcb1ee640 1 -- 172.21.15.161:0/101506542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc40b8540 msgr2=0x7fabc4148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabcb1ee640 1 --2- 172.21.15.161:0/101506542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc40b8540 0x7fabc4148f10 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fabc40b9a80 tx=0x7fabb801c4c0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabcb1ee640 1 -- 172.21.15.161:0/101506542 shutdown_connections 2024-02-02T13:04:13.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabcb1ee640 1 --2- 172.21.15.161:0/101506542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc40b8540 0x7fabc4148f10 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabcb1ee640 1 --2- 172.21.15.161:0/101506542 >> v2:172.21.15.162:3300/0 conn(0x7fabc40b8df0 0x7fabc4142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabcb1ee640 1 -- 172.21.15.161:0/101506542 >> 172.21.15.161:0/101506542 conn(0x7fabc406a120 msgr2=0x7fabc406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:13.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabcb1ee640 1 -- 172.21.15.161:0/101506542 shutdown_connections 2024-02-02T13:04:13.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabcb1ee640 1 -- 172.21.15.161:0/101506542 wait complete. 2024-02-02T13:04:13.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabcb1ee640 1 Processor -- start 2024-02-02T13:04:13.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabcb1ee640 1 -- start start 2024-02-02T13:04:13.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabcb1ee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabc40b8540 0x7fabc4139600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabcb1ee640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc40b8df0 0x7fabc41321f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabcb1ee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabc4142d80 0x7fabc4132730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabcb1ee640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc4139b40 con 0x7fabc40b8df0 2024-02-02T13:04:13.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabcb1ee640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc413ed90 con 0x7fabc40b8540 2024-02-02T13:04:13.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabcb1ee640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc41e13d0 con 0x7fabc4142d80 2024-02-02T13:04:13.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabc3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc40b8df0 0x7fabc41321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabc3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc40b8df0 0x7fabc41321f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46908/0 (socket says 172.21.15.161:46908) 2024-02-02T13:04:13.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabc3fff640 1 -- 172.21.15.161:0/1922143589 learned_addr learned my addr 172.21.15.161:0/1922143589 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:13.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabc3fff640 1 -- 172.21.15.161:0/1922143589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabc4142d80 msgr2=0x7fabc4132730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabc3fff640 1 --2- 172.21.15.161:0/1922143589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabc4142d80 0x7fabc4132730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabc8f8a640 1 --2- 172.21.15.161:0/1922143589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabc40b8540 0x7fabc4139600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabc3fff640 1 -- 172.21.15.161:0/1922143589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabc40b8540 msgr2=0x7fabc4139600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabc3fff640 1 --2- 172.21.15.161:0/1922143589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabc40b8540 0x7fabc4139600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabc3fff640 1 -- 172.21.15.161:0/1922143589 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb80094d0 con 0x7fabc40b8df0 2024-02-02T13:04:13.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabc3fff640 1 --2- 172.21.15.161:0/1922143589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc40b8df0 0x7fabc41321f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fabb80ac040 tx=0x7fabb801ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:13.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabc17fa640 1 -- 172.21.15.161:0/1922143589 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80bd5f0 con 0x7fabc40b8df0 2024-02-02T13:04:13.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabc17fa640 1 -- 172.21.15.161:0/1922143589 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb80bd770 con 0x7fabc40b8df0 2024-02-02T13:04:13.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabcb1ee640 1 -- 172.21.15.161:0/1922143589 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc40ba540 con 0x7fabc40b8df0 2024-02-02T13:04:13.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabc17fa640 1 -- 172.21.15.161:0/1922143589 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80bdb20 con 0x7fabc40b8df0 2024-02-02T13:04:13.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabcb1ee640 1 -- 172.21.15.161:0/1922143589 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc40bcb00 con 0x7fabc40b8df0 2024-02-02T13:04:13.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.719+0000 7fabcb1ee640 1 -- 172.21.15.161:0/1922143589 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fabc40b6260 con 0x7fabc40b8df0 2024-02-02T13:04:13.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.723+0000 7fabc17fa640 1 -- 172.21.15.161:0/1922143589 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fabb80a8050 con 0x7fabc40b8df0 2024-02-02T13:04:13.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.723+0000 7fabc17fa640 1 --2- 172.21.15.161:0/1922143589 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fabb0065a90 0x7fabb0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.723+0000 7fabc17fa640 1 -- 172.21.15.161:0/1922143589 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fabb811d940 con 0x7fabc40b8df0 2024-02-02T13:04:13.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.723+0000 7fabc8f8a640 1 --2- 172.21.15.161:0/1922143589 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fabb0065a90 0x7fabb0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.723+0000 7fabc17fa640 1 --2- 172.21.15.161:0/1922143589 >> [v2:172.21.15.161:6824/27684,v1:172.21.15.161:6825/27684] conn(0x7fabb006b8f0 0x7fabb006dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.723+0000 7fabc17fa640 1 -- 172.21.15.161:0/1922143589 --> [v2:172.21.15.161:6824/27684,v1:172.21.15.161:6825/27684] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fabb006e3c0 con 0x7fabb006b8f0 2024-02-02T13:04:13.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.723+0000 7fabc17fa640 1 -- 172.21.15.161:0/1922143589 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabb811dd90 con 0x7fabc40b8df0 2024-02-02T13:04:13.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.723+0000 7fabc978b640 1 --2- 172.21.15.161:0/1922143589 >> [v2:172.21.15.161:6824/27684,v1:172.21.15.161:6825/27684] conn(0x7fabb006b8f0 0x7fabb006dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.723+0000 7fabc8f8a640 1 --2- 172.21.15.161:0/1922143589 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fabb0065a90 0x7fabb0067f50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fabb4006fd0 tx=0x7fabb4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:13.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.723+0000 7fabc978b640 1 --2- 172.21.15.161:0/1922143589 >> [v2:172.21.15.161:6824/27684,v1:172.21.15.161:6825/27684] conn(0x7fabb006b8f0 0x7fabb006dd10 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:13.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.723+0000 7fabc17fa640 1 -- 172.21.15.161:0/1922143589 <== osd.3 v2:172.21.15.161:6824/27684 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fabb006e3c0 con 0x7fabb006b8f0 2024-02-02T13:04:13.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.735+0000 7fabcb1ee640 1 -- 172.21.15.161:0/1922143589 --> [v2:172.21.15.161:6824/27684,v1:172.21.15.161:6825/27684] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fabc41e15d0 con 0x7fabb006b8f0 2024-02-02T13:04:13.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.735+0000 7fabc17fa640 1 -- 172.21.15.161:0/1922143589 <== osd.3 v2:172.21.15.161:6824/27684 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fabc41e15d0 con 0x7fabb006b8f0 2024-02-02T13:04:13.739 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-02-02T13:04:13.739 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-02-02T13:04:13.740 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-02-02T13:04:13.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.735+0000 7fabcb1ee640 1 -- 172.21.15.161:0/1922143589 >> [v2:172.21.15.161:6824/27684,v1:172.21.15.161:6825/27684] conn(0x7fabb006b8f0 msgr2=0x7fabb006dd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.735+0000 7fabcb1ee640 1 --2- 172.21.15.161:0/1922143589 >> [v2:172.21.15.161:6824/27684,v1:172.21.15.161:6825/27684] conn(0x7fabb006b8f0 0x7fabb006dd10 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.735+0000 7fabcb1ee640 1 -- 172.21.15.161:0/1922143589 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fabb0065a90 msgr2=0x7fabb0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.735+0000 7fabcb1ee640 1 --2- 172.21.15.161:0/1922143589 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fabb0065a90 0x7fabb0067f50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fabb4006fd0 tx=0x7fabb4008040 comp rx=0 tx=0).stop 2024-02-02T13:04:13.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.735+0000 7fabcb1ee640 1 -- 172.21.15.161:0/1922143589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc40b8df0 msgr2=0x7fabc41321f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.735+0000 7fabcb1ee640 1 --2- 172.21.15.161:0/1922143589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc40b8df0 0x7fabc41321f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fabb80ac040 tx=0x7fabb801ad00 comp rx=0 tx=0).stop 2024-02-02T13:04:13.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.735+0000 7fabc978b640 1 -- 172.21.15.161:0/1922143589 reap_dead start 2024-02-02T13:04:13.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.735+0000 7fabcb1ee640 1 -- 172.21.15.161:0/1922143589 shutdown_connections 2024-02-02T13:04:13.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.735+0000 7fabcb1ee640 1 -- 172.21.15.161:0/1922143589 >> 172.21.15.161:0/1922143589 conn(0x7fabc406a120 msgr2=0x7fabc413a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:13.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.735+0000 7fabcb1ee640 1 -- 172.21.15.161:0/1922143589 shutdown_connections 2024-02-02T13:04:13.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.735+0000 7fabcb1ee640 1 -- 172.21.15.161:0/1922143589 wait complete. 2024-02-02T13:04:13.754 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-02-02T13:04:13.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef7dda6640 1 Processor -- start 2024-02-02T13:04:13.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef7dda6640 1 -- start start 2024-02-02T13:04:13.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef7dda6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fef78071160 0x7fef780b9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef7dda6640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef780b3c40 con 0x7fef781429f0 2024-02-02T13:04:13.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef7dda6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef780b4720 con 0x7fef780b42d0 2024-02-02T13:04:13.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef7dda6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef780b5140 con 0x7fef78071160 2024-02-02T13:04:13.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef77fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fef781429f0 0x7fef78153260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47408/0 (socket says 172.21.15.161:47408) 2024-02-02T13:04:13.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef77fff640 1 -- 172.21.15.161:0/1365249726 learned_addr learned my addr 172.21.15.161:0/1365249726 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:04:13.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef777fe640 1 --2- 172.21.15.161:0/1365249726 >> v2:172.21.15.162:3300/0 conn(0x7fef78071160 0x7fef780b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef76ffd640 1 -- 172.21.15.161:0/1365249726 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218176430 0 0) 0x7fef780b3c40 con 0x7fef781429f0 2024-02-02T13:04:13.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef76ffd640 1 -- 172.21.15.161:0/1365249726 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef64003530 con 0x7fef781429f0 2024-02-02T13:04:13.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef76ffd640 1 -- 172.21.15.161:0/1365249726 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1553900147 0 0) 0x7fef64003530 con 0x7fef781429f0 2024-02-02T13:04:13.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef76ffd640 1 -- 172.21.15.161:0/1365249726 >> v2:172.21.15.162:3300/0 conn(0x7fef78071160 msgr2=0x7fef780b9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:13.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef76ffd640 1 --2- 172.21.15.161:0/1365249726 >> v2:172.21.15.162:3300/0 conn(0x7fef78071160 0x7fef780b9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef76ffd640 1 -- 172.21.15.161:0/1365249726 >> v1:172.21.15.162:6789/0 conn(0x7fef780b42d0 legacy=0x7fef780b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef76ffd640 1 -- 172.21.15.161:0/1365249726 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef780b9f60 con 0x7fef781429f0 2024-02-02T13:04:13.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef76ffd640 1 -- 172.21.15.161:0/1365249726 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7fef70001a00 con 0x7fef781429f0 2024-02-02T13:04:13.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef76ffd640 1 -- 172.21.15.161:0/1365249726 >> v1:172.21.15.161:6789/0 conn(0x7fef781429f0 legacy=0x7fef78153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef76ffd640 1 --2- 172.21.15.161:0/1365249726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef64003980 0x7fef64003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef76ffd640 1 --2- 172.21.15.161:0/1365249726 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef640047d0 0x7fef64004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef76ffd640 1 --2- 172.21.15.161:0/1365249726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef64005190 0x7fef6400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef76ffd640 1 -- 172.21.15.161:0/1365249726 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef780b5140 con 0x7fef640047d0 2024-02-02T13:04:13.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef76ffd640 1 -- 172.21.15.161:0/1365249726 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6400c130 con 0x7fef64003980 2024-02-02T13:04:13.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef76ffd640 1 -- 172.21.15.161:0/1365249726 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6400c2f0 con 0x7fef64005190 2024-02-02T13:04:13.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.855+0000 7fef6effd640 1 --2- 172.21.15.161:0/1365249726 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef640047d0 0x7fef64004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef777fe640 1 --2- 172.21.15.161:0/1365249726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef64003980 0x7fef64003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef6effd640 1 -- 172.21.15.161:0/1365249726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef64005190 msgr2=0x7fef6400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:13.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef6effd640 1 --2- 172.21.15.161:0/1365249726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef64005190 0x7fef6400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef6effd640 1 -- 172.21.15.161:0/1365249726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef64003980 msgr2=0x7fef64003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:13.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef6effd640 1 --2- 172.21.15.161:0/1365249726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef64003980 0x7fef64003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef6effd640 1 -- 172.21.15.161:0/1365249726 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef64003530 con 0x7fef640047d0 2024-02-02T13:04:13.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef77fff640 1 -- 172.21.15.161:0/1365249726 reap_dead start 2024-02-02T13:04:13.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef6effd640 1 --2- 172.21.15.161:0/1365249726 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef640047d0 0x7fef64004c50 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fef60001780 tx=0x7fef6001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d7b353251e9f48 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:13.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef76ffd640 1 -- 172.21.15.161:0/1365249726 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef600052d0 con 0x7fef640047d0 2024-02-02T13:04:13.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef76ffd640 1 -- 172.21.15.161:0/1365249726 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef600a7050 con 0x7fef640047d0 2024-02-02T13:04:13.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef76ffd640 1 -- 172.21.15.161:0/1365249726 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60003600 con 0x7fef640047d0 2024-02-02T13:04:13.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef7dda6640 1 -- 172.21.15.161:0/1365249726 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef640047d0 msgr2=0x7fef64004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef7dda6640 1 --2- 172.21.15.161:0/1365249726 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef640047d0 0x7fef64004c50 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fef60001780 tx=0x7fef6001c3b0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef7dda6640 1 -- 172.21.15.161:0/1365249726 shutdown_connections 2024-02-02T13:04:13.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef7dda6640 1 --2- 172.21.15.161:0/1365249726 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef640047d0 0x7fef64004c50 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef7dda6640 1 -- 172.21.15.161:0/1365249726 >> 172.21.15.161:0/1365249726 conn(0x7fef780be150 msgr2=0x7fef780be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:13.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef7dda6640 1 -- 172.21.15.161:0/1365249726 shutdown_connections 2024-02-02T13:04:13.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef7dda6640 1 -- 172.21.15.161:0/1365249726 wait complete. 2024-02-02T13:04:13.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef7dda6640 1 Processor -- start 2024-02-02T13:04:13.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.859+0000 7fef7dda6640 1 -- start start 2024-02-02T13:04:13.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef7dda6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef640047d0 0x7fef7806c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef7dda6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef7814ba50 0x7fef7809d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef7dda6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef780b79f0 0x7fef780b7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef7dda6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7809ee50 con 0x7fef640047d0 2024-02-02T13:04:13.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef7dda6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7806ca40 con 0x7fef7814ba50 2024-02-02T13:04:13.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef7dda6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7814a5f0 con 0x7fef780b79f0 2024-02-02T13:04:13.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef777fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef640047d0 0x7fef7806c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef777fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef640047d0 0x7fef7806c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46938/0 (socket says 172.21.15.161:46938) 2024-02-02T13:04:13.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef777fe640 1 -- 172.21.15.161:0/2867546761 learned_addr learned my addr 172.21.15.161:0/2867546761 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:13.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef6effd640 1 --2- 172.21.15.161:0/2867546761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef7814ba50 0x7fef7809d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef77fff640 1 --2- 172.21.15.161:0/2867546761 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef780b79f0 0x7fef780b7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef777fe640 1 -- 172.21.15.161:0/2867546761 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef780b79f0 msgr2=0x7fef780b7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef777fe640 1 --2- 172.21.15.161:0/2867546761 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef780b79f0 0x7fef780b7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef777fe640 1 -- 172.21.15.161:0/2867546761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef7814ba50 msgr2=0x7fef7809d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:13.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef777fe640 1 --2- 172.21.15.161:0/2867546761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef7814ba50 0x7fef7809d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:13.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef777fe640 1 -- 172.21.15.161:0/2867546761 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef780b83c0 con 0x7fef640047d0 2024-02-02T13:04:13.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef6effd640 1 --2- 172.21.15.161:0/2867546761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef7814ba50 0x7fef7809d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:13.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef777fe640 1 --2- 172.21.15.161:0/2867546761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef640047d0 0x7fef7806c500 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fef68010900 tx=0x7fef68010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:13.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef74ff9640 1 -- 172.21.15.161:0/2867546761 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef680096b0 con 0x7fef640047d0 2024-02-02T13:04:13.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef74ff9640 1 -- 172.21.15.161:0/2867546761 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6800ebc0 con 0x7fef640047d0 2024-02-02T13:04:13.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef74ff9640 1 -- 172.21.15.161:0/2867546761 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6801c400 con 0x7fef640047d0 2024-02-02T13:04:13.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef7dda6640 1 -- 172.21.15.161:0/2867546761 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7809fb10 con 0x7fef640047d0 2024-02-02T13:04:13.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef7dda6640 1 -- 172.21.15.161:0/2867546761 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef78149fa0 con 0x7fef640047d0 2024-02-02T13:04:13.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef7dda6640 1 -- 172.21.15.161:0/2867546761 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7804e000 con 0x7fef640047d0 2024-02-02T13:04:13.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef74ff9640 1 -- 172.21.15.161:0/2867546761 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fef6801c560 con 0x7fef640047d0 2024-02-02T13:04:13.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef74ff9640 1 --2- 172.21.15.161:0/2867546761 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fef58065a60 0x7fef58067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:13.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef6effd640 1 --2- 172.21.15.161:0/2867546761 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fef58065a60 0x7fef58067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:13.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.863+0000 7fef74ff9640 1 -- 172.21.15.161:0/2867546761 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fef68083430 con 0x7fef640047d0 2024-02-02T13:04:13.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.867+0000 7fef6effd640 1 --2- 172.21.15.161:0/2867546761 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fef58065a60 0x7fef58067f20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fef60001750 tx=0x7fef600011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:13.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:13.867+0000 7fef74ff9640 1 -- 172.21.15.161:0/2867546761 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fef68051230 con 0x7fef640047d0 2024-02-02T13:04:14.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.011+0000 7fef7dda6640 1 -- 172.21.15.161:0/2867546761 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fef780ba800 con 0x7fef58065a60 2024-02-02T13:04:14.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.011+0000 7fef74ff9640 1 -- 172.21.15.161:0/2867546761 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fef60005250 con 0x7fef58065a60 2024-02-02T13:04:14.017 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 3 to deep-scrub 2024-02-02T13:04:14.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.015+0000 7fef7dda6640 1 -- 172.21.15.161:0/2867546761 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fef58065a60 msgr2=0x7fef58067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.015+0000 7fef7dda6640 1 --2- 172.21.15.161:0/2867546761 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fef58065a60 0x7fef58067f20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fef60001750 tx=0x7fef600011a0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.015+0000 7fef7dda6640 1 -- 172.21.15.161:0/2867546761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef640047d0 msgr2=0x7fef7806c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.015+0000 7fef7dda6640 1 --2- 172.21.15.161:0/2867546761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef640047d0 0x7fef7806c500 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fef68010900 tx=0x7fef68010dc0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.015+0000 7fef7dda6640 1 -- 172.21.15.161:0/2867546761 shutdown_connections 2024-02-02T13:04:14.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.015+0000 7fef7dda6640 1 --2- 172.21.15.161:0/2867546761 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fef58065a60 0x7fef58067f20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.015+0000 7fef7dda6640 1 --2- 172.21.15.161:0/2867546761 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef780b79f0 0x7fef780b7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.015+0000 7fef7dda6640 1 --2- 172.21.15.161:0/2867546761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef7814ba50 0x7fef7809d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.015+0000 7fef7dda6640 1 --2- 172.21.15.161:0/2867546761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef640047d0 0x7fef7806c500 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.015+0000 7fef7dda6640 1 -- 172.21.15.161:0/2867546761 >> 172.21.15.161:0/2867546761 conn(0x7fef780be150 msgr2=0x7fef780bb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:14.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.015+0000 7fef7dda6640 1 -- 172.21.15.161:0/2867546761 shutdown_connections 2024-02-02T13:04:14.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.015+0000 7fef7dda6640 1 -- 172.21.15.161:0/2867546761 wait complete. 2024-02-02T13:04:14.034 INFO:tasks.ceph:Scrubbing osd.4 2024-02-02T13:04:14.035 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-02-02T13:04:14.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f09150d8640 1 Processor -- start 2024-02-02T13:04:14.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f09150d8640 1 -- start start 2024-02-02T13:04:14.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f09150d8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09100b90e0 0x7f09100ba190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f09150d8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0910070cc0 0x7f0910142590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f09150d8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09100b8690 con 0x7f09100b6880 2024-02-02T13:04:14.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f09150d8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09100b9520 con 0x7f0910070cc0 2024-02-02T13:04:14.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f09150d8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09100b80c0 con 0x7f09100b90e0 2024-02-02T13:04:14.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090ed9d640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f09100b6880 0x7f09100b7910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47414/0 (socket says 172.21.15.161:47414) 2024-02-02T13:04:14.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090ed9d640 1 -- 172.21.15.161:0/861847839 learned_addr learned my addr 172.21.15.161:0/861847839 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:04:14.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090f59e640 1 --2- 172.21.15.161:0/861847839 >> v2:172.21.15.162:3300/0 conn(0x7f0910070cc0 0x7f0910142590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090e59c640 1 --2- 172.21.15.161:0/861847839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09100b90e0 0x7f09100ba190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090dd9b640 1 -- 172.21.15.161:0/861847839 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181869381 0 0) 0x7f09100b8690 con 0x7f09100b6880 2024-02-02T13:04:14.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090dd9b640 1 -- 172.21.15.161:0/861847839 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08fc003530 con 0x7f09100b6880 2024-02-02T13:04:14.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090dd9b640 1 -- 172.21.15.161:0/861847839 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 139743044 0 0) 0x7f08fc003530 con 0x7f09100b6880 2024-02-02T13:04:14.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090dd9b640 1 -- 172.21.15.161:0/861847839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09100b90e0 msgr2=0x7f09100ba190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:14.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090dd9b640 1 --2- 172.21.15.161:0/861847839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09100b90e0 0x7f09100ba190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090dd9b640 1 -- 172.21.15.161:0/861847839 >> v2:172.21.15.162:3300/0 conn(0x7f0910070cc0 msgr2=0x7f0910142590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:14.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090dd9b640 1 --2- 172.21.15.161:0/861847839 >> v2:172.21.15.162:3300/0 conn(0x7f0910070cc0 0x7f0910142590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090dd9b640 1 -- 172.21.15.161:0/861847839 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09100b88e0 con 0x7f09100b6880 2024-02-02T13:04:14.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090dd9b640 1 -- 172.21.15.161:0/861847839 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f0908001680 con 0x7f09100b6880 2024-02-02T13:04:14.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090dd9b640 1 -- 172.21.15.161:0/861847839 >> v1:172.21.15.161:6789/0 conn(0x7f09100b6880 legacy=0x7f09100b7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090dd9b640 1 --2- 172.21.15.161:0/861847839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc003980 0x7f08fc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090dd9b640 1 --2- 172.21.15.161:0/861847839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09100b90e0 0x7f08fc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090dd9b640 1 --2- 172.21.15.161:0/861847839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08fc004d10 0x7f08fc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090dd9b640 1 -- 172.21.15.161:0/861847839 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09100b9520 con 0x7f08fc003980 2024-02-02T13:04:14.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090dd9b640 1 -- 172.21.15.161:0/861847839 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09100b80c0 con 0x7f08fc004d10 2024-02-02T13:04:14.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090dd9b640 1 -- 172.21.15.161:0/861847839 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc00b990 con 0x7f09100b90e0 2024-02-02T13:04:14.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090ed9d640 1 --2- 172.21.15.161:0/861847839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc003980 0x7f08fc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090e59c640 1 --2- 172.21.15.161:0/861847839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09100b90e0 0x7f08fc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090ed9d640 1 -- 172.21.15.161:0/861847839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09100b90e0 msgr2=0x7f08fc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:14.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090ed9d640 1 --2- 172.21.15.161:0/861847839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09100b90e0 0x7f08fc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090ed9d640 1 -- 172.21.15.161:0/861847839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08fc004d10 msgr2=0x7f08fc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:14.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090f59e640 1 --2- 172.21.15.161:0/861847839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08fc004d10 0x7f08fc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090ed9d640 1 --2- 172.21.15.161:0/861847839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08fc004d10 0x7f08fc005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090ed9d640 1 -- 172.21.15.161:0/861847839 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc003530 con 0x7f08fc003980 2024-02-02T13:04:14.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.143+0000 7f090e59c640 1 --2- 172.21.15.161:0/861847839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09100b90e0 0x7f08fc0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:14.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.147+0000 7f090ed9d640 1 --2- 172.21.15.161:0/861847839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc003980 0x7f08fc003da0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f090800c2c0 tx=0x7f090801cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb3e881d9fbd7fee server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:14.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.147+0000 7f090dd9b640 1 -- 172.21.15.161:0/861847839 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09080a5900 con 0x7f08fc003980 2024-02-02T13:04:14.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.147+0000 7f090dd9b640 1 -- 172.21.15.161:0/861847839 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09080a5a60 con 0x7f08fc003980 2024-02-02T13:04:14.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.147+0000 7f090dd9b640 1 -- 172.21.15.161:0/861847839 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09080a5e10 con 0x7f08fc003980 2024-02-02T13:04:14.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.147+0000 7f09150d8640 1 -- 172.21.15.161:0/861847839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc003980 msgr2=0x7f08fc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.147+0000 7f09150d8640 1 --2- 172.21.15.161:0/861847839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08fc003980 0x7f08fc003da0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f090800c2c0 tx=0x7f090801cc90 comp rx=0 tx=0).stop 2024-02-02T13:04:14.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.147+0000 7f090f59e640 1 -- 172.21.15.161:0/861847839 reap_dead start 2024-02-02T13:04:14.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.147+0000 7f09150d8640 1 -- 172.21.15.161:0/861847839 shutdown_connections 2024-02-02T13:04:14.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.147+0000 7f09150d8640 1 -- 172.21.15.161:0/861847839 >> 172.21.15.161:0/861847839 conn(0x7f09100bcf70 msgr2=0x7f09100bd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:14.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.147+0000 7f09150d8640 1 -- 172.21.15.161:0/861847839 shutdown_connections 2024-02-02T13:04:14.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.147+0000 7f09150d8640 1 -- 172.21.15.161:0/861847839 wait complete. 2024-02-02T13:04:14.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09150d8640 1 Processor -- start 2024-02-02T13:04:14.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09150d8640 1 -- start start 2024-02-02T13:04:14.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09150d8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08fc003980 0x7f0910147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09150d8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09101482b0 0x7f091013a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09150d8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f091013a790 0x7f09101e0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09150d8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0910146220 con 0x7f091013a790 2024-02-02T13:04:14.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09150d8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09101478d0 con 0x7f08fc003980 2024-02-02T13:04:14.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09150d8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0910145f60 con 0x7f09101482b0 2024-02-02T13:04:14.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f090f59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f091013a790 0x7f09101e0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f090f59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f091013a790 0x7f09101e0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46964/0 (socket says 172.21.15.161:46964) 2024-02-02T13:04:14.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f090f59e640 1 -- 172.21.15.161:0/2727820115 learned_addr learned my addr 172.21.15.161:0/2727820115 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:14.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f090f59e640 1 -- 172.21.15.161:0/2727820115 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09101482b0 msgr2=0x7f091013a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f090f59e640 1 --2- 172.21.15.161:0/2727820115 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09101482b0 0x7f091013a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f090f59e640 1 -- 172.21.15.161:0/2727820115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08fc003980 msgr2=0x7f0910147390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f090f59e640 1 --2- 172.21.15.161:0/2727820115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08fc003980 0x7f0910147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f090f59e640 1 -- 172.21.15.161:0/2727820115 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09100bca30 con 0x7f091013a790 2024-02-02T13:04:14.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f090f59e640 1 --2- 172.21.15.161:0/2727820115 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f091013a790 0x7f09101e0840 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0910071ea0 tx=0x7f0900010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:14.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09077fe640 1 -- 172.21.15.161:0/2727820115 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000e8a0 con 0x7f091013a790 2024-02-02T13:04:14.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09077fe640 1 -- 172.21.15.161:0/2727820115 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090000ea20 con 0x7f091013a790 2024-02-02T13:04:14.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09150d8640 1 -- 172.21.15.161:0/2727820115 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0910148ae0 con 0x7f091013a790 2024-02-02T13:04:14.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09077fe640 1 -- 172.21.15.161:0/2727820115 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000edd0 con 0x7f091013a790 2024-02-02T13:04:14.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09150d8640 1 -- 172.21.15.161:0/2727820115 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0910140740 con 0x7f091013a790 2024-02-02T13:04:14.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09150d8640 1 -- 172.21.15.161:0/2727820115 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09100b6c60 con 0x7f091013a790 2024-02-02T13:04:14.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09077fe640 1 -- 172.21.15.161:0/2727820115 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f09000253f0 con 0x7f091013a790 2024-02-02T13:04:14.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09077fe640 1 --2- 172.21.15.161:0/2727820115 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f08f0065a60 0x7f08f0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09077fe640 1 -- 172.21.15.161:0/2727820115 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0900082f80 con 0x7f091013a790 2024-02-02T13:04:14.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f090ed9d640 1 --2- 172.21.15.161:0/2727820115 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f08f0065a60 0x7f08f0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09077fe640 1 --2- 172.21.15.161:0/2727820115 >> [v2:172.21.15.162:6816/27912,v1:172.21.15.162:6817/27912] conn(0x7f08f006b8c0 0x7f08f006dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09077fe640 1 -- 172.21.15.161:0/2727820115 --> [v2:172.21.15.162:6816/27912,v1:172.21.15.162:6817/27912] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f08f006e390 con 0x7f08f006b8c0 2024-02-02T13:04:14.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f09077fe640 1 -- 172.21.15.161:0/2727820115 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09000855e0 con 0x7f091013a790 2024-02-02T13:04:14.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f090ed9d640 1 --2- 172.21.15.161:0/2727820115 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f08f0065a60 0x7f08f0067f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f09080aa000 tx=0x7f0908000ff0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:14.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.151+0000 7f090e59c640 1 --2- 172.21.15.161:0/2727820115 >> [v2:172.21.15.162:6816/27912,v1:172.21.15.162:6817/27912] conn(0x7f08f006b8c0 0x7f08f006dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.155+0000 7f090e59c640 1 --2- 172.21.15.161:0/2727820115 >> [v2:172.21.15.162:6816/27912,v1:172.21.15.162:6817/27912] conn(0x7f08f006b8c0 0x7f08f006dce0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:14.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.155+0000 7f09077fe640 1 -- 172.21.15.161:0/2727820115 <== osd.4 v2:172.21.15.162:6816/27912 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f08f006e390 con 0x7f08f006b8c0 2024-02-02T13:04:14.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.167+0000 7f09150d8640 1 -- 172.21.15.161:0/2727820115 --> [v2:172.21.15.162:6816/27912,v1:172.21.15.162:6817/27912] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0910142ee0 con 0x7f08f006b8c0 2024-02-02T13:04:14.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.167+0000 7f09077fe640 1 -- 172.21.15.161:0/2727820115 <== osd.4 v2:172.21.15.162:6816/27912 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f08f8011040 con 0x7f08f006b8c0 2024-02-02T13:04:14.171 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-02-02T13:04:14.171 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-02-02T13:04:14.171 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-02-02T13:04:14.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.167+0000 7f09150d8640 1 -- 172.21.15.161:0/2727820115 >> [v2:172.21.15.162:6816/27912,v1:172.21.15.162:6817/27912] conn(0x7f08f006b8c0 msgr2=0x7f08f006dce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.167+0000 7f09150d8640 1 --2- 172.21.15.161:0/2727820115 >> [v2:172.21.15.162:6816/27912,v1:172.21.15.162:6817/27912] conn(0x7f08f006b8c0 0x7f08f006dce0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.167+0000 7f09150d8640 1 -- 172.21.15.161:0/2727820115 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f08f0065a60 msgr2=0x7f08f0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.167+0000 7f09150d8640 1 --2- 172.21.15.161:0/2727820115 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f08f0065a60 0x7f08f0067f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f09080aa000 tx=0x7f0908000ff0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.167+0000 7f09150d8640 1 -- 172.21.15.161:0/2727820115 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f091013a790 msgr2=0x7f09101e0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.167+0000 7f09150d8640 1 --2- 172.21.15.161:0/2727820115 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f091013a790 0x7f09101e0840 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0910071ea0 tx=0x7f0900010c20 comp rx=0 tx=0).stop 2024-02-02T13:04:14.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.167+0000 7f090f59e640 1 -- 172.21.15.161:0/2727820115 reap_dead start 2024-02-02T13:04:14.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.167+0000 7f09150d8640 1 -- 172.21.15.161:0/2727820115 shutdown_connections 2024-02-02T13:04:14.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.167+0000 7f09150d8640 1 -- 172.21.15.161:0/2727820115 >> 172.21.15.161:0/2727820115 conn(0x7f09100bcf70 msgr2=0x7f091013d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:14.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.167+0000 7f09150d8640 1 -- 172.21.15.161:0/2727820115 shutdown_connections 2024-02-02T13:04:14.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.167+0000 7f09150d8640 1 -- 172.21.15.161:0/2727820115 wait complete. 2024-02-02T13:04:14.186 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-02-02T13:04:14.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.295+0000 7fcd269bb640 1 Processor -- start 2024-02-02T13:04:14.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.295+0000 7fcd269bb640 1 -- start start 2024-02-02T13:04:14.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.295+0000 7fcd269bb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcd200bc340 0x7fcd201415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.295+0000 7fcd269bb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd20141b30 0x7fcd20147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.295+0000 7fcd269bb640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcd200b8020 0x7fcd201481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.295+0000 7fcd269bb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd20071550 con 0x7fcd200bc340 2024-02-02T13:04:14.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.295+0000 7fcd269bb640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd20071810 con 0x7fcd200b8020 2024-02-02T13:04:14.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.295+0000 7fcd269bb640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd200bc720 con 0x7fcd20141b30 2024-02-02T13:04:14.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.295+0000 7fcd1ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcd200bc340 0x7fcd201415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.295+0000 7fcd1ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcd200bc340 0x7fcd201415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46966/0 (socket says 172.21.15.161:46966) 2024-02-02T13:04:14.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.295+0000 7fcd1ffff640 1 -- 172.21.15.161:0/1340331318 learned_addr learned my addr 172.21.15.161:0/1340331318 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:14.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.295+0000 7fcd17fff640 1 --2- 172.21.15.161:0/1340331318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd20141b30 0x7fcd20147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.295+0000 7fcd24f58640 1 --2- 172.21.15.161:0/1340331318 >> v2:172.21.15.162:3300/0 conn(0x7fcd200b8020 0x7fcd201481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.295+0000 7fcd1ffff640 1 -- 172.21.15.161:0/1340331318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd20141b30 msgr2=0x7fcd20147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:14.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.295+0000 7fcd1ffff640 1 --2- 172.21.15.161:0/1340331318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd20141b30 0x7fcd20147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.295+0000 7fcd1ffff640 1 -- 172.21.15.161:0/1340331318 >> v2:172.21.15.162:3300/0 conn(0x7fcd200b8020 msgr2=0x7fcd201481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:14.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.295+0000 7fcd1ffff640 1 --2- 172.21.15.161:0/1340331318 >> v2:172.21.15.162:3300/0 conn(0x7fcd200b8020 0x7fcd201481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.295+0000 7fcd1ffff640 1 -- 172.21.15.161:0/1340331318 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd200b2d90 con 0x7fcd200bc340 2024-02-02T13:04:14.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.295+0000 7fcd1ffff640 1 --2- 172.21.15.161:0/1340331318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd200bc340 0x7fcd201415f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fcd200b4090 tx=0x7fcd1001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89dbb5e747c3ef7 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:14.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd1f7fe640 1 -- 172.21.15.161:0/1340331318 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd100ab600 con 0x7fcd200bc340 2024-02-02T13:04:14.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd1f7fe640 1 -- 172.21.15.161:0/1340331318 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd100a7050 con 0x7fcd200bc340 2024-02-02T13:04:14.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd1f7fe640 1 -- 172.21.15.161:0/1340331318 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd100ab980 con 0x7fcd200bc340 2024-02-02T13:04:14.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd269bb640 1 -- 172.21.15.161:0/1340331318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd200bc340 msgr2=0x7fcd201415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd269bb640 1 --2- 172.21.15.161:0/1340331318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd200bc340 0x7fcd201415f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fcd200b4090 tx=0x7fcd1001c470 comp rx=0 tx=0).stop 2024-02-02T13:04:14.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd269bb640 1 -- 172.21.15.161:0/1340331318 shutdown_connections 2024-02-02T13:04:14.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd269bb640 1 --2- 172.21.15.161:0/1340331318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd20141b30 0x7fcd20147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd269bb640 1 --2- 172.21.15.161:0/1340331318 >> v2:172.21.15.162:3300/0 conn(0x7fcd200b8020 0x7fcd201481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd269bb640 1 --2- 172.21.15.161:0/1340331318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd200bc340 0x7fcd201415f0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd269bb640 1 -- 172.21.15.161:0/1340331318 >> 172.21.15.161:0/1340331318 conn(0x7fcd20069ef0 msgr2=0x7fcd2006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:14.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd269bb640 1 -- 172.21.15.161:0/1340331318 shutdown_connections 2024-02-02T13:04:14.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd269bb640 1 -- 172.21.15.161:0/1340331318 wait complete. 2024-02-02T13:04:14.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd269bb640 1 Processor -- start 2024-02-02T13:04:14.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd269bb640 1 -- start start 2024-02-02T13:04:14.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd269bb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd200b8020 0x7fcd201e1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd269bb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd200bc340 0x7fcd201e3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd269bb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd20141b30 0x7fcd200b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd269bb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd20139370 con 0x7fcd200b8020 2024-02-02T13:04:14.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd269bb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd200b7540 con 0x7fcd200bc340 2024-02-02T13:04:14.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd269bb640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd20137740 con 0x7fcd20141b30 2024-02-02T13:04:14.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd1ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd200b8020 0x7fcd201e1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd1ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd200b8020 0x7fcd201e1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46970/0 (socket says 172.21.15.161:46970) 2024-02-02T13:04:14.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd1ffff640 1 -- 172.21.15.161:0/3537833432 learned_addr learned my addr 172.21.15.161:0/3537833432 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:14.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd24f58640 1 --2- 172.21.15.161:0/3537833432 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd20141b30 0x7fcd200b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd17fff640 1 --2- 172.21.15.161:0/3537833432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd200bc340 0x7fcd201e3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd1ffff640 1 -- 172.21.15.161:0/3537833432 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd20141b30 msgr2=0x7fcd200b7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd1ffff640 1 --2- 172.21.15.161:0/3537833432 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd20141b30 0x7fcd200b7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd1ffff640 1 -- 172.21.15.161:0/3537833432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd200bc340 msgr2=0x7fcd201e3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd1ffff640 1 --2- 172.21.15.161:0/3537833432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd200bc340 0x7fcd201e3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd1ffff640 1 -- 172.21.15.161:0/3537833432 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd100094d0 con 0x7fcd200b8020 2024-02-02T13:04:14.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd24f58640 1 --2- 172.21.15.161:0/3537833432 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd20141b30 0x7fcd200b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:14.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd17fff640 1 --2- 172.21.15.161:0/3537833432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd200bc340 0x7fcd201e3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:14.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd1ffff640 1 --2- 172.21.15.161:0/3537833432 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd200b8020 0x7fcd201e1280 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fcd10000c10 tx=0x7fcd10019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:14.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd1d7fa640 1 -- 172.21.15.161:0/3537833432 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd100b5810 con 0x7fcd200b8020 2024-02-02T13:04:14.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd1d7fa640 1 -- 172.21.15.161:0/3537833432 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd100b5990 con 0x7fcd200b8020 2024-02-02T13:04:14.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd269bb640 1 -- 172.21.15.161:0/3537833432 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd201e07a0 con 0x7fcd200b8020 2024-02-02T13:04:14.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd1d7fa640 1 -- 172.21.15.161:0/3537833432 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd100b5d40 con 0x7fcd200b8020 2024-02-02T13:04:14.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.299+0000 7fcd269bb640 1 -- 172.21.15.161:0/3537833432 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd201e0d60 con 0x7fcd200b8020 2024-02-02T13:04:14.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.303+0000 7fcd269bb640 1 -- 172.21.15.161:0/3537833432 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd201e0f50 con 0x7fcd200b8020 2024-02-02T13:04:14.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.303+0000 7fcd1d7fa640 1 -- 172.21.15.161:0/3537833432 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcd100b43a0 con 0x7fcd200b8020 2024-02-02T13:04:14.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.303+0000 7fcd1d7fa640 1 --2- 172.21.15.161:0/3537833432 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fcd00065a60 0x7fcd00067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.303+0000 7fcd17fff640 1 --2- 172.21.15.161:0/3537833432 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fcd00065a60 0x7fcd00067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.303+0000 7fcd1d7fa640 1 -- 172.21.15.161:0/3537833432 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcd1011d750 con 0x7fcd200b8020 2024-02-02T13:04:14.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.303+0000 7fcd17fff640 1 --2- 172.21.15.161:0/3537833432 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fcd00065a60 0x7fcd00067f20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcd200b77d0 tx=0x7fcd08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:14.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.307+0000 7fcd1d7fa640 1 -- 172.21.15.161:0/3537833432 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcd100eb5c0 con 0x7fcd200b8020 2024-02-02T13:04:14.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.455+0000 7fcd269bb640 1 -- 172.21.15.161:0/3537833432 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd200b2f20 con 0x7fcd00065a60 2024-02-02T13:04:14.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.455+0000 7fcd1d7fa640 1 -- 172.21.15.161:0/3537833432 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcd08009d70 con 0x7fcd00065a60 2024-02-02T13:04:14.458 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 4 to deep-scrub 2024-02-02T13:04:14.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.455+0000 7fcd269bb640 1 -- 172.21.15.161:0/3537833432 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fcd00065a60 msgr2=0x7fcd00067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.455+0000 7fcd269bb640 1 --2- 172.21.15.161:0/3537833432 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fcd00065a60 0x7fcd00067f20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcd200b77d0 tx=0x7fcd08008040 comp rx=0 tx=0).stop 2024-02-02T13:04:14.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.455+0000 7fcd269bb640 1 -- 172.21.15.161:0/3537833432 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd200b8020 msgr2=0x7fcd201e1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.455+0000 7fcd269bb640 1 --2- 172.21.15.161:0/3537833432 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd200b8020 0x7fcd201e1280 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fcd10000c10 tx=0x7fcd10019210 comp rx=0 tx=0).stop 2024-02-02T13:04:14.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.455+0000 7fcd269bb640 1 -- 172.21.15.161:0/3537833432 shutdown_connections 2024-02-02T13:04:14.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.455+0000 7fcd269bb640 1 --2- 172.21.15.161:0/3537833432 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fcd00065a60 0x7fcd00067f20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.455+0000 7fcd269bb640 1 --2- 172.21.15.161:0/3537833432 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd20141b30 0x7fcd200b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.455+0000 7fcd269bb640 1 --2- 172.21.15.161:0/3537833432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd200bc340 0x7fcd201e3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.455+0000 7fcd269bb640 1 --2- 172.21.15.161:0/3537833432 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd200b8020 0x7fcd201e1280 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.455+0000 7fcd269bb640 1 -- 172.21.15.161:0/3537833432 >> 172.21.15.161:0/3537833432 conn(0x7fcd20069ef0 msgr2=0x7fcd2006f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:14.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.455+0000 7fcd269bb640 1 -- 172.21.15.161:0/3537833432 shutdown_connections 2024-02-02T13:04:14.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.455+0000 7fcd269bb640 1 -- 172.21.15.161:0/3537833432 wait complete. 2024-02-02T13:04:14.476 INFO:tasks.ceph:Scrubbing osd.5 2024-02-02T13:04:14.477 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-02-02T13:04:14.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.595+0000 7ff9d4622640 1 Processor -- start 2024-02-02T13:04:14.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.595+0000 7ff9d4622640 1 -- start start 2024-02-02T13:04:14.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d4622640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9cc0b8df0 0x7ff9cc147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d4622640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff9cc070e40 0x7ff9cc141620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d4622640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff9cc0b8530 0x7ff9cc141b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d4622640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9cc0b30e0 con 0x7ff9cc0b8530 2024-02-02T13:04:14.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d4622640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9cc0b3770 con 0x7ff9cc070e40 2024-02-02T13:04:14.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d4622640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc147780 con 0x7ff9cc0b8df0 2024-02-02T13:04:14.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d2bbf640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff9cc0b8530 0x7ff9cc141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d2bbf640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff9cc0b8530 0x7ff9cc141b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46978/0 (socket says 172.21.15.161:46978) 2024-02-02T13:04:14.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d2bbf640 1 -- 172.21.15.161:0/3124601976 learned_addr learned my addr 172.21.15.161:0/3124601976 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:14.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d23be640 1 --2- 172.21.15.161:0/3124601976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9cc0b8df0 0x7ff9cc147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d1bbd640 1 --2- 172.21.15.161:0/3124601976 >> v2:172.21.15.162:3300/0 conn(0x7ff9cc070e40 0x7ff9cc141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d2bbf640 1 -- 172.21.15.161:0/3124601976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9cc0b8df0 msgr2=0x7ff9cc147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:14.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d2bbf640 1 --2- 172.21.15.161:0/3124601976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9cc0b8df0 0x7ff9cc147eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d2bbf640 1 -- 172.21.15.161:0/3124601976 >> v2:172.21.15.162:3300/0 conn(0x7ff9cc070e40 msgr2=0x7ff9cc141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:14.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d2bbf640 1 --2- 172.21.15.161:0/3124601976 >> v2:172.21.15.162:3300/0 conn(0x7ff9cc070e40 0x7ff9cc141620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d2bbf640 1 -- 172.21.15.161:0/3124601976 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc06ec30 con 0x7ff9cc0b8530 2024-02-02T13:04:14.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d23be640 1 --2- 172.21.15.161:0/3124601976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9cc0b8df0 0x7ff9cc147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:14.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d1bbd640 1 --2- 172.21.15.161:0/3124601976 >> v2:172.21.15.162:3300/0 conn(0x7ff9cc070e40 0x7ff9cc141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:14.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d2bbf640 1 --2- 172.21.15.161:0/3124601976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9cc0b8530 0x7ff9cc141b60 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc06d1f0 tx=0x7ff9c401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1bd88e49dd9e72e server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:14.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d13bc640 1 -- 172.21.15.161:0/3124601976 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40a5740 con 0x7ff9cc0b8530 2024-02-02T13:04:14.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d13bc640 1 -- 172.21.15.161:0/3124601976 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c40a58a0 con 0x7ff9cc0b8530 2024-02-02T13:04:14.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.599+0000 7ff9d13bc640 1 -- 172.21.15.161:0/3124601976 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40a5c30 con 0x7ff9cc0b8530 2024-02-02T13:04:14.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 -- 172.21.15.161:0/3124601976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9cc0b8530 msgr2=0x7ff9cc141b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 --2- 172.21.15.161:0/3124601976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9cc0b8530 0x7ff9cc141b60 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc06d1f0 tx=0x7ff9c401c9d0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 -- 172.21.15.161:0/3124601976 shutdown_connections 2024-02-02T13:04:14.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 --2- 172.21.15.161:0/3124601976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9cc0b8530 0x7ff9cc141b60 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 --2- 172.21.15.161:0/3124601976 >> v2:172.21.15.162:3300/0 conn(0x7ff9cc070e40 0x7ff9cc141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 --2- 172.21.15.161:0/3124601976 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9cc0b8df0 0x7ff9cc147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 -- 172.21.15.161:0/3124601976 >> 172.21.15.161:0/3124601976 conn(0x7ff9cc06a120 msgr2=0x7ff9cc06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:14.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 -- 172.21.15.161:0/3124601976 shutdown_connections 2024-02-02T13:04:14.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 -- 172.21.15.161:0/3124601976 wait complete. 2024-02-02T13:04:14.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 Processor -- start 2024-02-02T13:04:14.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 -- start start 2024-02-02T13:04:14.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9cc0b8530 0x7ff9cc135d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9cc0b8df0 0x7ff9cc1e6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9cc133df0 0x7ff9cc137d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc1362d0 con 0x7ff9cc133df0 2024-02-02T13:04:14.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc1505c0 con 0x7ff9cc0b8530 2024-02-02T13:04:14.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc1335e0 con 0x7ff9cc0b8df0 2024-02-02T13:04:14.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d2bbf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9cc133df0 0x7ff9cc137d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d2bbf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9cc133df0 0x7ff9cc137d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46986/0 (socket says 172.21.15.161:46986) 2024-02-02T13:04:14.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d2bbf640 1 -- 172.21.15.161:0/634596100 learned_addr learned my addr 172.21.15.161:0/634596100 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:14.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d1bbd640 1 --2- 172.21.15.161:0/634596100 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9cc0b8df0 0x7ff9cc1e6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d23be640 1 --2- 172.21.15.161:0/634596100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9cc0b8530 0x7ff9cc135d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d2bbf640 1 -- 172.21.15.161:0/634596100 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9cc0b8df0 msgr2=0x7ff9cc1e6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d2bbf640 1 --2- 172.21.15.161:0/634596100 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9cc0b8df0 0x7ff9cc1e6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d2bbf640 1 -- 172.21.15.161:0/634596100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9cc0b8530 msgr2=0x7ff9cc135d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d2bbf640 1 --2- 172.21.15.161:0/634596100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9cc0b8530 0x7ff9cc135d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d2bbf640 1 -- 172.21.15.161:0/634596100 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c4009b30 con 0x7ff9cc133df0 2024-02-02T13:04:14.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d23be640 1 --2- 172.21.15.161:0/634596100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9cc0b8530 0x7ff9cc135d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:14.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d2bbf640 1 --2- 172.21.15.161:0/634596100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9cc133df0 0x7ff9cc137d40 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40af040 tx=0x7ff9c4019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:14.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9c2ffd640 1 -- 172.21.15.161:0/634596100 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40b8670 con 0x7ff9cc133df0 2024-02-02T13:04:14.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9c2ffd640 1 -- 172.21.15.161:0/634596100 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c40b87d0 con 0x7ff9cc133df0 2024-02-02T13:04:14.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 -- 172.21.15.161:0/634596100 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9cc1338c0 con 0x7ff9cc133df0 2024-02-02T13:04:14.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9c2ffd640 1 -- 172.21.15.161:0/634596100 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40b8b80 con 0x7ff9cc133df0 2024-02-02T13:04:14.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 -- 172.21.15.161:0/634596100 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9cc135610 con 0x7ff9cc133df0 2024-02-02T13:04:14.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.603+0000 7ff9d4622640 1 -- 172.21.15.161:0/634596100 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff9cc0b91d0 con 0x7ff9cc133df0 2024-02-02T13:04:14.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.607+0000 7ff9c2ffd640 1 -- 172.21.15.161:0/634596100 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff9c40b8ce0 con 0x7ff9cc133df0 2024-02-02T13:04:14.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.607+0000 7ff9c2ffd640 1 --2- 172.21.15.161:0/634596100 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff9b0065a60 0x7ff9b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.607+0000 7ff9c2ffd640 1 -- 172.21.15.161:0/634596100 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff9c411f0f0 con 0x7ff9cc133df0 2024-02-02T13:04:14.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.607+0000 7ff9c2ffd640 1 --2- 172.21.15.161:0/634596100 >> [v2:172.21.15.162:6824/27913,v1:172.21.15.162:6825/27913] conn(0x7ff9b006b8c0 0x7ff9b006dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.607+0000 7ff9d23be640 1 --2- 172.21.15.161:0/634596100 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff9b0065a60 0x7ff9b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.607+0000 7ff9c2ffd640 1 -- 172.21.15.161:0/634596100 --> [v2:172.21.15.162:6824/27913,v1:172.21.15.162:6825/27913] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff9b006e390 con 0x7ff9b006b8c0 2024-02-02T13:04:14.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.607+0000 7ff9c2ffd640 1 -- 172.21.15.161:0/634596100 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9c411f540 con 0x7ff9cc133df0 2024-02-02T13:04:14.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.607+0000 7ff9d1bbd640 1 --2- 172.21.15.161:0/634596100 >> [v2:172.21.15.162:6824/27913,v1:172.21.15.162:6825/27913] conn(0x7ff9b006b8c0 0x7ff9b006dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.607+0000 7ff9d23be640 1 --2- 172.21.15.161:0/634596100 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff9b0065a60 0x7ff9b0067f20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800b840 tx=0x7ff9c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:14.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.607+0000 7ff9d1bbd640 1 --2- 172.21.15.161:0/634596100 >> [v2:172.21.15.162:6824/27913,v1:172.21.15.162:6825/27913] conn(0x7ff9b006b8c0 0x7ff9b006dce0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:14.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.607+0000 7ff9c2ffd640 1 -- 172.21.15.161:0/634596100 <== osd.5 v2:172.21.15.162:6824/27913 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff9b006e390 con 0x7ff9b006b8c0 2024-02-02T13:04:14.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.619+0000 7ff9d4622640 1 -- 172.21.15.161:0/634596100 --> [v2:172.21.15.162:6824/27913,v1:172.21.15.162:6825/27913] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff9cc147990 con 0x7ff9b006b8c0 2024-02-02T13:04:14.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.623+0000 7ff9c2ffd640 1 -- 172.21.15.161:0/634596100 <== osd.5 v2:172.21.15.162:6824/27913 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff9bc00a670 con 0x7ff9b006b8c0 2024-02-02T13:04:14.625 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-02-02T13:04:14.625 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-02-02T13:04:14.625 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-02-02T13:04:14.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.623+0000 7ff9d4622640 1 -- 172.21.15.161:0/634596100 >> [v2:172.21.15.162:6824/27913,v1:172.21.15.162:6825/27913] conn(0x7ff9b006b8c0 msgr2=0x7ff9b006dce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.623+0000 7ff9d4622640 1 --2- 172.21.15.161:0/634596100 >> [v2:172.21.15.162:6824/27913,v1:172.21.15.162:6825/27913] conn(0x7ff9b006b8c0 0x7ff9b006dce0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.623+0000 7ff9d4622640 1 -- 172.21.15.161:0/634596100 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff9b0065a60 msgr2=0x7ff9b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.623+0000 7ff9d4622640 1 --2- 172.21.15.161:0/634596100 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff9b0065a60 0x7ff9b0067f20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800b840 tx=0x7ff9c8008040 comp rx=0 tx=0).stop 2024-02-02T13:04:14.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.623+0000 7ff9d4622640 1 -- 172.21.15.161:0/634596100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9cc133df0 msgr2=0x7ff9cc137d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.623+0000 7ff9d4622640 1 --2- 172.21.15.161:0/634596100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9cc133df0 0x7ff9cc137d40 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40af040 tx=0x7ff9c4019770 comp rx=0 tx=0).stop 2024-02-02T13:04:14.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.623+0000 7ff9d2bbf640 1 -- 172.21.15.161:0/634596100 reap_dead start 2024-02-02T13:04:14.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.623+0000 7ff9d4622640 1 -- 172.21.15.161:0/634596100 shutdown_connections 2024-02-02T13:04:14.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.623+0000 7ff9d4622640 1 -- 172.21.15.161:0/634596100 >> 172.21.15.161:0/634596100 conn(0x7ff9cc06a120 msgr2=0x7ff9cc144ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:14.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.623+0000 7ff9d4622640 1 -- 172.21.15.161:0/634596100 shutdown_connections 2024-02-02T13:04:14.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.623+0000 7ff9d4622640 1 -- 172.21.15.161:0/634596100 wait complete. 2024-02-02T13:04:14.640 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-02-02T13:04:14.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.747+0000 7fb488ecd640 1 Processor -- start 2024-02-02T13:04:14.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.747+0000 7fb488ecd640 1 -- start start 2024-02-02T13:04:14.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.747+0000 7fb488ecd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb4840b9900 0x7fb4840b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.747+0000 7fb488ecd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4841429f0 0x7fb484153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.747+0000 7fb488ecd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4840b3c40 con 0x7fb484071160 2024-02-02T13:04:14.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.747+0000 7fb488ecd640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4840b5140 con 0x7fb4840b9900 2024-02-02T13:04:14.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.747+0000 7fb488ecd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4840b9d50 con 0x7fb4841429f0 2024-02-02T13:04:14.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.747+0000 7fb481d9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb4840b9900 0x7fb4840b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.747+0000 7fb481d9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb4840b9900 0x7fb4840b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46990/0 (socket says 172.21.15.161:46990) 2024-02-02T13:04:14.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.747+0000 7fb481d9b640 1 -- 172.21.15.161:0/1947260802 learned_addr learned my addr 172.21.15.161:0/1947260802 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:14.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.747+0000 7fb482d9d640 1 --2- 172.21.15.161:0/1947260802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4841429f0 0x7fb484153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.747+0000 7fb481d9b640 1 -- 172.21.15.161:0/1947260802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4841429f0 msgr2=0x7fb484153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:14.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.747+0000 7fb481d9b640 1 --2- 172.21.15.161:0/1947260802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4841429f0 0x7fb484153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.747+0000 7fb481d9b640 1 -- 172.21.15.161:0/1947260802 >> v1:172.21.15.162:6789/0 conn(0x7fb484071160 legacy=0x7fb4840b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:14.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.747+0000 7fb481d9b640 1 -- 172.21.15.161:0/1947260802 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4840b9f60 con 0x7fb4840b9900 2024-02-02T13:04:14.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb481d9b640 1 --2- 172.21.15.161:0/1947260802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4840b9900 0x7fb4840b42d0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb474009e50 tx=0x7fb47401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4d2a60ff00b36e server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:14.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb48159a640 1 -- 172.21.15.161:0/1947260802 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4740a5870 con 0x7fb4840b9900 2024-02-02T13:04:14.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb48159a640 1 -- 172.21.15.161:0/1947260802 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4740a59d0 con 0x7fb4840b9900 2024-02-02T13:04:14.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb48159a640 1 -- 172.21.15.161:0/1947260802 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4740a5d60 con 0x7fb4840b9900 2024-02-02T13:04:14.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb488ecd640 1 -- 172.21.15.161:0/1947260802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4840b9900 msgr2=0x7fb4840b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb488ecd640 1 --2- 172.21.15.161:0/1947260802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4840b9900 0x7fb4840b42d0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb474009e50 tx=0x7fb47401c9d0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb488ecd640 1 -- 172.21.15.161:0/1947260802 shutdown_connections 2024-02-02T13:04:14.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb488ecd640 1 --2- 172.21.15.161:0/1947260802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4841429f0 0x7fb484153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb488ecd640 1 --2- 172.21.15.161:0/1947260802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4840b9900 0x7fb4840b42d0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb488ecd640 1 -- 172.21.15.161:0/1947260802 >> 172.21.15.161:0/1947260802 conn(0x7fb4840be150 msgr2=0x7fb4840be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:14.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb488ecd640 1 -- 172.21.15.161:0/1947260802 shutdown_connections 2024-02-02T13:04:14.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb488ecd640 1 -- 172.21.15.161:0/1947260802 wait complete. 2024-02-02T13:04:14.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb488ecd640 1 Processor -- start 2024-02-02T13:04:14.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb488ecd640 1 -- start start 2024-02-02T13:04:14.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb488ecd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb484071160 0x7fb484149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb488ecd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4840b9900 0x7fb48406c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb488ecd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4841429f0 0x7fb4841e6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb488ecd640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4841498a0 con 0x7fb484071160 2024-02-02T13:04:14.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb488ecd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4841e6900 con 0x7fb4840b9900 2024-02-02T13:04:14.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb488ecd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb484144f70 con 0x7fb4841429f0 2024-02-02T13:04:14.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb48259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb484071160 0x7fb484149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb48259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb484071160 0x7fb484149360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47000/0 (socket says 172.21.15.161:47000) 2024-02-02T13:04:14.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb48259c640 1 -- 172.21.15.161:0/2393358273 learned_addr learned my addr 172.21.15.161:0/2393358273 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:14.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb482d9d640 1 --2- 172.21.15.161:0/2393358273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4841429f0 0x7fb4841e6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb481d9b640 1 --2- 172.21.15.161:0/2393358273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4840b9900 0x7fb48406c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb48259c640 1 -- 172.21.15.161:0/2393358273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4841429f0 msgr2=0x7fb4841e6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb48259c640 1 --2- 172.21.15.161:0/2393358273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4841429f0 0x7fb4841e6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb48259c640 1 -- 172.21.15.161:0/2393358273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4840b9900 msgr2=0x7fb48406c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb48259c640 1 --2- 172.21.15.161:0/2393358273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4840b9900 0x7fb48406c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb48259c640 1 -- 172.21.15.161:0/2393358273 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb474009b30 con 0x7fb484071160 2024-02-02T13:04:14.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.751+0000 7fb482d9d640 1 --2- 172.21.15.161:0/2393358273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4841429f0 0x7fb4841e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T13:04:14.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.755+0000 7fb48259c640 1 --2- 172.21.15.161:0/2393358273 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb484071160 0x7fb484149360 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00c450 tx=0x7fb46c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:14.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.755+0000 7fb47affd640 1 -- 172.21.15.161:0/2393358273 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c012830 con 0x7fb484071160 2024-02-02T13:04:14.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.755+0000 7fb47affd640 1 -- 172.21.15.161:0/2393358273 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c0129b0 con 0x7fb484071160 2024-02-02T13:04:14.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.755+0000 7fb488ecd640 1 -- 172.21.15.161:0/2393358273 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb484145250 con 0x7fb484071160 2024-02-02T13:04:14.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.755+0000 7fb47affd640 1 -- 172.21.15.161:0/2393358273 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c012d60 con 0x7fb484071160 2024-02-02T13:04:14.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.755+0000 7fb488ecd640 1 -- 172.21.15.161:0/2393358273 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb484144ad0 con 0x7fb484071160 2024-02-02T13:04:14.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.755+0000 7fb488ecd640 1 -- 172.21.15.161:0/2393358273 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb484144d20 con 0x7fb484071160 2024-02-02T13:04:14.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.755+0000 7fb47affd640 1 -- 172.21.15.161:0/2393358273 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb46c01c460 con 0x7fb484071160 2024-02-02T13:04:14.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.755+0000 7fb47affd640 1 --2- 172.21.15.161:0/2393358273 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb464065a30 0x7fb464067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:14.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.755+0000 7fb47affd640 1 -- 172.21.15.161:0/2393358273 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb46c082c90 con 0x7fb484071160 2024-02-02T13:04:14.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.755+0000 7fb481d9b640 1 --2- 172.21.15.161:0/2393358273 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb464065a30 0x7fb464067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:14.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.755+0000 7fb481d9b640 1 --2- 172.21.15.161:0/2393358273 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb464065a30 0x7fb464067ef0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb4740ae000 tx=0x7fb4740a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:14.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.759+0000 7fb47affd640 1 -- 172.21.15.161:0/2393358273 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb46c050950 con 0x7fb484071160 2024-02-02T13:04:14.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.903+0000 7fb488ecd640 1 -- 172.21.15.161:0/2393358273 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4840b93e0 con 0x7fb464065a30 2024-02-02T13:04:14.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.903+0000 7fb47affd640 1 -- 172.21.15.161:0/2393358273 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb4740bc090 con 0x7fb464065a30 2024-02-02T13:04:14.907 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 5 to deep-scrub 2024-02-02T13:04:14.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.903+0000 7fb488ecd640 1 -- 172.21.15.161:0/2393358273 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb464065a30 msgr2=0x7fb464067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.903+0000 7fb488ecd640 1 --2- 172.21.15.161:0/2393358273 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb464065a30 0x7fb464067ef0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb4740ae000 tx=0x7fb4740a7070 comp rx=0 tx=0).stop 2024-02-02T13:04:14.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.903+0000 7fb488ecd640 1 -- 172.21.15.161:0/2393358273 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb484071160 msgr2=0x7fb484149360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:14.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.903+0000 7fb488ecd640 1 --2- 172.21.15.161:0/2393358273 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb484071160 0x7fb484149360 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00c450 tx=0x7fb46c00c910 comp rx=0 tx=0).stop 2024-02-02T13:04:14.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.903+0000 7fb488ecd640 1 -- 172.21.15.161:0/2393358273 shutdown_connections 2024-02-02T13:04:14.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.903+0000 7fb488ecd640 1 --2- 172.21.15.161:0/2393358273 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fb464065a30 0x7fb464067ef0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.903+0000 7fb488ecd640 1 --2- 172.21.15.161:0/2393358273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4841429f0 0x7fb4841e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.903+0000 7fb488ecd640 1 --2- 172.21.15.161:0/2393358273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4840b9900 0x7fb48406c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.903+0000 7fb488ecd640 1 --2- 172.21.15.161:0/2393358273 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb484071160 0x7fb484149360 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:14.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.903+0000 7fb488ecd640 1 -- 172.21.15.161:0/2393358273 >> 172.21.15.161:0/2393358273 conn(0x7fb4840be150 msgr2=0x7fb4841418c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:14.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.903+0000 7fb488ecd640 1 -- 172.21.15.161:0/2393358273 shutdown_connections 2024-02-02T13:04:14.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:14.903+0000 7fb488ecd640 1 -- 172.21.15.161:0/2393358273 wait complete. 2024-02-02T13:04:14.924 INFO:tasks.ceph:Scrubbing osd.6 2024-02-02T13:04:14.924 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-02-02T13:04:15.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.047+0000 7f77442df640 1 Processor -- start 2024-02-02T13:04:15.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.047+0000 7f77442df640 1 -- start start 2024-02-02T13:04:15.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.047+0000 7f77442df640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f773c0b8df0 0x7f773c142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.047+0000 7f77442df640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f773c0b8540 0x7f773c148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.047+0000 7f77442df640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773c148a80 con 0x7f773c142d80 2024-02-02T13:04:15.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.047+0000 7f77442df640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773c0b3890 con 0x7f773c0b8540 2024-02-02T13:04:15.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.047+0000 7f77442df640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0b3b70 con 0x7f773c0b8df0 2024-02-02T13:04:15.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.047+0000 7f774187a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f773c0b8540 0x7f773c148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.047+0000 7f774287c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f773c142d80 0x7f773c0b5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47422/0 (socket says 172.21.15.161:47422) 2024-02-02T13:04:15.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.047+0000 7f774187a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f773c0b8540 0x7f773c148f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47006/0 (socket says 172.21.15.161:47006) 2024-02-02T13:04:15.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.047+0000 7f774287c640 1 -- 172.21.15.161:0/1723375907 learned_addr learned my addr 172.21.15.161:0/1723375907 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:04:15.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.047+0000 7f774207b640 1 --2- 172.21.15.161:0/1723375907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f773c0b8df0 0x7f773c142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.047+0000 7f774187a640 1 -- 172.21.15.161:0/1723375907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f773c0b8df0 msgr2=0x7f773c142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:15.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.047+0000 7f774187a640 1 --2- 172.21.15.161:0/1723375907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f773c0b8df0 0x7f773c142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.047+0000 7f774187a640 1 -- 172.21.15.161:0/1723375907 >> v1:172.21.15.161:6789/0 conn(0x7f773c142d80 legacy=0x7f773c0b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.047+0000 7f774187a640 1 -- 172.21.15.161:0/1723375907 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c0b3e50 con 0x7f773c0b8540 2024-02-02T13:04:15.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.047+0000 7f774207b640 1 --2- 172.21.15.161:0/1723375907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f773c0b8df0 0x7f773c142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:15.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f774187a640 1 --2- 172.21.15.161:0/1723375907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f773c0b8540 0x7f773c148f10 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f772c0097c0 tx=0x7f772c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf969d46142b113 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:15.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f7741079640 1 -- 172.21.15.161:0/1723375907 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c0a6040 con 0x7f773c0b8540 2024-02-02T13:04:15.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f7741079640 1 -- 172.21.15.161:0/1723375907 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772c0aa600 con 0x7f773c0b8540 2024-02-02T13:04:15.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f7741079640 1 -- 172.21.15.161:0/1723375907 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c071930 con 0x7f773c0b8540 2024-02-02T13:04:15.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f77442df640 1 -- 172.21.15.161:0/1723375907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f773c0b8540 msgr2=0x7f773c148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f77442df640 1 --2- 172.21.15.161:0/1723375907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f773c0b8540 0x7f773c148f10 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f772c0097c0 tx=0x7f772c01c480 comp rx=0 tx=0).stop 2024-02-02T13:04:15.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f77442df640 1 -- 172.21.15.161:0/1723375907 shutdown_connections 2024-02-02T13:04:15.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f77442df640 1 --2- 172.21.15.161:0/1723375907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f773c0b8540 0x7f773c148f10 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f77442df640 1 --2- 172.21.15.161:0/1723375907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f773c0b8df0 0x7f773c142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f77442df640 1 -- 172.21.15.161:0/1723375907 >> 172.21.15.161:0/1723375907 conn(0x7f773c06a120 msgr2=0x7f773c06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:15.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f77442df640 1 -- 172.21.15.161:0/1723375907 shutdown_connections 2024-02-02T13:04:15.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f77442df640 1 -- 172.21.15.161:0/1723375907 wait complete. 2024-02-02T13:04:15.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f77442df640 1 Processor -- start 2024-02-02T13:04:15.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f77442df640 1 -- start start 2024-02-02T13:04:15.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f77442df640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f773c0b8540 0x7f773c0ba890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f77442df640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f773c0b8df0 0x7f773c0bb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f77442df640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f773c142d80 0x7f773c0bc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f77442df640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c131840 con 0x7f773c0b8540 2024-02-02T13:04:15.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f77442df640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c14b540 con 0x7f773c0b8df0 2024-02-02T13:04:15.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f77442df640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0badd0 con 0x7f773c142d80 2024-02-02T13:04:15.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f774207b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f773c0b8540 0x7f773c0ba890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f774207b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f773c0b8540 0x7f773c0ba890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47010/0 (socket says 172.21.15.161:47010) 2024-02-02T13:04:15.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f774207b640 1 -- 172.21.15.161:0/2443434365 learned_addr learned my addr 172.21.15.161:0/2443434365 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:15.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f774207b640 1 -- 172.21.15.161:0/2443434365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f773c142d80 msgr2=0x7f773c0bc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f774207b640 1 --2- 172.21.15.161:0/2443434365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f773c142d80 0x7f773c0bc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f774207b640 1 -- 172.21.15.161:0/2443434365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f773c0b8df0 msgr2=0x7f773c0bb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f774207b640 1 --2- 172.21.15.161:0/2443434365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f773c0b8df0 0x7f773c0bb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.051+0000 7f774207b640 1 -- 172.21.15.161:0/2443434365 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c009420 con 0x7f773c0b8540 2024-02-02T13:04:15.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.055+0000 7f774207b640 1 --2- 172.21.15.161:0/2443434365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f773c0b8540 0x7f773c0ba890 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f773800c7c0 tx=0x7f773800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:15.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.055+0000 7f7732ffd640 1 -- 172.21.15.161:0/2443434365 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738007a30 con 0x7f773c0b8540 2024-02-02T13:04:15.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.055+0000 7f7732ffd640 1 -- 172.21.15.161:0/2443434365 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7738007b90 con 0x7f773c0b8540 2024-02-02T13:04:15.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.055+0000 7f77442df640 1 -- 172.21.15.161:0/2443434365 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773c14b0b0 con 0x7f773c0b8540 2024-02-02T13:04:15.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.055+0000 7f7732ffd640 1 -- 172.21.15.161:0/2443434365 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773800ce70 con 0x7f773c0b8540 2024-02-02T13:04:15.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.055+0000 7f77442df640 1 -- 172.21.15.161:0/2443434365 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773c0bbf30 con 0x7f773c0b8540 2024-02-02T13:04:15.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.055+0000 7f77442df640 1 -- 172.21.15.161:0/2443434365 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f773c0b6260 con 0x7f773c0b8540 2024-02-02T13:04:15.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.055+0000 7f7732ffd640 1 -- 172.21.15.161:0/2443434365 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f77380113f0 con 0x7f773c0b8540 2024-02-02T13:04:15.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.055+0000 7f7732ffd640 1 --2- 172.21.15.161:0/2443434365 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7720065a60 0x7f7720067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.055+0000 7f7732ffd640 1 -- 172.21.15.161:0/2443434365 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7738083400 con 0x7f773c0b8540 2024-02-02T13:04:15.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.055+0000 7f774187a640 1 --2- 172.21.15.161:0/2443434365 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7720065a60 0x7f7720067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.055+0000 7f7732ffd640 1 --2- 172.21.15.161:0/2443434365 >> [v2:172.21.15.162:6800/27910,v1:172.21.15.162:6801/27910] conn(0x7f772006b8c0 0x7f772006dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.055+0000 7f7732ffd640 1 -- 172.21.15.161:0/2443434365 --> [v2:172.21.15.162:6800/27910,v1:172.21.15.162:6801/27910] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f772006e390 con 0x7f772006b8c0 2024-02-02T13:04:15.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.055+0000 7f7732ffd640 1 -- 172.21.15.161:0/2443434365 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7738083850 con 0x7f773c0b8540 2024-02-02T13:04:15.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.055+0000 7f774187a640 1 --2- 172.21.15.161:0/2443434365 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7720065a60 0x7f7720067f20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f772c0ae000 tx=0x7f772c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:15.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.055+0000 7f774287c640 1 --2- 172.21.15.161:0/2443434365 >> [v2:172.21.15.162:6800/27910,v1:172.21.15.162:6801/27910] conn(0x7f772006b8c0 0x7f772006dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.055+0000 7f774287c640 1 --2- 172.21.15.161:0/2443434365 >> [v2:172.21.15.162:6800/27910,v1:172.21.15.162:6801/27910] conn(0x7f772006b8c0 0x7f772006dce0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:15.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.059+0000 7f7732ffd640 1 -- 172.21.15.161:0/2443434365 <== osd.6 v2:172.21.15.162:6800/27910 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f772006e390 con 0x7f772006b8c0 2024-02-02T13:04:15.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.071+0000 7f77442df640 1 -- 172.21.15.161:0/2443434365 --> [v2:172.21.15.162:6800/27910,v1:172.21.15.162:6801/27910] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f773c04e000 con 0x7f772006b8c0 2024-02-02T13:04:15.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.071+0000 7f7732ffd640 1 -- 172.21.15.161:0/2443434365 <== osd.6 v2:172.21.15.162:6800/27910 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f773c04e000 con 0x7f772006b8c0 2024-02-02T13:04:15.076 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-02-02T13:04:15.076 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-02-02T13:04:15.076 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-02-02T13:04:15.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.071+0000 7f77442df640 1 -- 172.21.15.161:0/2443434365 >> [v2:172.21.15.162:6800/27910,v1:172.21.15.162:6801/27910] conn(0x7f772006b8c0 msgr2=0x7f772006dce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.071+0000 7f77442df640 1 --2- 172.21.15.161:0/2443434365 >> [v2:172.21.15.162:6800/27910,v1:172.21.15.162:6801/27910] conn(0x7f772006b8c0 0x7f772006dce0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.071+0000 7f77442df640 1 -- 172.21.15.161:0/2443434365 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7720065a60 msgr2=0x7f7720067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.071+0000 7f77442df640 1 --2- 172.21.15.161:0/2443434365 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f7720065a60 0x7f7720067f20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f772c0ae000 tx=0x7f772c008040 comp rx=0 tx=0).stop 2024-02-02T13:04:15.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.071+0000 7f77442df640 1 -- 172.21.15.161:0/2443434365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f773c0b8540 msgr2=0x7f773c0ba890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.071+0000 7f77442df640 1 --2- 172.21.15.161:0/2443434365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f773c0b8540 0x7f773c0ba890 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f773800c7c0 tx=0x7f773800cc80 comp rx=0 tx=0).stop 2024-02-02T13:04:15.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.071+0000 7f774287c640 1 -- 172.21.15.161:0/2443434365 reap_dead start 2024-02-02T13:04:15.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.071+0000 7f77442df640 1 -- 172.21.15.161:0/2443434365 shutdown_connections 2024-02-02T13:04:15.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.071+0000 7f77442df640 1 -- 172.21.15.161:0/2443434365 >> 172.21.15.161:0/2443434365 conn(0x7f773c06a120 msgr2=0x7f773c1402d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:15.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.071+0000 7f77442df640 1 -- 172.21.15.161:0/2443434365 shutdown_connections 2024-02-02T13:04:15.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.071+0000 7f77442df640 1 -- 172.21.15.161:0/2443434365 wait complete. 2024-02-02T13:04:15.092 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-02-02T13:04:15.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff050dd2640 1 Processor -- start 2024-02-02T13:04:15.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff050dd2640 1 -- start start 2024-02-02T13:04:15.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff050dd2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff04c071160 0x7ff04c0b9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff050dd2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff04c0b3c40 con 0x7ff04c0b42d0 2024-02-02T13:04:15.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff050dd2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff04c0b4720 con 0x7ff04c1429f0 2024-02-02T13:04:15.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff050dd2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04c0b5140 con 0x7ff04c071160 2024-02-02T13:04:15.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff049d9b640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff04c0b42d0 0x7ff04c0b8ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47438/0 (socket says 172.21.15.161:47438) 2024-02-02T13:04:15.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff049d9b640 1 -- 172.21.15.161:0/1647101451 learned_addr learned my addr 172.21.15.161:0/1647101451 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:04:15.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04a59c640 1 --2- 172.21.15.161:0/1647101451 >> v2:172.21.15.162:3300/0 conn(0x7ff04c071160 0x7ff04c0b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04959a640 1 -- 172.21.15.161:0/1647101451 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1210643000 0 0) 0x7ff04c0b3c40 con 0x7ff04c0b42d0 2024-02-02T13:04:15.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04959a640 1 -- 172.21.15.161:0/1647101451 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff038003530 con 0x7ff04c0b42d0 2024-02-02T13:04:15.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04959a640 1 -- 172.21.15.161:0/1647101451 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3129891448 0 0) 0x7ff038003530 con 0x7ff04c0b42d0 2024-02-02T13:04:15.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04959a640 1 -- 172.21.15.161:0/1647101451 >> v2:172.21.15.162:3300/0 conn(0x7ff04c071160 msgr2=0x7ff04c0b9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:15.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04959a640 1 --2- 172.21.15.161:0/1647101451 >> v2:172.21.15.162:3300/0 conn(0x7ff04c071160 0x7ff04c0b9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04959a640 1 -- 172.21.15.161:0/1647101451 >> v1:172.21.15.162:6789/0 conn(0x7ff04c1429f0 legacy=0x7ff04c153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04959a640 1 -- 172.21.15.161:0/1647101451 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c0b9f60 con 0x7ff04c0b42d0 2024-02-02T13:04:15.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04959a640 1 -- 172.21.15.161:0/1647101451 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7ff034001680 con 0x7ff04c0b42d0 2024-02-02T13:04:15.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04959a640 1 -- 172.21.15.161:0/1647101451 >> v1:172.21.15.161:6789/0 conn(0x7ff04c0b42d0 legacy=0x7ff04c0b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04959a640 1 --2- 172.21.15.161:0/1647101451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff038003980 0x7ff038003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04959a640 1 --2- 172.21.15.161:0/1647101451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0380047d0 0x7ff038004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04959a640 1 --2- 172.21.15.161:0/1647101451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff038005190 0x7ff03800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04959a640 1 -- 172.21.15.161:0/1647101451 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c0b5140 con 0x7ff038003980 2024-02-02T13:04:15.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04959a640 1 -- 172.21.15.161:0/1647101451 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03800c130 con 0x7ff0380047d0 2024-02-02T13:04:15.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04959a640 1 -- 172.21.15.161:0/1647101451 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03800c2f0 con 0x7ff038005190 2024-02-02T13:04:15.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04a59c640 1 --2- 172.21.15.161:0/1647101451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff038003980 0x7ff038003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff049d9b640 1 --2- 172.21.15.161:0/1647101451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0380047d0 0x7ff038004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04a59c640 1 -- 172.21.15.161:0/1647101451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff038005190 msgr2=0x7ff03800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:15.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04a59c640 1 --2- 172.21.15.161:0/1647101451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff038005190 0x7ff03800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04a59c640 1 -- 172.21.15.161:0/1647101451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0380047d0 msgr2=0x7ff038004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:15.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04a59c640 1 --2- 172.21.15.161:0/1647101451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0380047d0 0x7ff038004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04a59c640 1 -- 172.21.15.161:0/1647101451 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff038003530 con 0x7ff038003980 2024-02-02T13:04:15.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.191+0000 7ff04ad9d640 1 -- 172.21.15.161:0/1647101451 reap_dead start 2024-02-02T13:04:15.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.195+0000 7ff04a59c640 1 --2- 172.21.15.161:0/1647101451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff038003980 0x7ff038003da0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009ae0 tx=0x7ff03c01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16305bfca90d668c server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:15.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.195+0000 7ff04959a640 1 -- 172.21.15.161:0/1647101451 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c0a5610 con 0x7ff038003980 2024-02-02T13:04:15.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.195+0000 7ff04959a640 1 -- 172.21.15.161:0/1647101451 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c0a5770 con 0x7ff038003980 2024-02-02T13:04:15.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.195+0000 7ff04959a640 1 -- 172.21.15.161:0/1647101451 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c0a5b20 con 0x7ff038003980 2024-02-02T13:04:15.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.195+0000 7ff050dd2640 1 -- 172.21.15.161:0/1647101451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff038003980 msgr2=0x7ff038003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.195+0000 7ff050dd2640 1 --2- 172.21.15.161:0/1647101451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff038003980 0x7ff038003da0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009ae0 tx=0x7ff03c01ca20 comp rx=0 tx=0).stop 2024-02-02T13:04:15.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.195+0000 7ff050dd2640 1 -- 172.21.15.161:0/1647101451 shutdown_connections 2024-02-02T13:04:15.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.195+0000 7ff050dd2640 1 --2- 172.21.15.161:0/1647101451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff038003980 0x7ff038003da0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.195+0000 7ff050dd2640 1 -- 172.21.15.161:0/1647101451 >> 172.21.15.161:0/1647101451 conn(0x7ff04c0be150 msgr2=0x7ff04c0be560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:15.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.195+0000 7ff050dd2640 1 -- 172.21.15.161:0/1647101451 shutdown_connections 2024-02-02T13:04:15.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.195+0000 7ff050dd2640 1 -- 172.21.15.161:0/1647101451 wait complete. 2024-02-02T13:04:15.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.195+0000 7ff050dd2640 1 Processor -- start 2024-02-02T13:04:15.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.195+0000 7ff050dd2640 1 -- start start 2024-02-02T13:04:15.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff050dd2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff038003980 0x7ff04c1d7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff050dd2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff04c142290 0x7ff04c1d5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff050dd2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff04c1d64b0 0x7ff04c1e48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff050dd2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c13e700 con 0x7ff038003980 2024-02-02T13:04:15.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff050dd2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c1d7f50 con 0x7ff04c142290 2024-02-02T13:04:15.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff050dd2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c13d490 con 0x7ff04c1d64b0 2024-02-02T13:04:15.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff04a59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff038003980 0x7ff04c1d7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff04a59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff038003980 0x7ff04c1d7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47024/0 (socket says 172.21.15.161:47024) 2024-02-02T13:04:15.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff04a59c640 1 -- 172.21.15.161:0/2130920595 learned_addr learned my addr 172.21.15.161:0/2130920595 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:15.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff04a59c640 1 -- 172.21.15.161:0/2130920595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff04c1d64b0 msgr2=0x7ff04c1e48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff04ad9d640 1 --2- 172.21.15.161:0/2130920595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff04c1d64b0 0x7ff04c1e48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff049d9b640 1 --2- 172.21.15.161:0/2130920595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff04c142290 0x7ff04c1d5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff04a59c640 1 --2- 172.21.15.161:0/2130920595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff04c1d64b0 0x7ff04c1e48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff04a59c640 1 -- 172.21.15.161:0/2130920595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff04c142290 msgr2=0x7ff04c1d5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff04a59c640 1 --2- 172.21.15.161:0/2130920595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff04c142290 0x7ff04c1d5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff04a59c640 1 -- 172.21.15.161:0/2130920595 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c14b7f0 con 0x7ff038003980 2024-02-02T13:04:15.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff04a59c640 1 --2- 172.21.15.161:0/2130920595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff038003980 0x7ff04c1d7a10 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7ff03c01c850 tx=0x7ff03c0197c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:15.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff042ffd640 1 -- 172.21.15.161:0/2130920595 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c004020 con 0x7ff038003980 2024-02-02T13:04:15.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff042ffd640 1 -- 172.21.15.161:0/2130920595 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c0041c0 con 0x7ff038003980 2024-02-02T13:04:15.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff050dd2640 1 -- 172.21.15.161:0/2130920595 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04c13d700 con 0x7ff038003980 2024-02-02T13:04:15.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff042ffd640 1 -- 172.21.15.161:0/2130920595 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c003620 con 0x7ff038003980 2024-02-02T13:04:15.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff050dd2640 1 -- 172.21.15.161:0/2130920595 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04c13df00 con 0x7ff038003980 2024-02-02T13:04:15.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff050dd2640 1 -- 172.21.15.161:0/2130920595 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04c04e000 con 0x7ff038003980 2024-02-02T13:04:15.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff042ffd640 1 -- 172.21.15.161:0/2130920595 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff03c0b4070 con 0x7ff038003980 2024-02-02T13:04:15.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff042ffd640 1 --2- 172.21.15.161:0/2130920595 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff02c065a90 0x7ff02c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff042ffd640 1 -- 172.21.15.161:0/2130920595 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff03c11c9f0 con 0x7ff038003980 2024-02-02T13:04:15.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff049d9b640 1 --2- 172.21.15.161:0/2130920595 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff02c065a90 0x7ff02c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.199+0000 7ff049d9b640 1 --2- 172.21.15.161:0/2130920595 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff02c065a90 0x7ff02c067f50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff034001ec0 tx=0x7ff034001d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:15.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.203+0000 7ff042ffd640 1 -- 172.21.15.161:0/2130920595 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff03c0ea6b0 con 0x7ff038003980 2024-02-02T13:04:15.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.347+0000 7ff050dd2640 1 -- 172.21.15.161:0/2130920595 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7ff04c0ba800 con 0x7ff02c065a90 2024-02-02T13:04:15.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.347+0000 7ff042ffd640 1 -- 172.21.15.161:0/2130920595 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff034005e70 con 0x7ff02c065a90 2024-02-02T13:04:15.351 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 6 to deep-scrub 2024-02-02T13:04:15.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.347+0000 7ff050dd2640 1 -- 172.21.15.161:0/2130920595 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff02c065a90 msgr2=0x7ff02c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.347+0000 7ff050dd2640 1 --2- 172.21.15.161:0/2130920595 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff02c065a90 0x7ff02c067f50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff034001ec0 tx=0x7ff034001d50 comp rx=0 tx=0).stop 2024-02-02T13:04:15.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.347+0000 7ff050dd2640 1 -- 172.21.15.161:0/2130920595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff038003980 msgr2=0x7ff04c1d7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.347+0000 7ff050dd2640 1 --2- 172.21.15.161:0/2130920595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff038003980 0x7ff04c1d7a10 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7ff03c01c850 tx=0x7ff03c0197c0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.351+0000 7ff050dd2640 1 -- 172.21.15.161:0/2130920595 shutdown_connections 2024-02-02T13:04:15.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.351+0000 7ff050dd2640 1 --2- 172.21.15.161:0/2130920595 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff02c065a90 0x7ff02c067f50 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.351+0000 7ff050dd2640 1 --2- 172.21.15.161:0/2130920595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff04c1d64b0 0x7ff04c1e48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.351+0000 7ff050dd2640 1 --2- 172.21.15.161:0/2130920595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff04c142290 0x7ff04c1d5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.351+0000 7ff050dd2640 1 --2- 172.21.15.161:0/2130920595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff038003980 0x7ff04c1d7a10 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.351+0000 7ff050dd2640 1 -- 172.21.15.161:0/2130920595 >> 172.21.15.161:0/2130920595 conn(0x7ff04c0be150 msgr2=0x7ff04c0a13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:15.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.351+0000 7ff050dd2640 1 -- 172.21.15.161:0/2130920595 shutdown_connections 2024-02-02T13:04:15.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.351+0000 7ff050dd2640 1 -- 172.21.15.161:0/2130920595 wait complete. 2024-02-02T13:04:15.369 INFO:tasks.ceph:Scrubbing osd.7 2024-02-02T13:04:15.369 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-02-02T13:04:15.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.475+0000 7f4b121c3640 1 Processor -- start 2024-02-02T13:04:15.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.475+0000 7f4b121c3640 1 -- start start 2024-02-02T13:04:15.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.475+0000 7f4b121c3640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4b0c144b60 0x7f4b0c144fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.475+0000 7f4b121c3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4b0c06af50 0x7f4b0c06b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.475+0000 7f4b121c3640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0c14aca0 con 0x7f4b0c071060 2024-02-02T13:04:15.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.475+0000 7f4b121c3640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0c0b9090 con 0x7f4b0c06af50 2024-02-02T13:04:15.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.475+0000 7f4b121c3640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0c14af80 con 0x7f4b0c144b60 2024-02-02T13:04:15.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.475+0000 7f4b0bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4b0c06af50 0x7f4b0c06b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.475+0000 7f4b0b7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f4b0c071060 0x7f4b0c0b8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47444/0 (socket says 172.21.15.161:47444) 2024-02-02T13:04:15.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.475+0000 7f4b0b7fe640 1 -- 172.21.15.161:0/2598710807 learned_addr learned my addr 172.21.15.161:0/2598710807 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:04:15.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.475+0000 7f4b0bfff640 1 --2- 172.21.15.161:0/2598710807 >> v2:172.21.15.161:3300/0 conn(0x7f4b0c06af50 0x7f4b0c06b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47026/0 (socket says 172.21.15.161:47026) 2024-02-02T13:04:15.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.475+0000 7f4b0bfff640 1 -- 172.21.15.161:0/2598710807 >> v2:172.21.15.162:3300/0 conn(0x7f4b0c144b60 msgr2=0x7f4b0c144fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:15.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.475+0000 7f4b0bfff640 1 --2- 172.21.15.161:0/2598710807 >> v2:172.21.15.162:3300/0 conn(0x7f4b0c144b60 0x7f4b0c144fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.475+0000 7f4b0bfff640 1 -- 172.21.15.161:0/2598710807 >> v1:172.21.15.161:6789/0 conn(0x7f4b0c071060 legacy=0x7f4b0c0b8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.475+0000 7f4b0bfff640 1 -- 172.21.15.161:0/2598710807 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c14b260 con 0x7f4b0c06af50 2024-02-02T13:04:15.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.475+0000 7f4b0affd640 1 -- 172.21.15.161:0/2598710807 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115088168 0 0) 0x7f4b0c14aca0 con 0x7f4b0c071060 2024-02-02T13:04:15.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.479+0000 7f4b0bfff640 1 --2- 172.21.15.161:0/2598710807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b0c06af50 0x7f4b0c06b3e0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0bbf90 tx=0x7f4b0401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4476e894a5b421 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:15.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.479+0000 7f4b0affd640 1 -- 172.21.15.161:0/2598710807 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b040a5930 con 0x7f4b0c06af50 2024-02-02T13:04:15.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.479+0000 7f4b0affd640 1 -- 172.21.15.161:0/2598710807 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b040a5a90 con 0x7f4b0c06af50 2024-02-02T13:04:15.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.479+0000 7f4b0affd640 1 -- 172.21.15.161:0/2598710807 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b040a5e20 con 0x7f4b0c06af50 2024-02-02T13:04:15.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.479+0000 7f4b121c3640 1 -- 172.21.15.161:0/2598710807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b0c06af50 msgr2=0x7f4b0c06b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.479+0000 7f4b121c3640 1 --2- 172.21.15.161:0/2598710807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b0c06af50 0x7f4b0c06b3e0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0bbf90 tx=0x7f4b0401c850 comp rx=0 tx=0).stop 2024-02-02T13:04:15.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.479+0000 7f4b121c3640 1 -- 172.21.15.161:0/2598710807 shutdown_connections 2024-02-02T13:04:15.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.479+0000 7f4b121c3640 1 --2- 172.21.15.161:0/2598710807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b0c06af50 0x7f4b0c06b3e0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.479+0000 7f4b121c3640 1 --2- 172.21.15.161:0/2598710807 >> v2:172.21.15.162:3300/0 conn(0x7f4b0c144b60 0x7f4b0c144fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.479+0000 7f4b121c3640 1 -- 172.21.15.161:0/2598710807 >> 172.21.15.161:0/2598710807 conn(0x7f4b0c0be100 msgr2=0x7f4b0c0be510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:15.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.479+0000 7f4b121c3640 1 -- 172.21.15.161:0/2598710807 shutdown_connections 2024-02-02T13:04:15.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.479+0000 7f4b121c3640 1 -- 172.21.15.161:0/2598710807 wait complete. 2024-02-02T13:04:15.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.479+0000 7f4b121c3640 1 Processor -- start 2024-02-02T13:04:15.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.479+0000 7f4b121c3640 1 -- start start 2024-02-02T13:04:15.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b121c3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b0c06af50 0x7f4b0c0b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b121c3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b0c071060 0x7f4b0c0b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b121c3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b0c144b60 0x7f4b0c13e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b121c3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c0b1e80 con 0x7f4b0c144b60 2024-02-02T13:04:15.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b121c3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c0b84c0 con 0x7f4b0c06af50 2024-02-02T13:04:15.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b121c3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c0b1af0 con 0x7f4b0c071060 2024-02-02T13:04:15.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b0bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b0c144b60 0x7f4b0c13e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b0bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b0c144b60 0x7f4b0c13e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47032/0 (socket says 172.21.15.161:47032) 2024-02-02T13:04:15.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b0bfff640 1 -- 172.21.15.161:0/603163691 learned_addr learned my addr 172.21.15.161:0/603163691 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:15.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b0bfff640 1 -- 172.21.15.161:0/603163691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b0c071060 msgr2=0x7f4b0c0b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b0b7fe640 1 --2- 172.21.15.161:0/603163691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b0c06af50 0x7f4b0c0b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b02ffd640 1 --2- 172.21.15.161:0/603163691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b0c071060 0x7f4b0c0b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b0bfff640 1 --2- 172.21.15.161:0/603163691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b0c071060 0x7f4b0c0b58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b0bfff640 1 -- 172.21.15.161:0/603163691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b0c06af50 msgr2=0x7f4b0c0b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b0bfff640 1 --2- 172.21.15.161:0/603163691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b0c06af50 0x7f4b0c0b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b0bfff640 1 -- 172.21.15.161:0/603163691 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b04009a70 con 0x7f4b0c144b60 2024-02-02T13:04:15.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b0bfff640 1 --2- 172.21.15.161:0/603163691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b0c144b60 0x7f4b0c13e630 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f4b04019460 tx=0x7f4b040195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:15.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b08ff9640 1 -- 172.21.15.161:0/603163691 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b040ade20 con 0x7f4b0c144b60 2024-02-02T13:04:15.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b08ff9640 1 -- 172.21.15.161:0/603163691 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b040b7410 con 0x7f4b0c144b60 2024-02-02T13:04:15.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b08ff9640 1 -- 172.21.15.161:0/603163691 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b040b77c0 con 0x7f4b0c144b60 2024-02-02T13:04:15.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b121c3640 1 -- 172.21.15.161:0/603163691 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0c0b2090 con 0x7f4b0c144b60 2024-02-02T13:04:15.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b121c3640 1 -- 172.21.15.161:0/603163691 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0c0b3350 con 0x7f4b0c144b60 2024-02-02T13:04:15.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b121c3640 1 -- 172.21.15.161:0/603163691 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4b0c06b920 con 0x7f4b0c144b60 2024-02-02T13:04:15.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b08ff9640 1 -- 172.21.15.161:0/603163691 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4b040b4050 con 0x7f4b0c144b60 2024-02-02T13:04:15.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b08ff9640 1 --2- 172.21.15.161:0/603163691 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4aec065a90 0x7f4aec067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b08ff9640 1 -- 172.21.15.161:0/603163691 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4b0411e790 con 0x7f4b0c144b60 2024-02-02T13:04:15.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b0b7fe640 1 --2- 172.21.15.161:0/603163691 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4aec065a90 0x7f4aec067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b08ff9640 1 --2- 172.21.15.161:0/603163691 >> [v2:172.21.15.162:6808/27911,v1:172.21.15.162:6809/27911] conn(0x7f4aec06b8f0 0x7f4aec06dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b08ff9640 1 -- 172.21.15.161:0/603163691 --> [v2:172.21.15.162:6808/27911,v1:172.21.15.162:6809/27911] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4aec06e3c0 con 0x7f4aec06b8f0 2024-02-02T13:04:15.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b08ff9640 1 -- 172.21.15.161:0/603163691 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b0411ebe0 con 0x7f4b0c144b60 2024-02-02T13:04:15.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b0b7fe640 1 --2- 172.21.15.161:0/603163691 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4aec065a90 0x7f4aec067f50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4afc001370 tx=0x7f4afc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:15.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.483+0000 7f4b02ffd640 1 --2- 172.21.15.161:0/603163691 >> [v2:172.21.15.162:6808/27911,v1:172.21.15.162:6809/27911] conn(0x7f4aec06b8f0 0x7f4aec06dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.487+0000 7f4b02ffd640 1 --2- 172.21.15.161:0/603163691 >> [v2:172.21.15.162:6808/27911,v1:172.21.15.162:6809/27911] conn(0x7f4aec06b8f0 0x7f4aec06dd10 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:15.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.487+0000 7f4b08ff9640 1 -- 172.21.15.161:0/603163691 <== osd.7 v2:172.21.15.162:6808/27911 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4aec06e3c0 con 0x7f4aec06b8f0 2024-02-02T13:04:15.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.499+0000 7f4b121c3640 1 -- 172.21.15.161:0/603163691 --> [v2:172.21.15.162:6808/27911,v1:172.21.15.162:6809/27911] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4b0c04e000 con 0x7f4aec06b8f0 2024-02-02T13:04:15.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.499+0000 7f4b08ff9640 1 -- 172.21.15.161:0/603163691 <== osd.7 v2:172.21.15.162:6808/27911 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4b0c04e000 con 0x7f4aec06b8f0 2024-02-02T13:04:15.503 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-02-02T13:04:15.503 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-02-02T13:04:15.504 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-02-02T13:04:15.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.499+0000 7f4b121c3640 1 -- 172.21.15.161:0/603163691 >> [v2:172.21.15.162:6808/27911,v1:172.21.15.162:6809/27911] conn(0x7f4aec06b8f0 msgr2=0x7f4aec06dd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.499+0000 7f4b121c3640 1 --2- 172.21.15.161:0/603163691 >> [v2:172.21.15.162:6808/27911,v1:172.21.15.162:6809/27911] conn(0x7f4aec06b8f0 0x7f4aec06dd10 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.499+0000 7f4b121c3640 1 -- 172.21.15.161:0/603163691 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4aec065a90 msgr2=0x7f4aec067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.499+0000 7f4b121c3640 1 --2- 172.21.15.161:0/603163691 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f4aec065a90 0x7f4aec067f50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4afc001370 tx=0x7f4afc009040 comp rx=0 tx=0).stop 2024-02-02T13:04:15.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.499+0000 7f4b121c3640 1 -- 172.21.15.161:0/603163691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b0c144b60 msgr2=0x7f4b0c13e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.499+0000 7f4b121c3640 1 --2- 172.21.15.161:0/603163691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b0c144b60 0x7f4b0c13e630 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f4b04019460 tx=0x7f4b040195f0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.499+0000 7f4b0bfff640 1 -- 172.21.15.161:0/603163691 reap_dead start 2024-02-02T13:04:15.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.499+0000 7f4b121c3640 1 -- 172.21.15.161:0/603163691 shutdown_connections 2024-02-02T13:04:15.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.499+0000 7f4b121c3640 1 -- 172.21.15.161:0/603163691 >> 172.21.15.161:0/603163691 conn(0x7f4b0c0be100 msgr2=0x7f4b0c0b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:15.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.499+0000 7f4b121c3640 1 -- 172.21.15.161:0/603163691 shutdown_connections 2024-02-02T13:04:15.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.499+0000 7f4b121c3640 1 -- 172.21.15.161:0/603163691 wait complete. 2024-02-02T13:04:15.518 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-02-02T13:04:15.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.627+0000 7fa597952640 1 Processor -- start 2024-02-02T13:04:15.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.627+0000 7fa597952640 1 -- start start 2024-02-02T13:04:15.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.627+0000 7fa597952640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa590144b60 0x7fa5900658e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.627+0000 7fa597952640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa59006acd0 0x7fa590155450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.627+0000 7fa597952640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa590065f50 con 0x7fa59006a840 2024-02-02T13:04:15.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.627+0000 7fa597952640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa590071000 con 0x7fa590144b60 2024-02-02T13:04:15.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.627+0000 7fa597952640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa590071cf0 con 0x7fa59006acd0 2024-02-02T13:04:15.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.627+0000 7fa5956ee640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa590144b60 0x7fa5900658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.627+0000 7fa5956ee640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa590144b60 0x7fa5900658e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47044/0 (socket says 172.21.15.161:47044) 2024-02-02T13:04:15.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.627+0000 7fa5956ee640 1 -- 172.21.15.161:0/3485240240 learned_addr learned my addr 172.21.15.161:0/3485240240 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:15.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.627+0000 7fa5956ee640 1 -- 172.21.15.161:0/3485240240 >> v2:172.21.15.162:3300/0 conn(0x7fa59006acd0 msgr2=0x7fa590155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:15.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.627+0000 7fa5956ee640 1 --2- 172.21.15.161:0/3485240240 >> v2:172.21.15.162:3300/0 conn(0x7fa59006acd0 0x7fa590155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.627+0000 7fa5956ee640 1 -- 172.21.15.161:0/3485240240 >> v1:172.21.15.162:6789/0 conn(0x7fa59006a840 legacy=0x7fa59014e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:15.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.627+0000 7fa5956ee640 1 -- 172.21.15.161:0/3485240240 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa590070760 con 0x7fa590144b60 2024-02-02T13:04:15.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa5956ee640 1 --2- 172.21.15.161:0/3485240240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa590144b60 0x7fa5900658e0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fa5900704f0 tx=0x7fa58001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a1805e11630136 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:15.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa587fff640 1 -- 172.21.15.161:0/3485240240 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5800ab600 con 0x7fa590144b60 2024-02-02T13:04:15.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa587fff640 1 -- 172.21.15.161:0/3485240240 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5800ab760 con 0x7fa590144b60 2024-02-02T13:04:15.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa587fff640 1 -- 172.21.15.161:0/3485240240 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5800abaf0 con 0x7fa590144b60 2024-02-02T13:04:15.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa597952640 1 -- 172.21.15.161:0/3485240240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa590144b60 msgr2=0x7fa5900658e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa597952640 1 --2- 172.21.15.161:0/3485240240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa590144b60 0x7fa5900658e0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fa5900704f0 tx=0x7fa58001c400 comp rx=0 tx=0).stop 2024-02-02T13:04:15.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa597952640 1 -- 172.21.15.161:0/3485240240 shutdown_connections 2024-02-02T13:04:15.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa597952640 1 --2- 172.21.15.161:0/3485240240 >> v2:172.21.15.162:3300/0 conn(0x7fa59006acd0 0x7fa590155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa597952640 1 --2- 172.21.15.161:0/3485240240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa590144b60 0x7fa5900658e0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa597952640 1 -- 172.21.15.161:0/3485240240 >> 172.21.15.161:0/3485240240 conn(0x7fa590069d20 msgr2=0x7fa59006a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:15.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa597952640 1 -- 172.21.15.161:0/3485240240 shutdown_connections 2024-02-02T13:04:15.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa597952640 1 -- 172.21.15.161:0/3485240240 wait complete. 2024-02-02T13:04:15.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa597952640 1 Processor -- start 2024-02-02T13:04:15.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa597952640 1 -- start start 2024-02-02T13:04:15.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa597952640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa59006a840 0x7fa5900bb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa597952640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa59006acd0 0x7fa5901e33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa597952640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa590144b60 0x7fa590138a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa597952640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5900bbcf0 con 0x7fa59006a840 2024-02-02T13:04:15.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa597952640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa590145380 con 0x7fa59006acd0 2024-02-02T13:04:15.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa597952640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa590146630 con 0x7fa590144b60 2024-02-02T13:04:15.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa5956ee640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa59006a840 0x7fa5900bb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa5956ee640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa59006a840 0x7fa5900bb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47054/0 (socket says 172.21.15.161:47054) 2024-02-02T13:04:15.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa5956ee640 1 -- 172.21.15.161:0/821648247 learned_addr learned my addr 172.21.15.161:0/821648247 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:15.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa5956ee640 1 -- 172.21.15.161:0/821648247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa590144b60 msgr2=0x7fa590138a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa5956ee640 1 --2- 172.21.15.161:0/821648247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa590144b60 0x7fa590138a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa5956ee640 1 -- 172.21.15.161:0/821648247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa59006acd0 msgr2=0x7fa5901e33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa5956ee640 1 --2- 172.21.15.161:0/821648247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa59006acd0 0x7fa5901e33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa5956ee640 1 -- 172.21.15.161:0/821648247 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5800094d0 con 0x7fa59006a840 2024-02-02T13:04:15.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.631+0000 7fa5956ee640 1 --2- 172.21.15.161:0/821648247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa59006a840 0x7fa5900bb7b0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fa58001a030 tx=0x7fa58001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:15.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.635+0000 7fa585ffb640 1 -- 172.21.15.161:0/821648247 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5800b4800 con 0x7fa59006a840 2024-02-02T13:04:15.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.635+0000 7fa597952640 1 -- 172.21.15.161:0/821648247 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5901e38e0 con 0x7fa59006a840 2024-02-02T13:04:15.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.635+0000 7fa585ffb640 1 -- 172.21.15.161:0/821648247 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5800b4980 con 0x7fa59006a840 2024-02-02T13:04:15.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.635+0000 7fa585ffb640 1 -- 172.21.15.161:0/821648247 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5800b4d30 con 0x7fa59006a840 2024-02-02T13:04:15.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.635+0000 7fa597952640 1 -- 172.21.15.161:0/821648247 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa590145590 con 0x7fa59006a840 2024-02-02T13:04:15.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.635+0000 7fa597952640 1 -- 172.21.15.161:0/821648247 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa59014b650 con 0x7fa59006a840 2024-02-02T13:04:15.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.635+0000 7fa585ffb640 1 -- 172.21.15.161:0/821648247 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa5800c7440 con 0x7fa59006a840 2024-02-02T13:04:15.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.635+0000 7fa585ffb640 1 --2- 172.21.15.161:0/821648247 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa574065a60 0x7fa574067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.635+0000 7fa585ffb640 1 -- 172.21.15.161:0/821648247 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa58011d890 con 0x7fa59006a840 2024-02-02T13:04:15.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.635+0000 7fa594eed640 1 --2- 172.21.15.161:0/821648247 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa574065a60 0x7fa574067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.635+0000 7fa594eed640 1 --2- 172.21.15.161:0/821648247 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa574065a60 0x7fa574067f20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa58c007fd0 tx=0x7fa58c0079a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:15.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.639+0000 7fa585ffb640 1 -- 172.21.15.161:0/821648247 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa5800eb560 con 0x7fa59006a840 2024-02-02T13:04:15.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.783+0000 7fa597952640 1 -- 172.21.15.161:0/821648247 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fa590144f40 con 0x7fa574065a60 2024-02-02T13:04:15.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.783+0000 7fa585ffb640 1 -- 172.21.15.161:0/821648247 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa58c0050d0 con 0x7fa574065a60 2024-02-02T13:04:15.786 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 7 to deep-scrub 2024-02-02T13:04:15.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.783+0000 7fa597952640 1 -- 172.21.15.161:0/821648247 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa574065a60 msgr2=0x7fa574067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.783+0000 7fa597952640 1 --2- 172.21.15.161:0/821648247 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa574065a60 0x7fa574067f20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa58c007fd0 tx=0x7fa58c0079a0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.783+0000 7fa597952640 1 -- 172.21.15.161:0/821648247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa59006a840 msgr2=0x7fa5900bb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.783+0000 7fa597952640 1 --2- 172.21.15.161:0/821648247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa59006a840 0x7fa5900bb7b0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fa58001a030 tx=0x7fa58001ac40 comp rx=0 tx=0).stop 2024-02-02T13:04:15.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.783+0000 7fa597952640 1 -- 172.21.15.161:0/821648247 shutdown_connections 2024-02-02T13:04:15.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.783+0000 7fa597952640 1 --2- 172.21.15.161:0/821648247 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7fa574065a60 0x7fa574067f20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.783+0000 7fa597952640 1 --2- 172.21.15.161:0/821648247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa590144b60 0x7fa590138a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.783+0000 7fa597952640 1 --2- 172.21.15.161:0/821648247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa59006acd0 0x7fa5901e33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.783+0000 7fa597952640 1 --2- 172.21.15.161:0/821648247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa59006a840 0x7fa5900bb7b0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.783+0000 7fa597952640 1 -- 172.21.15.161:0/821648247 >> 172.21.15.161:0/821648247 conn(0x7fa590069d20 msgr2=0x7fa59013ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:15.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.783+0000 7fa597952640 1 -- 172.21.15.161:0/821648247 shutdown_connections 2024-02-02T13:04:15.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.783+0000 7fa597952640 1 -- 172.21.15.161:0/821648247 wait complete. 2024-02-02T13:04:15.803 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-02T13:04:15.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.903+0000 7f2ef1b2d640 1 Processor -- start 2024-02-02T13:04:15.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.903+0000 7f2ef1b2d640 1 -- start start 2024-02-02T13:04:15.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2ef1b2d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2eec14b540 0x7f2eec0bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2ef1b2d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2eec06a900 0x7f2eec14e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2ef1b2d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eec06ad70 con 0x7f2eec06a4c0 2024-02-02T13:04:15.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2ef1b2d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eec0bc320 con 0x7f2eec06a900 2024-02-02T13:04:15.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2ef1b2d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec0bb650 con 0x7f2eec14b540 2024-02-02T13:04:15.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2eebfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2eec06a900 0x7f2eec14e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2eebfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2eec06a900 0x7f2eec14e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47066/0 (socket says 172.21.15.161:47066) 2024-02-02T13:04:15.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2eebfff640 1 -- 172.21.15.161:0/2813306229 learned_addr learned my addr 172.21.15.161:0/2813306229 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:15.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2eebfff640 1 -- 172.21.15.161:0/2813306229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2eec14b540 msgr2=0x7f2eec0bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:15.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2eeb7fe640 1 --2- 172.21.15.161:0/2813306229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2eec14b540 0x7f2eec0bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2eebfff640 1 --2- 172.21.15.161:0/2813306229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2eec14b540 0x7f2eec0bac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2eebfff640 1 -- 172.21.15.161:0/2813306229 >> v1:172.21.15.162:6789/0 conn(0x7f2eec06a4c0 legacy=0x7f2eec14dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:15.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2eebfff640 1 -- 172.21.15.161:0/2813306229 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec0bc590 con 0x7f2eec06a900 2024-02-02T13:04:15.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2eebfff640 1 --2- 172.21.15.161:0/2813306229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eec06a900 0x7f2eec14e6e0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009870 tx=0x7f2ee401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d23c29818eb5da9 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:15.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2eea7fc640 1 -- 172.21.15.161:0/2813306229 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee40a89b0 con 0x7f2eec06a900 2024-02-02T13:04:15.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2eea7fc640 1 -- 172.21.15.161:0/2813306229 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee40a8b10 con 0x7f2eec06a900 2024-02-02T13:04:15.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2eea7fc640 1 -- 172.21.15.161:0/2813306229 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee40a8ea0 con 0x7f2eec06a900 2024-02-02T13:04:15.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2ef1b2d640 1 -- 172.21.15.161:0/2813306229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eec06a900 msgr2=0x7f2eec14e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2ef1b2d640 1 --2- 172.21.15.161:0/2813306229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eec06a900 0x7f2eec14e6e0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009870 tx=0x7f2ee401ecf0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2ef1b2d640 1 -- 172.21.15.161:0/2813306229 shutdown_connections 2024-02-02T13:04:15.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2ef1b2d640 1 --2- 172.21.15.161:0/2813306229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eec06a900 0x7f2eec14e6e0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2ef1b2d640 1 --2- 172.21.15.161:0/2813306229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2eec14b540 0x7f2eec0bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2ef1b2d640 1 -- 172.21.15.161:0/2813306229 >> 172.21.15.161:0/2813306229 conn(0x7f2eec0c02e0 msgr2=0x7f2eec0c06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:15.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2ef1b2d640 1 -- 172.21.15.161:0/2813306229 shutdown_connections 2024-02-02T13:04:15.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.907+0000 7f2ef1b2d640 1 -- 172.21.15.161:0/2813306229 wait complete. 2024-02-02T13:04:15.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2ef1b2d640 1 Processor -- start 2024-02-02T13:04:15.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2ef1b2d640 1 -- start start 2024-02-02T13:04:15.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2ef1b2d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eec06a4c0 0x7f2eec0b6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2ef1b2d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2eec06a900 0x7f2eec1e38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2ef1b2d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2eec14b540 0x7f2eec1e3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2ef1b2d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec0b6b40 con 0x7f2eec06a4c0 2024-02-02T13:04:15.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2ef1b2d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec099b00 con 0x7f2eec14b540 2024-02-02T13:04:15.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2ef1b2d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec099de0 con 0x7f2eec06a900 2024-02-02T13:04:15.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2eeb7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eec06a4c0 0x7f2eec0b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2eeb7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eec06a4c0 0x7f2eec0b6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47076/0 (socket says 172.21.15.161:47076) 2024-02-02T13:04:15.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2eeb7fe640 1 -- 172.21.15.161:0/2711754520 learned_addr learned my addr 172.21.15.161:0/2711754520 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:15.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2eebfff640 1 --2- 172.21.15.161:0/2711754520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2eec14b540 0x7f2eec1e3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2eeaffd640 1 --2- 172.21.15.161:0/2711754520 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2eec06a900 0x7f2eec1e38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2eeb7fe640 1 -- 172.21.15.161:0/2711754520 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2eec06a900 msgr2=0x7f2eec1e38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2eeb7fe640 1 --2- 172.21.15.161:0/2711754520 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2eec06a900 0x7f2eec1e38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2eeb7fe640 1 -- 172.21.15.161:0/2711754520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2eec14b540 msgr2=0x7f2eec1e3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:15.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2eeb7fe640 1 --2- 172.21.15.161:0/2711754520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2eec14b540 0x7f2eec1e3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:15.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2eeb7fe640 1 -- 172.21.15.161:0/2711754520 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee40094d0 con 0x7f2eec06a4c0 2024-02-02T13:04:15.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2eebfff640 1 --2- 172.21.15.161:0/2711754520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2eec14b540 0x7f2eec1e3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:15.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2eeb7fe640 1 --2- 172.21.15.161:0/2711754520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eec06a4c0 0x7f2eec0b6600 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f2edc00c7f0 tx=0x7f2edc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:15.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2ee3fff640 1 -- 172.21.15.161:0/2711754520 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc007820 con 0x7f2eec06a4c0 2024-02-02T13:04:15.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2ee3fff640 1 -- 172.21.15.161:0/2711754520 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2edc007980 con 0x7f2eec06a4c0 2024-02-02T13:04:15.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2ef1b2d640 1 -- 172.21.15.161:0/2711754520 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eec09a0c0 con 0x7f2eec06a4c0 2024-02-02T13:04:15.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2ee3fff640 1 -- 172.21.15.161:0/2711754520 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc007d30 con 0x7f2eec06a4c0 2024-02-02T13:04:15.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2ef1b2d640 1 -- 172.21.15.161:0/2711754520 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eec0994f0 con 0x7f2eec06a4c0 2024-02-02T13:04:15.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2ef1b2d640 1 -- 172.21.15.161:0/2711754520 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eec04e000 con 0x7f2eec06a4c0 2024-02-02T13:04:15.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2ee3fff640 1 -- 172.21.15.161:0/2711754520 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2edc0113f0 con 0x7f2eec06a4c0 2024-02-02T13:04:15.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.911+0000 7f2ee3fff640 1 --2- 172.21.15.161:0/2711754520 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ecc065a60 0x7f2ecc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:15.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.915+0000 7f2eeaffd640 1 --2- 172.21.15.161:0/2711754520 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ecc065a60 0x7f2ecc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:15.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.915+0000 7f2ee3fff640 1 -- 172.21.15.161:0/2711754520 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2edc083050 con 0x7f2eec06a4c0 2024-02-02T13:04:15.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.915+0000 7f2eeaffd640 1 --2- 172.21.15.161:0/2711754520 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ecc065a60 0x7f2ecc067f20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2eec147730 tx=0x7f2ed4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:15.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:15.919+0000 7f2ee3fff640 1 -- 172.21.15.161:0/2711754520 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2edc050da0 con 0x7f2eec06a4c0 2024-02-02T13:04:16.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:16.067+0000 7f2ef1b2d640 1 -- 172.21.15.161:0/2711754520 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2eec0bfa00 con 0x7f2ecc065a60 2024-02-02T13:04:16.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:16.071+0000 7f2ee3fff640 1 -- 172.21.15.161:0/2711754520 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49409 (secure 0 0 0) 0x7f2ed4004110 con 0x7f2ecc065a60 2024-02-02T13:04:16.075 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T13:04:16.076 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-02-02T13:04:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:16.075+0000 7f2ef1b2d640 1 -- 172.21.15.161:0/2711754520 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ecc065a60 msgr2=0x7f2ecc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:16.075+0000 7f2ef1b2d640 1 --2- 172.21.15.161:0/2711754520 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ecc065a60 0x7f2ecc067f20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2eec147730 tx=0x7f2ed4009040 comp rx=0 tx=0).stop 2024-02-02T13:04:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:16.075+0000 7f2ef1b2d640 1 -- 172.21.15.161:0/2711754520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eec06a4c0 msgr2=0x7f2eec0b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:16.075+0000 7f2ef1b2d640 1 --2- 172.21.15.161:0/2711754520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eec06a4c0 0x7f2eec0b6600 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f2edc00c7f0 tx=0x7f2edc00ccb0 comp rx=0 tx=0).stop 2024-02-02T13:04:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:16.075+0000 7f2ef1b2d640 1 -- 172.21.15.161:0/2711754520 shutdown_connections 2024-02-02T13:04:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:16.075+0000 7f2ef1b2d640 1 --2- 172.21.15.161:0/2711754520 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f2ecc065a60 0x7f2ecc067f20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:16.075+0000 7f2ef1b2d640 1 --2- 172.21.15.161:0/2711754520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2eec14b540 0x7f2eec1e3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:16.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:16.075+0000 7f2ef1b2d640 1 --2- 172.21.15.161:0/2711754520 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2eec06a900 0x7f2eec1e38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:16.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:16.075+0000 7f2ef1b2d640 1 --2- 172.21.15.161:0/2711754520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eec06a4c0 0x7f2eec0b6600 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:16.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:16.075+0000 7f2ef1b2d640 1 -- 172.21.15.161:0/2711754520 >> 172.21.15.161:0/2711754520 conn(0x7f2eec0c02e0 msgr2=0x7f2eec0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:16.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:16.075+0000 7f2ef1b2d640 1 -- 172.21.15.161:0/2711754520 shutdown_connections 2024-02-02T13:04:16.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:16.075+0000 7f2ef1b2d640 1 -- 172.21.15.161:0/2711754520 wait complete. 2024-02-02T13:04:16.095 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":2294,"stamp":"2024-02-02T13:04:15.755629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":9546444,"kb_used_data":4232,"kb_used_omap":13,"kb_used_meta":9542130,"kb_avail":745428276,"statfs":{"total":773094113280,"available":763318554624,"internally_reserved":0,"allocated":4333568,"data_stored":2396024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":9771141208},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-529797120,"num_objects":-1350,"num_object_clones":0,"num_object_copies":-2700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1350,"num_whiteouts":0,"num_read":-55231,"num_read_kb":-53479944,"num_write":-1425523,"num_write_kb":-58886648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002055"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":211,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-02-02T13:04:05.445103+0000","last_change":"2024-02-02T11:48:41.563754+0000","last_active":"2024-02-02T13:04:05.445103+0000","last_peered":"2024-02-02T13:04:05.445103+0000","last_clean":"2024-02-02T13:04:05.445103+0000","last_became_active":"2024-02-02T11:48:41.562629+0000","last_became_peered":"2024-02-02T11:48:41.562629+0000","last_unstale":"2024-02-02T13:04:05.445103+0000","last_undegraded":"2024-02-02T13:04:05.445103+0000","last_fullsized":"2024-02-02T13:04:05.445103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-02T11:48:40.536978+0000","last_clean_scrub_stamp":"2024-02-02T11:48:40.536978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T19:22:02.923582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575760,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1440396,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":1439422,"kb_avail":92931444,"statfs":{"total":96636764160,"available":95161798656,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1473968395},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.74399999999999999,"15min":0.77600000000000002},"min":{"1min":0.39800000000000002,"5min":0.32600000000000001,"15min":0.27900000000000003},"max":{"1min":3.8999999999999999,"5min":3.8999999999999999,"15min":3.8999999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.72999999999999998,"15min":0.78700000000000003},"min":{"1min":0.36099999999999999,"5min":0.30199999999999999,"15min":0.24299999999999999},"max":{"1min":1.1439999999999999,"5min":1.169,"15min":4.6180000000000003},"last":0.97299999999999998}]},{"osd":1,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.88200000000000001,"15min":0.871},"min":{"1min":0.435,"5min":0.314,"15min":0.26600000000000001},"max":{"1min":3.6869999999999998,"5min":3.6869999999999998,"15min":8.1199999999999992},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82399999999999995,"15min":0.875},"min":{"1min":0.46899999999999997,"5min":0.34000000000000002,"15min":0.26600000000000001},"max":{"1min":1.1819999999999999,"5min":1.4330000000000001,"15min":8.0429999999999993},"last":0.65800000000000003}]},{"osd":2,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76500000000000001,"15min":0.81499999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.33000000000000002},"max":{"1min":1.1459999999999999,"5min":2.0979999999999999,"15min":5.21},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.873,"15min":0.89100000000000001},"min":{"1min":0.497,"5min":0.39900000000000002,"15min":0.375},"max":{"1min":3.6179999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.90700000000000003}]},{"osd":3,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.84699999999999998,"15min":0.90200000000000002},"min":{"1min":0.46100000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":5.181},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.097,"5min":0.95599999999999996,"15min":0.97799999999999998},"min":{"1min":0.54100000000000004,"5min":0.39400000000000002,"15min":0.314},"max":{"1min":3.5899999999999999,"5min":3.5899999999999999,"15min":6.6230000000000002},"last":0.80000000000000004}]},{"osd":4,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.94299999999999995,"15min":0.94799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.27400000000000002},"max":{"1min":1.351,"5min":1.5589999999999999,"15min":4.6790000000000003},"last":0.872},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.93899999999999995,"15min":0.96199999999999997},"min":{"1min":0.41999999999999998,"5min":0.32700000000000001,"15min":0.312},"max":{"1min":1.2549999999999999,"5min":1.728,"15min":3.823},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.056,"15min":1.0580000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.315},"max":{"1min":3.5489999999999999,"5min":3.5489999999999999,"15min":4.6929999999999996},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.0469999999999999,"15min":1.0669999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.29199999999999998},"max":{"1min":1.3180000000000001,"5min":1.7789999999999999,"15min":4.6559999999999997},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.121,"15min":1.127},"min":{"1min":0.436,"5min":0.436,"15min":0.33300000000000002},"max":{"1min":4.3719999999999999,"5min":4.3719999999999999,"15min":5.383},"last":1.032},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0409999999999999,"15min":1.089},"min":{"1min":0.51100000000000001,"5min":0.50600000000000001,"15min":0.36799999999999999},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":5.0739999999999998},"last":0.94299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575759,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":880264,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":879870,"kb_avail":93491576,"statfs":{"total":96636764160,"available":95735373824,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":900987147},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.70799999999999996,"15min":0.73299999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27000000000000002},"max":{"1min":1.2130000000000001,"5min":1.238,"15min":3.9910000000000001},"last":0.876},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77500000000000002,"15min":0.79300000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":3.548},"last":0.91200000000000003}]},{"osd":1,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.79700000000000004,"15min":0.82199999999999995},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":5.383,"5min":5.383,"15min":7.3819999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.79400000000000004,"15min":0.85399999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":1.093,"5min":1.4199999999999999,"15min":8.9719999999999995},"last":0.623}]},{"osd":2,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79600000000000004,"15min":0.89800000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":25.451000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.88,"15min":1.0049999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.32700000000000001},"max":{"1min":5.4500000000000002,"5min":5.4500000000000002,"15min":25.044},"last":0.97299999999999998}]},{"osd":3,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":0.99299999999999999,"15min":1.139},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":8.4290000000000003,"5min":8.4290000000000003,"15min":21.263000000000002},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.96099999999999997,"15min":1.1140000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.371},"max":{"1min":1.3959999999999999,"5min":1.5189999999999999,"15min":21.361999999999998},"last":0.83499999999999996}]},{"osd":4,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":1.034,"15min":0.996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26600000000000001},"max":{"1min":1.5669999999999999,"5min":1.579,"15min":3.7480000000000002},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.0840000000000001,"15min":1.0509999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":5.4219999999999997,"5min":5.4219999999999997,"15min":7.548},"last":1.147}]},{"osd":5,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.0409999999999999,"15min":1.0740000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.253},"max":{"1min":1.623,"5min":1.623,"15min":15.833},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1399999999999999,"15min":1.2070000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.312},"max":{"1min":5.8029999999999999,"5min":5.8029999999999999,"15min":14.234},"last":0.79900000000000004}]},{"osd":7,"last update":"Fri Feb 2 13:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.1100000000000001,"15min":1.143},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":13.936},"last":1.036},{"interface":"front","average":{"1min":0.996,"5min":1.1080000000000001,"15min":1.1319999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.32400000000000001},"max":{"1min":1.542,"5min":1.542,"15min":13.904999999999999},"last":1.0089999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575758,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1165068,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1164670,"kb_avail":93206772,"statfs":{"total":96636764160,"available":95443734528,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1192622347},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.753,"15min":0.76300000000000001},"min":{"1min":0.40600000000000003,"5min":0.248,"15min":0.23300000000000001},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.804},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.84399999999999997,"15min":0.84899999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.40500000000000003},"max":{"1min":1.5129999999999999,"5min":3.492,"15min":4.2759999999999998},"last":0.89100000000000001}]},{"osd":1,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.98699999999999999,"15min":0.89200000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.308},"max":{"1min":1.1899999999999999,"5min":18.481999999999999,"15min":18.481999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.80000000000000004,"15min":0.83599999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.26500000000000001},"max":{"1min":1.2310000000000001,"5min":1.252,"15min":4.8380000000000001},"last":0.80300000000000005}]},{"osd":2,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.89300000000000002,"15min":0.89600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.41599999999999998},"max":{"1min":1.214,"5min":4.1280000000000001,"15min":4.3090000000000002},"last":1.002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90000000000000002,"15min":0.89400000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.369,"5min":4.1820000000000004,"15min":4.1820000000000004},"last":1.069}]},{"osd":3,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.032,"15min":0.999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.48,"5min":8.6809999999999992,"15min":8.6809999999999992},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.84999999999999998,"5min":1.0229999999999999,"15min":0.98799999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32300000000000001},"max":{"1min":1.304,"5min":5.2430000000000003,"15min":5.2430000000000003},"last":0.94299999999999995}]},{"osd":4,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.96199999999999997,"15min":0.96299999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.415,"5min":1.415,"15min":3.4500000000000002},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.0900000000000001,"15min":1.089},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.2989999999999999,"5min":3.5960000000000001,"15min":4.2119999999999997},"last":1.107}]},{"osd":6,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.071,"15min":1.0589999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.253},"max":{"1min":1.367,"5min":1.5880000000000001,"15min":3.5339999999999998},"last":1.1559999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.0760000000000001,"15min":1.0649999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.33300000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.488},"last":1.137}]},{"osd":7,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3640000000000001,"5min":3.5670000000000002,"15min":4.25},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.161,"15min":1.153},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.4179999999999999,"5min":1.6830000000000001,"15min":3.6589999999999998},"last":1.2330000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575758,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1430920,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1430526,"kb_avail":92940920,"statfs":{"total":96636764160,"available":95171502080,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1464858891},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:04:14 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.749,"15min":0.88},"min":{"1min":0.41399999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":3.7909999999999999,"5min":3.7909999999999999,"15min":9.5009999999999994},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.751,"15min":0.83599999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":3.492,"5min":3.492,"15min":7.2229999999999999},"last":0.90200000000000002}]},{"osd":1,"last update":"Fri Feb 2 13:04:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":0.85499999999999998,"15min":0.82599999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.25700000000000001},"max":{"1min":6.0359999999999996,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.84699999999999998,"15min":0.95899999999999996},"min":{"1min":0.46300000000000002,"5min":0.35899999999999999,"15min":0.26500000000000001},"max":{"1min":3.8730000000000002,"5min":3.8730000000000002,"15min":8.9450000000000003},"last":1.0569999999999999}]},{"osd":2,"last update":"Fri Feb 2 13:04:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":0.96099999999999997,"15min":0.95299999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":6.0609999999999999,"5min":6.0609999999999999,"15min":9.0619999999999994},"last":1.02},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.88600000000000001,"15min":1.0109999999999999},"min":{"1min":0.437,"5min":0.42799999999999999,"15min":0.372},"max":{"1min":3.8260000000000001,"5min":3.8260000000000001,"15min":11.909000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Feb 2 13:04:14 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.878,"15min":0.91400000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":3.516,"5min":3.516,"15min":4.093},"last":0.65100000000000002},{"interface":"front","average":{"1min":2.6240000000000001,"5min":1.2629999999999999,"15min":1.0960000000000001},"min":{"1min":0.42499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":33.121000000000002,"5min":33.121000000000002,"15min":33.121000000000002},"last":0.755}]},{"osd":5,"last update":"Fri Feb 2 13:04:14 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.0509999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.315},"max":{"1min":3.8940000000000001,"5min":3.8940000000000001,"15min":9.5329999999999995},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.1220000000000001,"15min":1.0429999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":12.772,"5min":12.772,"15min":12.772},"last":0.98799999999999999}]},{"osd":6,"last update":"Fri Feb 2 13:04:14 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.131,"15min":1.103},"min":{"1min":0.316,"5min":0.316,"15min":0.30599999999999999},"max":{"1min":6.141,"5min":6.141,"15min":12.382999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.369,"5min":1.155,"15min":1.2010000000000001},"min":{"1min":0.48899999999999999,"5min":0.45500000000000002,"15min":0.34799999999999998},"max":{"1min":5.4790000000000001,"5min":5.4790000000000001,"15min":12.513999999999999},"last":1.1379999999999999}]},{"osd":7,"last update":"Fri Feb 2 13:04:14 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.113,"15min":1.0940000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.782,"5min":4.782,"15min":4.782},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.663,"5min":1.228,"15min":1.1839999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.33800000000000002},"max":{"1min":9.3059999999999992,"5min":9.3059999999999992,"15min":9.3059999999999992},"last":1.0860000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575759,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1466248,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1465854,"kb_avail":92905592,"statfs":{"total":96636764160,"available":95135326208,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1501034763},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.218},"max":{"1min":10.516999999999999,"5min":10.516999999999999,"15min":10.516999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.60499999999999998,"15min":0.65400000000000003},"min":{"1min":0.32000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":5.0720000000000001,"5min":5.0720000000000001,"15min":7.6520000000000001},"last":0.83099999999999996}]},{"osd":1,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.55100000000000005,"15min":0.61099999999999999},"min":{"1min":0.26100000000000001,"5min":0.23899999999999999,"15min":0.223},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":6.0049999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":1.181,"5min":0.68500000000000005,"15min":0.66900000000000004},"min":{"1min":0.27600000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":10.587999999999999,"5min":10.587999999999999,"15min":10.587999999999999},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.71999999999999997,"15min":0.77500000000000002},"min":{"1min":0.307,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.1619999999999999,"5min":5.1619999999999999,"15min":7.6100000000000003},"last":0.62},{"interface":"front","average":{"1min":1.0820000000000001,"5min":0.82299999999999995,"15min":0.88100000000000001},"min":{"1min":0.35399999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":5.2030000000000003,"5min":5.2030000000000003,"15min":7.6289999999999996},"last":0.67800000000000005}]},{"osd":4,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84899999999999998,"15min":0.91700000000000004},"min":{"1min":0.373,"5min":0.34599999999999997,"15min":0.309},"max":{"1min":1.1830000000000001,"5min":1.766,"15min":5.96},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.1180000000000001,"5min":0.94899999999999995,"15min":0.97899999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":5.117,"5min":5.117,"15min":7.5659999999999998},"last":0.874}]},{"osd":5,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":0.98699999999999999,"15min":1.054},"min":{"1min":0.441,"5min":0.441,"15min":0.32700000000000001},"max":{"1min":10.558999999999999,"5min":10.558999999999999,"15min":10.558999999999999},"last":1.113},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89600000000000002,"15min":0.95699999999999996},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.31900000000000001},"max":{"1min":1.387,"5min":1.7909999999999999,"15min":5.9199999999999999},"last":0.94699999999999995}]},{"osd":6,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.0409999999999999,"15min":1.032},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.32800000000000001},"max":{"1min":10.622,"5min":10.622,"15min":10.622},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.0349999999999999,"15min":1.089},"min":{"1min":0.53300000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":5.1829999999999998,"5min":5.1829999999999998,"15min":7.5289999999999999},"last":1.135}]},{"osd":7,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.014,"15min":1.0980000000000001},"min":{"1min":0.624,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":5.141,"5min":5.141,"15min":8.0370000000000008},"last":1.085},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92000000000000004,"15min":1.0209999999999999},"min":{"1min":0.51900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.54,"5min":1.8100000000000001,"15min":5.9829999999999997},"last":1.0149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575758,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":996872,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":996478,"kb_avail":93374968,"statfs":{"total":96636764160,"available":95615967232,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1020393739},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:04:13 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.56499999999999995,"15min":0.63600000000000001},"min":{"1min":0.308,"5min":0.22800000000000001,"15min":0.215},"max":{"1min":2.016,"5min":2.016,"15min":10.903},"last":0.308},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.66800000000000004,"15min":0.68000000000000005},"min":{"1min":0.309,"5min":0.28199999999999997,"15min":0.23499999999999999},"max":{"1min":2.0539999999999998,"5min":4.1520000000000001,"15min":5.6509999999999998},"last":0.38800000000000001}]},{"osd":1,"last update":"Fri Feb 2 13:04:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.58399999999999996,"15min":0.67000000000000004},"min":{"1min":0.30599999999999999,"5min":0.24299999999999999,"15min":0.216},"max":{"1min":0.98999999999999999,"5min":1.0820000000000001,"15min":3.234},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69599999999999995,"15min":0.89800000000000002},"min":{"1min":0.34100000000000003,"5min":0.218,"15min":0.218},"max":{"1min":1.117,"5min":5.4660000000000002,"15min":62.295999999999999},"last":0.43099999999999999}]},{"osd":3,"last update":"Fri Feb 2 13:04:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.58199999999999996,"15min":0.65100000000000002},"min":{"1min":0.32700000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":5.8150000000000004},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.73699999999999999,"15min":0.82599999999999996},"min":{"1min":0.41199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.0379999999999998,"5min":3.0379999999999998,"15min":10.968},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Feb 2 13:04:13 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.90900000000000003,"15min":1.038},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.33500000000000002},"max":{"1min":3.0760000000000001,"5min":3.7490000000000001,"15min":18.731999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.998,"5min":1.0169999999999999,"15min":1.03},"min":{"1min":0.42699999999999999,"5min":0.39000000000000001,"15min":0.33700000000000002},"max":{"1min":3.2229999999999999,"5min":5.9589999999999996,"15min":10.101000000000001},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Feb 2 13:04:13 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.95299999999999996,"15min":1.1040000000000001},"min":{"1min":0.44600000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2809999999999999,"5min":4.218,"15min":22.279},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":0.94299999999999995,"15min":0.97499999999999998},"min":{"1min":0.54200000000000004,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":8.9879999999999995,"5min":8.9879999999999995,"15min":8.9879999999999995},"last":0.81200000000000006}]},{"osd":6,"last update":"Fri Feb 2 13:04:13 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.88700000000000001,"15min":1.0389999999999999},"min":{"1min":0.435,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.415,"5min":1.474,"15min":20.545000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.929,"5min":1.1559999999999999,"15min":1.2010000000000001},"min":{"1min":0.55400000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":23.978000000000002,"5min":23.978000000000002,"15min":32.533000000000001},"last":0.82699999999999996}]},{"osd":7,"last update":"Fri Feb 2 13:04:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0169999999999999,"15min":1.077},"min":{"1min":0.53100000000000003,"5min":0.46200000000000002,"15min":0.437},"max":{"1min":2.2679999999999998,"5min":4.242,"15min":5.7220000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":1.036,"5min":0.95099999999999996,"15min":1.099},"min":{"1min":0.54600000000000004,"5min":0.48399999999999999,"15min":0.433},"max":{"1min":1.3700000000000001,"5min":1.8,"15min":20.5},"last":0.84499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575759,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1313800,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1313406,"kb_avail":93058040,"statfs":{"total":96636764160,"available":95291432960,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1344928011},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.73299999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.189},"max":{"1min":1.621,"5min":1.621,"15min":34.694000000000003},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.55500000000000005,"15min":0.68600000000000005},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.217},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":10.916},"last":0.249}]},{"osd":2,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51700000000000002,"15min":0.67200000000000004},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":14.744999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.60599999999999998,"15min":0.83899999999999997},"min":{"1min":0.28899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":38.899000000000001},"last":0.64600000000000002}]},{"osd":3,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65200000000000002,"15min":0.91700000000000004},"min":{"1min":0.35499999999999998,"5min":0.30499999999999999,"15min":0.29099999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":38.932000000000002},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.63700000000000001,"15min":0.81499999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.24299999999999999},"max":{"1min":2.621,"5min":2.621,"15min":12.385},"last":0.31}]},{"osd":4,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.83599999999999997,"15min":1.2969999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.34499999999999997},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":97.268000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.878,"15min":1.2909999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.317},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":97.442999999999998},"last":1.1040000000000001}]},{"osd":5,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88400000000000001,"15min":1.0089999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.7149999999999999,"5min":2.7149999999999999,"15min":8.9849999999999994},"last":0.749},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.85799999999999998,"15min":1.046},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.34699999999999998},"max":{"1min":1.3620000000000001,"5min":1.492,"15min":14.776999999999999},"last":0.623}]},{"osd":6,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91500000000000004,"15min":1.3100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":68.975999999999999},"last":1.151},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93000000000000005,"15min":1.119},"min":{"1min":0.44,"5min":0.44,"15min":0.40899999999999997},"max":{"1min":2.6499999999999999,"5min":2.6499999999999999,"15min":20.527999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Feb 2 13:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.92500000000000004,"15min":1.1160000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":12.547000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.89200000000000002,"15min":1.0860000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.38100000000000001},"max":{"1min":1.379,"5min":1.5780000000000001,"15min":14.808},"last":0.67500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575758,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":852876,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":851902,"kb_avail":93518964,"statfs":{"total":96636764160,"available":95763419136,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":872347915},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.57099999999999995,"15min":0.69299999999999995},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.255},"max":{"1min":0.73199999999999998,"5min":0.88900000000000001,"15min":21.370999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56999999999999995,"15min":0.69499999999999995},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.21099999999999999},"max":{"1min":0.93500000000000005,"5min":1.01,"15min":10.538},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.61699999999999999,"15min":0.77200000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27300000000000002},"max":{"1min":4.2919999999999998,"5min":4.2919999999999998,"15min":21.431000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.145,"5min":0.69299999999999995,"15min":0.78200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.29499999999999998},"max":{"1min":10.978999999999999,"5min":10.978999999999999,"15min":11.412000000000001},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.53900000000000003,"15min":0.63500000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":3.25},"last":0.754},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.65000000000000002,"15min":0.752},"min":{"1min":0.316,"5min":0.316,"15min":0.245},"max":{"1min":1.2170000000000001,"5min":1.46,"15min":4.0359999999999996},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.84399999999999997,"15min":0.91600000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":4.4589999999999996},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.81599999999999995,"15min":0.871},"min":{"1min":0.502,"5min":0.48399999999999999,"15min":0.41199999999999998},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":2.6030000000000002},"last":0.84999999999999998}]},{"osd":5,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.89300000000000002,"15min":0.97299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.361,"5min":1.415,"15min":3.9790000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.90300000000000002,"15min":1.0189999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":7.2619999999999996},"last":0.88900000000000001}]},{"osd":6,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.85499999999999998,"15min":0.93899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.371},"max":{"1min":1.26,"5min":1.2729999999999999,"15min":2.573},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.95199999999999996,"15min":1.0309999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.41599999999999998},"max":{"1min":1.4370000000000001,"5min":1.5289999999999999,"15min":4.008},"last":0.99299999999999999}]},{"osd":7,"last update":"Fri Feb 2 13:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93700000000000006,"15min":1.0269999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.6429999999999998,"5min":3.6429999999999998,"15min":4.4290000000000003},"last":1.079},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.94399999999999995,"15min":1.0009999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.40200000000000002},"max":{"1min":3.7290000000000001,"5min":3.7290000000000001,"15min":3.7290000000000001},"last":0.97999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-02T13:04:16.099 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-02T11:48:40.536978+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=2, tm_hour=11, tm_min=48, tm_sec=40, tm_wday=4, tm_yday=33, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=2, tm_hour=13, tm_min=4, tm_sec=11, tm_wday=4, tm_yday=33, tm_isdst=0) 2024-02-02T13:04:16.099 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-02T13:04:35.063 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:04:35.067 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:04:35.070 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:04:36.101 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-02T13:04:36.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f88a29da640 1 Processor -- start 2024-02-02T13:04:36.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f88a29da640 1 -- start start 2024-02-02T13:04:36.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f88a29da640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f889c0b8020 0x7f889c147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f88a29da640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889c071550 con 0x7f889c0bc340 2024-02-02T13:04:36.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f88a29da640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889c141d00 con 0x7f889c070980 2024-02-02T13:04:36.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f88a29da640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f889c071810 con 0x7f889c0b8020 2024-02-02T13:04:36.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f889bfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f889c0bc340 0x7f889c1415f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:57052/0 (socket says 172.21.15.161:57052) 2024-02-02T13:04:36.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f889bfff640 1 -- 172.21.15.161:0/352171624 learned_addr learned my addr 172.21.15.161:0/352171624 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-02-02T13:04:36.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f889b7fe640 1 --2- 172.21.15.161:0/352171624 >> v2:172.21.15.162:3300/0 conn(0x7f889c0b8020 0x7f889c147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f889affd640 1 -- 172.21.15.161:0/352171624 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753318038 0 0) 0x7f889c071550 con 0x7f889c0bc340 2024-02-02T13:04:36.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f889affd640 1 -- 172.21.15.161:0/352171624 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8884005740 con 0x7f889c0bc340 2024-02-02T13:04:36.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f889affd640 1 -- 172.21.15.161:0/352171624 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3260251672 0 0) 0x7f8884005740 con 0x7f889c0bc340 2024-02-02T13:04:36.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f889affd640 1 -- 172.21.15.161:0/352171624 >> v2:172.21.15.162:3300/0 conn(0x7f889c0b8020 msgr2=0x7f889c147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f889affd640 1 --2- 172.21.15.161:0/352171624 >> v2:172.21.15.162:3300/0 conn(0x7f889c0b8020 0x7f889c147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f889affd640 1 -- 172.21.15.161:0/352171624 >> v1:172.21.15.162:6789/0 conn(0x7f889c070980 legacy=0x7f889c151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f889affd640 1 -- 172.21.15.161:0/352171624 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c0bc720 con 0x7f889c0bc340 2024-02-02T13:04:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f889affd640 1 -- 172.21.15.161:0/352171624 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1992675378 0 0) 0x7f888c001680 con 0x7f889c0bc340 2024-02-02T13:04:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f889affd640 1 -- 172.21.15.161:0/352171624 >> v1:172.21.15.161:6789/0 conn(0x7f889c0bc340 legacy=0x7f889c1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f889affd640 1 --2- 172.21.15.161:0/352171624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8884005b90 0x7f8884005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f889affd640 1 --2- 172.21.15.161:0/352171624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88840069e0 0x7f8884006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f889affd640 1 --2- 172.21.15.161:0/352171624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88840073a0 0x7f888400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f889affd640 1 -- 172.21.15.161:0/352171624 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c071810 con 0x7f88840069e0 2024-02-02T13:04:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f889affd640 1 -- 172.21.15.161:0/352171624 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888400e340 con 0x7f8884005b90 2024-02-02T13:04:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f889affd640 1 -- 172.21.15.161:0/352171624 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888400e500 con 0x7f88840073a0 2024-02-02T13:04:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.230+0000 7f889b7fe640 1 --2- 172.21.15.161:0/352171624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88840069e0 0x7f8884006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.234+0000 7f88a0f77640 1 --2- 172.21.15.161:0/352171624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88840073a0 0x7f888400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.234+0000 7f889b7fe640 1 -- 172.21.15.161:0/352171624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88840073a0 msgr2=0x7f888400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.234+0000 7f889b7fe640 1 --2- 172.21.15.161:0/352171624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88840073a0 0x7f888400dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.234+0000 7f889bfff640 1 --2- 172.21.15.161:0/352171624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8884005b90 0x7f8884005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.234+0000 7f889b7fe640 1 -- 172.21.15.161:0/352171624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8884005b90 msgr2=0x7f8884005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:36.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.234+0000 7f889b7fe640 1 --2- 172.21.15.161:0/352171624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8884005b90 0x7f8884005fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.234+0000 7f88a0f77640 1 -- 172.21.15.161:0/352171624 reap_dead start 2024-02-02T13:04:36.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.234+0000 7f889b7fe640 1 -- 172.21.15.161:0/352171624 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8884005740 con 0x7f88840069e0 2024-02-02T13:04:36.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.234+0000 7f889b7fe640 1 --2- 172.21.15.161:0/352171624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88840069e0 0x7f8884006e60 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f8890009ab0 tx=0x7f889001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34472bdd8805bf73 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:36.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.234+0000 7f889affd640 1 -- 172.21.15.161:0/352171624 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88900a6410 con 0x7f88840069e0 2024-02-02T13:04:36.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.234+0000 7f889affd640 1 -- 172.21.15.161:0/352171624 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88900a6570 con 0x7f88840069e0 2024-02-02T13:04:36.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.234+0000 7f889affd640 1 -- 172.21.15.161:0/352171624 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88900a6920 con 0x7f88840069e0 2024-02-02T13:04:36.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.234+0000 7f88a29da640 1 -- 172.21.15.161:0/352171624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88840069e0 msgr2=0x7f8884006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:36.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.234+0000 7f88a29da640 1 --2- 172.21.15.161:0/352171624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88840069e0 0x7f8884006e60 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f8890009ab0 tx=0x7f889001ca30 comp rx=0 tx=0).stop 2024-02-02T13:04:36.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.234+0000 7f88a29da640 1 -- 172.21.15.161:0/352171624 shutdown_connections 2024-02-02T13:04:36.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.234+0000 7f88a29da640 1 --2- 172.21.15.161:0/352171624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88840069e0 0x7f8884006e60 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.234+0000 7f88a29da640 1 -- 172.21.15.161:0/352171624 >> 172.21.15.161:0/352171624 conn(0x7f889c069ef0 msgr2=0x7f889c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:36.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.234+0000 7f88a29da640 1 -- 172.21.15.161:0/352171624 shutdown_connections 2024-02-02T13:04:36.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.234+0000 7f88a29da640 1 -- 172.21.15.161:0/352171624 wait complete. 2024-02-02T13:04:36.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f88a29da640 1 Processor -- start 2024-02-02T13:04:36.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f88a29da640 1 -- start start 2024-02-02T13:04:36.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f88a29da640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88840069e0 0x7f889c0b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f88a29da640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f889c1e1e20 0x7f889c148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f88a29da640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f889c0b6430 0x7f889c148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f88a29da640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c1e2c50 con 0x7f88840069e0 2024-02-02T13:04:36.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f88a29da640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c0b5540 con 0x7f889c0b6430 2024-02-02T13:04:36.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f88a29da640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c1e22b0 con 0x7f889c1e1e20 2024-02-02T13:04:36.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f889bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88840069e0 0x7f889c0b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f889bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88840069e0 0x7f889c0b5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37136/0 (socket says 172.21.15.161:37136) 2024-02-02T13:04:36.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f889bfff640 1 -- 172.21.15.161:0/3955651107 learned_addr learned my addr 172.21.15.161:0/3955651107 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:36.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f88a0f77640 1 --2- 172.21.15.161:0/3955651107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f889c0b6430 0x7f889c148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f889b7fe640 1 --2- 172.21.15.161:0/3955651107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f889c1e1e20 0x7f889c148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f889bfff640 1 -- 172.21.15.161:0/3955651107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f889c1e1e20 msgr2=0x7f889c148880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:36.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f889bfff640 1 --2- 172.21.15.161:0/3955651107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f889c1e1e20 0x7f889c148880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f889bfff640 1 -- 172.21.15.161:0/3955651107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f889c0b6430 msgr2=0x7f889c148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:36.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f889bfff640 1 --2- 172.21.15.161:0/3955651107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f889c0b6430 0x7f889c148dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f889bfff640 1 -- 172.21.15.161:0/3955651107 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c1e2590 con 0x7f88840069e0 2024-02-02T13:04:36.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f889bfff640 1 --2- 172.21.15.161:0/3955651107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88840069e0 0x7f889c0b5ef0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f888c001000 tx=0x7f888c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:36.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f8898ff9640 1 -- 172.21.15.161:0/3955651107 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c0072d0 con 0x7f88840069e0 2024-02-02T13:04:36.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f8898ff9640 1 -- 172.21.15.161:0/3955651107 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c007430 con 0x7f88840069e0 2024-02-02T13:04:36.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f88a29da640 1 -- 172.21.15.161:0/3955651107 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889c1e2870 con 0x7f88840069e0 2024-02-02T13:04:36.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f8898ff9640 1 -- 172.21.15.161:0/3955651107 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c0047f0 con 0x7f88840069e0 2024-02-02T13:04:36.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f88a29da640 1 -- 172.21.15.161:0/3955651107 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889c0b6c10 con 0x7f88840069e0 2024-02-02T13:04:36.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f88a29da640 1 -- 172.21.15.161:0/3955651107 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889c1e2d90 con 0x7f88840069e0 2024-02-02T13:04:36.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f8898ff9640 1 -- 172.21.15.161:0/3955651107 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f888c004950 con 0x7f88840069e0 2024-02-02T13:04:36.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f8898ff9640 1 --2- 172.21.15.161:0/3955651107 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8888065a60 0x7f8888067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.238+0000 7f8898ff9640 1 -- 172.21.15.161:0/3955651107 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f888c0828f0 con 0x7f88840069e0 2024-02-02T13:04:36.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.242+0000 7f889b7fe640 1 --2- 172.21.15.161:0/3955651107 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8888065a60 0x7f8888067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.242+0000 7f889b7fe640 1 --2- 172.21.15.161:0/3955651107 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8888065a60 0x7f8888067f20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f88900ad000 tx=0x7f88900a9040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:36.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.246+0000 7f8898ff9640 1 -- 172.21.15.161:0/3955651107 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f889c1e2d90 con 0x7f88840069e0 2024-02-02T13:04:36.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.398+0000 7f88a29da640 1 -- 172.21.15.161:0/3955651107 --> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f889c1e2d90 con 0x7f8888065a60 2024-02-02T13:04:36.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.402+0000 7f8898ff9640 1 -- 172.21.15.161:0/3955651107 <== mgr.4104 v2:172.21.15.161:6832/27599 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49198 (secure 0 0 0) 0x7f889c1e2d90 con 0x7f8888065a60 2024-02-02T13:04:36.408 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T13:04:36.409 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2024-02-02T13:04:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.406+0000 7f88a29da640 1 -- 172.21.15.161:0/3955651107 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8888065a60 msgr2=0x7f8888067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.406+0000 7f88a29da640 1 --2- 172.21.15.161:0/3955651107 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8888065a60 0x7f8888067f20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f88900ad000 tx=0x7f88900a9040 comp rx=0 tx=0).stop 2024-02-02T13:04:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.406+0000 7f88a29da640 1 -- 172.21.15.161:0/3955651107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88840069e0 msgr2=0x7f889c0b5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.406+0000 7f88a29da640 1 --2- 172.21.15.161:0/3955651107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88840069e0 0x7f889c0b5ef0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f888c001000 tx=0x7f888c00dc00 comp rx=0 tx=0).stop 2024-02-02T13:04:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.406+0000 7f88a29da640 1 -- 172.21.15.161:0/3955651107 shutdown_connections 2024-02-02T13:04:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.406+0000 7f88a29da640 1 --2- 172.21.15.161:0/3955651107 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f8888065a60 0x7f8888067f20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.406+0000 7f88a29da640 1 --2- 172.21.15.161:0/3955651107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f889c0b6430 0x7f889c148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.406+0000 7f88a29da640 1 --2- 172.21.15.161:0/3955651107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f889c1e1e20 0x7f889c148880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.406+0000 7f88a29da640 1 --2- 172.21.15.161:0/3955651107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88840069e0 0x7f889c0b5ef0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.406+0000 7f88a29da640 1 -- 172.21.15.161:0/3955651107 >> 172.21.15.161:0/3955651107 conn(0x7f889c069ef0 msgr2=0x7f889c13d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:36.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.406+0000 7f88a29da640 1 -- 172.21.15.161:0/3955651107 shutdown_connections 2024-02-02T13:04:36.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.406+0000 7f88a29da640 1 -- 172.21.15.161:0/3955651107 wait complete. 2024-02-02T13:04:36.427 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":2304,"stamp":"2024-02-02T13:04:35.760999+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":9546444,"kb_used_data":4232,"kb_used_omap":13,"kb_used_meta":9542130,"kb_avail":745428276,"statfs":{"total":773094113280,"available":763318554624,"internally_reserved":0,"allocated":4333568,"data_stored":2396024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":9771141208},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003236"},"pg_stats":[{"pgid":"1.0","version":"34'119","reported_seq":225,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-02T13:04:16.656050+0000","last_change":"2024-02-02T13:04:16.656152+0000","last_active":"2024-02-02T13:04:16.656050+0000","last_peered":"2024-02-02T13:04:16.656050+0000","last_clean":"2024-02-02T13:04:16.656050+0000","last_became_active":"2024-02-02T11:48:41.562629+0000","last_became_peered":"2024-02-02T11:48:41.562629+0000","last_unstale":"2024-02-02T13:04:16.656050+0000","last_undegraded":"2024-02-02T13:04:16.656050+0000","last_fullsized":"2024-02-02T13:04:16.656050+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-02-02T13:04:16.656025+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-02-02T13:04:16.656025+0000","last_clean_scrub_stamp":"2024-02-02T13:04:16.656025+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-03T15:57:43.391275+0000","scrub_duration":0.48934657300000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575764,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1440396,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":1439422,"kb_avail":92931444,"statfs":{"total":96636764160,"available":95161798656,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1473968395},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.74399999999999999,"15min":0.77600000000000002},"min":{"1min":0.39800000000000002,"5min":0.32600000000000001,"15min":0.27900000000000003},"max":{"1min":3.8999999999999999,"5min":3.8999999999999999,"15min":3.8999999999999999},"last":1.167},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.72999999999999998,"15min":0.78700000000000003},"min":{"1min":0.36099999999999999,"5min":0.30199999999999999,"15min":0.24299999999999999},"max":{"1min":1.1439999999999999,"5min":1.169,"15min":4.6180000000000003},"last":0.71099999999999997}]},{"osd":1,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.88200000000000001,"15min":0.871},"min":{"1min":0.435,"5min":0.314,"15min":0.26600000000000001},"max":{"1min":3.6869999999999998,"5min":3.6869999999999998,"15min":8.1199999999999992},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.82399999999999995,"15min":0.875},"min":{"1min":0.46899999999999997,"5min":0.34000000000000002,"15min":0.26600000000000001},"max":{"1min":1.1819999999999999,"5min":1.4330000000000001,"15min":8.0429999999999993},"last":0.88400000000000001}]},{"osd":2,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76500000000000001,"15min":0.81499999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.33000000000000002},"max":{"1min":1.1459999999999999,"5min":2.0979999999999999,"15min":5.21},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.873,"15min":0.89100000000000001},"min":{"1min":0.497,"5min":0.39900000000000002,"15min":0.375},"max":{"1min":3.6179999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":1.3140000000000001}]},{"osd":3,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.84699999999999998,"15min":0.90200000000000002},"min":{"1min":0.46100000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":5.181},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.097,"5min":0.95599999999999996,"15min":0.97799999999999998},"min":{"1min":0.54100000000000004,"5min":0.39400000000000002,"15min":0.314},"max":{"1min":3.5899999999999999,"5min":3.5899999999999999,"15min":6.6230000000000002},"last":1.087}]},{"osd":4,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.94299999999999995,"15min":0.94799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.27400000000000002},"max":{"1min":1.351,"5min":1.5589999999999999,"15min":4.6790000000000003},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.93899999999999995,"15min":0.96199999999999997},"min":{"1min":0.41999999999999998,"5min":0.32700000000000001,"15min":0.312},"max":{"1min":1.2549999999999999,"5min":1.728,"15min":3.823},"last":1.038}]},{"osd":5,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.056,"15min":1.0580000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.315},"max":{"1min":3.5489999999999999,"5min":3.5489999999999999,"15min":4.6929999999999996},"last":1.2410000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.0469999999999999,"15min":1.0669999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.29199999999999998},"max":{"1min":1.3180000000000001,"5min":1.7789999999999999,"15min":4.6559999999999997},"last":0.94599999999999995}]},{"osd":6,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.121,"15min":1.127},"min":{"1min":0.436,"5min":0.436,"15min":0.33300000000000002},"max":{"1min":4.3719999999999999,"5min":4.3719999999999999,"15min":5.383},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0409999999999999,"15min":1.089},"min":{"1min":0.51100000000000001,"5min":0.50600000000000001,"15min":0.36799999999999999},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":5.0739999999999998},"last":1.129}]}]},{"osd":6,"up_from":13,"seq":55834575763,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":880264,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":879870,"kb_avail":93491576,"statfs":{"total":96636764160,"available":95735373824,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":900987147},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:04:18 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.70699999999999996,"15min":0.73899999999999999},"min":{"1min":0.379,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.095,"5min":1.238,"15min":3.9910000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77300000000000002,"15min":0.79900000000000004},"min":{"1min":0.45400000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.3120000000000001,"5min":1.5800000000000001,"15min":3.548},"last":1.0820000000000001}]},{"osd":1,"last update":"Fri Feb 2 13:04:18 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79100000000000004,"15min":0.82999999999999996},"min":{"1min":0.49199999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.2210000000000001,"5min":5.383,"15min":7.3819999999999997},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.78000000000000003,"15min":0.85399999999999998},"min":{"1min":0.39400000000000002,"5min":0.26800000000000002,"15min":0.251},"max":{"1min":1.0549999999999999,"5min":1.2350000000000001,"15min":8.9719999999999995},"last":0.86799999999999999}]},{"osd":2,"last update":"Fri Feb 2 13:04:18 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78600000000000003,"15min":0.90200000000000002},"min":{"1min":0.47999999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.121,"5min":1.3879999999999999,"15min":25.451000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.879,"15min":1.02},"min":{"1min":0.47599999999999998,"5min":0.373,"15min":0.371},"max":{"1min":1.3160000000000001,"5min":5.4500000000000002,"15min":25.044},"last":1.054}]},{"osd":3,"last update":"Fri Feb 2 13:04:18 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.97599999999999998,"15min":1.0580000000000001},"min":{"1min":0.52000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":1.272,"5min":8.4290000000000003,"15min":17.881},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.94899999999999995,"15min":1.0309999999999999},"min":{"1min":0.55800000000000005,"5min":0.40500000000000003,"15min":0.38500000000000001},"max":{"1min":1.365,"5min":1.415,"15min":8.8849999999999998},"last":0.95499999999999996}]},{"osd":4,"last update":"Fri Feb 2 13:04:18 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.96499999999999997,"15min":1.002},"min":{"1min":0.31,"5min":0.30199999999999999,"15min":0.26600000000000001},"max":{"1min":1.3089999999999999,"5min":1.5669999999999999,"15min":3.7480000000000002},"last":1.008},{"interface":"front","average":{"1min":0.90000000000000002,"5min":1.0369999999999999,"15min":1.0620000000000001},"min":{"1min":0.376,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.3220000000000001,"5min":5.4219999999999997,"15min":7.548},"last":0.73999999999999999}]},{"osd":5,"last update":"Fri Feb 2 13:04:18 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.99299999999999999,"15min":1.022},"min":{"1min":0.36099999999999999,"5min":0.29299999999999998,"15min":0.253},"max":{"1min":1.2829999999999999,"5min":1.623,"15min":9.0299999999999994},"last":0.627},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.0820000000000001,"15min":1.1579999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.274,"5min":5.8029999999999999,"15min":11.768000000000001},"last":0.97999999999999998}]},{"osd":7,"last update":"Fri Feb 2 13:04:18 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.0529999999999999,"15min":1.129},"min":{"1min":0.34000000000000002,"5min":0.31900000000000001,"15min":0.31},"max":{"1min":1.4119999999999999,"5min":1.9399999999999999,"15min":13.936},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.018,"5min":1.0660000000000001,"15min":1.1419999999999999},"min":{"1min":0.41799999999999998,"5min":0.39300000000000002,"15min":0.32400000000000001},"max":{"1min":1.3380000000000001,"5min":1.542,"15min":13.904999999999999},"last":0.92400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575762,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1165068,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1164670,"kb_avail":93206772,"statfs":{"total":96636764160,"available":95443734528,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1192622347},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.753,"15min":0.76300000000000001},"min":{"1min":0.40600000000000003,"5min":0.248,"15min":0.23300000000000001},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.804},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.84399999999999997,"15min":0.84899999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.40500000000000003},"max":{"1min":1.5129999999999999,"5min":3.492,"15min":4.2759999999999998},"last":0.84399999999999997}]},{"osd":1,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.98699999999999999,"15min":0.89200000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.308},"max":{"1min":1.1899999999999999,"5min":18.481999999999999,"15min":18.481999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.80000000000000004,"15min":0.83599999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.26500000000000001},"max":{"1min":1.2310000000000001,"5min":1.252,"15min":4.8380000000000001},"last":0.97499999999999998}]},{"osd":2,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.89300000000000002,"15min":0.89600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.41599999999999998},"max":{"1min":1.214,"5min":4.1280000000000001,"15min":4.3090000000000002},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90000000000000002,"15min":0.89400000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.369,"5min":4.1820000000000004,"15min":4.1820000000000004},"last":1.05}]},{"osd":3,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.032,"15min":0.999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.48,"5min":8.6809999999999992,"15min":8.6809999999999992},"last":1.4279999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":1.0229999999999999,"15min":0.98799999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32300000000000001},"max":{"1min":1.304,"5min":5.2430000000000003,"15min":5.2430000000000003},"last":0.89600000000000002}]},{"osd":4,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.96199999999999997,"15min":0.96299999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.415,"5min":1.415,"15min":3.4500000000000002},"last":0.875},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.0900000000000001,"15min":1.089},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.2989999999999999,"5min":3.5960000000000001,"15min":4.2119999999999997},"last":1.218}]},{"osd":6,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.071,"15min":1.0589999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.253},"max":{"1min":1.367,"5min":1.5880000000000001,"15min":3.5339999999999998},"last":1.268},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.0760000000000001,"15min":1.0649999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.33300000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.488},"last":0.78600000000000003}]},{"osd":7,"last update":"Fri Feb 2 13:04:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3640000000000001,"5min":3.5670000000000002,"15min":4.25},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.161,"15min":1.153},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.4179999999999999,"5min":1.6830000000000001,"15min":3.6589999999999998},"last":1.337}]}]},{"osd":4,"up_from":13,"seq":55834575762,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1430920,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1430526,"kb_avail":92940920,"statfs":{"total":96636764160,"available":95171502080,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1464858891},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:04:14 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.749,"15min":0.88},"min":{"1min":0.41399999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":3.7909999999999999,"5min":3.7909999999999999,"15min":9.5009999999999994},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.751,"15min":0.83599999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":3.492,"5min":3.492,"15min":7.2229999999999999},"last":1.0589999999999999}]},{"osd":1,"last update":"Fri Feb 2 13:04:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":0.85499999999999998,"15min":0.82599999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.25700000000000001},"max":{"1min":6.0359999999999996,"5min":6.0359999999999996,"15min":6.0359999999999996},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.84699999999999998,"15min":0.95899999999999996},"min":{"1min":0.46300000000000002,"5min":0.35899999999999999,"15min":0.26500000000000001},"max":{"1min":3.8730000000000002,"5min":3.8730000000000002,"15min":8.9450000000000003},"last":0.93000000000000005}]},{"osd":2,"last update":"Fri Feb 2 13:04:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":0.96099999999999997,"15min":0.95299999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":6.0609999999999999,"5min":6.0609999999999999,"15min":9.0619999999999994},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.88600000000000001,"15min":1.0109999999999999},"min":{"1min":0.437,"5min":0.42799999999999999,"15min":0.372},"max":{"1min":3.8260000000000001,"5min":3.8260000000000001,"15min":11.909000000000001},"last":0.85899999999999999}]},{"osd":3,"last update":"Fri Feb 2 13:04:14 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.878,"15min":0.91400000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":3.516,"5min":3.516,"15min":4.093},"last":0.90400000000000003},{"interface":"front","average":{"1min":2.6240000000000001,"5min":1.2629999999999999,"15min":1.0960000000000001},"min":{"1min":0.42499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":33.121000000000002,"5min":33.121000000000002,"15min":33.121000000000002},"last":0.84099999999999997}]},{"osd":5,"last update":"Fri Feb 2 13:04:14 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.0509999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.315},"max":{"1min":3.8940000000000001,"5min":3.8940000000000001,"15min":9.5329999999999995},"last":1.026},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.1220000000000001,"15min":1.0429999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":12.772,"5min":12.772,"15min":12.772},"last":0.81000000000000005}]},{"osd":6,"last update":"Fri Feb 2 13:04:14 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.131,"15min":1.103},"min":{"1min":0.316,"5min":0.316,"15min":0.30599999999999999},"max":{"1min":6.141,"5min":6.141,"15min":12.382999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.369,"5min":1.155,"15min":1.2010000000000001},"min":{"1min":0.48899999999999999,"5min":0.45500000000000002,"15min":0.34799999999999998},"max":{"1min":5.4790000000000001,"5min":5.4790000000000001,"15min":12.513999999999999},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri Feb 2 13:04:14 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.113,"15min":1.0940000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.782,"5min":4.782,"15min":4.782},"last":1},{"interface":"front","average":{"1min":1.663,"5min":1.228,"15min":1.1839999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.33800000000000002},"max":{"1min":9.3059999999999992,"5min":9.3059999999999992,"15min":9.3059999999999992},"last":1.089}]}]},{"osd":3,"up_from":13,"seq":55834575763,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1466248,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1465854,"kb_avail":92905592,"statfs":{"total":96636764160,"available":95135326208,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1501034763},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.218},"max":{"1min":10.516999999999999,"5min":10.516999999999999,"15min":10.516999999999999},"last":0.625},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.60499999999999998,"15min":0.65400000000000003},"min":{"1min":0.32000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":5.0720000000000001,"5min":5.0720000000000001,"15min":7.6520000000000001},"last":0.93899999999999995}]},{"osd":1,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.55100000000000005,"15min":0.61099999999999999},"min":{"1min":0.26100000000000001,"5min":0.23899999999999999,"15min":0.223},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":6.0049999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.181,"5min":0.68500000000000005,"15min":0.66900000000000004},"min":{"1min":0.27600000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":10.587999999999999,"5min":10.587999999999999,"15min":10.587999999999999},"last":0.71599999999999997}]},{"osd":2,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.71999999999999997,"15min":0.77500000000000002},"min":{"1min":0.307,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.1619999999999999,"5min":5.1619999999999999,"15min":7.6100000000000003},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.0820000000000001,"5min":0.82299999999999995,"15min":0.88100000000000001},"min":{"1min":0.35399999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":5.2030000000000003,"5min":5.2030000000000003,"15min":7.6289999999999996},"last":1.1379999999999999}]},{"osd":4,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84899999999999998,"15min":0.91700000000000004},"min":{"1min":0.373,"5min":0.34599999999999997,"15min":0.309},"max":{"1min":1.1830000000000001,"5min":1.766,"15min":5.96},"last":1.095},{"interface":"front","average":{"1min":1.1180000000000001,"5min":0.94899999999999995,"15min":0.97899999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":5.117,"5min":5.117,"15min":7.5659999999999998},"last":1.238}]},{"osd":5,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":0.98699999999999999,"15min":1.054},"min":{"1min":0.441,"5min":0.441,"15min":0.32700000000000001},"max":{"1min":10.558999999999999,"5min":10.558999999999999,"15min":10.558999999999999},"last":0.996},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89600000000000002,"15min":0.95699999999999996},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.31900000000000001},"max":{"1min":1.387,"5min":1.7909999999999999,"15min":5.9199999999999999},"last":1.1659999999999999}]},{"osd":6,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.0409999999999999,"15min":1.032},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.32800000000000001},"max":{"1min":10.622,"5min":10.622,"15min":10.622},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.0349999999999999,"15min":1.089},"min":{"1min":0.53300000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":5.1829999999999998,"5min":5.1829999999999998,"15min":7.5289999999999999},"last":1.292}]},{"osd":7,"last update":"Fri Feb 2 13:04:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.014,"15min":1.0980000000000001},"min":{"1min":0.624,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":5.141,"5min":5.141,"15min":8.0370000000000008},"last":1.341},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92000000000000004,"15min":1.0209999999999999},"min":{"1min":0.51900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.54,"5min":1.8100000000000001,"15min":5.9829999999999997},"last":1.2190000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575762,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":996872,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":996478,"kb_avail":93374968,"statfs":{"total":96636764160,"available":95615967232,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1020393739},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:04:13 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.56499999999999995,"15min":0.63600000000000001},"min":{"1min":0.308,"5min":0.22800000000000001,"15min":0.215},"max":{"1min":2.016,"5min":2.016,"15min":10.903},"last":0.627},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.66800000000000004,"15min":0.68000000000000005},"min":{"1min":0.309,"5min":0.28199999999999997,"15min":0.23499999999999999},"max":{"1min":2.0539999999999998,"5min":4.1520000000000001,"15min":5.6509999999999998},"last":0.67600000000000005}]},{"osd":1,"last update":"Fri Feb 2 13:04:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.58399999999999996,"15min":0.67000000000000004},"min":{"1min":0.30599999999999999,"5min":0.24299999999999999,"15min":0.216},"max":{"1min":0.98999999999999999,"5min":1.0820000000000001,"15min":3.234},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69599999999999995,"15min":0.89800000000000002},"min":{"1min":0.34100000000000003,"5min":0.218,"15min":0.218},"max":{"1min":1.117,"5min":5.4660000000000002,"15min":62.295999999999999},"last":0.877}]},{"osd":3,"last update":"Fri Feb 2 13:04:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.58199999999999996,"15min":0.65100000000000002},"min":{"1min":0.32700000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":5.8150000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.73699999999999999,"15min":0.82599999999999996},"min":{"1min":0.41199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.0379999999999998,"5min":3.0379999999999998,"15min":10.968},"last":0.81599999999999995}]},{"osd":4,"last update":"Fri Feb 2 13:04:13 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.90900000000000003,"15min":1.038},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.33500000000000002},"max":{"1min":3.0760000000000001,"5min":3.7490000000000001,"15min":18.731999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.998,"5min":1.0169999999999999,"15min":1.03},"min":{"1min":0.42699999999999999,"5min":0.39000000000000001,"15min":0.33700000000000002},"max":{"1min":3.2229999999999999,"5min":5.9589999999999996,"15min":10.101000000000001},"last":0.99099999999999999}]},{"osd":5,"last update":"Fri Feb 2 13:04:13 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.95299999999999996,"15min":1.1040000000000001},"min":{"1min":0.44600000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2809999999999999,"5min":4.218,"15min":22.279},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":0.94299999999999995,"15min":0.97499999999999998},"min":{"1min":0.54200000000000004,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":8.9879999999999995,"5min":8.9879999999999995,"15min":8.9879999999999995},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Feb 2 13:04:13 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.88700000000000001,"15min":1.0389999999999999},"min":{"1min":0.435,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.415,"5min":1.474,"15min":20.545000000000002},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.929,"5min":1.1559999999999999,"15min":1.2010000000000001},"min":{"1min":0.55400000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":23.978000000000002,"5min":23.978000000000002,"15min":32.533000000000001},"last":0.90900000000000003}]},{"osd":7,"last update":"Fri Feb 2 13:04:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0169999999999999,"15min":1.077},"min":{"1min":0.53100000000000003,"5min":0.46200000000000002,"15min":0.437},"max":{"1min":2.2679999999999998,"5min":4.242,"15min":5.7220000000000004},"last":1.099},{"interface":"front","average":{"1min":1.036,"5min":0.95099999999999996,"15min":1.099},"min":{"1min":0.54600000000000004,"5min":0.48399999999999999,"15min":0.433},"max":{"1min":1.3700000000000001,"5min":1.8,"15min":20.5},"last":1.018}]}]},{"osd":1,"up_from":13,"seq":55834575763,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1313800,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1313406,"kb_avail":93058040,"statfs":{"total":96636764160,"available":95291432960,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":1344928011},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Feb 2 13:04:21 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.55800000000000005,"15min":0.73099999999999998},"min":{"1min":0.27700000000000002,"5min":0.19500000000000001,"15min":0.189},"max":{"1min":0.89100000000000001,"5min":1.621,"15min":34.694000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.58099999999999996,"15min":0.68000000000000005},"min":{"1min":0.249,"5min":0.23899999999999999,"15min":0.217},"max":{"1min":0.873,"5min":2.5089999999999999,"15min":10.916},"last":0.78100000000000003}]},{"osd":2,"last update":"Fri Feb 2 13:04:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.54400000000000004,"15min":0.65600000000000003},"min":{"1min":0.309,"5min":0.22,"15min":0.22},"max":{"1min":1.05,"5min":1.0640000000000001,"15min":14.744999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.64100000000000001,"15min":0.82899999999999996},"min":{"1min":0.35499999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.1000000000000001,"5min":1.6579999999999999,"15min":38.899000000000001},"last":0.97399999999999998}]},{"osd":3,"last update":"Fri Feb 2 13:04:21 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.66800000000000004,"15min":0.91700000000000004},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.29099999999999998},"max":{"1min":1.016,"5min":1.6859999999999999,"15min":38.932000000000002},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66100000000000003,"15min":0.80300000000000005},"min":{"1min":0.31,"5min":0.307,"15min":0.24299999999999999},"max":{"1min":0.97399999999999998,"5min":2.621,"15min":12.385},"last":1.026}]},{"osd":4,"last update":"Fri Feb 2 13:04:21 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.83299999999999996,"15min":1.288},"min":{"1min":0.54000000000000004,"5min":0.38300000000000001,"15min":0.34499999999999997},"max":{"1min":1.2030000000000001,"5min":1.4259999999999999,"15min":97.268000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.036,"5min":0.91100000000000003,"15min":1.292},"min":{"1min":0.59499999999999997,"5min":0.38800000000000001,"15min":0.317},"max":{"1min":1.4239999999999999,"5min":1.7090000000000001,"15min":97.442999999999998},"last":1.0800000000000001}]},{"osd":5,"last update":"Fri Feb 2 13:04:21 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.89800000000000002,"15min":1.0069999999999999},"min":{"1min":0.68999999999999995,"5min":0.379,"15min":0.379},"max":{"1min":1.3979999999999999,"5min":2.7149999999999999,"15min":8.9849999999999994},"last":1.2330000000000001},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.874,"15min":1.04},"min":{"1min":0.60499999999999998,"5min":0.39500000000000002,"15min":0.34699999999999998},"max":{"1min":1.3740000000000001,"5min":1.492,"15min":14.776999999999999},"last":1.1339999999999999}]},{"osd":6,"last update":"Fri Feb 2 13:04:21 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":0.94199999999999995,"15min":1.3049999999999999},"min":{"1min":0.72199999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.49,"5min":1.7829999999999999,"15min":68.975999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.94899999999999995,"15min":1.117},"min":{"1min":0.57799999999999996,"5min":0.44,"15min":0.40899999999999997},"max":{"1min":1.341,"5min":2.6499999999999999,"15min":20.527999999999999},"last":1.339}]},{"osd":7,"last update":"Fri Feb 2 13:04:21 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":0.95299999999999996,"15min":1.0960000000000001},"min":{"1min":0.70299999999999996,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3999999999999999,"5min":2.7490000000000001,"15min":12.547000000000001},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.92200000000000004,"15min":1.077},"min":{"1min":0.67500000000000004,"5min":0.41699999999999998,"15min":0.38100000000000001},"max":{"1min":1.369,"5min":1.5780000000000001,"15min":14.808},"last":1.306}]}]},{"osd":0,"up_from":13,"seq":55834575762,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":852876,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":851902,"kb_avail":93518964,"statfs":{"total":96636764160,"available":95763419136,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":872347915},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Feb 2 13:04:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56699999999999995,"15min":0.68700000000000006},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":21.370999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.59199999999999997,"15min":0.68600000000000005},"min":{"1min":0.32400000000000001,"5min":0.22900000000000001,"15min":0.21099999999999999},"max":{"1min":1.149,"5min":1.149,"15min":10.538},"last":0.84499999999999997}]},{"osd":2,"last update":"Fri Feb 2 13:04:17 2024","interfaces":[{"interface":"back","average":{"1min":2.258,"5min":0.95899999999999996,"15min":0.86499999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":34.725999999999999,"5min":34.725999999999999,"15min":34.725999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":2.2839999999999998,"5min":1.034,"15min":0.86899999999999999},"min":{"1min":0.33600000000000002,"5min":0.30099999999999999,"15min":0.29499999999999998},"max":{"1min":34.703000000000003,"5min":34.703000000000003,"15min":34.703000000000003},"last":0.752}]},{"osd":3,"last update":"Fri Feb 2 13:04:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.55700000000000005,"15min":0.623},"min":{"1min":0.316,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":3.25},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66400000000000003,"15min":0.74299999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.165,"5min":1.46,"15min":4.0359999999999996},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri Feb 2 13:04:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.81200000000000006,"15min":0.90500000000000003},"min":{"1min":0.38700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.1910000000000001,"5min":1.8069999999999999,"15min":4.4589999999999996},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79700000000000004,"15min":0.86499999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.0800000000000001,"5min":1.8720000000000001,"15min":2.6030000000000002},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri Feb 2 13:04:17 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.88200000000000001,"15min":0.96699999999999997},"min":{"1min":0.46400000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.25,"5min":1.361,"15min":3.9790000000000001},"last":1.123},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":1.0049999999999999},"min":{"1min":0.432,"5min":0.374,"15min":0.374},"max":{"1min":1.2509999999999999,"5min":1.7210000000000001,"15min":7.2619999999999996},"last":1.101}]},{"osd":6,"last update":"Fri Feb 2 13:04:17 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.83799999999999997,"15min":0.92800000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.2190000000000001,"5min":1.2729999999999999,"15min":2.573},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.93700000000000006,"15min":1.0269999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.48399999999999999},"max":{"1min":1.3440000000000001,"5min":1.4370000000000001,"15min":4.008},"last":1.0329999999999999}]},{"osd":7,"last update":"Fri Feb 2 13:04:17 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92600000000000005,"15min":1.014},"min":{"1min":0.438,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.329,"5min":3.6429999999999998,"15min":4.4290000000000003},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.93500000000000005,"15min":0.99099999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3080000000000001,"5min":3.7290000000000001,"15min":3.7290000000000001},"last":1.0800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-02T13:04:36.429 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-02-02T13:04:36.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.546+0000 7f6588a23640 1 Processor -- start 2024-02-02T13:04:36.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.546+0000 7f6588a23640 1 -- start start 2024-02-02T13:04:36.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f6588a23640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f65840b8df0 0x7f6584142840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f6588a23640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65840b8540 0x7f6584148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f6588a23640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6584142d80 0x7f6584149450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f6588a23640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6584148a80 con 0x7f65840b8df0 2024-02-02T13:04:36.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f6588a23640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65840b3890 con 0x7f6584142d80 2024-02-02T13:04:36.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f6588a23640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65840b3b70 con 0x7f65840b8540 2024-02-02T13:04:36.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f658259c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f65840b8df0 0x7f6584142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f658259c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f65840b8df0 0x7f6584142840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37142/0 (socket says 172.21.15.161:37142) 2024-02-02T13:04:36.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f658259c640 1 -- 172.21.15.161:0/2597712422 learned_addr learned my addr 172.21.15.161:0/2597712422 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:36.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f6582d9d640 1 --2- 172.21.15.161:0/2597712422 >> v2:172.21.15.162:3300/0 conn(0x7f6584142d80 0x7f6584149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f6581d9b640 1 --2- 172.21.15.161:0/2597712422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65840b8540 0x7f6584148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f658259c640 1 -- 172.21.15.161:0/2597712422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65840b8540 msgr2=0x7f6584148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:36.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f658259c640 1 --2- 172.21.15.161:0/2597712422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65840b8540 0x7f6584148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f658259c640 1 -- 172.21.15.161:0/2597712422 >> v2:172.21.15.162:3300/0 conn(0x7f6584142d80 msgr2=0x7f6584149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:36.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f658259c640 1 --2- 172.21.15.161:0/2597712422 >> v2:172.21.15.162:3300/0 conn(0x7f6584142d80 0x7f6584149450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f658259c640 1 -- 172.21.15.161:0/2597712422 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65840b3e50 con 0x7f65840b8df0 2024-02-02T13:04:36.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f6581d9b640 1 --2- 172.21.15.161:0/2597712422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65840b8540 0x7f6584148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-02T13:04:36.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f658259c640 1 --2- 172.21.15.161:0/2597712422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65840b8df0 0x7f6584142840 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f65840b2a00 tx=0x7f657401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdca5edc6b0d111b server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f658159a640 1 -- 172.21.15.161:0/2597712422 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6584071930 con 0x7f65840b8df0 2024-02-02T13:04:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f658159a640 1 -- 172.21.15.161:0/2597712422 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65740ac640 con 0x7f65840b8df0 2024-02-02T13:04:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.550+0000 7f658159a640 1 -- 172.21.15.161:0/2597712422 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65740ac9d0 con 0x7f65840b8df0 2024-02-02T13:04:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6588a23640 1 -- 172.21.15.161:0/2597712422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65840b8df0 msgr2=0x7f6584142840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6588a23640 1 --2- 172.21.15.161:0/2597712422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65840b8df0 0x7f6584142840 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f65840b2a00 tx=0x7f657401c500 comp rx=0 tx=0).stop 2024-02-02T13:04:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6588a23640 1 -- 172.21.15.161:0/2597712422 shutdown_connections 2024-02-02T13:04:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6588a23640 1 --2- 172.21.15.161:0/2597712422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65840b8540 0x7f6584148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6588a23640 1 --2- 172.21.15.161:0/2597712422 >> v2:172.21.15.162:3300/0 conn(0x7f6584142d80 0x7f6584149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6588a23640 1 --2- 172.21.15.161:0/2597712422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65840b8df0 0x7f6584142840 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6588a23640 1 -- 172.21.15.161:0/2597712422 >> 172.21.15.161:0/2597712422 conn(0x7f658406a120 msgr2=0x7f658406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:36.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6588a23640 1 -- 172.21.15.161:0/2597712422 shutdown_connections 2024-02-02T13:04:36.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6588a23640 1 -- 172.21.15.161:0/2597712422 wait complete. 2024-02-02T13:04:36.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6588a23640 1 Processor -- start 2024-02-02T13:04:36.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6588a23640 1 -- start start 2024-02-02T13:04:36.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6588a23640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65840b8540 0x7f65840b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6588a23640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65840b8df0 0x7f658406edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6588a23640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6584142d80 0x7f65840ba1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6588a23640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65840b77e0 con 0x7f65840b8540 2024-02-02T13:04:36.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6588a23640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6584070320 con 0x7f65840b8df0 2024-02-02T13:04:36.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6588a23640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6584070b40 con 0x7f6584142d80 2024-02-02T13:04:36.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f658259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65840b8540 0x7f65840b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f658259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65840b8540 0x7f65840b72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37144/0 (socket says 172.21.15.161:37144) 2024-02-02T13:04:36.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f658259c640 1 -- 172.21.15.161:0/2708557328 learned_addr learned my addr 172.21.15.161:0/2708557328 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:36.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6581d9b640 1 --2- 172.21.15.161:0/2708557328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65840b8df0 0x7f658406edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6582d9d640 1 --2- 172.21.15.161:0/2708557328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6584142d80 0x7f65840ba1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f658259c640 1 -- 172.21.15.161:0/2708557328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6584142d80 msgr2=0x7f65840ba1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:36.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f658259c640 1 --2- 172.21.15.161:0/2708557328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6584142d80 0x7f65840ba1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f658259c640 1 -- 172.21.15.161:0/2708557328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65840b8df0 msgr2=0x7f658406edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:36.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f658259c640 1 --2- 172.21.15.161:0/2708557328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65840b8df0 0x7f658406edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f658259c640 1 -- 172.21.15.161:0/2708557328 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65740094d0 con 0x7f65840b8540 2024-02-02T13:04:36.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f658259c640 1 --2- 172.21.15.161:0/2708557328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65840b8540 0x7f65840b72a0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f657401abb0 tx=0x7f65740192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:36.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6572ffd640 1 -- 172.21.15.161:0/2708557328 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65740b5650 con 0x7f65840b8540 2024-02-02T13:04:36.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6572ffd640 1 -- 172.21.15.161:0/2708557328 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65740b57b0 con 0x7f65840b8540 2024-02-02T13:04:36.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6572ffd640 1 -- 172.21.15.161:0/2708557328 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65740b5b40 con 0x7f65840b8540 2024-02-02T13:04:36.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6588a23640 1 -- 172.21.15.161:0/2708557328 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65840bb1d0 con 0x7f65840b8540 2024-02-02T13:04:36.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.554+0000 7f6588a23640 1 -- 172.21.15.161:0/2708557328 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6584138aa0 con 0x7f65840b8540 2024-02-02T13:04:36.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.558+0000 7f6588a23640 1 -- 172.21.15.161:0/2708557328 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f658404e000 con 0x7f65840b8540 2024-02-02T13:04:36.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.558+0000 7f6572ffd640 1 -- 172.21.15.161:0/2708557328 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f65740b3070 con 0x7f65840b8540 2024-02-02T13:04:36.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.558+0000 7f6572ffd640 1 --2- 172.21.15.161:0/2708557328 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6564065a90 0x7f6564067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.558+0000 7f6572ffd640 1 -- 172.21.15.161:0/2708557328 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f657411ceb0 con 0x7f65840b8540 2024-02-02T13:04:36.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.558+0000 7f6581d9b640 1 --2- 172.21.15.161:0/2708557328 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6564065a90 0x7f6564067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.558+0000 7f6581d9b640 1 --2- 172.21.15.161:0/2708557328 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6564065a90 0x7f6564067f50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6584152910 tx=0x7f6578008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:36.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.562+0000 7f6572ffd640 1 -- 172.21.15.161:0/2708557328 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f65740eac00 con 0x7f65840b8540 2024-02-02T13:04:36.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.718+0000 7f6588a23640 1 -- 172.21.15.161:0/2708557328 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f65840bb1d0 con 0x7f65840b8540 2024-02-02T13:04:36.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.726+0000 7f6572ffd640 1 -- 172.21.15.161:0/2708557328 <== mon.0 v2:172.21.15.161:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f65740eac00 con 0x7f65840b8540 2024-02-02T13:04:36.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.726+0000 7f6572ffd640 1 -- 172.21.15.161:0/2708557328 <== mon.0 v2:172.21.15.161:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f65840bb1d0 con 0x7f65840b8540 2024-02-02T13:04:36.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.730+0000 7f6588a23640 1 -- 172.21.15.161:0/2708557328 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6564065a90 msgr2=0x7f6564067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:36.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.730+0000 7f6588a23640 1 --2- 172.21.15.161:0/2708557328 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6564065a90 0x7f6564067f50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6584152910 tx=0x7f6578008040 comp rx=0 tx=0).stop 2024-02-02T13:04:36.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.730+0000 7f6588a23640 1 -- 172.21.15.161:0/2708557328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65840b8540 msgr2=0x7f65840b72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:36.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.730+0000 7f6588a23640 1 --2- 172.21.15.161:0/2708557328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65840b8540 0x7f65840b72a0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f657401abb0 tx=0x7f65740192a0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.730+0000 7f6588a23640 1 -- 172.21.15.161:0/2708557328 shutdown_connections 2024-02-02T13:04:36.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.730+0000 7f6588a23640 1 --2- 172.21.15.161:0/2708557328 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7f6564065a90 0x7f6564067f50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.730+0000 7f6588a23640 1 --2- 172.21.15.161:0/2708557328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6584142d80 0x7f65840ba1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.730+0000 7f6588a23640 1 --2- 172.21.15.161:0/2708557328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65840b8df0 0x7f658406edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.730+0000 7f6588a23640 1 --2- 172.21.15.161:0/2708557328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65840b8540 0x7f65840b72a0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.730+0000 7f6588a23640 1 -- 172.21.15.161:0/2708557328 >> 172.21.15.161:0/2708557328 conn(0x7f658406a120 msgr2=0x7f65841414d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:36.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.730+0000 7f6588a23640 1 -- 172.21.15.161:0/2708557328 shutdown_connections 2024-02-02T13:04:36.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.730+0000 7f6588a23640 1 -- 172.21.15.161:0/2708557328 wait complete. 2024-02-02T13:04:36.752 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-02T13:04:36.753 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-02T13:04:36.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.866+0000 7ff211952640 1 Processor -- start 2024-02-02T13:04:36.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.870+0000 7ff211952640 1 -- start start 2024-02-02T13:04:36.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.870+0000 7ff211952640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff20c0bc340 0x7ff20c1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.870+0000 7ff211952640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff20c141b30 0x7ff20c147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.870+0000 7ff211952640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20c071550 con 0x7ff20c0b8020 2024-02-02T13:04:36.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.870+0000 7ff211952640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff20c071810 con 0x7ff20c141b30 2024-02-02T13:04:36.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.870+0000 7ff211952640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c071950 con 0x7ff20c0bc340 2024-02-02T13:04:36.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.870+0000 7ff20a7fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff20c141b30 0x7ff20c147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.870+0000 7ff20a7fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff20c141b30 0x7ff20c147c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37160/0 (socket says 172.21.15.161:37160) 2024-02-02T13:04:36.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.870+0000 7ff20a7fc640 1 -- 172.21.15.161:0/4004234551 learned_addr learned my addr 172.21.15.161:0/4004234551 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:36.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.870+0000 7ff20affd640 1 --2- 172.21.15.161:0/4004234551 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff20c0bc340 0x7ff20c1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.870+0000 7ff20a7fc640 1 -- 172.21.15.161:0/4004234551 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff20c0bc340 msgr2=0x7ff20c1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:36.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.870+0000 7ff20a7fc640 1 --2- 172.21.15.161:0/4004234551 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff20c0bc340 0x7ff20c1415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.870+0000 7ff20a7fc640 1 -- 172.21.15.161:0/4004234551 >> v1:172.21.15.162:6789/0 conn(0x7ff20c0b8020 legacy=0x7ff20c14abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-02T13:04:36.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.870+0000 7ff20a7fc640 1 -- 172.21.15.161:0/4004234551 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c0bc720 con 0x7ff20c141b30 2024-02-02T13:04:36.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.870+0000 7ff20a7fc640 1 --2- 172.21.15.161:0/4004234551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff20c141b30 0x7ff20c147c60 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7ff200009870 tx=0x7ff20001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebf44c8c37f2b7b server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:36.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.870+0000 7ff209ffb640 1 -- 172.21.15.161:0/4004234551 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2000ab600 con 0x7ff20c141b30 2024-02-02T13:04:36.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.870+0000 7ff209ffb640 1 -- 172.21.15.161:0/4004234551 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff2000a7050 con 0x7ff20c141b30 2024-02-02T13:04:36.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.870+0000 7ff209ffb640 1 -- 172.21.15.161:0/4004234551 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2000ab9a0 con 0x7ff20c141b30 2024-02-02T13:04:36.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff211952640 1 -- 172.21.15.161:0/4004234551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff20c141b30 msgr2=0x7ff20c147c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:36.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff211952640 1 --2- 172.21.15.161:0/4004234551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff20c141b30 0x7ff20c147c60 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7ff200009870 tx=0x7ff20001c470 comp rx=0 tx=0).stop 2024-02-02T13:04:36.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff211952640 1 -- 172.21.15.161:0/4004234551 shutdown_connections 2024-02-02T13:04:36.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff211952640 1 --2- 172.21.15.161:0/4004234551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff20c141b30 0x7ff20c147c60 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff211952640 1 --2- 172.21.15.161:0/4004234551 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff20c0bc340 0x7ff20c1415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff211952640 1 -- 172.21.15.161:0/4004234551 >> 172.21.15.161:0/4004234551 conn(0x7ff20c069ef0 msgr2=0x7ff20c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:36.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff211952640 1 -- 172.21.15.161:0/4004234551 shutdown_connections 2024-02-02T13:04:36.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff211952640 1 -- 172.21.15.161:0/4004234551 wait complete. 2024-02-02T13:04:36.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff211952640 1 Processor -- start 2024-02-02T13:04:36.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff211952640 1 -- start start 2024-02-02T13:04:36.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff211952640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff20c0b8020 0x7ff20c145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff211952640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff20c0bc340 0x7ff20c1e4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff211952640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff20c141b30 0x7ff20c132be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff211952640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c1394c0 con 0x7ff20c141b30 2024-02-02T13:04:36.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff211952640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c1e49b0 con 0x7ff20c0b8020 2024-02-02T13:04:36.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff211952640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c145bb0 con 0x7ff20c0bc340 2024-02-02T13:04:36.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff20b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff20c141b30 0x7ff20c132be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff20b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff20c141b30 0x7ff20c132be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37168/0 (socket says 172.21.15.161:37168) 2024-02-02T13:04:36.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff20b7fe640 1 -- 172.21.15.161:0/3691007661 learned_addr learned my addr 172.21.15.161:0/3691007661 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-02T13:04:36.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff20affd640 1 --2- 172.21.15.161:0/3691007661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff20c0b8020 0x7ff20c145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff20a7fc640 1 --2- 172.21.15.161:0/3691007661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff20c0bc340 0x7ff20c1e4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff20b7fe640 1 -- 172.21.15.161:0/3691007661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff20c0bc340 msgr2=0x7ff20c1e4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:36.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff20b7fe640 1 --2- 172.21.15.161:0/3691007661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff20c0bc340 0x7ff20c1e4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff20b7fe640 1 -- 172.21.15.161:0/3691007661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff20c0b8020 msgr2=0x7ff20c145670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:36.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff20b7fe640 1 --2- 172.21.15.161:0/3691007661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff20c0b8020 0x7ff20c145670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:36.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff20b7fe640 1 -- 172.21.15.161:0/3691007661 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2000094d0 con 0x7ff20c141b30 2024-02-02T13:04:36.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff20affd640 1 --2- 172.21.15.161:0/3691007661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff20c0b8020 0x7ff20c145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:36.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff20a7fc640 1 --2- 172.21.15.161:0/3691007661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff20c0bc340 0x7ff20c1e4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-02T13:04:36.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff20b7fe640 1 --2- 172.21.15.161:0/3691007661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff20c141b30 0x7ff20c132be0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7ff20400c7b0 tx=0x7ff20400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:36.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff1f3fff640 1 -- 172.21.15.161:0/3691007661 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20400aa50 con 0x7ff20c141b30 2024-02-02T13:04:36.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff1f3fff640 1 -- 172.21.15.161:0/3691007661 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff20400abf0 con 0x7ff20c141b30 2024-02-02T13:04:36.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff211952640 1 -- 172.21.15.161:0/3691007661 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff20c148be0 con 0x7ff20c141b30 2024-02-02T13:04:36.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff1f3fff640 1 -- 172.21.15.161:0/3691007661 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20400ce60 con 0x7ff20c141b30 2024-02-02T13:04:36.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.874+0000 7ff211952640 1 -- 172.21.15.161:0/3691007661 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20c1e45d0 con 0x7ff20c141b30 2024-02-02T13:04:36.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.878+0000 7ff211952640 1 -- 172.21.15.161:0/3691007661 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20c1e4af0 con 0x7ff20c141b30 2024-02-02T13:04:36.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.878+0000 7ff1f3fff640 1 -- 172.21.15.161:0/3691007661 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff204012420 con 0x7ff20c141b30 2024-02-02T13:04:36.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.878+0000 7ff1f3fff640 1 --2- 172.21.15.161:0/3691007661 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff1f8065a60 0x7ff1f8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-02T13:04:36.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.878+0000 7ff1f3fff640 1 -- 172.21.15.161:0/3691007661 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff204083110 con 0x7ff20c141b30 2024-02-02T13:04:36.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.878+0000 7ff20affd640 1 --2- 172.21.15.161:0/3691007661 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff1f8065a60 0x7ff1f8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-02T13:04:36.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.878+0000 7ff20affd640 1 --2- 172.21.15.161:0/3691007661 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff1f8065a60 0x7ff1f8067f20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc006fd0 tx=0x7ff1fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-02T13:04:36.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:36.882+0000 7ff1f3fff640 1 -- 172.21.15.161:0/3691007661 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff20c1e4af0 con 0x7ff20c141b30 2024-02-02T13:04:37.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:37.066+0000 7ff211952640 1 -- 172.21.15.161:0/3691007661 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff20c1e4af0 con 0x7ff20c141b30 2024-02-02T13:04:37.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:37.066+0000 7ff1f3fff640 1 -- 172.21.15.161:0/3691007661 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2778 (secure 0 0 0) 0x7ff20c1e4af0 con 0x7ff20c141b30 2024-02-02T13:04:37.070 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-02T13:04:37.070 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4535,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/236294405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":236294405},{"type":"v1","addr":"172.21.15.162:6833","nonce":236294405}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3772183556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3772183556},{"type":"v1","addr":"172.21.15.161:6835","nonce":3772183556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":6732,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/3915096370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6836","nonce":3915096370},{"type":"v1","addr":"172.21.15.161:6837","nonce":3915096370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[]} 2024-02-02T13:04:37.070 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 16 2024-02-02T13:04:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:37.066+0000 7ff211952640 1 -- 172.21.15.161:0/3691007661 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff1f8065a60 msgr2=0x7ff1f8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:37.066+0000 7ff211952640 1 --2- 172.21.15.161:0/3691007661 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff1f8065a60 0x7ff1f8067f20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc006fd0 tx=0x7ff1fc008040 comp rx=0 tx=0).stop 2024-02-02T13:04:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:37.066+0000 7ff211952640 1 -- 172.21.15.161:0/3691007661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff20c141b30 msgr2=0x7ff20c132be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-02T13:04:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:37.066+0000 7ff211952640 1 --2- 172.21.15.161:0/3691007661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff20c141b30 0x7ff20c132be0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7ff20400c7b0 tx=0x7ff20400cc70 comp rx=0 tx=0).stop 2024-02-02T13:04:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:37.066+0000 7ff211952640 1 -- 172.21.15.161:0/3691007661 shutdown_connections 2024-02-02T13:04:37.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:37.066+0000 7ff211952640 1 --2- 172.21.15.161:0/3691007661 >> [v2:172.21.15.161:6832/27599,v1:172.21.15.161:6833/27599] conn(0x7ff1f8065a60 0x7ff1f8067f20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:37.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:37.066+0000 7ff211952640 1 --2- 172.21.15.161:0/3691007661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff20c141b30 0x7ff20c132be0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:37.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:37.066+0000 7ff211952640 1 --2- 172.21.15.161:0/3691007661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff20c0bc340 0x7ff20c1e4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:37.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:37.066+0000 7ff211952640 1 --2- 172.21.15.161:0/3691007661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff20c0b8020 0x7ff20c145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-02T13:04:37.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:37.066+0000 7ff211952640 1 -- 172.21.15.161:0/3691007661 >> 172.21.15.161:0/3691007661 conn(0x7ff20c069ef0 msgr2=0x7ff20c06fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-02T13:04:37.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:37.066+0000 7ff211952640 1 -- 172.21.15.161:0/3691007661 shutdown_connections 2024-02-02T13:04:37.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-02T13:04:37.066+0000 7ff211952640 1 -- 172.21.15.161:0/3691007661 wait complete. 2024-02-02T13:04:37.087 DEBUG:tasks.cephfs.filesystem:already dead... 2024-02-02T13:04:37.088 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-02T13:04:37.088 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-02T13:04:37.088 INFO:teuthology.orchestra.run:waiting for 300 2024-02-02T13:04:37.099 INFO:tasks.ceph.mds.a:Stopped 2024-02-02T13:04:37.099 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-02T13:04:37.099 INFO:teuthology.orchestra.run:waiting for 300 2024-02-02T13:04:37.156 INFO:tasks.ceph.mds.c:Stopped 2024-02-02T13:04:37.157 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-02T13:04:37.157 INFO:teuthology.orchestra.run:waiting for 300 2024-02-02T13:04:37.177 INFO:tasks.ceph.mds.b:Stopped 2024-02-02T13:04:37.177 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-02T13:04:37.177 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-02T13:04:37.177 INFO:teuthology.orchestra.run:waiting for 300 2024-02-02T13:04:38.887 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-02-02T13:04:43.279 INFO:tasks.ceph.osd.0:Stopped 2024-02-02T13:04:43.280 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-02T13:04:43.280 INFO:teuthology.orchestra.run:waiting for 300 2024-02-02T13:04:44.999 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-02-02T13:04:44.999 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-02-02T13:04:49.382 INFO:tasks.ceph.osd.1:Stopped 2024-02-02T13:04:49.383 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-02T13:04:49.383 INFO:teuthology.orchestra.run:waiting for 300 2024-02-02T13:04:51.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-02-02T13:04:51.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-02-02T13:04:55.485 INFO:tasks.ceph.osd.2:Stopped 2024-02-02T13:04:55.486 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-02T13:04:55.486 INFO:teuthology.orchestra.run:waiting for 300 2024-02-02T13:04:56.920 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-02-02T13:04:56.920 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-02-02T13:05:01.588 INFO:tasks.ceph.osd.3:Stopped 2024-02-02T13:05:01.588 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-02-02T13:05:01.589 INFO:teuthology.orchestra.run:waiting for 300 2024-02-02T13:05:02.728 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-02-02T13:05:02.728 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-02-02T13:05:05.194 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:05:05.196 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:05:05.199 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:05:07.691 INFO:tasks.ceph.osd.4:Stopped 2024-02-02T13:05:07.691 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-02-02T13:05:07.691 INFO:teuthology.orchestra.run:waiting for 300 2024-02-02T13:05:08.503 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-02-02T13:05:08.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-02-02T13:05:13.793 INFO:tasks.ceph.osd.5:Stopped 2024-02-02T13:05:13.794 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-02-02T13:05:13.794 INFO:teuthology.orchestra.run:waiting for 300 2024-02-02T13:05:13.891 INFO:tasks.ceph.osd.6:Stopped 2024-02-02T13:05:13.891 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-02-02T13:05:13.891 INFO:teuthology.orchestra.run:waiting for 300 2024-02-02T13:05:14.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~6s 2024-02-02T13:05:19.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-02-02T13:05:19.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-02-02T13:05:19.993 INFO:tasks.ceph.osd.7:Stopped 2024-02-02T13:05:19.994 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-02T13:05:19.994 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-02-02T13:05:19.994 INFO:teuthology.orchestra.run:waiting for 300 2024-02-02T13:05:20.028 INFO:tasks.ceph.mgr.y:Stopped 2024-02-02T13:05:20.028 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-02T13:05:20.029 INFO:teuthology.orchestra.run:waiting for 300 2024-02-02T13:05:20.057 INFO:tasks.ceph.mgr.x:Stopped 2024-02-02T13:05:20.057 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-02T13:05:20.057 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-02T13:05:20.057 INFO:teuthology.orchestra.run:waiting for 300 2024-02-02T13:05:20.094 INFO:tasks.ceph.mon.a:Stopped 2024-02-02T13:05:20.094 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-02-02T13:05:20.094 INFO:teuthology.orchestra.run:waiting for 300 2024-02-02T13:05:20.114 INFO:tasks.ceph.mon.b:Stopped 2024-02-02T13:05:20.114 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-02-02T13:05:20.114 INFO:teuthology.orchestra.run:waiting for 300 2024-02-02T13:05:20.174 INFO:tasks.ceph.mon.c:Stopped 2024-02-02T13:05:20.174 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-02T13:05:20.174 DEBUG:teuthology.orchestra.run.smithi161:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-02T13:05:20.249 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi161.front.sepia.ceph.com 2024-02-02T13:05:20.249 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-02T13:05:20.514 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi161.front.sepia.ceph.com 2024-02-02T13:05:20.515 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-02T13:05:20.702 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi161.front.sepia.ceph.com 2024-02-02T13:05:20.702 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-02T13:05:20.886 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi161.front.sepia.ceph.com 2024-02-02T13:05:20.886 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-02T13:05:21.061 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi162.front.sepia.ceph.com 2024-02-02T13:05:21.061 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-02-02T13:05:21.468 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi162.front.sepia.ceph.com 2024-02-02T13:05:21.468 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-02-02T13:05:21.728 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi162.front.sepia.ceph.com 2024-02-02T13:05:21.728 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-02-02T13:05:21.915 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi162.front.sepia.ceph.com 2024-02-02T13:05:21.916 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-02-02T13:05:22.181 INFO:tasks.ceph:Archiving mon data... 2024-02-02T13:05:22.183 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393/data/mon.a.tgz 2024-02-02T13:05:22.183 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2024-02-02T13:05:22.206 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.2OBxKfKqEK 2024-02-02T13:05:22.207 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.2OBxKfKqEK 2024-02-02T13:05:22.331 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.2OBxKfKqEK 2024-02-02T13:05:22.423 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.2OBxKfKqEK is 290KB 2024-02-02T13:05:22.483 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.2OBxKfKqEK 2024-02-02T13:05:22.490 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393/data/mon.b.tgz 2024-02-02T13:05:22.490 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-02-02T13:05:22.523 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.WRxggHoGYH 2024-02-02T13:05:22.523 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.WRxggHoGYH 2024-02-02T13:05:22.662 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.WRxggHoGYH 2024-02-02T13:05:22.753 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.WRxggHoGYH is 299KB 2024-02-02T13:05:22.769 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.WRxggHoGYH 2024-02-02T13:05:22.774 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393/data/mon.c.tgz 2024-02-02T13:05:22.775 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-02-02T13:05:22.823 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.kjb65v6tJO 2024-02-02T13:05:22.823 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.kjb65v6tJO 2024-02-02T13:05:22.932 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.kjb65v6tJO 2024-02-02T13:05:22.994 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.kjb65v6tJO is 299KB 2024-02-02T13:05:23.052 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.kjb65v6tJO 2024-02-02T13:05:23.057 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-02T13:05:23.058 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-02T13:05:23.060 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-02T13:05:23.100 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-02T13:05:23.140 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-02-02T13:05:23.140 DEBUG:teuthology.orchestra.run.smithi161:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-02-02T13:05:23.150 DEBUG:teuthology.orchestra.run.smithi162:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-02-02T13:05:23.168 DEBUG:teuthology.orchestra.run.smithi177:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-02-02T13:05:23.183 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-02-02T13:05:23.188 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-02-02T13:05:23.233 INFO:teuthology.orchestra.run.smithi177.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-02-02T13:05:23.241 INFO:tasks.ceph:Archiving crash dumps... 2024-02-02T13:05:23.243 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393/remote/smithi161/crash 2024-02-02T13:05:23.244 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-02T13:05:23.256 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393/remote/smithi162/crash 2024-02-02T13:05:23.257 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-02T13:05:23.268 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393/remote/smithi177/crash 2024-02-02T13:05:23.269 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-02T13:05:23.296 INFO:tasks.ceph:Shutting down logrotate 2024-02-02T13:05:23.296 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:05:23.306 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:05:23.312 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-02T13:05:23.394 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-02T13:05:23.423 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-02T13:05:23.454 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-02T13:05:23.475 INFO:tasks.ceph:Compressing logs... 2024-02-02T13:05:23.475 DEBUG:teuthology.orchestra.run.smithi161:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-02T13:05:23.477 DEBUG:teuthology.orchestra.run.smithi162:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-02T13:05:23.500 DEBUG:teuthology.orchestra.run.smithi177:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-02T13:05:24.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-02-02T13:11:10.972 INFO:tasks.ceph:Archiving logs... 2024-02-02T13:11:10.973 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393/remote/smithi161/log 2024-02-02T13:11:10.974 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-02T13:12:55.222 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393/remote/smithi162/log 2024-02-02T13:12:55.223 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-02T13:13:20.387 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393/remote/smithi177/log 2024-02-02T13:13:20.388 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-02T13:13:21.406 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-02T13:13:21.437 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-02T13:13:21.437 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-02T13:13:21.440 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-02T13:13:21.442 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-02T13:13:21.613 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-02T13:13:21.622 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-02T13:13:21.622 DEBUG:teuthology.orchestra.run.smithi161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-02T13:13:21.625 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-02T13:13:21.627 DEBUG:teuthology.orchestra.run.smithi177:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-02T13:13:21.684 INFO:teuthology.orchestra.run.smithi161.stdout: remote refid st t when poll reach delay offset jitter 2024-02-02T13:13:21.684 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================== 2024-02-02T13:13:21.684 INFO:teuthology.orchestra.run.smithi161.stdout:*hv01.front.sepi 44.4.53.2 2 u 56 64 377 0.089 -2.327 0.200 2024-02-02T13:13:21.684 INFO:teuthology.orchestra.run.smithi161.stdout:+hv02.front.sepi 63.231.80.2 3 u 57 64 377 0.082 +0.112 0.243 2024-02-02T13:13:21.685 INFO:teuthology.orchestra.run.smithi161.stdout:+hv03.front.sepi 74.6.168.72 3 u 50 64 377 0.105 -2.935 0.127 2024-02-02T13:13:21.685 INFO:teuthology.orchestra.run.smithi161.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-02-02T13:13:21.695 INFO:teuthology.orchestra.run.smithi162.stdout: remote refid st t when poll reach delay offset jitter 2024-02-02T13:13:21.695 INFO:teuthology.orchestra.run.smithi162.stdout:============================================================================== 2024-02-02T13:13:21.696 INFO:teuthology.orchestra.run.smithi162.stdout:*hv01.front.sepi 44.4.53.2 2 u 63 128 377 0.103 -3.437 0.487 2024-02-02T13:13:21.696 INFO:teuthology.orchestra.run.smithi162.stdout:+hv02.front.sepi 63.231.80.2 3 u 73 128 377 0.129 -0.575 0.419 2024-02-02T13:13:21.696 INFO:teuthology.orchestra.run.smithi162.stdout:+hv03.front.sepi 74.6.168.72 3 u 67 128 377 0.121 -4.183 0.462 2024-02-02T13:13:21.696 INFO:teuthology.orchestra.run.smithi162.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-02-02T13:13:21.707 INFO:teuthology.orchestra.run.smithi177.stdout: remote refid st t when poll reach delay offset jitter 2024-02-02T13:13:21.707 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================== 2024-02-02T13:13:21.707 INFO:teuthology.orchestra.run.smithi177.stdout:*hv01.front.sepi 44.4.53.2 2 u 55 128 377 0.098 -2.099 0.343 2024-02-02T13:13:21.707 INFO:teuthology.orchestra.run.smithi177.stdout:+hv02.front.sepi 63.231.80.2 3 u 106 128 377 0.083 +0.120 0.474 2024-02-02T13:13:21.707 INFO:teuthology.orchestra.run.smithi177.stdout:+hv03.front.sepi 74.6.168.72 3 u 57 128 377 0.090 -2.874 0.332 2024-02-02T13:13:21.708 INFO:teuthology.orchestra.run.smithi177.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-02-02T13:13:21.709 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-02T13:13:21.718 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-02T13:13:21.718 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-02T13:13:21.727 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-02T13:13:21.736 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-02T13:13:21.745 INFO:teuthology.task.internal:Duration was 5759.491828 seconds 2024-02-02T13:13:21.745 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-02T13:13:21.755 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-02T13:13:21.756 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-02T13:13:21.758 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-02T13:13:21.761 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-02T13:13:21.960 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-02T13:13:21.961 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi161.front.sepia.ceph.com 2024-02-02T13:13:21.961 DEBUG:teuthology.orchestra.run.smithi161:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-02T13:13:21.971 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-02-02T13:13:21.971 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-02T13:13:21.981 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi177.front.sepia.ceph.com 2024-02-02T13:13:21.982 DEBUG:teuthology.orchestra.run.smithi177:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-02T13:13:22.051 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-02T13:13:22.052 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-02T13:13:22.054 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-02T13:13:22.057 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-02T13:13:22.153 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-02T13:13:22.154 DEBUG:teuthology.orchestra.run.smithi161:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-02T13:13:22.156 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-02T13:13:22.159 DEBUG:teuthology.orchestra.run.smithi177:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-02T13:13:22.501 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-02T13:13:22.512 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-02T13:13:22.512 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-02T13:13:22.536 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-02T13:13:22.582 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-02T13:13:22.603 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-02T13:13:22.613 DEBUG:teuthology.orchestra.run.smithi161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-02T13:13:22.616 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-02T13:13:22.624 DEBUG:teuthology.orchestra.run.smithi177:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-02T13:13:22.637 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = core 2024-02-02T13:13:22.645 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-02-02T13:13:22.672 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = core 2024-02-02T13:13:22.691 DEBUG:teuthology.orchestra.run.smithi161:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-02T13:13:22.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-02T13:13:22.721 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-02T13:13:22.726 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-02T13:13:22.726 DEBUG:teuthology.orchestra.run.smithi177:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-02T13:13:22.739 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-02T13:13:22.740 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-02T13:13:22.750 INFO:teuthology.task.internal:Transferring archived files... 2024-02-02T13:13:22.751 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393/remote/smithi161 2024-02-02T13:13:22.751 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-02T13:13:22.789 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393/remote/smithi162 2024-02-02T13:13:22.789 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-02T13:13:22.809 DEBUG:teuthology.misc:Transferring archived files from smithi177:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393/remote/smithi177 2024-02-02T13:13:22.810 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-02T13:13:22.837 INFO:teuthology.task.internal:Removing archive directory... 2024-02-02T13:13:22.837 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-02T13:13:22.839 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-02T13:13:22.852 DEBUG:teuthology.orchestra.run.smithi177:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-02T13:13:22.885 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-02T13:13:22.897 INFO:teuthology.task.internal:Not uploading archives. 2024-02-02T13:13:22.897 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-02T13:13:22.907 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-02T13:13:22.907 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-02T13:13:22.909 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-02T13:13:22.911 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-02T13:13:22.912 INFO:teuthology.orchestra.run.smithi161.stdout: 524291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 2 13:13 /home/ubuntu/cephtest 2024-02-02T13:13:22.915 INFO:teuthology.orchestra.run.smithi162.stdout: 524291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 2 13:13 /home/ubuntu/cephtest 2024-02-02T13:13:22.940 INFO:teuthology.orchestra.run.smithi177.stdout: 658074 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 2 13:13 /home/ubuntu/cephtest 2024-02-02T13:13:22.942 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-02T13:13:22.953 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-02T13:13:22.974 INFO:teuthology.nuke:Checking targets against current locks 2024-02-02T13:13:22.999 DEBUG:teuthology.nuke:shortname: smithi161 2024-02-02T13:13:22.999 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-02T13:13:23.023 DEBUG:teuthology.nuke:shortname: smithi162 2024-02-02T13:13:23.024 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-02T13:13:23.028 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-02 11:27:32.014869', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD8AQxeyGy1Ran+lsQkpIBYdni1Na9WVvUjOtv2uNm8OBPg5oQi+345XoPA33KN0dITYMzj8a+qAoky/LUIqErM='} 2024-02-02T13:13:23.048 DEBUG:teuthology.nuke:shortname: smithi177 2024-02-02T13:13:23.048 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-02T13:13:23.051 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-02 11:27:32.013744', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOy+tkgV21E+41tQtUdhGX7YE3e/kTnTfWnDI1MPetjwsV4kyXD5V4DCJO+sC5rP0EnNNghhPIQ14wHpvZWHHw='} 2024-02-02T13:13:23.068 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-02_11:17:23-fs-wip-vshankar-testing1-reef-2024-02-02-1152-testing-default-smithi/7543393', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-02 11:27:32.012326', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMetkB1DiD+2vxtyQikH8Ai3S6nK+r+lzjQOCt9ilykW5d8RP9vWy35ixSqHlFkEzx6LzKU28YYB3bUsvKYMPvY='} 2024-02-02T13:13:23.080 INFO:teuthology.orchestra.console.smithi161:Power off 2024-02-02T13:13:23.080 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-02T13:13:23.107 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-02-02T13:13:23.107 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-02T13:13:23.122 INFO:teuthology.orchestra.console.smithi177:Power off 2024-02-02T13:13:23.122 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-02T13:13:23.138 INFO:teuthology.orchestra.console.smithi162:Power off 2024-02-02T13:13:23.139 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-02T13:13:23.148 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-02-02T13:13:23.149 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2024-02-02T13:13:23.149 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-02T13:13:23.163 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2024-02-02T13:13:23.163 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-02T13:13:23.172 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-02-02T13:13:23.185 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-02-02T13:13:27.150 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-02T13:13:27.173 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-02T13:13:27.186 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-02T13:13:27.260 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-02-02T13:13:27.282 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-02-02T13:13:27.294 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-02-02T13:13:31.263 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-02T13:13:31.283 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-02T13:13:31.295 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-02T13:13:31.374 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-02-02T13:13:31.394 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-02-02T13:13:31.407 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-02-02T13:13:31.475 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-02-02T13:13:31.495 INFO:teuthology.orchestra.console.smithi177:Power off completed 2024-02-02T13:13:35.407 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-02T13:13:35.518 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-02-02T13:13:35.618 INFO:teuthology.orchestra.console.smithi162:Power off completed 2024-02-02T13:13:35.724 INFO:teuthology.run:Summary data: client.0-kernel-sha1: cd42140e628558a450ba1d39a9d0835a2fa62cda description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} duration: 5759.49182844162 failure_reason: 'Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9d3b6b039e6d4ec3a4d1e3734a04e98c status: fail success: false 2024-02-02T13:13:35.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-02T13:13:35.808 INFO:teuthology.run:FAIL